2023-06-20T13:05:37.695 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-20T13:05:37.696 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/vshankar-2023-06-20_10:07:44-fs-wip-vshankar-testing-20230620.052303-testing-default-smithi/7308866 --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --owner scheduled_vshankar@teuthology --name vshankar-2023-06-20_10:07:44-fs-wip-vshankar-testing-20230620.052303-testing-default-smithi -- /home/teuthworker/archive/vshankar-2023-06-20_10:07:44-fs-wip-vshankar-testing-20230620.052303-testing-default-smithi/7308866/orig.config.yaml 2023-06-20T13:05:37.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T13:05:37.872 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-06-20_10:07:44-fs-wip-vshankar-testing-20230620.052303-testing-default-smithi/7308866 branch: wip-vshankar-testing-20230620.052303 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: vshankar@redhat.com first_in_suite: false job_id: '7308866' kernel: client: branch: testing flavor: default kdb: true sha1: 1c622d92b6f18ce44a7c33802686ff61c3c273ab ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-06-20_10:07:44-fs-wip-vshankar-testing-20230620.052303-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-vshankar-testing-20230620.052303 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 2016e3af238feea2bbee7eb0e99c925a041afbfb ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 2016e3af238feea2bbee7eb0e99c925a041afbfb kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20230620.052303 sha1: 2016e3af238feea2bbee7eb0e99c925a041afbfb owner: scheduled_vshankar@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: 2016e3af238feea2bbee7eb0e99c925a041afbfb sleep_before_teardown: 0 suite: fs suite_branch: wip-vshankar-testing-20230620.052303 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_2016e3af238feea2bbee7eb0e99c925a041afbfb/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 2016e3af238feea2bbee7eb0e99c925a041afbfb syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi032.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfGIZ045wxjthMA1GwwiZt8rM4+vpUQY0mHp6dMWLKzsuOapYB0EzMBhmtny3IZ9bYC5V5bA1V6kcYFDFUNRsFPd933Zx9GMm/vbH6N5fmwjn8NcELiBtSe0rTzCJc7eDoYe+2WnTiF9jH62aQ3TmtuiPxom3Fv1Am/A/MmvrsKaTZJwKLOVkS6xeV/1c7EJRaLtd8Tksk+BOBGBKSOTE8LeeC05W5ndLnujbTfFZAjhcqaz8iQe2luB2rB7wVUp5cfmrkJcOAxie5RWSZexRIOm9CcA/eJPMWoK4tjHSlpE+TCw6OutxicChQCjPeW3s6ACsTFhdRKkzriz3R7Ah9i75ZzV5OMoNXmYIZPsy9ngsggo8TOuXAaVwXDuj5531n3ASmtD4LUSV14BfvZnWX60ydTcTQYyL7ZYNoNO03kpyObrqjrMIhjnHTD4/F4Yz27mo/HVeJAr11Q9DeC8taOEuysfwTwz113HlQm2nWlhpFDDYgyk275TQ4gmKFWz8= smithi115.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMYn8Z9x/5poa1T2GUnxve/ePo+iDzmTqU0yfOxTEuX38Q6juJkqGkc+JQtoZfwuMwlhLRVF51G2Ba34Jn1qHH7dxYMq1Wl3b/7mDXNk51Ua02nMReGnuN+dVW5nGP/h+Yz9dyvmIzeX2KS8AE5ei7i/IfdNU1tZckOhw+FSgGKYJnenvpvUW3pNj0wakJqkyZqPo/6IHdvg425od/zdYOgca8MTdxqGR736M5wYzpcl5Q94tPIsOMSK+1dd19pHJauUFvtfQeqYBkGJE+jWu0iTLyeLmfMH8JI9DpUygGmlFidKzAsF8TNgiey6e4nL20P9rfj5OOa+qdw2NtXbQwV4YNhQE2VLRRV2g5KzmGaGpvxD8byOyaz4wQNHPuIjcb5hruH8nJLHgOySaT6hJA/aTxAQEFQZHX1P8+MpYQbiiO98AA7EjAUDkLFvwmlZ+95ayPQGi3A+U0G5yFhi0QOmqU/L6eewGo7DTOgJltlIsgB8ONwuY8XkvUANdoTbE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 076bbebc42a14f7d568aaa78eabb0038327bcb23 timestamp: 2023-06-20_10:07:44 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-06-20T13:05:37.873 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_2016e3af238feea2bbee7eb0e99c925a041afbfb/qa; will attempt to use it 2023-06-20T13:05:37.874 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_2016e3af238feea2bbee7eb0e99c925a041afbfb/qa/tasks 2023-06-20T13:05:37.874 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-06-20T13:05:37.876 INFO:teuthology.task.internal:Checking packages... 2023-06-20T13:05:37.908 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2016e3af238feea2bbee7eb0e99c925a041afbfb' 2023-06-20T13:05:37.909 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-06-20T13:05:37.909 INFO:teuthology.packaging:ref: None 2023-06-20T13:05:37.910 INFO:teuthology.packaging:tag: None 2023-06-20T13:05:37.910 INFO:teuthology.packaging:branch: wip-vshankar-testing-20230620.052303 2023-06-20T13:05:37.910 INFO:teuthology.packaging:sha1: 2016e3af238feea2bbee7eb0e99c925a041afbfb 2023-06-20T13:05:37.910 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing-20230620.052303 2023-06-20T13:05:38.049 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4512.g2016e3af 2023-06-20T13:05:38.050 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-06-20T13:05:38.056 INFO:teuthology.task.internal:no buildpackages task found 2023-06-20T13:05:38.056 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-06-20T13:05:38.078 INFO:teuthology.task.internal:Saving configuration 2023-06-20T13:05:38.094 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-06-20T13:05:38.105 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-20T13:05:38.134 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-06-20_10:07:44-fs-wip-vshankar-testing-20230620.052303-testing-default-smithi/7308866', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-20 13:00:38.646659', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHj5LChxiCCMrla6zLt+DmPQqPmJSETTaE2aCKRRSStz+yA5u9qX+M661gaH5SsEdwyWG1tQRFxBmrzxPS62sWU='} 2023-06-20T13:05:38.162 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-06-20_10:07:44-fs-wip-vshankar-testing-20230620.052303-testing-default-smithi/7308866', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-20 13:00:38.648671', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEyql4hPNSR9g2RH2dQDJF824WNArPcqYeMQniWTpF2Boj2rZwrwTjgRc71GbXlNy82c6EqNu7MLbSfMnYsKQA4='} 2023-06-20T13:05:38.162 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-06-20T13:05:38.169 INFO:teuthology.task.internal:roles: ubuntu@smithi032.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-06-20T13:05:38.169 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-06-20T13:05:38.169 INFO:teuthology.run_tasks:Running task console_log... 2023-06-20T13:05:38.252 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6d2dfa4040>, signals=[15]) 2023-06-20T13:05:38.254 INFO:teuthology.run_tasks:Running task internal.connect... 2023-06-20T13:05:38.269 INFO:teuthology.task.internal:Opening connections... 2023-06-20T13:05:38.270 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi032.front.sepia.ceph.com 2023-06-20T13:05:38.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T13:05:38.345 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi115.front.sepia.ceph.com 2023-06-20T13:05:38.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T13:05:38.414 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-06-20T13:05:38.421 DEBUG:teuthology.orchestra.run.smithi032:> uname -m 2023-06-20T13:05:38.445 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2023-06-20T13:05:38.446 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2023-06-20T13:05:38.506 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="CentOS Stream" 2023-06-20T13:05:38.506 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="8" 2023-06-20T13:05:38.507 INFO:teuthology.orchestra.run.smithi032.stdout:ID="centos" 2023-06-20T13:05:38.507 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="rhel fedora" 2023-06-20T13:05:38.507 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="8" 2023-06-20T13:05:38.507 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el8" 2023-06-20T13:05:38.507 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-20T13:05:38.507 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31" 2023-06-20T13:05:38.507 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-20T13:05:38.508 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://centos.org/" 2023-06-20T13:05:38.508 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T13:05:38.508 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T13:05:38.508 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-20T13:05:38.509 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2023-06-20T13:05:38.531 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2023-06-20T13:05:38.554 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2023-06-20T13:05:38.554 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2023-06-20T13:05:38.615 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2023-06-20T13:05:38.615 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8" 2023-06-20T13:05:38.616 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2023-06-20T13:05:38.616 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2023-06-20T13:05:38.616 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8" 2023-06-20T13:05:38.616 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8" 2023-06-20T13:05:38.616 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-20T13:05:38.617 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2023-06-20T13:05:38.617 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-20T13:05:38.617 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2023-06-20T13:05:38.617 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T13:05:38.617 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T13:05:38.617 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-20T13:05:38.618 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2023-06-20T13:05:38.639 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-06-20T13:05:38.650 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-06-20T13:05:38.661 INFO:teuthology.task.internal:Checking for old test directory... 2023-06-20T13:05:38.661 DEBUG:teuthology.orchestra.run.smithi032:> test '!' -e /home/ubuntu/cephtest 2023-06-20T13:05:38.664 DEBUG:teuthology.orchestra.run.smithi115:> test '!' -e /home/ubuntu/cephtest 2023-06-20T13:05:38.684 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-06-20T13:05:38.694 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-06-20T13:05:38.694 DEBUG:teuthology.orchestra.run.smithi032:> test -z $(ls -A /var/lib/ceph) 2023-06-20T13:05:38.726 DEBUG:teuthology.orchestra.run.smithi115:> test -z $(ls -A /var/lib/ceph) 2023-06-20T13:05:38.755 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-06-20T13:05:38.819 INFO:teuthology.run_tasks:Running task kernel... 2023-06-20T13:05:38.842 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '1c622d92b6f18ce44a7c33802686ff61c3c273ab'} 2023-06-20T13:05:38.843 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-06-20T13:05:38.843 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-06-20T13:05:38.843 DEBUG:teuthology.orchestra.run.smithi032:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-20T13:05:38.844 DEBUG:teuthology.orchestra.run.smithi115:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-20T13:05:38.864 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-20T13:05:38.865 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-06-20T13:05:38.867 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-20T13:05:38.868 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-06-20T13:05:39.040 DEBUG:teuthology.task.kernel:sha1 for client.0 is 1c622d92b6f18ce44a7c33802686ff61c3c273ab 2023-06-20T13:05:39.040 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "1c622d92b6f18ce44a7c33802686ff61c3c273ab"... 2023-06-20T13:05:39.041 DEBUG:teuthology.orchestra.run.smithi032:> uname -r 2023-06-20T13:05:39.063 INFO:teuthology.orchestra.run.smithi032.stdout:4.18.0-489.el8.x86_64 2023-06-20T13:05:39.063 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 1c622d92b6f18ce44a7c33802686ff61c3c273ab 2023-06-20T13:05:39.064 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-06-20T13:05:39.064 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum upgrade -y linux-firmware 2023-06-20T13:05:39.103 DEBUG:teuthology.task.kernel:sha1 for client.1 is 1c622d92b6f18ce44a7c33802686ff61c3c273ab 2023-06-20T13:05:39.103 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "1c622d92b6f18ce44a7c33802686ff61c3c273ab"... 2023-06-20T13:05:39.103 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2023-06-20T13:05:39.124 INFO:teuthology.orchestra.run.smithi115.stdout:4.18.0-489.el8.x86_64 2023-06-20T13:05:39.125 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 1c622d92b6f18ce44a7c33802686ff61c3c273ab 2023-06-20T13:05:39.125 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-06-20T13:05:39.126 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum upgrade -y linux-firmware 2023-06-20T13:05:44.360 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 8 - AppStream 12 MB/s | 30 MB 00:02 2023-06-20T13:05:44.390 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 8 - AppStream 11 MB/s | 30 MB 00:02 2023-06-20T13:05:52.559 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 8 - BaseOS 14 MB/s | 39 MB 00:02 2023-06-20T13:05:53.132 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 8 - BaseOS 13 MB/s | 39 MB 00:03 2023-06-20T13:05:58.708 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 8 - Extras 47 kB/s | 18 kB 00:00 2023-06-20T13:05:59.117 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 8 - Extras common packages 26 kB/s | 6.6 kB 00:00 2023-06-20T13:05:59.549 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 8 - Extras 85 kB/s | 18 kB 00:00 2023-06-20T13:06:00.100 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.6 kB 00:00 2023-06-20T13:06:01.569 INFO:teuthology.orchestra.run.smithi115.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2023-06-20T13:06:02.160 INFO:teuthology.orchestra.run.smithi032.stdout:Copr repo for python3-asyncssh owned by ceph 1.8 kB/s | 3.5 kB 00:01 2023-06-20T13:06:02.622 INFO:teuthology.orchestra.run.smithi115.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2023-06-20T13:06:06.354 INFO:teuthology.orchestra.run.smithi115.stdout:lab-extras 616 kB/s | 24 kB 00:00 2023-06-20T13:06:09.779 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2023-06-20T13:06:09.780 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2023-06-20T13:06:09.780 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repo Size 2023-06-20T13:06:09.781 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2023-06-20T13:06:09.781 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrading: 2023-06-20T13:06:09.781 INFO:teuthology.orchestra.run.smithi115.stdout: linux-firmware noarch 20230515-115.gitd1962891.el8 baseos 266 M 2023-06-20T13:06:09.781 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:06:09.781 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2023-06-20T13:06:09.781 INFO:teuthology.orchestra.run.smithi115.stdout:================================================================================ 2023-06-20T13:06:09.781 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrade 1 Package 2023-06-20T13:06:09.782 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:06:09.782 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 266 M 2023-06-20T13:06:09.782 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2023-06-20T13:06:23.254 INFO:teuthology.orchestra.run.smithi115.stdout:linux-firmware-20230515-115.gitd1962891.el8.noa 22 MB/s | 266 MB 00:11 2023-06-20T13:06:23.254 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2023-06-20T13:06:23.254 INFO:teuthology.orchestra.run.smithi115.stdout:Total 20 MB/s | 266 MB 00:13 2023-06-20T13:06:24.831 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2023-06-20T13:06:24.895 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2023-06-20T13:06:24.895 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2023-06-20T13:06:26.555 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2023-06-20T13:06:26.624 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2023-06-20T13:06:44.485 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2023-06-20T13:06:44.873 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-06-20T13:06:45.136 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-06-20T13:06:45.387 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-06-20T13:06:45.387 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-06-20T13:06:46.101 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-06-20T13:06:46.102 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:06:46.102 INFO:teuthology.orchestra.run.smithi115.stdout:Upgraded: 2023-06-20T13:06:46.102 INFO:teuthology.orchestra.run.smithi115.stdout: linux-firmware-20230515-115.gitd1962891.el8.noarch 2023-06-20T13:06:46.102 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:06:46.102 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2023-06-20T13:06:46.285 INFO:teuthology.task.kernel:Downloading kernel 1c622d92b6f18ce44a7c33802686ff61c3c273ab on client.1... 2023-06-20T13:06:46.286 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1c622d92b6f18ce44a7c33802686ff61c3c273ab 2023-06-20T13:06:46.504 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/1c622d92b6f18ce44a7c33802686ff61c3c273ab/centos/8/flavors/default/x86_64/ 2023-06-20T13:06:46.505 DEBUG:teuthology.orchestra.run.smithi115:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.4.0_rc5_g1c622d92b6f1-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/1c622d92b6f18ce44a7c33802686ff61c3c273ab/centos/8/flavors/default/x86_64/ --input-file=- 2023-06-20T13:06:46.507 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi115.front.sepia.ceph.com to complete... 2023-06-20T13:06:59.392 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20 13:06:59 URL:https://2.chacra.ceph.com/r/kernel/testing/1c622d92b6f18ce44a7c33802686ff61c3c273ab/centos/8/flavors/default/x86_64/kernel-6.4.0_rc5_g1c622d92b6f1-1.x86_64.rpm [379883408/379883408] -> "/tmp/kernel.x86_64.rpm" [1] 2023-06-20T13:06:59.393 INFO:teuthology.orchestra.run.smithi115.stderr:FINISHED --2023-06-20 13:06:59-- 2023-06-20T13:06:59.393 INFO:teuthology.orchestra.run.smithi115.stderr:Total wall clock time: 13s 2023-06-20T13:06:59.393 INFO:teuthology.orchestra.run.smithi115.stderr:Downloaded: 1 files, 362M in 13s (28.8 MB/s) 2023-06-20T13:06:59.394 INFO:teuthology.task.kernel:Installing kernel 1c622d92b6f18ce44a7c33802686ff61c3c273ab on client.1... 2023-06-20T13:06:59.394 DEBUG:teuthology.orchestra.run.smithi115:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-06-20T13:07:01.061 INFO:teuthology.orchestra.run.smithi115.stdout:Verifying... ######################################## 2023-06-20T13:07:01.105 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing... ######################################## 2023-06-20T13:07:01.214 INFO:teuthology.orchestra.run.smithi115.stdout:Updating / installing... 2023-06-20T13:07:38.985 INFO:teuthology.orchestra.run.smithi115.stdout:kernel-6.4.0_rc5_g1c622d92b6f1-1 ######################################## 2023-06-20T13:07:59.765 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi115.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-06-20T13:07:59.766 DEBUG:teuthology.orchestra.run.smithi115:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-06-20T13:07:59.820 INFO:teuthology.orchestra.run.smithi115.stdout:/boot/System.map-6.4.0-rc5-g1c622d92b6f1 2023-06-20T13:07:59.821 INFO:teuthology.orchestra.run.smithi115.stdout:/boot/config-6.4.0-rc5-g1c622d92b6f1 2023-06-20T13:07:59.821 INFO:teuthology.orchestra.run.smithi115.stdout:/boot/vmlinuz-6.4.0-rc5-g1c622d92b6f1 2023-06-20T13:07:59.821 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1 2023-06-20T13:07:59.821 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel 2023-06-20T13:07:59.821 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch 2023-06-20T13:07:59.822 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86 2023-06-20T13:07:59.822 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto 2023-06-20T13:07:59.822 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-06-20T13:07:59.822 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-06-20T13:07:59.822 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-06-20T13:07:59.822 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-06-20T13:07:59.822 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-06-20T13:07:59.823 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-06-20T13:07:59.823 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-06-20T13:07:59.823 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/crc32c-intel.ko 2023-06-20T13:07:59.823 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-06-20T13:07:59.823 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-06-20T13:07:59.823 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-06-20T13:07:59.823 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-06-20T13:07:59.823 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/serpent-avx2.ko 2023-06-20T13:07:59.824 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-06-20T13:07:59.824 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-06-20T13:07:59.824 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-06-20T13:07:59.824 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-06-20T13:07:59.824 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-06-20T13:07:59.824 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-06-20T13:07:59.824 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-06-20T13:07:59.824 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kernel 2023-06-20T13:07:59.825 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kernel/cpu 2023-06-20T13:07:59.825 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kernel/cpu/mce 2023-06-20T13:07:59.825 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-06-20T13:07:59.825 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kvm 2023-06-20T13:07:59.825 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kvm/kvm-amd.ko 2023-06-20T13:07:59.825 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kvm/kvm-intel.ko 2023-06-20T13:07:59.825 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kvm/kvm.ko 2023-06-20T13:07:59.825 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto 2023-06-20T13:07:59.826 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/ansi_cprng.ko 2023-06-20T13:07:59.826 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/anubis.ko 2023-06-20T13:07:59.826 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/arc4.ko 2023-06-20T13:07:59.826 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx 2023-06-20T13:07:59.826 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_memcpy.ko 2023-06-20T13:07:59.826 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_pq.ko 2023-06-20T13:07:59.826 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_raid6_recov.ko 2023-06-20T13:07:59.827 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_tx.ko 2023-06-20T13:07:59.827 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_xor.ko 2023-06-20T13:07:59.827 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/raid6test.ko 2023-06-20T13:07:59.827 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/authenc.ko 2023-06-20T13:07:59.827 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/authencesn.ko 2023-06-20T13:07:59.827 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/blake2b_generic.ko 2023-06-20T13:07:59.827 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/blowfish_common.ko 2023-06-20T13:07:59.827 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/blowfish_generic.ko 2023-06-20T13:07:59.828 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/camellia_generic.ko 2023-06-20T13:07:59.828 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cast5_generic.ko 2023-06-20T13:07:59.828 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cast6_generic.ko 2023-06-20T13:07:59.828 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cast_common.ko 2023-06-20T13:07:59.828 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/ccm.ko 2023-06-20T13:07:59.828 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cmac.ko 2023-06-20T13:07:59.828 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/crc32_generic.ko 2023-06-20T13:07:59.828 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/crypto_engine.ko 2023-06-20T13:07:59.829 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/crypto_user.ko 2023-06-20T13:07:59.829 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cts.ko 2023-06-20T13:07:59.829 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/des_generic.ko 2023-06-20T13:07:59.829 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/dh_generic.ko 2023-06-20T13:07:59.829 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/echainiv.ko 2023-06-20T13:07:59.829 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/essiv.ko 2023-06-20T13:07:59.829 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/fcrypt.ko 2023-06-20T13:07:59.829 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/khazad.ko 2023-06-20T13:07:59.830 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/lz4.ko 2023-06-20T13:07:59.830 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/lz4hc.ko 2023-06-20T13:07:59.830 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/md4.ko 2023-06-20T13:07:59.830 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/michael_mic.ko 2023-06-20T13:07:59.830 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/pcbc.ko 2023-06-20T13:07:59.830 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/pcrypt.ko 2023-06-20T13:07:59.830 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/rmd160.ko 2023-06-20T13:07:59.830 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/seed.ko 2023-06-20T13:07:59.831 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/serpent_generic.ko 2023-06-20T13:07:59.831 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/tcrypt.ko 2023-06-20T13:07:59.831 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/tea.ko 2023-06-20T13:07:59.831 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/twofish_common.ko 2023-06-20T13:07:59.831 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/twofish_generic.ko 2023-06-20T13:07:59.831 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/vmac.ko 2023-06-20T13:07:59.831 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/wp512.ko 2023-06-20T13:07:59.831 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/xcbc.ko 2023-06-20T13:07:59.832 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/xor.ko 2023-06-20T13:07:59.832 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/xxhash_generic.ko 2023-06-20T13:07:59.832 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers 2023-06-20T13:07:59.832 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi 2023-06-20T13:07:59.832 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/acpi_ipmi.ko 2023-06-20T13:07:59.832 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/acpi_pad.ko 2023-06-20T13:07:59.832 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/custom_method.ko 2023-06-20T13:07:59.833 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/ec_sys.ko 2023-06-20T13:07:59.833 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/platform_profile.ko 2023-06-20T13:07:59.833 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/sbs.ko 2023-06-20T13:07:59.833 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/sbshc.ko 2023-06-20T13:07:59.833 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/video.ko 2023-06-20T13:07:59.833 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata 2023-06-20T13:07:59.833 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/acard-ahci.ko 2023-06-20T13:07:59.833 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/ahci_platform.ko 2023-06-20T13:07:59.834 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/ata_generic.ko 2023-06-20T13:07:59.834 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/libahci_platform.ko 2023-06-20T13:07:59.834 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_acpi.ko 2023-06-20T13:07:59.834 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_ali.ko 2023-06-20T13:07:59.834 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_amd.ko 2023-06-20T13:07:59.834 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_artop.ko 2023-06-20T13:07:59.834 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_atiixp.ko 2023-06-20T13:07:59.834 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_atp867x.ko 2023-06-20T13:07:59.835 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_cmd640.ko 2023-06-20T13:07:59.835 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_cmd64x.ko 2023-06-20T13:07:59.835 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_cypress.ko 2023-06-20T13:07:59.835 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_efar.ko 2023-06-20T13:07:59.835 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_hpt366.ko 2023-06-20T13:07:59.835 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_hpt37x.ko 2023-06-20T13:07:59.835 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_hpt3x2n.ko 2023-06-20T13:07:59.835 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_hpt3x3.ko 2023-06-20T13:07:59.836 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_it8213.ko 2023-06-20T13:07:59.836 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_it821x.ko 2023-06-20T13:07:59.836 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_jmicron.ko 2023-06-20T13:07:59.836 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_marvell.ko 2023-06-20T13:07:59.836 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_mpiix.ko 2023-06-20T13:07:59.836 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_netcell.ko 2023-06-20T13:07:59.836 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_ninja32.ko 2023-06-20T13:07:59.837 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_ns87410.ko 2023-06-20T13:07:59.837 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_ns87415.ko 2023-06-20T13:07:59.837 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_oldpiix.ko 2023-06-20T13:07:59.837 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_opti.ko 2023-06-20T13:07:59.837 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_optidma.ko 2023-06-20T13:07:59.837 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_pcmcia.ko 2023-06-20T13:07:59.837 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_pdc2027x.ko 2023-06-20T13:07:59.837 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-06-20T13:07:59.838 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_piccolo.ko 2023-06-20T13:07:59.838 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_rdc.ko 2023-06-20T13:07:59.838 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_sch.ko 2023-06-20T13:07:59.838 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_serverworks.ko 2023-06-20T13:07:59.838 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_sil680.ko 2023-06-20T13:07:59.838 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_sis.ko 2023-06-20T13:07:59.838 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_sl82c105.ko 2023-06-20T13:07:59.838 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_triflex.ko 2023-06-20T13:07:59.839 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_via.ko 2023-06-20T13:07:59.839 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pdc_adma.ko 2023-06-20T13:07:59.839 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_inic162x.ko 2023-06-20T13:07:59.839 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_mv.ko 2023-06-20T13:07:59.839 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_nv.ko 2023-06-20T13:07:59.839 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_promise.ko 2023-06-20T13:07:59.839 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_qstor.ko 2023-06-20T13:07:59.839 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_sil.ko 2023-06-20T13:07:59.840 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_sil24.ko 2023-06-20T13:07:59.840 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_sis.ko 2023-06-20T13:07:59.840 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_svw.ko 2023-06-20T13:07:59.840 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_sx4.ko 2023-06-20T13:07:59.840 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_uli.ko 2023-06-20T13:07:59.840 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_via.ko 2023-06-20T13:07:59.840 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_vsc.ko 2023-06-20T13:07:59.840 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/auxdisplay 2023-06-20T13:07:59.841 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/auxdisplay/ks0108.ko 2023-06-20T13:07:59.841 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/base 2023-06-20T13:07:59.841 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/base/regmap 2023-06-20T13:07:59.841 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/base/regmap/regmap-i2c.ko 2023-06-20T13:07:59.841 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/bcma 2023-06-20T13:07:59.841 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/bcma/bcma.ko 2023-06-20T13:07:59.841 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block 2023-06-20T13:07:59.841 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/aoe 2023-06-20T13:07:59.842 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/aoe/aoe.ko 2023-06-20T13:07:59.842 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/brd.ko 2023-06-20T13:07:59.842 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/drbd 2023-06-20T13:07:59.842 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/drbd/drbd.ko 2023-06-20T13:07:59.842 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/floppy.ko 2023-06-20T13:07:59.842 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/loop.ko 2023-06-20T13:07:59.842 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/mtip32xx 2023-06-20T13:07:59.842 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-06-20T13:07:59.843 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/nbd.ko 2023-06-20T13:07:59.843 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/null_blk 2023-06-20T13:07:59.843 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/null_blk/null_blk.ko 2023-06-20T13:07:59.843 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/pktcdvd.ko 2023-06-20T13:07:59.843 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/rbd.ko 2023-06-20T13:07:59.843 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/virtio_blk.ko 2023-06-20T13:07:59.843 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/xen-blkback 2023-06-20T13:07:59.844 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-06-20T13:07:59.844 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/xen-blkfront.ko 2023-06-20T13:07:59.844 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/zram 2023-06-20T13:07:59.844 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/zram/zram.ko 2023-06-20T13:07:59.844 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char 2023-06-20T13:07:59.844 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hangcheck-timer.ko 2023-06-20T13:07:59.845 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random 2023-06-20T13:07:59.845 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/amd-rng.ko 2023-06-20T13:07:59.845 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/intel-rng.ko 2023-06-20T13:07:59.845 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-06-20T13:07:59.845 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/via-rng.ko 2023-06-20T13:07:59.845 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/virtio-rng.ko 2023-06-20T13:07:59.845 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi 2023-06-20T13:07:59.845 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-06-20T13:07:59.846 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-06-20T13:07:59.846 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-06-20T13:07:59.846 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_si.ko 2023-06-20T13:07:59.846 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-06-20T13:07:59.846 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-06-20T13:07:59.846 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/lp.ko 2023-06-20T13:07:59.846 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/mwave 2023-06-20T13:07:59.847 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/mwave/mwave.ko 2023-06-20T13:07:59.847 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ppdev.ko 2023-06-20T13:07:59.847 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tlclk.ko 2023-06-20T13:07:59.847 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm 2023-06-20T13:07:59.847 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm.ko 2023-06-20T13:07:59.847 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_atmel.ko 2023-06-20T13:07:59.847 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_infineon.ko 2023-06-20T13:07:59.847 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_nsc.ko 2023-06-20T13:07:59.848 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_tis.ko 2023-06-20T13:07:59.848 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-06-20T13:07:59.848 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/uv_mmtimer.ko 2023-06-20T13:07:59.848 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/virtio_console.ko 2023-06-20T13:07:59.848 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq 2023-06-20T13:07:59.848 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-06-20T13:07:59.848 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-06-20T13:07:59.848 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/p4-clockmod.ko 2023-06-20T13:07:59.849 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-06-20T13:07:59.849 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/powernow-k8.ko 2023-06-20T13:07:59.849 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/speedstep-lib.ko 2023-06-20T13:07:59.849 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto 2023-06-20T13:07:59.849 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/ccp 2023-06-20T13:07:59.849 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-06-20T13:07:59.849 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/ccp/ccp.ko 2023-06-20T13:07:59.849 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel 2023-06-20T13:07:59.850 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat 2023-06-20T13:07:59.850 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat/qat_common 2023-06-20T13:07:59.850 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-06-20T13:07:59.850 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-06-20T13:07:59.850 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-06-20T13:07:59.850 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/padlock-aes.ko 2023-06-20T13:07:59.850 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/padlock-sha.ko 2023-06-20T13:07:59.850 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/virtio 2023-06-20T13:07:59.851 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-06-20T13:07:59.851 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dca 2023-06-20T13:07:59.851 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dca/dca.ko 2023-06-20T13:07:59.851 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/devfreq 2023-06-20T13:07:59.851 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-06-20T13:07:59.851 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma 2023-06-20T13:07:59.851 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma/dw 2023-06-20T13:07:59.852 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma/dw/dw_dmac.ko 2023-06-20T13:07:59.852 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma/ioat 2023-06-20T13:07:59.852 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma/ioat/ioatdma.ko 2023-06-20T13:07:59.852 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac 2023-06-20T13:07:59.852 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/amd64_edac.ko 2023-06-20T13:07:59.852 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/e752x_edac.ko 2023-06-20T13:07:59.852 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/edac_mce_amd.ko 2023-06-20T13:07:59.852 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i3000_edac.ko 2023-06-20T13:07:59.853 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i3200_edac.ko 2023-06-20T13:07:59.853 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i5100_edac.ko 2023-06-20T13:07:59.853 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i5400_edac.ko 2023-06-20T13:07:59.853 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i7300_edac.ko 2023-06-20T13:07:59.853 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i7core_edac.ko 2023-06-20T13:07:59.853 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i82975x_edac.ko 2023-06-20T13:07:59.853 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/ie31200_edac.ko 2023-06-20T13:07:59.853 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/sb_edac.ko 2023-06-20T13:07:59.854 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/x38_edac.ko 2023-06-20T13:07:59.854 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/firmware 2023-06-20T13:07:59.854 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/firmware/edd.ko 2023-06-20T13:07:59.854 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/firmware/iscsi_ibft.ko 2023-06-20T13:07:59.854 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/gpio 2023-06-20T13:07:59.854 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/gpio/gpio-ich.ko 2023-06-20T13:07:59.854 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/gpio/gpio-viperboard.ko 2023-06-20T13:07:59.854 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid 2023-06-20T13:07:59.855 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-appleir.ko 2023-06-20T13:07:59.855 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-aureal.ko 2023-06-20T13:07:59.855 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-axff.ko 2023-06-20T13:07:59.855 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-dr.ko 2023-06-20T13:07:59.855 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-elecom.ko 2023-06-20T13:07:59.855 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-elo.ko 2023-06-20T13:07:59.855 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-emsff.ko 2023-06-20T13:07:59.855 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-gaff.ko 2023-06-20T13:07:59.856 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-gt683r.ko 2023-06-20T13:07:59.856 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-gyration.ko 2023-06-20T13:07:59.856 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-holtek-kbd.ko 2023-06-20T13:07:59.856 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-holtek-mouse.ko 2023-06-20T13:07:59.856 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-holtekff.ko 2023-06-20T13:07:59.856 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-hyperv.ko 2023-06-20T13:07:59.856 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-icade.ko 2023-06-20T13:07:59.857 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-keytouch.ko 2023-06-20T13:07:59.857 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-kye.ko 2023-06-20T13:07:59.857 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-lcpower.ko 2023-06-20T13:07:59.857 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-led.ko 2023-06-20T13:07:59.857 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-lenovo.ko 2023-06-20T13:07:59.857 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-logitech-dj.ko 2023-06-20T13:07:59.857 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-06-20T13:07:59.857 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-multitouch.ko 2023-06-20T13:07:59.858 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-ortek.ko 2023-06-20T13:07:59.858 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-penmount.ko 2023-06-20T13:07:59.858 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-petalynx.ko 2023-06-20T13:07:59.858 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-picolcd.ko 2023-06-20T13:07:59.858 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-pl.ko 2023-06-20T13:07:59.858 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-plantronics.ko 2023-06-20T13:07:59.858 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-primax.ko 2023-06-20T13:07:59.858 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-rmi.ko 2023-06-20T13:07:59.859 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-arvo.ko 2023-06-20T13:07:59.859 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-common.ko 2023-06-20T13:07:59.859 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-isku.ko 2023-06-20T13:07:59.859 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-kone.ko 2023-06-20T13:07:59.859 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-06-20T13:07:59.859 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-konepure.ko 2023-06-20T13:07:59.859 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-06-20T13:07:59.860 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-lua.ko 2023-06-20T13:07:59.860 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-pyra.ko 2023-06-20T13:07:59.860 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-ryos.ko 2023-06-20T13:07:59.860 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-savu.ko 2023-06-20T13:07:59.860 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat.ko 2023-06-20T13:07:59.860 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-saitek.ko 2023-06-20T13:07:59.860 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-samsung.ko 2023-06-20T13:07:59.860 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-sensor-hub.ko 2023-06-20T13:07:59.861 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-sjoy.ko 2023-06-20T13:07:59.861 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-sony.ko 2023-06-20T13:07:59.861 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-speedlink.ko 2023-06-20T13:07:59.861 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-steelseries.ko 2023-06-20T13:07:59.861 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-sunplus.ko 2023-06-20T13:07:59.861 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-thrustmaster.ko 2023-06-20T13:07:59.861 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-tivo.ko 2023-06-20T13:07:59.861 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-tmff.ko 2023-06-20T13:07:59.862 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-topseed.ko 2023-06-20T13:07:59.862 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-twinhan.ko 2023-06-20T13:07:59.862 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-uclogic.ko 2023-06-20T13:07:59.862 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-waltop.ko 2023-06-20T13:07:59.862 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-wiimote.ko 2023-06-20T13:07:59.862 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-xinmo.ko 2023-06-20T13:07:59.862 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-zpff.ko 2023-06-20T13:07:59.862 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-zydacron.ko 2023-06-20T13:07:59.863 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/uhid.ko 2023-06-20T13:07:59.863 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/wacom.ko 2023-06-20T13:07:59.863 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hv 2023-06-20T13:07:59.863 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hv/hv_balloon.ko 2023-06-20T13:07:59.863 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hv/hv_utils.ko 2023-06-20T13:07:59.863 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hv/hv_vmbus.ko 2023-06-20T13:07:59.863 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon 2023-06-20T13:07:59.863 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/abituguru.ko 2023-06-20T13:07:59.864 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/abituguru3.ko 2023-06-20T13:07:59.864 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/acpi_power_meter.ko 2023-06-20T13:07:59.864 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ad7414.ko 2023-06-20T13:07:59.864 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ad7418.ko 2023-06-20T13:07:59.864 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adc128d818.ko 2023-06-20T13:07:59.864 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm1025.ko 2023-06-20T13:07:59.864 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm1026.ko 2023-06-20T13:07:59.865 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm1029.ko 2023-06-20T13:07:59.865 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm1031.ko 2023-06-20T13:07:59.865 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm9240.ko 2023-06-20T13:07:59.865 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ads7828.ko 2023-06-20T13:07:59.865 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7410.ko 2023-06-20T13:07:59.865 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7411.ko 2023-06-20T13:07:59.865 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7462.ko 2023-06-20T13:07:59.865 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7470.ko 2023-06-20T13:07:59.866 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7475.ko 2023-06-20T13:07:59.866 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7x10.ko 2023-06-20T13:07:59.866 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/amc6821.ko 2023-06-20T13:07:59.866 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/applesmc.ko 2023-06-20T13:07:59.866 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/asb100.ko 2023-06-20T13:07:59.866 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/asc7621.ko 2023-06-20T13:07:59.866 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/asus_atk0110.ko 2023-06-20T13:07:59.866 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/atxp1.ko 2023-06-20T13:07:59.867 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/coretemp.ko 2023-06-20T13:07:59.867 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-06-20T13:07:59.867 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/dme1737.ko 2023-06-20T13:07:59.867 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ds1621.ko 2023-06-20T13:07:59.867 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ds620.ko 2023-06-20T13:07:59.867 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/emc1403.ko 2023-06-20T13:07:59.867 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/emc6w201.ko 2023-06-20T13:07:59.867 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/f71805f.ko 2023-06-20T13:07:59.868 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/f71882fg.ko 2023-06-20T13:07:59.868 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/f75375s.ko 2023-06-20T13:07:59.868 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/fam15h_power.ko 2023-06-20T13:07:59.868 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/fschmd.ko 2023-06-20T13:07:59.868 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/g760a.ko 2023-06-20T13:07:59.868 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/g762.ko 2023-06-20T13:07:59.868 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/gl518sm.ko 2023-06-20T13:07:59.869 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/gl520sm.ko 2023-06-20T13:07:59.869 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/hwmon-vid.ko 2023-06-20T13:07:59.869 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/i5500_temp.ko 2023-06-20T13:07:59.869 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/i5k_amb.ko 2023-06-20T13:07:59.869 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ibmaem.ko 2023-06-20T13:07:59.869 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ibmpex.ko 2023-06-20T13:07:59.869 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ina209.ko 2023-06-20T13:07:59.869 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ina2xx.ko 2023-06-20T13:07:59.870 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/it87.ko 2023-06-20T13:07:59.870 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/k10temp.ko 2023-06-20T13:07:59.870 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/k8temp.ko 2023-06-20T13:07:59.870 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lineage-pem.ko 2023-06-20T13:07:59.870 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm63.ko 2023-06-20T13:07:59.870 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm73.ko 2023-06-20T13:07:59.870 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm75.ko 2023-06-20T13:07:59.870 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm77.ko 2023-06-20T13:07:59.871 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm78.ko 2023-06-20T13:07:59.871 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm80.ko 2023-06-20T13:07:59.871 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm83.ko 2023-06-20T13:07:59.871 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm85.ko 2023-06-20T13:07:59.871 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm87.ko 2023-06-20T13:07:59.871 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm90.ko 2023-06-20T13:07:59.871 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm92.ko 2023-06-20T13:07:59.871 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm93.ko 2023-06-20T13:07:59.872 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm95234.ko 2023-06-20T13:07:59.872 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm95241.ko 2023-06-20T13:07:59.872 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm95245.ko 2023-06-20T13:07:59.872 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc2945.ko 2023-06-20T13:07:59.872 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4151.ko 2023-06-20T13:07:59.872 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4215.ko 2023-06-20T13:07:59.872 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4222.ko 2023-06-20T13:07:59.872 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4245.ko 2023-06-20T13:07:59.873 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4260.ko 2023-06-20T13:07:59.873 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4261.ko 2023-06-20T13:07:59.873 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max16065.ko 2023-06-20T13:07:59.873 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max1619.ko 2023-06-20T13:07:59.873 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max1668.ko 2023-06-20T13:07:59.873 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max197.ko 2023-06-20T13:07:59.873 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max6639.ko 2023-06-20T13:07:59.873 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max6650.ko 2023-06-20T13:07:59.874 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max6697.ko 2023-06-20T13:07:59.874 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/mcp3021.ko 2023-06-20T13:07:59.874 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/nct6683.ko 2023-06-20T13:07:59.874 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/nct6775-core.ko 2023-06-20T13:07:59.874 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/nct6775.ko 2023-06-20T13:07:59.874 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/nct7802.ko 2023-06-20T13:07:59.874 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pc87360.ko 2023-06-20T13:07:59.874 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pc87427.ko 2023-06-20T13:07:59.875 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pcf8591.ko 2023-06-20T13:07:59.875 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus 2023-06-20T13:07:59.875 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-06-20T13:07:59.875 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-06-20T13:07:59.875 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-06-20T13:07:59.875 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/max16064.ko 2023-06-20T13:07:59.875 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/max34440.ko 2023-06-20T13:07:59.875 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/max8688.ko 2023-06-20T13:07:59.876 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-06-20T13:07:59.876 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-06-20T13:07:59.876 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-06-20T13:07:59.876 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-06-20T13:07:59.876 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-06-20T13:07:59.876 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-06-20T13:07:59.876 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/powr1220.ko 2023-06-20T13:07:59.877 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sch5627.ko 2023-06-20T13:07:59.877 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sch5636.ko 2023-06-20T13:07:59.877 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sch56xx-common.ko 2023-06-20T13:07:59.877 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sht15.ko 2023-06-20T13:07:59.877 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sht21.ko 2023-06-20T13:07:59.877 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/shtc1.ko 2023-06-20T13:07:59.877 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sis5595.ko 2023-06-20T13:07:59.877 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/smsc47b397.ko 2023-06-20T13:07:59.878 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/smsc47m1.ko 2023-06-20T13:07:59.878 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/smsc47m192.ko 2023-06-20T13:07:59.878 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/thmc50.ko 2023-06-20T13:07:59.878 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/tmp102.ko 2023-06-20T13:07:59.878 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/tmp103.ko 2023-06-20T13:07:59.878 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/tmp401.ko 2023-06-20T13:07:59.878 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/tmp421.ko 2023-06-20T13:07:59.878 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/via-cputemp.ko 2023-06-20T13:07:59.879 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/via686a.ko 2023-06-20T13:07:59.879 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/vt1211.ko 2023-06-20T13:07:59.879 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/vt8231.ko 2023-06-20T13:07:59.879 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83627ehf.ko 2023-06-20T13:07:59.879 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83627hf.ko 2023-06-20T13:07:59.879 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83781d.ko 2023-06-20T13:07:59.879 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83791d.ko 2023-06-20T13:07:59.879 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83792d.ko 2023-06-20T13:07:59.880 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83793.ko 2023-06-20T13:07:59.880 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83795.ko 2023-06-20T13:07:59.880 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83l785ts.ko 2023-06-20T13:07:59.880 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83l786ng.ko 2023-06-20T13:07:59.880 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c 2023-06-20T13:07:59.880 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/algos 2023-06-20T13:07:59.880 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-06-20T13:07:59.880 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-06-20T13:07:59.881 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses 2023-06-20T13:07:59.881 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-06-20T13:07:59.881 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-06-20T13:07:59.881 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-06-20T13:07:59.881 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-06-20T13:07:59.881 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-06-20T13:07:59.881 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-06-20T13:07:59.882 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-06-20T13:07:59.882 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-06-20T13:07:59.882 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-i801.ko 2023-06-20T13:07:59.882 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-isch.ko 2023-06-20T13:07:59.882 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-06-20T13:07:59.882 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-06-20T13:07:59.882 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-06-20T13:07:59.882 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-parport.ko 2023-06-20T13:07:59.883 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-06-20T13:07:59.883 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-06-20T13:07:59.883 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-06-20T13:07:59.883 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-06-20T13:07:59.883 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-06-20T13:07:59.883 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-06-20T13:07:59.883 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-via.ko 2023-06-20T13:07:59.883 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-06-20T13:07:59.884 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-06-20T13:07:59.884 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-dev.ko 2023-06-20T13:07:59.884 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-mux.ko 2023-06-20T13:07:59.884 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-06-20T13:07:59.884 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-smbus.ko 2023-06-20T13:07:59.884 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-stub.ko 2023-06-20T13:07:59.884 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband 2023-06-20T13:07:59.884 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core 2023-06-20T13:07:59.885 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/ib_cm.ko 2023-06-20T13:07:59.885 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/ib_core.ko 2023-06-20T13:07:59.885 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/ib_umad.ko 2023-06-20T13:07:59.885 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-06-20T13:07:59.885 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/iw_cm.ko 2023-06-20T13:07:59.885 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/rdma_cm.ko 2023-06-20T13:07:59.885 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-06-20T13:07:59.885 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw 2023-06-20T13:07:59.886 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/cxgb4 2023-06-20T13:07:59.886 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-06-20T13:07:59.886 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mlx4 2023-06-20T13:07:59.886 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-06-20T13:07:59.886 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mlx5 2023-06-20T13:07:59.886 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-06-20T13:07:59.886 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mthca 2023-06-20T13:07:59.886 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-06-20T13:07:59.887 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp 2023-06-20T13:07:59.887 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/ipoib 2023-06-20T13:07:59.887 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-06-20T13:07:59.887 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/iser 2023-06-20T13:07:59.887 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-06-20T13:07:59.888 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/isert 2023-06-20T13:07:59.888 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-06-20T13:07:59.888 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/srp 2023-06-20T13:07:59.888 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-06-20T13:07:59.888 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/srpt 2023-06-20T13:07:59.888 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-06-20T13:07:59.888 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input 2023-06-20T13:07:59.888 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport 2023-06-20T13:07:59.889 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-06-20T13:07:59.889 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/fm801-gp.ko 2023-06-20T13:07:59.889 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/gameport.ko 2023-06-20T13:07:59.889 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/lightning.ko 2023-06-20T13:07:59.889 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/ns558.ko 2023-06-20T13:07:59.889 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/joydev.ko 2023-06-20T13:07:59.889 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/keyboard 2023-06-20T13:07:59.889 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/keyboard/gpio_keys.ko 2023-06-20T13:07:59.890 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse 2023-06-20T13:07:59.890 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/appletouch.ko 2023-06-20T13:07:59.890 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/bcm5974.ko 2023-06-20T13:07:59.890 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/cyapatp.ko 2023-06-20T13:07:59.890 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/elan_i2c.ko 2023-06-20T13:07:59.890 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/sermouse.ko 2023-06-20T13:07:59.890 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-06-20T13:07:59.890 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/synaptics_usb.ko 2023-06-20T13:07:59.891 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/vsxxxaa.ko 2023-06-20T13:07:59.891 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/rmi4 2023-06-20T13:07:59.891 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/rmi4/rmi_core.ko 2023-06-20T13:07:59.891 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio 2023-06-20T13:07:59.891 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio/altera_ps2.ko 2023-06-20T13:07:59.891 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio/arc_ps2.ko 2023-06-20T13:07:59.891 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-06-20T13:07:59.892 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio/serio_raw.ko 2023-06-20T13:07:59.892 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/sparse-keymap.ko 2023-06-20T13:07:59.892 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/iommu 2023-06-20T13:07:59.892 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/iommu/amd 2023-06-20T13:07:59.892 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/iommu/amd/iommu_v2.ko 2023-06-20T13:07:59.892 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds 2023-06-20T13:07:59.892 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/leds-blinkm.ko 2023-06-20T13:07:59.892 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/leds-lm3530.ko 2023-06-20T13:07:59.893 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/leds-lp3944.ko 2023-06-20T13:07:59.893 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/leds-ss4200.ko 2023-06-20T13:07:59.893 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger 2023-06-20T13:07:59.893 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-06-20T13:07:59.893 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-06-20T13:07:59.893 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-06-20T13:07:59.893 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-06-20T13:07:59.893 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-06-20T13:07:59.894 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-06-20T13:07:59.894 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-06-20T13:07:59.894 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-06-20T13:07:59.894 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md 2023-06-20T13:07:59.894 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/bcache 2023-06-20T13:07:59.894 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/bcache/bcache.ko 2023-06-20T13:07:59.894 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-bio-prison.ko 2023-06-20T13:07:59.894 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-cache-smq.ko 2023-06-20T13:07:59.895 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-cache.ko 2023-06-20T13:07:59.895 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-crypt.ko 2023-06-20T13:07:59.895 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-delay.ko 2023-06-20T13:07:59.895 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-flakey.ko 2023-06-20T13:07:59.895 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-log-userspace.ko 2023-06-20T13:07:59.895 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-multipath.ko 2023-06-20T13:07:59.895 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-queue-length.ko 2023-06-20T13:07:59.895 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-raid.ko 2023-06-20T13:07:59.896 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-round-robin.ko 2023-06-20T13:07:59.896 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-service-time.ko 2023-06-20T13:07:59.896 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-switch.ko 2023-06-20T13:07:59.896 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-thin-pool.ko 2023-06-20T13:07:59.896 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-verity.ko 2023-06-20T13:07:59.896 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/faulty.ko 2023-06-20T13:07:59.896 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/linear.ko 2023-06-20T13:07:59.897 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/multipath.ko 2023-06-20T13:07:59.897 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/persistent-data 2023-06-20T13:07:59.897 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-06-20T13:07:59.897 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/raid0.ko 2023-06-20T13:07:59.897 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/raid1.ko 2023-06-20T13:07:59.897 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/raid10.ko 2023-06-20T13:07:59.897 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/raid456.ko 2023-06-20T13:07:59.897 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message 2023-06-20T13:07:59.898 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion 2023-06-20T13:07:59.898 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptbase.ko 2023-06-20T13:07:59.898 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptctl.ko 2023-06-20T13:07:59.898 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptfc.ko 2023-06-20T13:07:59.898 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptlan.ko 2023-06-20T13:07:59.898 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptsas.ko 2023-06-20T13:07:59.898 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptscsih.ko 2023-06-20T13:07:59.898 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptspi.ko 2023-06-20T13:07:59.899 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd 2023-06-20T13:07:59.899 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/lpc_ich.ko 2023-06-20T13:07:59.899 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/lpc_sch.ko 2023-06-20T13:07:59.899 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/mfd-core.ko 2023-06-20T13:07:59.899 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/sm501.ko 2023-06-20T13:07:59.899 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/viperboard.ko 2023-06-20T13:07:59.899 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/vx855.ko 2023-06-20T13:07:59.899 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/wl1273-core.ko 2023-06-20T13:07:59.900 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc 2023-06-20T13:07:59.900 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/altera-stapl 2023-06-20T13:07:59.900 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-06-20T13:07:59.900 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/apds9802als.ko 2023-06-20T13:07:59.900 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/apds990x.ko 2023-06-20T13:07:59.900 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/bh1770glc.ko 2023-06-20T13:07:59.900 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/cb710 2023-06-20T13:07:59.900 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/cb710/cb710.ko 2023-06-20T13:07:59.901 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom 2023-06-20T13:07:59.901 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom/at24.ko 2023-06-20T13:07:59.901 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom/eeprom.ko 2023-06-20T13:07:59.901 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-06-20T13:07:59.901 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom/max6875.ko 2023-06-20T13:07:59.901 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/enclosure.ko 2023-06-20T13:07:59.901 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/hpilo.ko 2023-06-20T13:07:59.901 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/isl29003.ko 2023-06-20T13:07:59.902 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/isl29020.ko 2023-06-20T13:07:59.902 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/lis3lv02d 2023-06-20T13:07:59.902 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-06-20T13:07:59.902 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-06-20T13:07:59.902 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/mei 2023-06-20T13:07:59.902 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/mei/mei-me.ko 2023-06-20T13:07:59.902 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/mei/mei-txe.ko 2023-06-20T13:07:59.902 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/mei/mei.ko 2023-06-20T13:07:59.903 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-gru 2023-06-20T13:07:59.903 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-gru/gru.ko 2023-06-20T13:07:59.903 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-xp 2023-06-20T13:07:59.903 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-xp/xp.ko 2023-06-20T13:07:59.903 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-xp/xpc.ko 2023-06-20T13:07:59.903 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-06-20T13:07:59.903 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/tifm_7xx1.ko 2023-06-20T13:07:59.903 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/tifm_core.ko 2023-06-20T13:07:59.904 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/tsl2550.ko 2023-06-20T13:07:59.904 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/vmw_balloon.ko 2023-06-20T13:07:59.904 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/vmw_vmci 2023-06-20T13:07:59.904 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-06-20T13:07:59.904 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net 2023-06-20T13:07:59.904 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/bonding 2023-06-20T13:07:59.904 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/bonding/bonding.ko 2023-06-20T13:07:59.904 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa 2023-06-20T13:07:59.905 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/b53 2023-06-20T13:07:59.905 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/b53/b53_common.ko 2023-06-20T13:07:59.905 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/bcm-sf2.ko 2023-06-20T13:07:59.905 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/mv88e6060.ko 2023-06-20T13:07:59.905 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/mv88e6xxx 2023-06-20T13:07:59.905 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-06-20T13:07:59.905 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dummy.ko 2023-06-20T13:07:59.905 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/eql.ko 2023-06-20T13:07:59.906 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet 2023-06-20T13:07:59.906 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com 2023-06-20T13:07:59.906 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-06-20T13:07:59.906 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-06-20T13:07:59.906 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-06-20T13:07:59.906 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-06-20T13:07:59.906 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390 2023-06-20T13:07:59.907 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390/8390.ko 2023-06-20T13:07:59.907 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-06-20T13:07:59.907 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-06-20T13:07:59.907 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-06-20T13:07:59.907 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/adaptec 2023-06-20T13:07:59.907 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-06-20T13:07:59.907 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/agere 2023-06-20T13:07:59.907 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/agere/et131x.ko 2023-06-20T13:07:59.907 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/alteon 2023-06-20T13:07:59.908 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-06-20T13:07:59.908 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/altera 2023-06-20T13:07:59.908 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-06-20T13:07:59.908 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/amd 2023-06-20T13:07:59.908 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-06-20T13:07:59.908 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-06-20T13:07:59.908 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-06-20T13:07:59.909 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros 2023-06-20T13:07:59.909 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/alx 2023-06-20T13:07:59.909 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-06-20T13:07:59.909 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atl1c 2023-06-20T13:07:59.909 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-06-20T13:07:59.909 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atl1e 2023-06-20T13:07:59.909 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-06-20T13:07:59.909 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atlx 2023-06-20T13:07:59.910 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-06-20T13:07:59.910 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-06-20T13:07:59.910 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom 2023-06-20T13:07:59.910 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-06-20T13:07:59.910 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-06-20T13:07:59.910 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-06-20T13:07:59.910 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-06-20T13:07:59.910 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-06-20T13:07:59.911 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/genet 2023-06-20T13:07:59.911 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-06-20T13:07:59.911 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-06-20T13:07:59.911 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/brocade 2023-06-20T13:07:59.911 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/brocade/bna 2023-06-20T13:07:59.912 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-06-20T13:07:59.912 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio 2023-06-20T13:07:59.912 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb 2023-06-20T13:07:59.912 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-06-20T13:07:59.912 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-06-20T13:07:59.913 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-06-20T13:07:59.913 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-06-20T13:07:59.913 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-06-20T13:07:59.913 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-06-20T13:07:59.913 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-06-20T13:07:59.913 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-06-20T13:07:59.913 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-06-20T13:07:59.914 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/cisco 2023-06-20T13:07:59.914 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/cisco/enic 2023-06-20T13:07:59.914 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-06-20T13:07:59.914 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec 2023-06-20T13:07:59.914 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip 2023-06-20T13:07:59.914 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-06-20T13:07:59.914 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-06-20T13:07:59.915 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-06-20T13:07:59.915 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-06-20T13:07:59.915 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-06-20T13:07:59.915 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-06-20T13:07:59.915 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dlink 2023-06-20T13:07:59.915 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-06-20T13:07:59.915 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-06-20T13:07:59.915 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dnet.ko 2023-06-20T13:07:59.916 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/emulex 2023-06-20T13:07:59.916 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/emulex/benet 2023-06-20T13:07:59.916 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-06-20T13:07:59.916 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/ethoc.ko 2023-06-20T13:07:59.916 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/fealnx.ko 2023-06-20T13:07:59.916 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel 2023-06-20T13:07:59.916 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e100.ko 2023-06-20T13:07:59.916 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e1000 2023-06-20T13:07:59.917 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-06-20T13:07:59.917 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e1000e 2023-06-20T13:07:59.917 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-06-20T13:07:59.917 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/fm10k 2023-06-20T13:07:59.917 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-06-20T13:07:59.917 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/i40e 2023-06-20T13:07:59.917 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-06-20T13:07:59.917 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/iavf 2023-06-20T13:07:59.918 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-06-20T13:07:59.918 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/igb 2023-06-20T13:07:59.918 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-06-20T13:07:59.918 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/igbvf 2023-06-20T13:07:59.918 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-06-20T13:07:59.918 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/ixgbe 2023-06-20T13:07:59.918 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-06-20T13:07:59.918 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/ixgbevf 2023-06-20T13:07:59.919 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-06-20T13:07:59.919 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/jme.ko 2023-06-20T13:07:59.919 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/marvell 2023-06-20T13:07:59.919 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-06-20T13:07:59.919 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/marvell/skge.ko 2023-06-20T13:07:59.919 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-06-20T13:07:59.919 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox 2023-06-20T13:07:59.920 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx4 2023-06-20T13:07:59.920 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-06-20T13:07:59.920 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-06-20T13:07:59.920 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx5 2023-06-20T13:07:59.920 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-06-20T13:07:59.920 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-06-20T13:07:59.920 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/micrel 2023-06-20T13:07:59.920 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-06-20T13:07:59.921 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/myricom 2023-06-20T13:07:59.921 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/myricom/myri10ge 2023-06-20T13:07:59.921 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-06-20T13:07:59.921 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/natsemi 2023-06-20T13:07:59.921 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-06-20T13:07:59.921 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-06-20T13:07:59.921 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/neterion 2023-06-20T13:07:59.921 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-06-20T13:07:59.922 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/nvidia 2023-06-20T13:07:59.922 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-06-20T13:07:59.922 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/packetengines 2023-06-20T13:07:59.922 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-06-20T13:07:59.922 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-06-20T13:07:59.922 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic 2023-06-20T13:07:59.922 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/netxen 2023-06-20T13:07:59.922 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-06-20T13:07:59.923 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-06-20T13:07:59.923 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-06-20T13:07:59.923 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-06-20T13:07:59.923 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/rdc 2023-06-20T13:07:59.923 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-06-20T13:07:59.923 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek 2023-06-20T13:07:59.923 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-06-20T13:07:59.923 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-06-20T13:07:59.924 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek/atp.ko 2023-06-20T13:07:59.924 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-06-20T13:07:59.924 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/rocker 2023-06-20T13:07:59.924 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-06-20T13:07:59.924 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sfc 2023-06-20T13:07:59.924 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-06-20T13:07:59.924 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/silan 2023-06-20T13:07:59.925 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-06-20T13:07:59.925 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sis 2023-06-20T13:07:59.925 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sis/sis190.ko 2023-06-20T13:07:59.925 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sis/sis900.ko 2023-06-20T13:07:59.925 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc 2023-06-20T13:07:59.925 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-06-20T13:07:59.925 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-06-20T13:07:59.925 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-06-20T13:07:59.926 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-06-20T13:07:59.926 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/stmicro 2023-06-20T13:07:59.926 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/stmicro/stmmac 2023-06-20T13:07:59.926 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-06-20T13:07:59.926 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-06-20T13:07:59.926 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun 2023-06-20T13:07:59.926 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun/cassini.ko 2023-06-20T13:07:59.926 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun/niu.ko 2023-06-20T13:07:59.927 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun/sungem.ko 2023-06-20T13:07:59.927 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-06-20T13:07:59.927 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/tehuti 2023-06-20T13:07:59.927 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-06-20T13:07:59.927 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/ti 2023-06-20T13:07:59.927 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/ti/tlan.ko 2023-06-20T13:07:59.927 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/via 2023-06-20T13:07:59.927 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-06-20T13:07:59.928 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-06-20T13:07:59.928 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/wiznet 2023-06-20T13:07:59.928 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-06-20T13:07:59.928 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-06-20T13:07:59.928 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/xircom 2023-06-20T13:07:59.928 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-06-20T13:07:59.928 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/geneve.ko 2023-06-20T13:07:59.928 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/hyperv 2023-06-20T13:07:59.929 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-06-20T13:07:59.929 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ieee802154 2023-06-20T13:07:59.929 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ieee802154/fakelb.ko 2023-06-20T13:07:59.929 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ifb.ko 2023-06-20T13:07:59.929 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ipvlan 2023-06-20T13:07:59.929 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ipvlan/ipvlan.ko 2023-06-20T13:07:59.929 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/macvlan.ko 2023-06-20T13:07:59.929 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/macvtap.ko 2023-06-20T13:07:59.930 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mdio 2023-06-20T13:07:59.930 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mdio.ko 2023-06-20T13:07:59.930 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-06-20T13:07:59.930 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-06-20T13:07:59.930 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mii.ko 2023-06-20T13:07:59.930 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/net_failover.ko 2023-06-20T13:07:59.930 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/netconsole.ko 2023-06-20T13:07:59.930 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/nlmon.ko 2023-06-20T13:07:59.931 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/pcs 2023-06-20T13:07:59.931 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-06-20T13:07:59.931 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-06-20T13:07:59.931 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy 2023-06-20T13:07:59.931 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/amd.ko 2023-06-20T13:07:59.931 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-06-20T13:07:59.931 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-06-20T13:07:59.931 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/bcm7xxx.ko 2023-06-20T13:07:59.932 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/bcm87xx.ko 2023-06-20T13:07:59.932 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/broadcom.ko 2023-06-20T13:07:59.932 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/cicada.ko 2023-06-20T13:07:59.932 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/davicom.ko 2023-06-20T13:07:59.932 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/dp83640.ko 2023-06-20T13:07:59.932 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/et1011c.ko 2023-06-20T13:07:59.932 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/icplus.ko 2023-06-20T13:07:59.933 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/lxt.ko 2023-06-20T13:07:59.933 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/marvell.ko 2023-06-20T13:07:59.933 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/micrel.ko 2023-06-20T13:07:59.933 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/national.ko 2023-06-20T13:07:59.933 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/phylink.ko 2023-06-20T13:07:59.933 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/qsemi.ko 2023-06-20T13:07:59.933 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/realtek.ko 2023-06-20T13:07:59.933 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/smsc.ko 2023-06-20T13:07:59.934 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/ste10Xp.ko 2023-06-20T13:07:59.934 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/vitesse.ko 2023-06-20T13:07:59.934 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp 2023-06-20T13:07:59.934 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/bsd_comp.ko 2023-06-20T13:07:59.934 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_async.ko 2023-06-20T13:07:59.934 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_deflate.ko 2023-06-20T13:07:59.934 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_generic.ko 2023-06-20T13:07:59.934 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_mppe.ko 2023-06-20T13:07:59.935 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_synctty.ko 2023-06-20T13:07:59.935 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/pppoe.ko 2023-06-20T13:07:59.935 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/pppox.ko 2023-06-20T13:07:59.935 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/pptp.ko 2023-06-20T13:07:59.935 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/slip 2023-06-20T13:07:59.935 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/slip/slhc.ko 2023-06-20T13:07:59.935 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/slip/slip.ko 2023-06-20T13:07:59.935 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/sungem_phy.ko 2023-06-20T13:07:59.936 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/tap.ko 2023-06-20T13:07:59.936 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team 2023-06-20T13:07:59.936 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team.ko 2023-06-20T13:07:59.936 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_activebackup.ko 2023-06-20T13:07:59.936 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_broadcast.ko 2023-06-20T13:07:59.936 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-06-20T13:07:59.936 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_random.ko 2023-06-20T13:07:59.936 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-06-20T13:07:59.937 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/tun.ko 2023-06-20T13:07:59.937 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/veth.ko 2023-06-20T13:07:59.937 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/virtio_net.ko 2023-06-20T13:07:59.937 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/vmxnet3 2023-06-20T13:07:59.937 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-06-20T13:07:59.937 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/vxlan 2023-06-20T13:07:59.937 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/vxlan/vxlan.ko 2023-06-20T13:07:59.937 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/xen-netback 2023-06-20T13:07:59.938 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/xen-netback/xen-netback.ko 2023-06-20T13:07:59.938 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/xen-netfront.ko 2023-06-20T13:07:59.938 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ntb 2023-06-20T13:07:59.938 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ntb/ntb.ko 2023-06-20T13:07:59.938 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/nvme 2023-06-20T13:07:59.938 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/nvme/host 2023-06-20T13:07:59.938 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/nvme/host/nvme-core.ko 2023-06-20T13:07:59.938 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/nvme/host/nvme.ko 2023-06-20T13:07:59.939 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport 2023-06-20T13:07:59.939 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport/parport.ko 2023-06-20T13:07:59.939 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport/parport_cs.ko 2023-06-20T13:07:59.939 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport/parport_pc.ko 2023-06-20T13:07:59.939 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport/parport_serial.ko 2023-06-20T13:07:59.939 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci 2023-06-20T13:07:59.939 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/hotplug 2023-06-20T13:07:59.939 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-06-20T13:07:59.940 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/pcie 2023-06-20T13:07:59.940 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/pcie/aer_inject.ko 2023-06-20T13:07:59.940 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/xen-pcifront.ko 2023-06-20T13:07:59.940 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pcmcia 2023-06-20T13:07:59.940 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pcmcia/i82092.ko 2023-06-20T13:07:59.940 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pcmcia/pd6729.ko 2023-06-20T13:07:59.940 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pcmcia/yenta_socket.ko 2023-06-20T13:07:59.940 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pinctrl 2023-06-20T13:07:59.941 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pinctrl/intel 2023-06-20T13:07:59.941 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-06-20T13:07:59.941 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform 2023-06-20T13:07:59.941 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86 2023-06-20T13:07:59.941 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/acer-wmi.ko 2023-06-20T13:07:59.941 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/acerhdf.ko 2023-06-20T13:07:59.941 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/apple-gmux.ko 2023-06-20T13:07:59.941 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/asus-laptop.ko 2023-06-20T13:07:59.942 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-06-20T13:07:59.942 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/asus-wmi.ko 2023-06-20T13:07:59.942 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/classmate-laptop.ko 2023-06-20T13:07:59.942 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-06-20T13:07:59.942 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-06-20T13:07:59.942 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-06-20T13:07:59.942 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-06-20T13:07:59.942 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/hdaps.ko 2023-06-20T13:07:59.943 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/intel 2023-06-20T13:07:59.943 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-06-20T13:07:59.943 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/intel_ips.ko 2023-06-20T13:07:59.943 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/msi-wmi.ko 2023-06-20T13:07:59.943 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/mxm-wmi.ko 2023-06-20T13:07:59.943 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-06-20T13:07:59.943 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/samsung-laptop.ko 2023-06-20T13:07:59.943 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/samsung-q10.ko 2023-06-20T13:07:59.944 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/topstar-laptop.ko 2023-06-20T13:07:59.944 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-06-20T13:07:59.944 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/toshiba_haps.ko 2023-06-20T13:07:59.944 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/wmi-bmof.ko 2023-06-20T13:07:59.944 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/wmi.ko 2023-06-20T13:07:59.944 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/powercap 2023-06-20T13:07:59.944 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/powercap/intel_rapl_common.ko 2023-06-20T13:07:59.945 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/powercap/intel_rapl_msr.ko 2023-06-20T13:07:59.945 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps 2023-06-20T13:07:59.945 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/clients 2023-06-20T13:07:59.945 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/clients/pps-gpio.ko 2023-06-20T13:07:59.945 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/clients/pps-ldisc.ko 2023-06-20T13:07:59.945 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/clients/pps_parport.ko 2023-06-20T13:07:59.945 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/pps_core.ko 2023-06-20T13:07:59.945 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ptp 2023-06-20T13:07:59.946 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ptp/ptp.ko 2023-06-20T13:07:59.946 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ptp/ptp_kvm.ko 2023-06-20T13:07:59.946 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc 2023-06-20T13:07:59.946 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-bq32k.ko 2023-06-20T13:07:59.946 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-bq4802.ko 2023-06-20T13:07:59.946 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1286.ko 2023-06-20T13:07:59.946 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1307.ko 2023-06-20T13:07:59.946 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1374.ko 2023-06-20T13:07:59.947 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1511.ko 2023-06-20T13:07:59.947 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1553.ko 2023-06-20T13:07:59.947 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1672.ko 2023-06-20T13:07:59.947 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1742.ko 2023-06-20T13:07:59.947 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds2404.ko 2023-06-20T13:07:59.947 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds3232.ko 2023-06-20T13:07:59.947 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-em3027.ko 2023-06-20T13:07:59.947 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-fm3130.ko 2023-06-20T13:07:59.948 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-isl12022.ko 2023-06-20T13:07:59.948 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-isl1208.ko 2023-06-20T13:07:59.948 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-m41t80.ko 2023-06-20T13:07:59.948 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-m48t35.ko 2023-06-20T13:07:59.948 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-m48t59.ko 2023-06-20T13:07:59.948 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-max6900.ko 2023-06-20T13:07:59.948 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-msm6242.ko 2023-06-20T13:07:59.948 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf2127.ko 2023-06-20T13:07:59.949 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf85063.ko 2023-06-20T13:07:59.949 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf8523.ko 2023-06-20T13:07:59.949 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf8563.ko 2023-06-20T13:07:59.949 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf8583.ko 2023-06-20T13:07:59.949 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rp5c01.ko 2023-06-20T13:07:59.949 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rs5c372.ko 2023-06-20T13:07:59.949 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-06-20T13:07:59.949 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rx8025.ko 2023-06-20T13:07:59.950 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rx8581.ko 2023-06-20T13:07:59.950 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-06-20T13:07:59.950 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-x1205.ko 2023-06-20T13:07:59.950 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi 2023-06-20T13:07:59.950 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/3w-9xxx.ko 2023-06-20T13:07:59.950 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/3w-sas.ko 2023-06-20T13:07:59.950 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/3w-xxxx.ko 2023-06-20T13:07:59.950 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/BusLogic.ko 2023-06-20T13:07:59.951 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/a100u2w.ko 2023-06-20T13:07:59.951 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aacraid 2023-06-20T13:07:59.951 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aacraid/aacraid.ko 2023-06-20T13:07:59.951 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/advansys.ko 2023-06-20T13:07:59.951 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aic7xxx 2023-06-20T13:07:59.951 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-06-20T13:07:59.951 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-06-20T13:07:59.951 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/am53c974.ko 2023-06-20T13:07:59.952 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/arcmsr 2023-06-20T13:07:59.952 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-06-20T13:07:59.952 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/atp870u.ko 2023-06-20T13:07:59.952 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/be2iscsi 2023-06-20T13:07:59.952 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-06-20T13:07:59.952 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bfa 2023-06-20T13:07:59.952 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bfa/bfa.ko 2023-06-20T13:07:59.952 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bnx2fc 2023-06-20T13:07:59.953 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-06-20T13:07:59.953 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bnx2i 2023-06-20T13:07:59.953 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-06-20T13:07:59.953 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/ch.ko 2023-06-20T13:07:59.953 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/csiostor 2023-06-20T13:07:59.953 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/csiostor/csiostor.ko 2023-06-20T13:07:59.953 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi 2023-06-20T13:07:59.953 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/cxgb3i 2023-06-20T13:07:59.954 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-06-20T13:07:59.954 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/cxgb4i 2023-06-20T13:07:59.954 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-06-20T13:07:59.954 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-06-20T13:07:59.954 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/dc395x.ko 2023-06-20T13:07:59.954 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler 2023-06-20T13:07:59.954 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-06-20T13:07:59.954 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-06-20T13:07:59.955 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-06-20T13:07:59.955 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-06-20T13:07:59.955 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/dmx3191d.ko 2023-06-20T13:07:59.955 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/esas2r 2023-06-20T13:07:59.955 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/esas2r/esas2r.ko 2023-06-20T13:07:59.955 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/esp_scsi.ko 2023-06-20T13:07:59.955 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fcoe 2023-06-20T13:07:59.955 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fcoe/fcoe.ko 2023-06-20T13:07:59.956 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-06-20T13:07:59.956 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fnic 2023-06-20T13:07:59.956 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fnic/fnic.ko 2023-06-20T13:07:59.956 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/hpsa.ko 2023-06-20T13:07:59.956 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/hptiop.ko 2023-06-20T13:07:59.956 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/hv_storvsc.ko 2023-06-20T13:07:59.956 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/initio.ko 2023-06-20T13:07:59.956 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/ipr.ko 2023-06-20T13:07:59.957 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/ips.ko 2023-06-20T13:07:59.957 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/isci 2023-06-20T13:07:59.957 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/isci/isci.ko 2023-06-20T13:07:59.957 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-06-20T13:07:59.957 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/iscsi_tcp.ko 2023-06-20T13:07:59.957 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libfc 2023-06-20T13:07:59.957 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libfc/libfc.ko 2023-06-20T13:07:59.958 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libiscsi.ko 2023-06-20T13:07:59.958 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libiscsi_tcp.ko 2023-06-20T13:07:59.958 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libsas 2023-06-20T13:07:59.958 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libsas/libsas.ko 2023-06-20T13:07:59.958 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/lpfc 2023-06-20T13:07:59.958 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/lpfc/lpfc.ko 2023-06-20T13:07:59.958 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid 2023-06-20T13:07:59.958 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid.ko 2023-06-20T13:07:59.959 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-06-20T13:07:59.959 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-06-20T13:07:59.959 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-06-20T13:07:59.959 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mpt3sas 2023-06-20T13:07:59.959 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-06-20T13:07:59.959 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mvsas 2023-06-20T13:07:59.959 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mvsas/mvsas.ko 2023-06-20T13:07:59.959 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mvumi.ko 2023-06-20T13:07:59.960 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/pm8001 2023-06-20T13:07:59.960 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-06-20T13:07:59.960 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/pmcraid.ko 2023-06-20T13:07:59.960 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla1280.ko 2023-06-20T13:07:59.960 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla2xxx 2023-06-20T13:07:59.960 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-06-20T13:07:59.960 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-06-20T13:07:59.960 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla4xxx 2023-06-20T13:07:59.961 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-06-20T13:07:59.961 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/raid_class.ko 2023-06-20T13:07:59.961 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_debug.ko 2023-06-20T13:07:59.961 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_fc.ko 2023-06-20T13:07:59.961 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-06-20T13:07:59.961 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_sas.ko 2023-06-20T13:07:59.961 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_spi.ko 2023-06-20T13:07:59.961 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_srp.ko 2023-06-20T13:07:59.962 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/ses.ko 2023-06-20T13:07:59.962 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/st.ko 2023-06-20T13:07:59.962 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/stex.ko 2023-06-20T13:07:59.962 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/sym53c8xx_2 2023-06-20T13:07:59.962 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-06-20T13:07:59.962 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/virtio_scsi.ko 2023-06-20T13:07:59.962 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/vmw_pvscsi.ko 2023-06-20T13:07:59.962 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/wd719x.ko 2023-06-20T13:07:59.963 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ssb 2023-06-20T13:07:59.963 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ssb/ssb.ko 2023-06-20T13:07:59.963 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target 2023-06-20T13:07:59.963 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/iscsi 2023-06-20T13:07:59.963 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-06-20T13:07:59.963 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/loopback 2023-06-20T13:07:59.963 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/loopback/tcm_loop.ko 2023-06-20T13:07:59.963 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_file.ko 2023-06-20T13:07:59.964 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_iblock.ko 2023-06-20T13:07:59.964 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_mod.ko 2023-06-20T13:07:59.964 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_pscsi.ko 2023-06-20T13:07:59.964 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_user.ko 2023-06-20T13:07:59.964 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/tcm_fc 2023-06-20T13:07:59.964 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-06-20T13:07:59.964 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal 2023-06-20T13:07:59.964 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel 2023-06-20T13:07:59.965 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal 2023-06-20T13:07:59.965 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-06-20T13:07:59.965 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-06-20T13:07:59.965 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-06-20T13:07:59.965 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-06-20T13:07:59.965 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-06-20T13:07:59.965 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-06-20T13:07:59.965 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-06-20T13:07:59.966 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-06-20T13:07:59.966 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-06-20T13:07:59.966 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-06-20T13:07:59.966 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-06-20T13:07:59.966 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-06-20T13:07:59.966 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-06-20T13:07:59.966 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-06-20T13:07:59.966 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-06-20T13:07:59.967 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty 2023-06-20T13:07:59.967 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/ipwireless 2023-06-20T13:07:59.967 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-06-20T13:07:59.967 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/n_gsm.ko 2023-06-20T13:07:59.967 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/n_hdlc.ko 2023-06-20T13:07:59.967 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/nozomi.ko 2023-06-20T13:07:59.967 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial 2023-06-20T13:07:59.967 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/8250 2023-06-20T13:07:59.968 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-06-20T13:07:59.968 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/arc_uart.ko 2023-06-20T13:07:59.968 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/jsm 2023-06-20T13:07:59.968 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/jsm/jsm.ko 2023-06-20T13:07:59.968 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/synclink_gt.ko 2023-06-20T13:07:59.968 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs 2023-06-20T13:07:59.968 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs/core 2023-06-20T13:07:59.968 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs/core/ufshcd-core.ko 2023-06-20T13:07:59.969 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs/host 2023-06-20T13:07:59.969 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-06-20T13:07:59.969 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio 2023-06-20T13:07:59.969 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio.ko 2023-06-20T13:07:59.969 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio_aec.ko 2023-06-20T13:07:59.969 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio_cif.ko 2023-06-20T13:07:59.969 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio_pci_generic.ko 2023-06-20T13:07:59.969 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio_sercos3.ko 2023-06-20T13:07:59.970 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb 2023-06-20T13:07:59.970 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class 2023-06-20T13:07:59.970 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class/cdc-acm.ko 2023-06-20T13:07:59.970 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class/cdc-wdm.ko 2023-06-20T13:07:59.970 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class/usblp.ko 2023-06-20T13:07:59.970 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class/usbtmc.ko 2023-06-20T13:07:59.970 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/host 2023-06-20T13:07:59.970 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/host/sl811-hcd.ko 2023-06-20T13:07:59.971 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/image 2023-06-20T13:07:59.971 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/image/mdc800.ko 2023-06-20T13:07:59.971 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/image/microtek.ko 2023-06-20T13:07:59.971 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc 2023-06-20T13:07:59.971 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/adutux.ko 2023-06-20T13:07:59.971 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/appledisplay.ko 2023-06-20T13:07:59.971 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/emi26.ko 2023-06-20T13:07:59.971 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/emi62.ko 2023-06-20T13:07:59.972 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/ezusb.ko 2023-06-20T13:07:59.972 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/idmouse.ko 2023-06-20T13:07:59.972 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/iowarrior.ko 2023-06-20T13:07:59.972 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/isight_firmware.ko 2023-06-20T13:07:59.972 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/ldusb.ko 2023-06-20T13:07:59.972 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/legousbtower.ko 2023-06-20T13:07:59.972 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/sisusbvga 2023-06-20T13:07:59.972 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-06-20T13:07:59.973 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/trancevibrator.ko 2023-06-20T13:07:59.973 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/usb3503.ko 2023-06-20T13:07:59.973 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/usblcd.ko 2023-06-20T13:07:59.973 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/usbsevseg.ko 2023-06-20T13:07:59.973 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/uss720.ko 2023-06-20T13:07:59.973 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/yurex.ko 2023-06-20T13:07:59.973 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/phy 2023-06-20T13:07:59.973 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/phy/phy-generic.ko 2023-06-20T13:07:59.974 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial 2023-06-20T13:07:59.974 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/aircable.ko 2023-06-20T13:07:59.974 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ark3116.ko 2023-06-20T13:07:59.974 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/belkin_sa.ko 2023-06-20T13:07:59.974 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ch341.ko 2023-06-20T13:07:59.974 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/cp210x.ko 2023-06-20T13:07:59.974 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/cyberjack.ko 2023-06-20T13:07:59.974 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/cypress_m8.ko 2023-06-20T13:07:59.975 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/digi_acceleport.ko 2023-06-20T13:07:59.975 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/empeg.ko 2023-06-20T13:07:59.975 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ftdi_sio.ko 2023-06-20T13:07:59.975 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/garmin_gps.ko 2023-06-20T13:07:59.975 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/io_edgeport.ko 2023-06-20T13:07:59.975 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/io_ti.ko 2023-06-20T13:07:59.975 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ipaq.ko 2023-06-20T13:07:59.975 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ipw.ko 2023-06-20T13:07:59.976 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ir-usb.ko 2023-06-20T13:07:59.976 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-06-20T13:07:59.976 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/keyspan.ko 2023-06-20T13:07:59.976 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/keyspan_pda.ko 2023-06-20T13:07:59.976 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/kl5kusb105.ko 2023-06-20T13:07:59.976 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/kobil_sct.ko 2023-06-20T13:07:59.976 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/mct_u232.ko 2023-06-20T13:07:59.976 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/mos7720.ko 2023-06-20T13:07:59.977 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/mos7840.ko 2023-06-20T13:07:59.977 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/navman.ko 2023-06-20T13:07:59.977 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/omninet.ko 2023-06-20T13:07:59.977 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/opticon.ko 2023-06-20T13:07:59.977 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/option.ko 2023-06-20T13:07:59.977 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/oti6858.ko 2023-06-20T13:07:59.977 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/pl2303.ko 2023-06-20T13:07:59.977 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/qcaux.ko 2023-06-20T13:07:59.978 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/qcserial.ko 2023-06-20T13:07:59.978 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/quatech2.ko 2023-06-20T13:07:59.978 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/safe_serial.ko 2023-06-20T13:07:59.978 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/sierra.ko 2023-06-20T13:07:59.978 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/spcp8x5.ko 2023-06-20T13:07:59.978 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ssu100.ko 2023-06-20T13:07:59.978 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/symbolserial.ko 2023-06-20T13:07:59.978 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-06-20T13:07:59.979 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-06-20T13:07:59.979 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/usb_debug.ko 2023-06-20T13:07:59.979 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/usb_wwan.ko 2023-06-20T13:07:59.979 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/visor.ko 2023-06-20T13:07:59.979 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/whiteheat.ko 2023-06-20T13:07:59.979 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/xsens_mt.ko 2023-06-20T13:07:59.979 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage 2023-06-20T13:07:59.979 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/uas.ko 2023-06-20T13:07:59.980 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-alauda.ko 2023-06-20T13:07:59.980 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-cypress.ko 2023-06-20T13:07:59.980 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-datafab.ko 2023-06-20T13:07:59.980 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-06-20T13:07:59.980 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-freecom.ko 2023-06-20T13:07:59.980 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-isd200.ko 2023-06-20T13:07:59.980 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-06-20T13:07:59.980 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-karma.ko 2023-06-20T13:07:59.981 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-onetouch.ko 2023-06-20T13:07:59.981 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-realtek.ko 2023-06-20T13:07:59.981 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-sddr09.ko 2023-06-20T13:07:59.981 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-sddr55.ko 2023-06-20T13:07:59.981 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-usbat.ko 2023-06-20T13:07:59.981 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/usb-storage.ko 2023-06-20T13:07:59.981 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/usbip 2023-06-20T13:07:59.981 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/usbip/usbip-core.ko 2023-06-20T13:07:59.982 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/usbip/usbip-host.ko 2023-06-20T13:07:59.982 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-06-20T13:07:59.982 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio 2023-06-20T13:07:59.982 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/pci 2023-06-20T13:07:59.982 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-06-20T13:07:59.982 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/pci/vfio-pci.ko 2023-06-20T13:07:59.982 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/vfio.ko 2023-06-20T13:07:59.982 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-06-20T13:07:59.983 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost 2023-06-20T13:07:59.983 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost/vhost.ko 2023-06-20T13:07:59.983 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost/vhost_iotlb.ko 2023-06-20T13:07:59.983 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost/vhost_net.ko 2023-06-20T13:07:59.983 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost/vhost_scsi.ko 2023-06-20T13:07:59.983 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video 2023-06-20T13:07:59.983 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video/backlight 2023-06-20T13:07:59.983 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video/backlight/apple_bl.ko 2023-06-20T13:07:59.984 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video/backlight/lcd.ko 2023-06-20T13:07:59.984 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video/backlight/platform_lcd.ko 2023-06-20T13:07:59.984 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio 2023-06-20T13:07:59.984 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio.ko 2023-06-20T13:07:59.984 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_balloon.ko 2023-06-20T13:07:59.984 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_mmio.ko 2023-06-20T13:07:59.984 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_pci.ko 2023-06-20T13:07:59.984 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-06-20T13:07:59.985 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-06-20T13:07:59.985 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_ring.ko 2023-06-20T13:07:59.985 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1 2023-06-20T13:07:59.985 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/masters 2023-06-20T13:07:59.985 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/masters/ds2482.ko 2023-06-20T13:07:59.985 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/masters/ds2490.ko 2023-06-20T13:07:59.985 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves 2023-06-20T13:07:59.985 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-06-20T13:07:59.986 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-06-20T13:07:59.986 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-06-20T13:07:59.986 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-06-20T13:07:59.986 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-06-20T13:07:59.986 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-06-20T13:07:59.986 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-06-20T13:07:59.986 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-06-20T13:07:59.986 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-06-20T13:07:59.987 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_smem.ko 2023-06-20T13:07:59.987 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_therm.ko 2023-06-20T13:07:59.987 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/wire.ko 2023-06-20T13:07:59.987 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog 2023-06-20T13:07:59.987 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/alim1535_wdt.ko 2023-06-20T13:07:59.987 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/alim7101_wdt.ko 2023-06-20T13:07:59.987 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/f71808e_wdt.ko 2023-06-20T13:07:59.987 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/hpwdt.ko 2023-06-20T13:07:59.988 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/i6300esb.ko 2023-06-20T13:07:59.988 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-06-20T13:07:59.988 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/iTCO_wdt.ko 2023-06-20T13:07:59.988 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/ib700wdt.ko 2023-06-20T13:07:59.988 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/ibmasr.ko 2023-06-20T13:07:59.988 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-06-20T13:07:59.988 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/it8712f_wdt.ko 2023-06-20T13:07:59.988 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/it87_wdt.ko 2023-06-20T13:07:59.989 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/machzwd.ko 2023-06-20T13:07:59.989 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/nv_tco.ko 2023-06-20T13:07:59.989 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/pcwd_pci.ko 2023-06-20T13:07:59.989 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/pcwd_usb.ko 2023-06-20T13:07:59.989 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-06-20T13:07:59.989 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/sch311x_wdt.ko 2023-06-20T13:07:59.989 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/softdog.ko 2023-06-20T13:07:59.989 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/sp5100_tco.ko 2023-06-20T13:07:59.990 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/via_wdt.ko 2023-06-20T13:07:59.990 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-06-20T13:07:59.990 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/w83877f_wdt.ko 2023-06-20T13:07:59.990 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/w83977f_wdt.ko 2023-06-20T13:07:59.990 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/wdt_pci.ko 2023-06-20T13:07:59.990 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/xen_wdt.ko 2023-06-20T13:07:59.990 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen 2023-06-20T13:07:59.990 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-acpi-processor.ko 2023-06-20T13:07:59.991 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-evtchn.ko 2023-06-20T13:07:59.991 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-gntalloc.ko 2023-06-20T13:07:59.991 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-gntdev.ko 2023-06-20T13:07:59.991 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-pciback 2023-06-20T13:07:59.991 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-06-20T13:07:59.991 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-privcmd.ko 2023-06-20T13:07:59.991 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xenfs 2023-06-20T13:07:59.991 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xenfs/xenfs.ko 2023-06-20T13:07:59.992 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs 2023-06-20T13:07:59.992 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/9p 2023-06-20T13:07:59.992 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/9p/9p.ko 2023-06-20T13:07:59.992 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/affs 2023-06-20T13:07:59.992 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/affs/affs.ko 2023-06-20T13:07:59.992 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/befs 2023-06-20T13:07:59.992 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/befs/befs.ko 2023-06-20T13:07:59.992 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/binfmt_misc.ko 2023-06-20T13:07:59.993 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/btrfs 2023-06-20T13:07:59.993 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/btrfs/btrfs.ko 2023-06-20T13:07:59.993 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/cachefiles 2023-06-20T13:07:59.993 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/cachefiles/cachefiles.ko 2023-06-20T13:07:59.993 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ceph 2023-06-20T13:07:59.993 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ceph/ceph.ko 2023-06-20T13:07:59.993 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/coda 2023-06-20T13:07:59.993 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/coda/coda.ko 2023-06-20T13:07:59.994 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/cramfs 2023-06-20T13:07:59.994 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/cramfs/cramfs.ko 2023-06-20T13:07:59.994 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/dlm 2023-06-20T13:07:59.994 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/dlm/dlm.ko 2023-06-20T13:07:59.994 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ecryptfs 2023-06-20T13:07:59.994 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ecryptfs/ecryptfs.ko 2023-06-20T13:07:59.994 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/f2fs 2023-06-20T13:07:59.994 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/f2fs/f2fs.ko 2023-06-20T13:07:59.995 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fat 2023-06-20T13:07:59.995 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fat/fat.ko 2023-06-20T13:07:59.995 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fat/msdos.ko 2023-06-20T13:07:59.995 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fat/vfat.ko 2023-06-20T13:07:59.995 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fscache 2023-06-20T13:07:59.995 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fscache/fscache.ko 2023-06-20T13:07:59.995 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fuse 2023-06-20T13:07:59.995 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fuse/cuse.ko 2023-06-20T13:07:59.996 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fuse/fuse.ko 2023-06-20T13:07:59.996 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/gfs2 2023-06-20T13:07:59.996 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/gfs2/gfs2.ko 2023-06-20T13:07:59.996 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/hfs 2023-06-20T13:07:59.996 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/hfs/hfs.ko 2023-06-20T13:07:59.996 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/hfsplus 2023-06-20T13:07:59.996 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/hfsplus/hfsplus.ko 2023-06-20T13:07:59.996 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/isofs 2023-06-20T13:07:59.997 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/isofs/isofs.ko 2023-06-20T13:07:59.997 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/jfs 2023-06-20T13:07:59.997 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/jfs/jfs.ko 2023-06-20T13:07:59.997 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/lockd 2023-06-20T13:07:59.997 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/lockd/lockd.ko 2023-06-20T13:07:59.997 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/minix 2023-06-20T13:07:59.997 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/minix/minix.ko 2023-06-20T13:07:59.997 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/netfs 2023-06-20T13:07:59.998 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/netfs/netfs.ko 2023-06-20T13:07:59.998 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs 2023-06-20T13:07:59.998 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/blocklayout 2023-06-20T13:07:59.998 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-06-20T13:07:59.998 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/filelayout 2023-06-20T13:07:59.998 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-06-20T13:07:59.998 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/flexfilelayout 2023-06-20T13:07:59.998 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-06-20T13:07:59.999 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/nfs.ko 2023-06-20T13:07:59.999 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/nfsv3.ko 2023-06-20T13:07:59.999 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/nfsv4.ko 2023-06-20T13:07:59.999 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs_common 2023-06-20T13:07:59.999 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs_common/grace.ko 2023-06-20T13:07:59.999 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs_common/nfs_acl.ko 2023-06-20T13:07:59.999 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfsd 2023-06-20T13:07:59.999 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfsd/nfsd.ko 2023-06-20T13:08:00.000 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nilfs2 2023-06-20T13:08:00.000 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nilfs2/nilfs2.ko 2023-06-20T13:08:00.000 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls 2023-06-20T13:08:00.000 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-celtic.ko 2023-06-20T13:08:00.000 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-centeuro.ko 2023-06-20T13:08:00.000 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-croatian.ko 2023-06-20T13:08:00.000 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-cyrillic.ko 2023-06-20T13:08:00.001 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-gaelic.ko 2023-06-20T13:08:00.001 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-greek.ko 2023-06-20T13:08:00.001 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-iceland.ko 2023-06-20T13:08:00.001 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-inuit.ko 2023-06-20T13:08:00.001 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-roman.ko 2023-06-20T13:08:00.001 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-romanian.ko 2023-06-20T13:08:00.001 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-turkish.ko 2023-06-20T13:08:00.001 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp1250.ko 2023-06-20T13:08:00.002 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp1251.ko 2023-06-20T13:08:00.002 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp1255.ko 2023-06-20T13:08:00.002 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp737.ko 2023-06-20T13:08:00.002 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp775.ko 2023-06-20T13:08:00.002 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp850.ko 2023-06-20T13:08:00.002 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp852.ko 2023-06-20T13:08:00.002 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp855.ko 2023-06-20T13:08:00.002 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp857.ko 2023-06-20T13:08:00.003 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp860.ko 2023-06-20T13:08:00.003 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp861.ko 2023-06-20T13:08:00.003 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp862.ko 2023-06-20T13:08:00.003 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp863.ko 2023-06-20T13:08:00.003 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp864.ko 2023-06-20T13:08:00.003 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp865.ko 2023-06-20T13:08:00.003 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp866.ko 2023-06-20T13:08:00.003 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp869.ko 2023-06-20T13:08:00.004 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp874.ko 2023-06-20T13:08:00.004 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp932.ko 2023-06-20T13:08:00.004 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp936.ko 2023-06-20T13:08:00.004 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp949.ko 2023-06-20T13:08:00.004 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp950.ko 2023-06-20T13:08:00.004 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_euc-jp.ko 2023-06-20T13:08:00.004 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-1.ko 2023-06-20T13:08:00.004 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-13.ko 2023-06-20T13:08:00.005 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-14.ko 2023-06-20T13:08:00.005 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-15.ko 2023-06-20T13:08:00.005 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-2.ko 2023-06-20T13:08:00.005 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-3.ko 2023-06-20T13:08:00.005 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-4.ko 2023-06-20T13:08:00.005 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-5.ko 2023-06-20T13:08:00.005 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-6.ko 2023-06-20T13:08:00.005 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-7.ko 2023-06-20T13:08:00.006 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-9.ko 2023-06-20T13:08:00.006 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_koi8-r.ko 2023-06-20T13:08:00.006 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_koi8-ru.ko 2023-06-20T13:08:00.006 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_koi8-u.ko 2023-06-20T13:08:00.006 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_utf8.ko 2023-06-20T13:08:00.006 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2 2023-06-20T13:08:00.006 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/cluster 2023-06-20T13:08:00.006 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-06-20T13:08:00.007 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/dlm 2023-06-20T13:08:00.007 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-06-20T13:08:00.007 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/dlmfs 2023-06-20T13:08:00.007 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-06-20T13:08:00.007 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/ocfs2.ko 2023-06-20T13:08:00.007 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-06-20T13:08:00.007 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-06-20T13:08:00.007 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-06-20T13:08:00.008 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/overlayfs 2023-06-20T13:08:00.008 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/overlayfs/overlay.ko 2023-06-20T13:08:00.008 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/pstore 2023-06-20T13:08:00.008 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/pstore/ramoops.ko 2023-06-20T13:08:00.008 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/reiserfs 2023-06-20T13:08:00.008 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/reiserfs/reiserfs.ko 2023-06-20T13:08:00.008 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/romfs 2023-06-20T13:08:00.008 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/romfs/romfs.ko 2023-06-20T13:08:00.009 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb 2023-06-20T13:08:00.009 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/client 2023-06-20T13:08:00.009 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/client/cifs.ko 2023-06-20T13:08:00.009 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/common 2023-06-20T13:08:00.009 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/common/cifs_arc4.ko 2023-06-20T13:08:00.009 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/common/cifs_md4.ko 2023-06-20T13:08:00.009 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/squashfs 2023-06-20T13:08:00.009 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/squashfs/squashfs.ko 2023-06-20T13:08:00.010 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/sysv 2023-06-20T13:08:00.010 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/sysv/sysv.ko 2023-06-20T13:08:00.010 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/udf 2023-06-20T13:08:00.010 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/udf/udf.ko 2023-06-20T13:08:00.010 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ufs 2023-06-20T13:08:00.010 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ufs/ufs.ko 2023-06-20T13:08:00.010 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/xfs 2023-06-20T13:08:00.010 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/xfs/xfs.ko 2023-06-20T13:08:00.011 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel 2023-06-20T13:08:00.011 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/rcu 2023-06-20T13:08:00.011 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/rcu/rcutorture.ko 2023-06-20T13:08:00.011 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/torture.ko 2023-06-20T13:08:00.011 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/trace 2023-06-20T13:08:00.011 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-06-20T13:08:00.011 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib 2023-06-20T13:08:00.011 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/asn1_encoder.ko 2023-06-20T13:08:00.012 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crc-itu-t.ko 2023-06-20T13:08:00.012 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crc8.ko 2023-06-20T13:08:00.012 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crypto 2023-06-20T13:08:00.012 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crypto/libarc4.ko 2023-06-20T13:08:00.012 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crypto/libdes.ko 2023-06-20T13:08:00.012 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/libcrc32c.ko 2023-06-20T13:08:00.012 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/lru_cache.ko 2023-06-20T13:08:00.013 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/lz4 2023-06-20T13:08:00.013 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/lz4/lz4_compress.ko 2023-06-20T13:08:00.013 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/lz4/lz4hc_compress.ko 2023-06-20T13:08:00.013 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/math 2023-06-20T13:08:00.013 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/math/cordic.ko 2023-06-20T13:08:00.013 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/raid6 2023-06-20T13:08:00.013 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/raid6/raid6_pq.ko 2023-06-20T13:08:00.013 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/reed_solomon 2023-06-20T13:08:00.014 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/reed_solomon/reed_solomon.ko 2023-06-20T13:08:00.014 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/ts_bm.ko 2023-06-20T13:08:00.014 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/ts_fsm.ko 2023-06-20T13:08:00.014 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/ts_kmp.ko 2023-06-20T13:08:00.014 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/zstd 2023-06-20T13:08:00.014 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/zstd/zstd_compress.ko 2023-06-20T13:08:00.014 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/mm 2023-06-20T13:08:00.014 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/mm/hwpoison-inject.ko 2023-06-20T13:08:00.014 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net 2023-06-20T13:08:00.015 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan 2023-06-20T13:08:00.015 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/6lowpan.ko 2023-06-20T13:08:00.015 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_dest.ko 2023-06-20T13:08:00.015 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_fragment.ko 2023-06-20T13:08:00.015 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_hop.ko 2023-06-20T13:08:00.015 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_ipv6.ko 2023-06-20T13:08:00.015 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_mobility.ko 2023-06-20T13:08:00.015 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_routing.ko 2023-06-20T13:08:00.016 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_udp.ko 2023-06-20T13:08:00.016 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802 2023-06-20T13:08:00.016 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/garp.ko 2023-06-20T13:08:00.016 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/mrp.ko 2023-06-20T13:08:00.016 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/p8022.ko 2023-06-20T13:08:00.016 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/psnap.ko 2023-06-20T13:08:00.016 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/stp.ko 2023-06-20T13:08:00.017 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/8021q 2023-06-20T13:08:00.017 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/8021q/8021q.ko 2023-06-20T13:08:00.017 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p 2023-06-20T13:08:00.017 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p/9pnet.ko 2023-06-20T13:08:00.017 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p/9pnet_fd.ko 2023-06-20T13:08:00.017 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p/9pnet_rdma.ko 2023-06-20T13:08:00.017 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p/9pnet_virtio.ko 2023-06-20T13:08:00.017 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/batman-adv 2023-06-20T13:08:00.018 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/batman-adv/batman-adv.ko 2023-06-20T13:08:00.018 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge 2023-06-20T13:08:00.018 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/br_netfilter.ko 2023-06-20T13:08:00.018 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/bridge.ko 2023-06-20T13:08:00.018 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter 2023-06-20T13:08:00.018 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-06-20T13:08:00.018 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_among.ko 2023-06-20T13:08:00.018 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_arp.ko 2023-06-20T13:08:00.018 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-06-20T13:08:00.019 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-06-20T13:08:00.019 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_ip.ko 2023-06-20T13:08:00.019 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-06-20T13:08:00.019 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_limit.ko 2023-06-20T13:08:00.019 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_log.ko 2023-06-20T13:08:00.019 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_mark.ko 2023-06-20T13:08:00.019 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-06-20T13:08:00.019 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-06-20T13:08:00.020 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-06-20T13:08:00.020 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-06-20T13:08:00.020 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_snat.ko 2023-06-20T13:08:00.020 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_stp.ko 2023-06-20T13:08:00.021 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-06-20T13:08:00.021 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-06-20T13:08:00.021 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-06-20T13:08:00.021 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-06-20T13:08:00.021 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebtables.ko 2023-06-20T13:08:00.021 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-06-20T13:08:00.021 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-06-20T13:08:00.022 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-06-20T13:08:00.022 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ceph 2023-06-20T13:08:00.022 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ceph/libceph.ko 2023-06-20T13:08:00.022 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/core 2023-06-20T13:08:00.022 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/core/failover.ko 2023-06-20T13:08:00.022 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/core/pktgen.ko 2023-06-20T13:08:00.022 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp 2023-06-20T13:08:00.023 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp/dccp.ko 2023-06-20T13:08:00.023 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp/dccp_diag.ko 2023-06-20T13:08:00.023 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp/dccp_ipv4.ko 2023-06-20T13:08:00.023 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp/dccp_ipv6.ko 2023-06-20T13:08:00.023 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dns_resolver 2023-06-20T13:08:00.023 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dns_resolver/dns_resolver.ko 2023-06-20T13:08:00.023 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa 2023-06-20T13:08:00.023 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/dsa_core.ko 2023-06-20T13:08:00.024 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/tag_brcm.ko 2023-06-20T13:08:00.024 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/tag_dsa.ko 2023-06-20T13:08:00.024 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/tag_none.ko 2023-06-20T13:08:00.024 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/tag_trailer.ko 2023-06-20T13:08:00.024 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154 2023-06-20T13:08:00.024 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154/6lowpan 2023-06-20T13:08:00.024 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-06-20T13:08:00.025 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154/ieee802154.ko 2023-06-20T13:08:00.025 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154/ieee802154_socket.ko 2023-06-20T13:08:00.025 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4 2023-06-20T13:08:00.025 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ah4.ko 2023-06-20T13:08:00.025 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/esp4.ko 2023-06-20T13:08:00.025 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/fou.ko 2023-06-20T13:08:00.025 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/gre.ko 2023-06-20T13:08:00.025 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/inet_diag.ko 2023-06-20T13:08:00.026 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ip_gre.ko 2023-06-20T13:08:00.026 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ip_tunnel.ko 2023-06-20T13:08:00.026 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ip_vti.ko 2023-06-20T13:08:00.026 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ipcomp.ko 2023-06-20T13:08:00.026 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ipip.ko 2023-06-20T13:08:00.026 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter 2023-06-20T13:08:00.026 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/arp_tables.ko 2023-06-20T13:08:00.026 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-06-20T13:08:00.027 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-06-20T13:08:00.027 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-06-20T13:08:00.027 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-06-20T13:08:00.027 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-06-20T13:08:00.027 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-06-20T13:08:00.027 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-06-20T13:08:00.027 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-06-20T13:08:00.028 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-06-20T13:08:00.028 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/iptable_security.ko 2023-06-20T13:08:00.028 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-06-20T13:08:00.028 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-06-20T13:08:00.028 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-06-20T13:08:00.028 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-06-20T13:08:00.028 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-06-20T13:08:00.029 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-06-20T13:08:00.029 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-06-20T13:08:00.029 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-06-20T13:08:00.029 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-06-20T13:08:00.029 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-06-20T13:08:00.029 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_bic.ko 2023-06-20T13:08:00.029 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_dctcp.ko 2023-06-20T13:08:00.029 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_diag.ko 2023-06-20T13:08:00.030 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_highspeed.ko 2023-06-20T13:08:00.030 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_htcp.ko 2023-06-20T13:08:00.030 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_hybla.ko 2023-06-20T13:08:00.030 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_illinois.ko 2023-06-20T13:08:00.030 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_lp.ko 2023-06-20T13:08:00.030 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_scalable.ko 2023-06-20T13:08:00.030 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_vegas.ko 2023-06-20T13:08:00.030 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_veno.ko 2023-06-20T13:08:00.031 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_westwood.ko 2023-06-20T13:08:00.031 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_yeah.ko 2023-06-20T13:08:00.031 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tunnel4.ko 2023-06-20T13:08:00.031 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/udp_diag.ko 2023-06-20T13:08:00.031 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/udp_tunnel.ko 2023-06-20T13:08:00.031 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/xfrm4_tunnel.ko 2023-06-20T13:08:00.031 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6 2023-06-20T13:08:00.031 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ah6.ko 2023-06-20T13:08:00.032 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/esp6.ko 2023-06-20T13:08:00.032 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/fou6.ko 2023-06-20T13:08:00.032 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ip6_tunnel.ko 2023-06-20T13:08:00.032 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-06-20T13:08:00.032 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ip6_vti.ko 2023-06-20T13:08:00.032 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ipcomp6.ko 2023-06-20T13:08:00.032 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter 2023-06-20T13:08:00.032 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-06-20T13:08:00.033 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-06-20T13:08:00.033 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-06-20T13:08:00.033 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-06-20T13:08:00.033 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-06-20T13:08:00.033 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-06-20T13:08:00.033 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-06-20T13:08:00.033 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-06-20T13:08:00.033 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-06-20T13:08:00.034 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-06-20T13:08:00.034 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-06-20T13:08:00.034 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-06-20T13:08:00.034 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-06-20T13:08:00.034 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-06-20T13:08:00.034 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-06-20T13:08:00.034 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-06-20T13:08:00.034 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-06-20T13:08:00.035 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-06-20T13:08:00.035 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-06-20T13:08:00.035 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-06-20T13:08:00.035 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-06-20T13:08:00.035 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-06-20T13:08:00.035 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-06-20T13:08:00.035 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-06-20T13:08:00.035 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/sit.ko 2023-06-20T13:08:00.036 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/tunnel6.ko 2023-06-20T13:08:00.036 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/xfrm6_tunnel.ko 2023-06-20T13:08:00.036 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/key 2023-06-20T13:08:00.036 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/key/af_key.ko 2023-06-20T13:08:00.036 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp 2023-06-20T13:08:00.036 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_core.ko 2023-06-20T13:08:00.036 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_debugfs.ko 2023-06-20T13:08:00.037 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_eth.ko 2023-06-20T13:08:00.037 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_ip.ko 2023-06-20T13:08:00.037 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_ip6.ko 2023-06-20T13:08:00.037 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_netlink.ko 2023-06-20T13:08:00.037 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_ppp.ko 2023-06-20T13:08:00.037 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/llc 2023-06-20T13:08:00.037 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/llc/llc.ko 2023-06-20T13:08:00.037 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/mac802154 2023-06-20T13:08:00.038 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/mac802154/mac802154.ko 2023-06-20T13:08:00.038 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/mpls 2023-06-20T13:08:00.038 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/mpls/mpls_gso.ko 2023-06-20T13:08:00.038 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter 2023-06-20T13:08:00.038 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset 2023-06-20T13:08:00.038 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set.ko 2023-06-20T13:08:00.038 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-06-20T13:08:00.039 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-06-20T13:08:00.039 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-06-20T13:08:00.039 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-06-20T13:08:00.039 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-06-20T13:08:00.039 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-06-20T13:08:00.039 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-06-20T13:08:00.039 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-06-20T13:08:00.039 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-06-20T13:08:00.040 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-06-20T13:08:00.040 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-06-20T13:08:00.040 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-06-20T13:08:00.040 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-06-20T13:08:00.040 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-06-20T13:08:00.040 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-06-20T13:08:00.040 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs 2023-06-20T13:08:00.040 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs.ko 2023-06-20T13:08:00.041 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-06-20T13:08:00.041 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-06-20T13:08:00.041 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-06-20T13:08:00.041 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-06-20T13:08:00.041 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-06-20T13:08:00.041 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-06-20T13:08:00.041 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-06-20T13:08:00.042 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-06-20T13:08:00.042 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-06-20T13:08:00.042 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-06-20T13:08:00.042 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-06-20T13:08:00.042 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-06-20T13:08:00.042 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-06-20T13:08:00.042 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conncount.ko 2023-06-20T13:08:00.042 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack.ko 2023-06-20T13:08:00.043 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-06-20T13:08:00.043 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-06-20T13:08:00.043 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-06-20T13:08:00.043 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_h323.ko 2023-06-20T13:08:00.043 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_irc.ko 2023-06-20T13:08:00.043 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-06-20T13:08:00.043 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-06-20T13:08:00.043 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-06-20T13:08:00.044 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_sane.ko 2023-06-20T13:08:00.044 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_sip.ko 2023-06-20T13:08:00.044 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-06-20T13:08:00.044 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-06-20T13:08:00.044 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_dup_netdev.ko 2023-06-20T13:08:00.044 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_flow_table.ko 2023-06-20T13:08:00.044 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_flow_table_inet.ko 2023-06-20T13:08:00.044 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_log_syslog.ko 2023-06-20T13:08:00.045 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat.ko 2023-06-20T13:08:00.045 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_amanda.ko 2023-06-20T13:08:00.045 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_ftp.ko 2023-06-20T13:08:00.045 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_irc.ko 2023-06-20T13:08:00.045 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_sip.ko 2023-06-20T13:08:00.045 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_tftp.ko 2023-06-20T13:08:00.045 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_synproxy_core.ko 2023-06-20T13:08:00.046 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_tables.ko 2023-06-20T13:08:00.046 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink.ko 2023-06-20T13:08:00.046 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink_acct.ko 2023-06-20T13:08:00.046 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink_log.ko 2023-06-20T13:08:00.046 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink_osf.ko 2023-06-20T13:08:00.046 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink_queue.ko 2023-06-20T13:08:00.046 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_chain_nat.ko 2023-06-20T13:08:00.046 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_compat.ko 2023-06-20T13:08:00.047 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_ct.ko 2023-06-20T13:08:00.047 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_dup_netdev.ko 2023-06-20T13:08:00.047 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_fib.ko 2023-06-20T13:08:00.047 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_fwd_netdev.ko 2023-06-20T13:08:00.047 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_hash.ko 2023-06-20T13:08:00.047 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_limit.ko 2023-06-20T13:08:00.047 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_log.ko 2023-06-20T13:08:00.047 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_masq.ko 2023-06-20T13:08:00.048 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_nat.ko 2023-06-20T13:08:00.048 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_numgen.ko 2023-06-20T13:08:00.048 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_queue.ko 2023-06-20T13:08:00.048 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_quota.ko 2023-06-20T13:08:00.048 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_redir.ko 2023-06-20T13:08:00.048 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_reject.ko 2023-06-20T13:08:00.048 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_reject_inet.ko 2023-06-20T13:08:00.048 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_socket.ko 2023-06-20T13:08:00.049 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_tunnel.ko 2023-06-20T13:08:00.049 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_AUDIT.ko 2023-06-20T13:08:00.049 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_CHECKSUM.ko 2023-06-20T13:08:00.049 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_CLASSIFY.ko 2023-06-20T13:08:00.049 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-06-20T13:08:00.049 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_CT.ko 2023-06-20T13:08:00.049 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_DSCP.ko 2023-06-20T13:08:00.049 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_HL.ko 2023-06-20T13:08:00.050 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_HMARK.ko 2023-06-20T13:08:00.050 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_IDLETIMER.ko 2023-06-20T13:08:00.050 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_LED.ko 2023-06-20T13:08:00.050 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_LOG.ko 2023-06-20T13:08:00.050 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_MASQUERADE.ko 2023-06-20T13:08:00.050 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_NETMAP.ko 2023-06-20T13:08:00.050 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_NFLOG.ko 2023-06-20T13:08:00.050 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_NFQUEUE.ko 2023-06-20T13:08:00.051 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_RATEEST.ko 2023-06-20T13:08:00.051 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_REDIRECT.ko 2023-06-20T13:08:00.051 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_SECMARK.ko 2023-06-20T13:08:00.051 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TCPMSS.ko 2023-06-20T13:08:00.051 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-06-20T13:08:00.051 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TEE.ko 2023-06-20T13:08:00.051 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TPROXY.ko 2023-06-20T13:08:00.051 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TRACE.ko 2023-06-20T13:08:00.052 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_addrtype.ko 2023-06-20T13:08:00.052 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_bpf.ko 2023-06-20T13:08:00.052 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_cgroup.ko 2023-06-20T13:08:00.052 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_cluster.ko 2023-06-20T13:08:00.052 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_comment.ko 2023-06-20T13:08:00.052 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_connbytes.ko 2023-06-20T13:08:00.052 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_connlabel.ko 2023-06-20T13:08:00.052 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_connlimit.ko 2023-06-20T13:08:00.053 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_connmark.ko 2023-06-20T13:08:00.053 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_conntrack.ko 2023-06-20T13:08:00.053 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_cpu.ko 2023-06-20T13:08:00.053 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_dccp.ko 2023-06-20T13:08:00.053 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_devgroup.ko 2023-06-20T13:08:00.053 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_dscp.ko 2023-06-20T13:08:00.053 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_ecn.ko 2023-06-20T13:08:00.053 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_esp.ko 2023-06-20T13:08:00.054 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_hashlimit.ko 2023-06-20T13:08:00.054 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_helper.ko 2023-06-20T13:08:00.054 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_hl.ko 2023-06-20T13:08:00.054 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_ipcomp.ko 2023-06-20T13:08:00.054 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_iprange.ko 2023-06-20T13:08:00.054 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_ipvs.ko 2023-06-20T13:08:00.054 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_l2tp.ko 2023-06-20T13:08:00.054 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_length.ko 2023-06-20T13:08:00.055 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_limit.ko 2023-06-20T13:08:00.055 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_mac.ko 2023-06-20T13:08:00.055 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_mark.ko 2023-06-20T13:08:00.055 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_multiport.ko 2023-06-20T13:08:00.055 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_nat.ko 2023-06-20T13:08:00.055 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_nfacct.ko 2023-06-20T13:08:00.055 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_osf.ko 2023-06-20T13:08:00.055 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_owner.ko 2023-06-20T13:08:00.056 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_physdev.ko 2023-06-20T13:08:00.056 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_pkttype.ko 2023-06-20T13:08:00.056 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_policy.ko 2023-06-20T13:08:00.056 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_quota.ko 2023-06-20T13:08:00.056 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_rateest.ko 2023-06-20T13:08:00.056 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_realm.ko 2023-06-20T13:08:00.056 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_recent.ko 2023-06-20T13:08:00.056 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_sctp.ko 2023-06-20T13:08:00.057 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_set.ko 2023-06-20T13:08:00.057 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_socket.ko 2023-06-20T13:08:00.057 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_state.ko 2023-06-20T13:08:00.057 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_statistic.ko 2023-06-20T13:08:00.057 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_string.ko 2023-06-20T13:08:00.057 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_tcpmss.ko 2023-06-20T13:08:00.057 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_time.ko 2023-06-20T13:08:00.058 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_u32.ko 2023-06-20T13:08:00.058 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netlink 2023-06-20T13:08:00.058 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netlink/netlink_diag.ko 2023-06-20T13:08:00.058 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/nsh 2023-06-20T13:08:00.058 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/nsh/nsh.ko 2023-06-20T13:08:00.058 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch 2023-06-20T13:08:00.058 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch/openvswitch.ko 2023-06-20T13:08:00.058 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch/vport-geneve.ko 2023-06-20T13:08:00.059 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch/vport-gre.ko 2023-06-20T13:08:00.059 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch/vport-vxlan.ko 2023-06-20T13:08:00.059 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/packet 2023-06-20T13:08:00.059 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/packet/af_packet_diag.ko 2023-06-20T13:08:00.059 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/rds 2023-06-20T13:08:00.059 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/rds/rds.ko 2023-06-20T13:08:00.059 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/rds/rds_rdma.ko 2023-06-20T13:08:00.059 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/rds/rds_tcp.ko 2023-06-20T13:08:00.060 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched 2023-06-20T13:08:00.060 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_csum.ko 2023-06-20T13:08:00.060 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_gact.ko 2023-06-20T13:08:00.060 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_ipt.ko 2023-06-20T13:08:00.060 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_mirred.ko 2023-06-20T13:08:00.060 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_nat.ko 2023-06-20T13:08:00.060 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_pedit.ko 2023-06-20T13:08:00.061 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_police.ko 2023-06-20T13:08:00.061 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_simple.ko 2023-06-20T13:08:00.061 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_skbedit.ko 2023-06-20T13:08:00.061 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_vlan.ko 2023-06-20T13:08:00.061 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_basic.ko 2023-06-20T13:08:00.061 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_bpf.ko 2023-06-20T13:08:00.061 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_flow.ko 2023-06-20T13:08:00.061 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_fw.ko 2023-06-20T13:08:00.062 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_route.ko 2023-06-20T13:08:00.062 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_u32.ko 2023-06-20T13:08:00.062 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_cmp.ko 2023-06-20T13:08:00.062 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_ipset.ko 2023-06-20T13:08:00.062 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_meta.ko 2023-06-20T13:08:00.062 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_nbyte.ko 2023-06-20T13:08:00.062 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_text.ko 2023-06-20T13:08:00.062 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_u32.ko 2023-06-20T13:08:00.063 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_choke.ko 2023-06-20T13:08:00.063 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_codel.ko 2023-06-20T13:08:00.063 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_drr.ko 2023-06-20T13:08:00.063 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_fq.ko 2023-06-20T13:08:00.063 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_gred.ko 2023-06-20T13:08:00.063 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_hfsc.ko 2023-06-20T13:08:00.063 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_hhf.ko 2023-06-20T13:08:00.063 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_htb.ko 2023-06-20T13:08:00.064 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_ingress.ko 2023-06-20T13:08:00.064 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_mqprio.ko 2023-06-20T13:08:00.064 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_mqprio_lib.ko 2023-06-20T13:08:00.064 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_multiq.ko 2023-06-20T13:08:00.064 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_netem.ko 2023-06-20T13:08:00.064 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_pie.ko 2023-06-20T13:08:00.064 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_plug.ko 2023-06-20T13:08:00.064 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_prio.ko 2023-06-20T13:08:00.065 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_qfq.ko 2023-06-20T13:08:00.065 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_red.ko 2023-06-20T13:08:00.065 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_sfb.ko 2023-06-20T13:08:00.065 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_sfq.ko 2023-06-20T13:08:00.065 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_tbf.ko 2023-06-20T13:08:00.065 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_teql.ko 2023-06-20T13:08:00.065 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sctp 2023-06-20T13:08:00.065 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sctp/sctp.ko 2023-06-20T13:08:00.066 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sctp/sctp_diag.ko 2023-06-20T13:08:00.066 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc 2023-06-20T13:08:00.066 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/auth_gss 2023-06-20T13:08:00.066 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-06-20T13:08:00.066 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-06-20T13:08:00.066 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/sunrpc.ko 2023-06-20T13:08:00.066 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/xprtrdma 2023-06-20T13:08:00.067 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-06-20T13:08:00.067 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/tipc 2023-06-20T13:08:00.067 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/tipc/diag.ko 2023-06-20T13:08:00.067 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/tipc/tipc.ko 2023-06-20T13:08:00.067 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/unix 2023-06-20T13:08:00.067 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/unix/unix_diag.ko 2023-06-20T13:08:00.067 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock 2023-06-20T13:08:00.067 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-06-20T13:08:00.068 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-06-20T13:08:00.068 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vsock.ko 2023-06-20T13:08:00.068 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vsock_diag.ko 2023-06-20T13:08:00.068 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vsock_loopback.ko 2023-06-20T13:08:00.068 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/xfrm 2023-06-20T13:08:00.068 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/xfrm/xfrm_ipcomp.ko 2023-06-20T13:08:00.068 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security 2023-06-20T13:08:00.068 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys 2023-06-20T13:08:00.069 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys/encrypted-keys 2023-06-20T13:08:00.069 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-06-20T13:08:00.069 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys/trusted-keys 2023-06-20T13:08:00.069 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys/trusted-keys/trusted.ko 2023-06-20T13:08:00.069 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/virt 2023-06-20T13:08:00.069 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/virt/lib 2023-06-20T13:08:00.069 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/virt/lib/irqbypass.ko 2023-06-20T13:08:00.070 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.alias 2023-06-20T13:08:00.070 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.alias.bin 2023-06-20T13:08:00.070 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.builtin 2023-06-20T13:08:00.070 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.builtin.bin 2023-06-20T13:08:00.070 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.builtin.modinfo 2023-06-20T13:08:00.070 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.dep 2023-06-20T13:08:00.070 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.dep.bin 2023-06-20T13:08:00.070 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.devname 2023-06-20T13:08:00.071 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.order 2023-06-20T13:08:00.071 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.softdep 2023-06-20T13:08:00.071 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.symbols 2023-06-20T13:08:00.071 INFO:teuthology.orchestra.run.smithi115.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.symbols.bin 2023-06-20T13:08:00.072 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-rc5-g1c622d92b6f1 2023-06-20T13:08:00.072 DEBUG:teuthology.orchestra.run.smithi115:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-06-20T13:08:00.098 INFO:teuthology.orchestra.run.smithi115.stdout:postinstall scriptlet (using /bin/sh): 2023-06-20T13:08:00.098 INFO:teuthology.orchestra.run.smithi115.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.4.0-rc5-g1c622d92b6f1 -a -r /boot/System.map-6.4.0-rc5-g1c622d92b6f1 ]; then 2023-06-20T13:08:00.098 INFO:teuthology.orchestra.run.smithi115.stdout:cp /boot/vmlinuz-6.4.0-rc5-g1c622d92b6f1 /boot/.vmlinuz-6.4.0-rc5-g1c622d92b6f1-rpm 2023-06-20T13:08:00.098 INFO:teuthology.orchestra.run.smithi115.stdout:cp /boot/System.map-6.4.0-rc5-g1c622d92b6f1 /boot/.System.map-6.4.0-rc5-g1c622d92b6f1-rpm 2023-06-20T13:08:00.098 INFO:teuthology.orchestra.run.smithi115.stdout:rm -f /boot/vmlinuz-6.4.0-rc5-g1c622d92b6f1 /boot/System.map-6.4.0-rc5-g1c622d92b6f1 2023-06-20T13:08:00.099 INFO:teuthology.orchestra.run.smithi115.stdout:/sbin/installkernel 6.4.0-rc5-g1c622d92b6f1 /boot/.vmlinuz-6.4.0-rc5-g1c622d92b6f1-rpm /boot/.System.map-6.4.0-rc5-g1c622d92b6f1-rpm 2023-06-20T13:08:00.099 INFO:teuthology.orchestra.run.smithi115.stdout:rm -f /boot/.vmlinuz-6.4.0-rc5-g1c622d92b6f1-rpm /boot/.System.map-6.4.0-rc5-g1c622d92b6f1-rpm 2023-06-20T13:08:00.099 INFO:teuthology.orchestra.run.smithi115.stdout:fi 2023-06-20T13:08:00.099 INFO:teuthology.orchestra.run.smithi115.stdout:preuninstall scriptlet (using /bin/sh): 2023-06-20T13:08:00.099 INFO:teuthology.orchestra.run.smithi115.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-06-20T13:08:00.099 INFO:teuthology.orchestra.run.smithi115.stdout:new-kernel-pkg --remove 6.4.0-rc5-g1c622d92b6f1 --rminitrd --initrdfile=/boot/initramfs-6.4.0-rc5-g1c622d92b6f1.img 2023-06-20T13:08:00.099 INFO:teuthology.orchestra.run.smithi115.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-06-20T13:08:00.100 INFO:teuthology.orchestra.run.smithi115.stdout:kernel-install remove 6.4.0-rc5-g1c622d92b6f1 2023-06-20T13:08:00.100 INFO:teuthology.orchestra.run.smithi115.stdout:fi 2023-06-20T13:08:00.100 INFO:teuthology.orchestra.run.smithi115.stdout:postuninstall scriptlet (using /bin/sh): 2023-06-20T13:08:00.100 INFO:teuthology.orchestra.run.smithi115.stdout:if [ -x /sbin/update-bootloader ]; then 2023-06-20T13:08:00.100 INFO:teuthology.orchestra.run.smithi115.stdout:/sbin/update-bootloader --remove 6.4.0-rc5-g1c622d92b6f1 2023-06-20T13:08:00.100 INFO:teuthology.orchestra.run.smithi115.stdout:fi 2023-06-20T13:08:00.101 DEBUG:teuthology.orchestra.run.smithi115:> sudo rpm -qi grub2-tools 2023-06-20T13:08:00.176 INFO:teuthology.orchestra.run.smithi115.stdout:Name : grub2-tools 2023-06-20T13:08:00.177 INFO:teuthology.orchestra.run.smithi115.stdout:Epoch : 1 2023-06-20T13:08:00.177 INFO:teuthology.orchestra.run.smithi115.stdout:Version : 2.02 2023-06-20T13:08:00.177 INFO:teuthology.orchestra.run.smithi115.stdout:Release : 129.el8 2023-06-20T13:08:00.177 INFO:teuthology.orchestra.run.smithi115.stdout:Architecture: x86_64 2023-06-20T13:08:00.177 INFO:teuthology.orchestra.run.smithi115.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-06-20T13:08:00.177 INFO:teuthology.orchestra.run.smithi115.stdout:Group : System Environment/Base 2023-06-20T13:08:00.177 INFO:teuthology.orchestra.run.smithi115.stdout:Size : 9265586 2023-06-20T13:08:00.178 INFO:teuthology.orchestra.run.smithi115.stdout:License : GPLv3+ 2023-06-20T13:08:00.178 INFO:teuthology.orchestra.run.smithi115.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-06-20T13:08:00.178 INFO:teuthology.orchestra.run.smithi115.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-06-20T13:08:00.178 INFO:teuthology.orchestra.run.smithi115.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-06-20T13:08:00.178 INFO:teuthology.orchestra.run.smithi115.stdout:Build Host : kbuilder.bsys.centos.org 2023-06-20T13:08:00.178 INFO:teuthology.orchestra.run.smithi115.stdout:Relocations : (not relocatable) 2023-06-20T13:08:00.178 INFO:teuthology.orchestra.run.smithi115.stdout:Packager : CentOS BuildSystem 2023-06-20T13:08:00.179 INFO:teuthology.orchestra.run.smithi115.stdout:Vendor : CentOS 2023-06-20T13:08:00.179 INFO:teuthology.orchestra.run.smithi115.stdout:URL : http://www.gnu.org/software/grub/ 2023-06-20T13:08:00.179 INFO:teuthology.orchestra.run.smithi115.stdout:Summary : Support tools for GRUB. 2023-06-20T13:08:00.179 INFO:teuthology.orchestra.run.smithi115.stdout:Description : 2023-06-20T13:08:00.179 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:08:00.179 INFO:teuthology.orchestra.run.smithi115.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-06-20T13:08:00.179 INFO:teuthology.orchestra.run.smithi115.stdout:customizable bootloader with modular architecture. It supports a rich 2023-06-20T13:08:00.179 INFO:teuthology.orchestra.run.smithi115.stdout:variety of kernel formats, file systems, computer architectures and 2023-06-20T13:08:00.179 INFO:teuthology.orchestra.run.smithi115.stdout:hardware devices. 2023-06-20T13:08:00.180 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:08:00.180 INFO:teuthology.orchestra.run.smithi115.stdout:This subpackage provides tools for support of all platforms. 2023-06-20T13:08:00.181 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-06-20T13:08:00.181 INFO:teuthology.task.kernel:Updating grub on smithi115 to boot 6.4.0-rc5-g1c622d92b6f1 2023-06-20T13:08:00.181 DEBUG:teuthology.orchestra.run.smithi115:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-06-20T13:08:06.528 INFO:teuthology.orchestra.run.smithi115.stderr:Generating grub configuration file ... 2023-06-20T13:08:08.903 INFO:teuthology.orchestra.run.smithi115.stderr:done 2023-06-20T13:08:08.906 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2023-06-20T13:08:08.938 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.dqstFGMcsY 2023-06-20T13:08:08.939 DEBUG:teuthology.orchestra.run.smithi115:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.dqstFGMcsY 2023-06-20T13:08:09.039 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.dqstFGMcsY 2023-06-20T13:08:09.144 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.dqstFGMcsY is 6KB 2023-06-20T13:08:09.191 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.dqstFGMcsY 2023-06-20T13:08:09.209 DEBUG:teuthology.orchestra.run.smithi115:> sudo /bin/ls /boot/loader/entries || true 2023-06-20T13:08:09.291 INFO:teuthology.orchestra.run.smithi115.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-06-20T13:08:09.292 INFO:teuthology.orchestra.run.smithi115.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-06-20T13:08:09.292 INFO:teuthology.orchestra.run.smithi115.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-06-20T13:08:09.292 INFO:teuthology.orchestra.run.smithi115.stdout:a1b29d6c289747bdb22930598d39874a-6.4.0-rc5-g1c622d92b6f1.conf 2023-06-20T13:08:09.293 DEBUG:teuthology.orchestra.run.smithi115:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.4.0-rc5-g1c622d92b6f1 2023-06-20T13:08:09.442 DEBUG:teuthology.orchestra.run.smithi115:> sudo shutdown -r now 2023-06-20T13:08:39.445 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-06-20T13:08:39.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-06-20T13:08:39.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T13:08:57.840 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-06-20T13:09:27.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-06-20T13:09:27.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T13:09:30.896 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-06-20T13:10:00.897 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-06-20T13:10:00.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T13:10:01.178 DEBUG:teuthology.orchestra.run.smithi115:> true 2023-06-20T13:10:01.586 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-06-20T13:10:01.586 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.4.0-rc5-g1c622d92b6f1"... 2023-06-20T13:10:01.587 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2023-06-20T13:10:01.631 INFO:teuthology.orchestra.run.smithi115.stdout:6.4.0-rc5-g1c622d92b6f1 2023-06-20T13:10:01.631 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-rc5-g1c622d92b6f1 vs 6.4.0-rc5-g1c622d92b6f1 2023-06-20T13:10:01.631 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-20T13:10:01.632 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-06-20T13:10:02.633 DEBUG:teuthology.parallel:result is None 2023-06-20T13:10:23.359 INFO:teuthology.orchestra.run.smithi032.stdout:Extra Packages for Enterprise Linux 61 kB/s | 16 MB 04:21 2023-06-20T13:10:27.348 INFO:teuthology.orchestra.run.smithi032.stdout:lab-extras 575 kB/s | 24 kB 00:00 2023-06-20T13:10:30.845 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2023-06-20T13:10:30.846 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2023-06-20T13:10:30.846 INFO:teuthology.orchestra.run.smithi032.stdout: Package Arch Version Repo Size 2023-06-20T13:10:30.846 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2023-06-20T13:10:30.846 INFO:teuthology.orchestra.run.smithi032.stdout:Upgrading: 2023-06-20T13:10:30.847 INFO:teuthology.orchestra.run.smithi032.stdout: linux-firmware noarch 20230515-115.gitd1962891.el8 baseos 266 M 2023-06-20T13:10:30.847 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:10:30.847 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction Summary 2023-06-20T13:10:30.847 INFO:teuthology.orchestra.run.smithi032.stdout:================================================================================ 2023-06-20T13:10:30.847 INFO:teuthology.orchestra.run.smithi032.stdout:Upgrade 1 Package 2023-06-20T13:10:30.847 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:10:30.848 INFO:teuthology.orchestra.run.smithi032.stdout:Total download size: 266 M 2023-06-20T13:10:30.848 INFO:teuthology.orchestra.run.smithi032.stdout:Downloading Packages: 2023-06-20T13:10:31.088 INFO:teuthology.orchestra.run.smithi032.stdout:[MIRROR] linux-firmware-20230515-115.gitd1962891.el8.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirror.math.princeton.edu/pub/centos/8-stream/BaseOS/x86_64/os/Packages/linux-firmware-20230515-115.gitd1962891.el8.noarch.rpm [Failed to connect to mirror.math.princeton.edu port 80: Connection refused] 2023-06-20T13:10:38.374 INFO:teuthology.orchestra.run.smithi032.stdout:linux-firmware-20230515-115.gitd1962891.el8.noa 36 MB/s | 266 MB 00:07 2023-06-20T13:10:38.374 INFO:teuthology.orchestra.run.smithi032.stdout:-------------------------------------------------------------------------------- 2023-06-20T13:10:38.375 INFO:teuthology.orchestra.run.smithi032.stdout:Total 35 MB/s | 266 MB 00:07 2023-06-20T13:10:40.035 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction check 2023-06-20T13:10:40.108 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction check succeeded. 2023-06-20T13:10:40.109 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction test 2023-06-20T13:10:41.878 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction test succeeded. 2023-06-20T13:10:41.895 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction 2023-06-20T13:11:00.763 INFO:teuthology.orchestra.run.smithi032.stdout: Preparing : 1/1 2023-06-20T13:11:01.142 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-06-20T13:11:01.378 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-06-20T13:11:01.604 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-06-20T13:11:01.605 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-06-20T13:11:02.275 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-06-20T13:11:02.275 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:11:02.276 INFO:teuthology.orchestra.run.smithi032.stdout:Upgraded: 2023-06-20T13:11:02.276 INFO:teuthology.orchestra.run.smithi032.stdout: linux-firmware-20230515-115.gitd1962891.el8.noarch 2023-06-20T13:11:02.276 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:11:02.276 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2023-06-20T13:11:02.451 INFO:teuthology.task.kernel:Downloading kernel 1c622d92b6f18ce44a7c33802686ff61c3c273ab on client.0... 2023-06-20T13:11:02.452 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1c622d92b6f18ce44a7c33802686ff61c3c273ab 2023-06-20T13:11:02.667 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/1c622d92b6f18ce44a7c33802686ff61c3c273ab/centos/8/flavors/default/x86_64/ 2023-06-20T13:11:02.668 DEBUG:teuthology.orchestra.run.smithi032:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.4.0_rc5_g1c622d92b6f1-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/1c622d92b6f18ce44a7c33802686ff61c3c273ab/centos/8/flavors/default/x86_64/ --input-file=- 2023-06-20T13:11:02.670 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi032.front.sepia.ceph.com to complete... 2023-06-20T13:11:23.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20 13:11:23 URL:https://2.chacra.ceph.com/r/kernel/testing/1c622d92b6f18ce44a7c33802686ff61c3c273ab/centos/8/flavors/default/x86_64/kernel-6.4.0_rc5_g1c622d92b6f1-1.x86_64.rpm [379883408/379883408] -> "/tmp/kernel.x86_64.rpm" [1] 2023-06-20T13:11:23.676 INFO:teuthology.orchestra.run.smithi032.stderr:FINISHED --2023-06-20 13:11:23-- 2023-06-20T13:11:23.676 INFO:teuthology.orchestra.run.smithi032.stderr:Total wall clock time: 21s 2023-06-20T13:11:23.676 INFO:teuthology.orchestra.run.smithi032.stderr:Downloaded: 1 files, 362M in 21s (17.6 MB/s) 2023-06-20T13:11:23.677 INFO:teuthology.task.kernel:Installing kernel 1c622d92b6f18ce44a7c33802686ff61c3c273ab on client.0... 2023-06-20T13:11:23.677 DEBUG:teuthology.orchestra.run.smithi032:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-06-20T13:11:25.418 INFO:teuthology.orchestra.run.smithi032.stdout:Verifying... ######################################## 2023-06-20T13:11:25.464 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing... ######################################## 2023-06-20T13:11:25.580 INFO:teuthology.orchestra.run.smithi032.stdout:Updating / installing... 2023-06-20T13:12:05.957 INFO:teuthology.orchestra.run.smithi032.stdout:kernel-6.4.0_rc5_g1c622d92b6f1-1 ######################################## 2023-06-20T13:12:29.898 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi032.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-06-20T13:12:29.899 DEBUG:teuthology.orchestra.run.smithi032:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-06-20T13:12:29.994 INFO:teuthology.orchestra.run.smithi032.stdout:/boot/System.map-6.4.0-rc5-g1c622d92b6f1 2023-06-20T13:12:29.994 INFO:teuthology.orchestra.run.smithi032.stdout:/boot/config-6.4.0-rc5-g1c622d92b6f1 2023-06-20T13:12:29.994 INFO:teuthology.orchestra.run.smithi032.stdout:/boot/vmlinuz-6.4.0-rc5-g1c622d92b6f1 2023-06-20T13:12:29.994 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1 2023-06-20T13:12:29.995 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel 2023-06-20T13:12:29.995 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch 2023-06-20T13:12:29.995 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86 2023-06-20T13:12:29.995 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto 2023-06-20T13:12:29.995 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-06-20T13:12:29.995 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-06-20T13:12:29.995 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-06-20T13:12:29.996 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-06-20T13:12:29.996 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-06-20T13:12:29.996 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-06-20T13:12:29.996 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-06-20T13:12:29.996 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/crc32c-intel.ko 2023-06-20T13:12:29.996 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-06-20T13:12:29.996 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-06-20T13:12:29.997 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-06-20T13:12:29.997 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-06-20T13:12:29.997 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/serpent-avx2.ko 2023-06-20T13:12:29.997 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-06-20T13:12:29.997 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-06-20T13:12:29.997 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-06-20T13:12:29.997 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-06-20T13:12:29.998 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-06-20T13:12:29.998 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-06-20T13:12:29.998 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-06-20T13:12:29.998 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kernel 2023-06-20T13:12:29.998 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kernel/cpu 2023-06-20T13:12:29.998 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kernel/cpu/mce 2023-06-20T13:12:29.998 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-06-20T13:12:29.998 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kvm 2023-06-20T13:12:29.999 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kvm/kvm-amd.ko 2023-06-20T13:12:29.999 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kvm/kvm-intel.ko 2023-06-20T13:12:29.999 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kvm/kvm.ko 2023-06-20T13:12:29.999 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto 2023-06-20T13:12:29.999 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/ansi_cprng.ko 2023-06-20T13:12:29.999 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/anubis.ko 2023-06-20T13:12:29.999 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/arc4.ko 2023-06-20T13:12:29.999 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx 2023-06-20T13:12:30.000 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_memcpy.ko 2023-06-20T13:12:30.000 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_pq.ko 2023-06-20T13:12:30.000 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_raid6_recov.ko 2023-06-20T13:12:30.000 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_tx.ko 2023-06-20T13:12:30.000 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_xor.ko 2023-06-20T13:12:30.000 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/raid6test.ko 2023-06-20T13:12:30.000 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/authenc.ko 2023-06-20T13:12:30.001 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/authencesn.ko 2023-06-20T13:12:30.001 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/blake2b_generic.ko 2023-06-20T13:12:30.001 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/blowfish_common.ko 2023-06-20T13:12:30.001 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/blowfish_generic.ko 2023-06-20T13:12:30.001 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/camellia_generic.ko 2023-06-20T13:12:30.001 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cast5_generic.ko 2023-06-20T13:12:30.001 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cast6_generic.ko 2023-06-20T13:12:30.001 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cast_common.ko 2023-06-20T13:12:30.002 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/ccm.ko 2023-06-20T13:12:30.002 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cmac.ko 2023-06-20T13:12:30.002 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/crc32_generic.ko 2023-06-20T13:12:30.002 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/crypto_engine.ko 2023-06-20T13:12:30.002 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/crypto_user.ko 2023-06-20T13:12:30.002 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cts.ko 2023-06-20T13:12:30.002 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/des_generic.ko 2023-06-20T13:12:30.002 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/dh_generic.ko 2023-06-20T13:12:30.003 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/echainiv.ko 2023-06-20T13:12:30.003 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/essiv.ko 2023-06-20T13:12:30.003 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/fcrypt.ko 2023-06-20T13:12:30.003 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/khazad.ko 2023-06-20T13:12:30.003 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/lz4.ko 2023-06-20T13:12:30.003 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/lz4hc.ko 2023-06-20T13:12:30.003 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/md4.ko 2023-06-20T13:12:30.004 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/michael_mic.ko 2023-06-20T13:12:30.004 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/pcbc.ko 2023-06-20T13:12:30.004 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/pcrypt.ko 2023-06-20T13:12:30.004 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/rmd160.ko 2023-06-20T13:12:30.004 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/seed.ko 2023-06-20T13:12:30.005 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/serpent_generic.ko 2023-06-20T13:12:30.005 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/tcrypt.ko 2023-06-20T13:12:30.005 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/tea.ko 2023-06-20T13:12:30.005 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/twofish_common.ko 2023-06-20T13:12:30.005 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/twofish_generic.ko 2023-06-20T13:12:30.005 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/vmac.ko 2023-06-20T13:12:30.005 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/wp512.ko 2023-06-20T13:12:30.005 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/xcbc.ko 2023-06-20T13:12:30.006 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/xor.ko 2023-06-20T13:12:30.006 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/xxhash_generic.ko 2023-06-20T13:12:30.006 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers 2023-06-20T13:12:30.006 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi 2023-06-20T13:12:30.006 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/acpi_ipmi.ko 2023-06-20T13:12:30.006 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/acpi_pad.ko 2023-06-20T13:12:30.006 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/custom_method.ko 2023-06-20T13:12:30.006 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/ec_sys.ko 2023-06-20T13:12:30.007 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/platform_profile.ko 2023-06-20T13:12:30.007 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/sbs.ko 2023-06-20T13:12:30.007 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/sbshc.ko 2023-06-20T13:12:30.007 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/video.ko 2023-06-20T13:12:30.007 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata 2023-06-20T13:12:30.007 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/acard-ahci.ko 2023-06-20T13:12:30.007 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/ahci_platform.ko 2023-06-20T13:12:30.008 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/ata_generic.ko 2023-06-20T13:12:30.008 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/libahci_platform.ko 2023-06-20T13:12:30.008 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_acpi.ko 2023-06-20T13:12:30.008 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_ali.ko 2023-06-20T13:12:30.008 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_amd.ko 2023-06-20T13:12:30.008 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_artop.ko 2023-06-20T13:12:30.008 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_atiixp.ko 2023-06-20T13:12:30.008 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_atp867x.ko 2023-06-20T13:12:30.009 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_cmd640.ko 2023-06-20T13:12:30.009 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_cmd64x.ko 2023-06-20T13:12:30.009 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_cypress.ko 2023-06-20T13:12:30.009 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_efar.ko 2023-06-20T13:12:30.009 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_hpt366.ko 2023-06-20T13:12:30.009 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_hpt37x.ko 2023-06-20T13:12:30.009 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_hpt3x2n.ko 2023-06-20T13:12:30.010 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_hpt3x3.ko 2023-06-20T13:12:30.010 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_it8213.ko 2023-06-20T13:12:30.010 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_it821x.ko 2023-06-20T13:12:30.010 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_jmicron.ko 2023-06-20T13:12:30.010 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_marvell.ko 2023-06-20T13:12:30.010 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_mpiix.ko 2023-06-20T13:12:30.010 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_netcell.ko 2023-06-20T13:12:30.010 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_ninja32.ko 2023-06-20T13:12:30.011 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_ns87410.ko 2023-06-20T13:12:30.011 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_ns87415.ko 2023-06-20T13:12:30.011 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_oldpiix.ko 2023-06-20T13:12:30.011 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_opti.ko 2023-06-20T13:12:30.011 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_optidma.ko 2023-06-20T13:12:30.011 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_pcmcia.ko 2023-06-20T13:12:30.011 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_pdc2027x.ko 2023-06-20T13:12:30.012 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-06-20T13:12:30.012 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_piccolo.ko 2023-06-20T13:12:30.012 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_rdc.ko 2023-06-20T13:12:30.012 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_sch.ko 2023-06-20T13:12:30.012 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_serverworks.ko 2023-06-20T13:12:30.012 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_sil680.ko 2023-06-20T13:12:30.012 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_sis.ko 2023-06-20T13:12:30.012 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_sl82c105.ko 2023-06-20T13:12:30.013 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_triflex.ko 2023-06-20T13:12:30.013 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_via.ko 2023-06-20T13:12:30.013 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pdc_adma.ko 2023-06-20T13:12:30.013 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_inic162x.ko 2023-06-20T13:12:30.013 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_mv.ko 2023-06-20T13:12:30.013 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_nv.ko 2023-06-20T13:12:30.013 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_promise.ko 2023-06-20T13:12:30.013 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_qstor.ko 2023-06-20T13:12:30.014 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_sil.ko 2023-06-20T13:12:30.014 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_sil24.ko 2023-06-20T13:12:30.014 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_sis.ko 2023-06-20T13:12:30.014 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_svw.ko 2023-06-20T13:12:30.014 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_sx4.ko 2023-06-20T13:12:30.014 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_uli.ko 2023-06-20T13:12:30.014 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_via.ko 2023-06-20T13:12:30.014 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_vsc.ko 2023-06-20T13:12:30.015 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/auxdisplay 2023-06-20T13:12:30.015 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/auxdisplay/ks0108.ko 2023-06-20T13:12:30.015 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/base 2023-06-20T13:12:30.015 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/base/regmap 2023-06-20T13:12:30.015 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/base/regmap/regmap-i2c.ko 2023-06-20T13:12:30.015 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/bcma 2023-06-20T13:12:30.015 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/bcma/bcma.ko 2023-06-20T13:12:30.016 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block 2023-06-20T13:12:30.016 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/aoe 2023-06-20T13:12:30.016 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/aoe/aoe.ko 2023-06-20T13:12:30.016 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/brd.ko 2023-06-20T13:12:30.016 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/drbd 2023-06-20T13:12:30.016 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/drbd/drbd.ko 2023-06-20T13:12:30.016 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/floppy.ko 2023-06-20T13:12:30.016 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/loop.ko 2023-06-20T13:12:30.017 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/mtip32xx 2023-06-20T13:12:30.017 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-06-20T13:12:30.017 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/nbd.ko 2023-06-20T13:12:30.017 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/null_blk 2023-06-20T13:12:30.017 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/null_blk/null_blk.ko 2023-06-20T13:12:30.017 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/pktcdvd.ko 2023-06-20T13:12:30.017 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/rbd.ko 2023-06-20T13:12:30.018 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/virtio_blk.ko 2023-06-20T13:12:30.018 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/xen-blkback 2023-06-20T13:12:30.018 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-06-20T13:12:30.018 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/xen-blkfront.ko 2023-06-20T13:12:30.018 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/zram 2023-06-20T13:12:30.018 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/zram/zram.ko 2023-06-20T13:12:30.018 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char 2023-06-20T13:12:30.018 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hangcheck-timer.ko 2023-06-20T13:12:30.019 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random 2023-06-20T13:12:30.019 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/amd-rng.ko 2023-06-20T13:12:30.019 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/intel-rng.ko 2023-06-20T13:12:30.019 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-06-20T13:12:30.019 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/via-rng.ko 2023-06-20T13:12:30.019 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/virtio-rng.ko 2023-06-20T13:12:30.019 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi 2023-06-20T13:12:30.020 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-06-20T13:12:30.020 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-06-20T13:12:30.020 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-06-20T13:12:30.020 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_si.ko 2023-06-20T13:12:30.020 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-06-20T13:12:30.020 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-06-20T13:12:30.020 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/lp.ko 2023-06-20T13:12:30.021 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/mwave 2023-06-20T13:12:30.021 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/mwave/mwave.ko 2023-06-20T13:12:30.021 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ppdev.ko 2023-06-20T13:12:30.021 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tlclk.ko 2023-06-20T13:12:30.021 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm 2023-06-20T13:12:30.021 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm.ko 2023-06-20T13:12:30.021 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_atmel.ko 2023-06-20T13:12:30.021 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_infineon.ko 2023-06-20T13:12:30.022 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_nsc.ko 2023-06-20T13:12:30.022 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_tis.ko 2023-06-20T13:12:30.022 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-06-20T13:12:30.022 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/uv_mmtimer.ko 2023-06-20T13:12:30.022 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/virtio_console.ko 2023-06-20T13:12:30.022 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq 2023-06-20T13:12:30.022 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-06-20T13:12:30.022 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-06-20T13:12:30.023 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/p4-clockmod.ko 2023-06-20T13:12:30.023 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-06-20T13:12:30.023 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/powernow-k8.ko 2023-06-20T13:12:30.023 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/speedstep-lib.ko 2023-06-20T13:12:30.023 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto 2023-06-20T13:12:30.023 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/ccp 2023-06-20T13:12:30.023 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-06-20T13:12:30.023 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/ccp/ccp.ko 2023-06-20T13:12:30.024 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel 2023-06-20T13:12:30.024 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat 2023-06-20T13:12:30.024 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat/qat_common 2023-06-20T13:12:30.024 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-06-20T13:12:30.024 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-06-20T13:12:30.024 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-06-20T13:12:30.024 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/padlock-aes.ko 2023-06-20T13:12:30.025 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/padlock-sha.ko 2023-06-20T13:12:30.025 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/virtio 2023-06-20T13:12:30.025 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-06-20T13:12:30.025 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dca 2023-06-20T13:12:30.025 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dca/dca.ko 2023-06-20T13:12:30.025 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/devfreq 2023-06-20T13:12:30.025 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-06-20T13:12:30.025 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma 2023-06-20T13:12:30.026 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma/dw 2023-06-20T13:12:30.026 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma/dw/dw_dmac.ko 2023-06-20T13:12:30.026 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma/ioat 2023-06-20T13:12:30.026 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma/ioat/ioatdma.ko 2023-06-20T13:12:30.026 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac 2023-06-20T13:12:30.026 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/amd64_edac.ko 2023-06-20T13:12:30.026 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/e752x_edac.ko 2023-06-20T13:12:30.027 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/edac_mce_amd.ko 2023-06-20T13:12:30.027 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i3000_edac.ko 2023-06-20T13:12:30.027 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i3200_edac.ko 2023-06-20T13:12:30.027 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i5100_edac.ko 2023-06-20T13:12:30.027 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i5400_edac.ko 2023-06-20T13:12:30.027 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i7300_edac.ko 2023-06-20T13:12:30.027 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i7core_edac.ko 2023-06-20T13:12:30.027 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i82975x_edac.ko 2023-06-20T13:12:30.028 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/ie31200_edac.ko 2023-06-20T13:12:30.028 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/sb_edac.ko 2023-06-20T13:12:30.028 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/x38_edac.ko 2023-06-20T13:12:30.028 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/firmware 2023-06-20T13:12:30.028 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/firmware/edd.ko 2023-06-20T13:12:30.028 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/firmware/iscsi_ibft.ko 2023-06-20T13:12:30.028 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/gpio 2023-06-20T13:12:30.029 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/gpio/gpio-ich.ko 2023-06-20T13:12:30.029 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/gpio/gpio-viperboard.ko 2023-06-20T13:12:30.029 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid 2023-06-20T13:12:30.029 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-appleir.ko 2023-06-20T13:12:30.029 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-aureal.ko 2023-06-20T13:12:30.029 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-axff.ko 2023-06-20T13:12:30.029 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-dr.ko 2023-06-20T13:12:30.029 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-elecom.ko 2023-06-20T13:12:30.030 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-elo.ko 2023-06-20T13:12:30.030 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-emsff.ko 2023-06-20T13:12:30.030 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-gaff.ko 2023-06-20T13:12:30.030 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-gt683r.ko 2023-06-20T13:12:30.030 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-gyration.ko 2023-06-20T13:12:30.030 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-holtek-kbd.ko 2023-06-20T13:12:30.030 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-holtek-mouse.ko 2023-06-20T13:12:30.030 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-holtekff.ko 2023-06-20T13:12:30.031 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-hyperv.ko 2023-06-20T13:12:30.031 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-icade.ko 2023-06-20T13:12:30.031 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-keytouch.ko 2023-06-20T13:12:30.031 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-kye.ko 2023-06-20T13:12:30.031 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-lcpower.ko 2023-06-20T13:12:30.031 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-led.ko 2023-06-20T13:12:30.031 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-lenovo.ko 2023-06-20T13:12:30.032 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-logitech-dj.ko 2023-06-20T13:12:30.032 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-06-20T13:12:30.032 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-multitouch.ko 2023-06-20T13:12:30.032 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-ortek.ko 2023-06-20T13:12:30.032 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-penmount.ko 2023-06-20T13:12:30.032 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-petalynx.ko 2023-06-20T13:12:30.032 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-picolcd.ko 2023-06-20T13:12:30.032 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-pl.ko 2023-06-20T13:12:30.033 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-plantronics.ko 2023-06-20T13:12:30.033 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-primax.ko 2023-06-20T13:12:30.033 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-rmi.ko 2023-06-20T13:12:30.033 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-arvo.ko 2023-06-20T13:12:30.033 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-common.ko 2023-06-20T13:12:30.033 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-isku.ko 2023-06-20T13:12:30.033 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-kone.ko 2023-06-20T13:12:30.033 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-06-20T13:12:30.034 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-konepure.ko 2023-06-20T13:12:30.034 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-06-20T13:12:30.034 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-lua.ko 2023-06-20T13:12:30.034 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-pyra.ko 2023-06-20T13:12:30.034 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-ryos.ko 2023-06-20T13:12:30.034 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-savu.ko 2023-06-20T13:12:30.034 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat.ko 2023-06-20T13:12:30.034 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-saitek.ko 2023-06-20T13:12:30.035 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-samsung.ko 2023-06-20T13:12:30.035 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-sensor-hub.ko 2023-06-20T13:12:30.035 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-sjoy.ko 2023-06-20T13:12:30.035 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-sony.ko 2023-06-20T13:12:30.035 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-speedlink.ko 2023-06-20T13:12:30.035 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-steelseries.ko 2023-06-20T13:12:30.035 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-sunplus.ko 2023-06-20T13:12:30.036 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-thrustmaster.ko 2023-06-20T13:12:30.036 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-tivo.ko 2023-06-20T13:12:30.036 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-tmff.ko 2023-06-20T13:12:30.036 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-topseed.ko 2023-06-20T13:12:30.036 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-twinhan.ko 2023-06-20T13:12:30.036 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-uclogic.ko 2023-06-20T13:12:30.036 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-waltop.ko 2023-06-20T13:12:30.037 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-wiimote.ko 2023-06-20T13:12:30.037 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-xinmo.ko 2023-06-20T13:12:30.037 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-zpff.ko 2023-06-20T13:12:30.037 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-zydacron.ko 2023-06-20T13:12:30.037 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/uhid.ko 2023-06-20T13:12:30.037 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/wacom.ko 2023-06-20T13:12:30.037 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hv 2023-06-20T13:12:30.037 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hv/hv_balloon.ko 2023-06-20T13:12:30.038 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hv/hv_utils.ko 2023-06-20T13:12:30.038 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hv/hv_vmbus.ko 2023-06-20T13:12:30.038 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon 2023-06-20T13:12:30.038 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/abituguru.ko 2023-06-20T13:12:30.038 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/abituguru3.ko 2023-06-20T13:12:30.038 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/acpi_power_meter.ko 2023-06-20T13:12:30.038 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ad7414.ko 2023-06-20T13:12:30.038 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ad7418.ko 2023-06-20T13:12:30.039 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adc128d818.ko 2023-06-20T13:12:30.039 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm1025.ko 2023-06-20T13:12:30.039 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm1026.ko 2023-06-20T13:12:30.039 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm1029.ko 2023-06-20T13:12:30.039 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm1031.ko 2023-06-20T13:12:30.039 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm9240.ko 2023-06-20T13:12:30.039 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ads7828.ko 2023-06-20T13:12:30.040 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7410.ko 2023-06-20T13:12:30.040 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7411.ko 2023-06-20T13:12:30.040 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7462.ko 2023-06-20T13:12:30.040 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7470.ko 2023-06-20T13:12:30.040 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7475.ko 2023-06-20T13:12:30.040 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7x10.ko 2023-06-20T13:12:30.040 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/amc6821.ko 2023-06-20T13:12:30.040 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/applesmc.ko 2023-06-20T13:12:30.041 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/asb100.ko 2023-06-20T13:12:30.041 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/asc7621.ko 2023-06-20T13:12:30.041 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/asus_atk0110.ko 2023-06-20T13:12:30.041 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/atxp1.ko 2023-06-20T13:12:30.041 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/coretemp.ko 2023-06-20T13:12:30.041 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-06-20T13:12:30.041 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/dme1737.ko 2023-06-20T13:12:30.042 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ds1621.ko 2023-06-20T13:12:30.042 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ds620.ko 2023-06-20T13:12:30.042 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/emc1403.ko 2023-06-20T13:12:30.042 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/emc6w201.ko 2023-06-20T13:12:30.042 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/f71805f.ko 2023-06-20T13:12:30.042 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/f71882fg.ko 2023-06-20T13:12:30.042 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/f75375s.ko 2023-06-20T13:12:30.042 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/fam15h_power.ko 2023-06-20T13:12:30.043 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/fschmd.ko 2023-06-20T13:12:30.043 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/g760a.ko 2023-06-20T13:12:30.043 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/g762.ko 2023-06-20T13:12:30.043 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/gl518sm.ko 2023-06-20T13:12:30.043 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/gl520sm.ko 2023-06-20T13:12:30.043 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/hwmon-vid.ko 2023-06-20T13:12:30.043 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/i5500_temp.ko 2023-06-20T13:12:30.043 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/i5k_amb.ko 2023-06-20T13:12:30.044 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ibmaem.ko 2023-06-20T13:12:30.044 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ibmpex.ko 2023-06-20T13:12:30.044 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ina209.ko 2023-06-20T13:12:30.044 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ina2xx.ko 2023-06-20T13:12:30.044 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/it87.ko 2023-06-20T13:12:30.044 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/k10temp.ko 2023-06-20T13:12:30.044 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/k8temp.ko 2023-06-20T13:12:30.044 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lineage-pem.ko 2023-06-20T13:12:30.045 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm63.ko 2023-06-20T13:12:30.045 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm73.ko 2023-06-20T13:12:30.045 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm75.ko 2023-06-20T13:12:30.045 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm77.ko 2023-06-20T13:12:30.045 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm78.ko 2023-06-20T13:12:30.045 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm80.ko 2023-06-20T13:12:30.045 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm83.ko 2023-06-20T13:12:30.046 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm85.ko 2023-06-20T13:12:30.046 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm87.ko 2023-06-20T13:12:30.046 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm90.ko 2023-06-20T13:12:30.046 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm92.ko 2023-06-20T13:12:30.046 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm93.ko 2023-06-20T13:12:30.046 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm95234.ko 2023-06-20T13:12:30.046 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm95241.ko 2023-06-20T13:12:30.046 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm95245.ko 2023-06-20T13:12:30.047 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc2945.ko 2023-06-20T13:12:30.047 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4151.ko 2023-06-20T13:12:30.047 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4215.ko 2023-06-20T13:12:30.047 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4222.ko 2023-06-20T13:12:30.047 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4245.ko 2023-06-20T13:12:30.047 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4260.ko 2023-06-20T13:12:30.047 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4261.ko 2023-06-20T13:12:30.047 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max16065.ko 2023-06-20T13:12:30.048 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max1619.ko 2023-06-20T13:12:30.048 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max1668.ko 2023-06-20T13:12:30.048 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max197.ko 2023-06-20T13:12:30.048 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max6639.ko 2023-06-20T13:12:30.048 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max6650.ko 2023-06-20T13:12:30.048 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max6697.ko 2023-06-20T13:12:30.048 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/mcp3021.ko 2023-06-20T13:12:30.048 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/nct6683.ko 2023-06-20T13:12:30.049 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/nct6775-core.ko 2023-06-20T13:12:30.049 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/nct6775.ko 2023-06-20T13:12:30.049 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/nct7802.ko 2023-06-20T13:12:30.049 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pc87360.ko 2023-06-20T13:12:30.049 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pc87427.ko 2023-06-20T13:12:30.049 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pcf8591.ko 2023-06-20T13:12:30.049 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus 2023-06-20T13:12:30.050 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-06-20T13:12:30.050 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-06-20T13:12:30.050 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-06-20T13:12:30.050 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/max16064.ko 2023-06-20T13:12:30.050 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/max34440.ko 2023-06-20T13:12:30.050 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/max8688.ko 2023-06-20T13:12:30.050 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-06-20T13:12:30.050 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-06-20T13:12:30.051 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-06-20T13:12:30.051 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-06-20T13:12:30.051 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-06-20T13:12:30.051 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-06-20T13:12:30.051 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/powr1220.ko 2023-06-20T13:12:30.051 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sch5627.ko 2023-06-20T13:12:30.051 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sch5636.ko 2023-06-20T13:12:30.051 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sch56xx-common.ko 2023-06-20T13:12:30.052 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sht15.ko 2023-06-20T13:12:30.052 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sht21.ko 2023-06-20T13:12:30.052 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/shtc1.ko 2023-06-20T13:12:30.052 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sis5595.ko 2023-06-20T13:12:30.052 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/smsc47b397.ko 2023-06-20T13:12:30.052 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/smsc47m1.ko 2023-06-20T13:12:30.052 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/smsc47m192.ko 2023-06-20T13:12:30.052 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/thmc50.ko 2023-06-20T13:12:30.053 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/tmp102.ko 2023-06-20T13:12:30.053 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/tmp103.ko 2023-06-20T13:12:30.053 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/tmp401.ko 2023-06-20T13:12:30.053 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/tmp421.ko 2023-06-20T13:12:30.053 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/via-cputemp.ko 2023-06-20T13:12:30.053 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/via686a.ko 2023-06-20T13:12:30.053 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/vt1211.ko 2023-06-20T13:12:30.053 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/vt8231.ko 2023-06-20T13:12:30.054 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83627ehf.ko 2023-06-20T13:12:30.054 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83627hf.ko 2023-06-20T13:12:30.054 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83781d.ko 2023-06-20T13:12:30.054 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83791d.ko 2023-06-20T13:12:30.054 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83792d.ko 2023-06-20T13:12:30.054 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83793.ko 2023-06-20T13:12:30.054 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83795.ko 2023-06-20T13:12:30.054 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83l785ts.ko 2023-06-20T13:12:30.055 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83l786ng.ko 2023-06-20T13:12:30.055 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c 2023-06-20T13:12:30.055 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/algos 2023-06-20T13:12:30.055 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-06-20T13:12:30.055 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-06-20T13:12:30.055 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses 2023-06-20T13:12:30.055 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-06-20T13:12:30.055 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-06-20T13:12:30.056 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-06-20T13:12:30.056 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-06-20T13:12:30.056 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-06-20T13:12:30.056 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-06-20T13:12:30.056 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-06-20T13:12:30.056 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-06-20T13:12:30.057 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-i801.ko 2023-06-20T13:12:30.057 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-isch.ko 2023-06-20T13:12:30.057 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-06-20T13:12:30.057 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-06-20T13:12:30.057 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-06-20T13:12:30.057 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-parport.ko 2023-06-20T13:12:30.057 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-06-20T13:12:30.057 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-06-20T13:12:30.058 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-06-20T13:12:30.058 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-06-20T13:12:30.058 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-06-20T13:12:30.058 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-06-20T13:12:30.058 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-via.ko 2023-06-20T13:12:30.058 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-06-20T13:12:30.058 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-06-20T13:12:30.058 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-dev.ko 2023-06-20T13:12:30.059 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-mux.ko 2023-06-20T13:12:30.059 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-06-20T13:12:30.059 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-smbus.ko 2023-06-20T13:12:30.059 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-stub.ko 2023-06-20T13:12:30.059 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband 2023-06-20T13:12:30.059 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core 2023-06-20T13:12:30.059 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/ib_cm.ko 2023-06-20T13:12:30.060 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/ib_core.ko 2023-06-20T13:12:30.060 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/ib_umad.ko 2023-06-20T13:12:30.060 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-06-20T13:12:30.060 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/iw_cm.ko 2023-06-20T13:12:30.060 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/rdma_cm.ko 2023-06-20T13:12:30.060 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-06-20T13:12:30.060 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw 2023-06-20T13:12:30.060 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/cxgb4 2023-06-20T13:12:30.061 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-06-20T13:12:30.061 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mlx4 2023-06-20T13:12:30.061 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-06-20T13:12:30.061 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mlx5 2023-06-20T13:12:30.061 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-06-20T13:12:30.061 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mthca 2023-06-20T13:12:30.061 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-06-20T13:12:30.061 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp 2023-06-20T13:12:30.062 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/ipoib 2023-06-20T13:12:30.062 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-06-20T13:12:30.062 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/iser 2023-06-20T13:12:30.062 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-06-20T13:12:30.062 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/isert 2023-06-20T13:12:30.062 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-06-20T13:12:30.062 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/srp 2023-06-20T13:12:30.063 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-06-20T13:12:30.063 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/srpt 2023-06-20T13:12:30.063 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-06-20T13:12:30.063 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input 2023-06-20T13:12:30.063 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport 2023-06-20T13:12:30.063 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-06-20T13:12:30.063 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/fm801-gp.ko 2023-06-20T13:12:30.063 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/gameport.ko 2023-06-20T13:12:30.064 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/lightning.ko 2023-06-20T13:12:30.064 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/ns558.ko 2023-06-20T13:12:30.064 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/joydev.ko 2023-06-20T13:12:30.064 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/keyboard 2023-06-20T13:12:30.064 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/keyboard/gpio_keys.ko 2023-06-20T13:12:30.064 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse 2023-06-20T13:12:30.064 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/appletouch.ko 2023-06-20T13:12:30.064 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/bcm5974.ko 2023-06-20T13:12:30.065 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/cyapatp.ko 2023-06-20T13:12:30.065 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/elan_i2c.ko 2023-06-20T13:12:30.065 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/sermouse.ko 2023-06-20T13:12:30.065 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-06-20T13:12:30.065 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/synaptics_usb.ko 2023-06-20T13:12:30.065 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/vsxxxaa.ko 2023-06-20T13:12:30.065 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/rmi4 2023-06-20T13:12:30.066 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/rmi4/rmi_core.ko 2023-06-20T13:12:30.066 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio 2023-06-20T13:12:30.066 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio/altera_ps2.ko 2023-06-20T13:12:30.066 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio/arc_ps2.ko 2023-06-20T13:12:30.066 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-06-20T13:12:30.066 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio/serio_raw.ko 2023-06-20T13:12:30.066 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/sparse-keymap.ko 2023-06-20T13:12:30.066 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/iommu 2023-06-20T13:12:30.067 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/iommu/amd 2023-06-20T13:12:30.067 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/iommu/amd/iommu_v2.ko 2023-06-20T13:12:30.067 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds 2023-06-20T13:12:30.067 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/leds-blinkm.ko 2023-06-20T13:12:30.067 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/leds-lm3530.ko 2023-06-20T13:12:30.067 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/leds-lp3944.ko 2023-06-20T13:12:30.067 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/leds-ss4200.ko 2023-06-20T13:12:30.067 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger 2023-06-20T13:12:30.068 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-06-20T13:12:30.068 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-06-20T13:12:30.068 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-06-20T13:12:30.068 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-06-20T13:12:30.068 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-06-20T13:12:30.068 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-06-20T13:12:30.068 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-06-20T13:12:30.069 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-06-20T13:12:30.069 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md 2023-06-20T13:12:30.069 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/bcache 2023-06-20T13:12:30.069 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/bcache/bcache.ko 2023-06-20T13:12:30.069 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-bio-prison.ko 2023-06-20T13:12:30.069 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-cache-smq.ko 2023-06-20T13:12:30.069 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-cache.ko 2023-06-20T13:12:30.069 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-crypt.ko 2023-06-20T13:12:30.070 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-delay.ko 2023-06-20T13:12:30.070 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-flakey.ko 2023-06-20T13:12:30.070 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-log-userspace.ko 2023-06-20T13:12:30.070 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-multipath.ko 2023-06-20T13:12:30.070 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-queue-length.ko 2023-06-20T13:12:30.070 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-raid.ko 2023-06-20T13:12:30.070 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-round-robin.ko 2023-06-20T13:12:30.070 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-service-time.ko 2023-06-20T13:12:30.071 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-switch.ko 2023-06-20T13:12:30.071 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-thin-pool.ko 2023-06-20T13:12:30.071 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-verity.ko 2023-06-20T13:12:30.071 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/faulty.ko 2023-06-20T13:12:30.071 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/linear.ko 2023-06-20T13:12:30.071 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/multipath.ko 2023-06-20T13:12:30.071 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/persistent-data 2023-06-20T13:12:30.071 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-06-20T13:12:30.072 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/raid0.ko 2023-06-20T13:12:30.072 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/raid1.ko 2023-06-20T13:12:30.072 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/raid10.ko 2023-06-20T13:12:30.072 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/raid456.ko 2023-06-20T13:12:30.072 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message 2023-06-20T13:12:30.072 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion 2023-06-20T13:12:30.072 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptbase.ko 2023-06-20T13:12:30.073 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptctl.ko 2023-06-20T13:12:30.073 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptfc.ko 2023-06-20T13:12:30.073 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptlan.ko 2023-06-20T13:12:30.073 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptsas.ko 2023-06-20T13:12:30.073 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptscsih.ko 2023-06-20T13:12:30.073 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptspi.ko 2023-06-20T13:12:30.073 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd 2023-06-20T13:12:30.073 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/lpc_ich.ko 2023-06-20T13:12:30.074 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/lpc_sch.ko 2023-06-20T13:12:30.074 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/mfd-core.ko 2023-06-20T13:12:30.074 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/sm501.ko 2023-06-20T13:12:30.074 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/viperboard.ko 2023-06-20T13:12:30.074 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/vx855.ko 2023-06-20T13:12:30.074 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/wl1273-core.ko 2023-06-20T13:12:30.074 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc 2023-06-20T13:12:30.074 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/altera-stapl 2023-06-20T13:12:30.074 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-06-20T13:12:30.075 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/apds9802als.ko 2023-06-20T13:12:30.075 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/apds990x.ko 2023-06-20T13:12:30.075 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/bh1770glc.ko 2023-06-20T13:12:30.075 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/cb710 2023-06-20T13:12:30.075 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/cb710/cb710.ko 2023-06-20T13:12:30.075 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom 2023-06-20T13:12:30.075 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom/at24.ko 2023-06-20T13:12:30.076 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom/eeprom.ko 2023-06-20T13:12:30.076 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-06-20T13:12:30.076 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom/max6875.ko 2023-06-20T13:12:30.076 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/enclosure.ko 2023-06-20T13:12:30.076 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/hpilo.ko 2023-06-20T13:12:30.076 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/isl29003.ko 2023-06-20T13:12:30.076 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/isl29020.ko 2023-06-20T13:12:30.076 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/lis3lv02d 2023-06-20T13:12:30.077 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-06-20T13:12:30.077 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-06-20T13:12:30.077 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/mei 2023-06-20T13:12:30.077 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/mei/mei-me.ko 2023-06-20T13:12:30.077 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/mei/mei-txe.ko 2023-06-20T13:12:30.077 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/mei/mei.ko 2023-06-20T13:12:30.077 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-gru 2023-06-20T13:12:30.077 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-gru/gru.ko 2023-06-20T13:12:30.078 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-xp 2023-06-20T13:12:30.078 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-xp/xp.ko 2023-06-20T13:12:30.078 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-xp/xpc.ko 2023-06-20T13:12:30.078 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-06-20T13:12:30.078 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/tifm_7xx1.ko 2023-06-20T13:12:30.078 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/tifm_core.ko 2023-06-20T13:12:30.078 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/tsl2550.ko 2023-06-20T13:12:30.078 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/vmw_balloon.ko 2023-06-20T13:12:30.079 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/vmw_vmci 2023-06-20T13:12:30.079 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-06-20T13:12:30.079 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net 2023-06-20T13:12:30.079 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/bonding 2023-06-20T13:12:30.079 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/bonding/bonding.ko 2023-06-20T13:12:30.079 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa 2023-06-20T13:12:30.079 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/b53 2023-06-20T13:12:30.079 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/b53/b53_common.ko 2023-06-20T13:12:30.080 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/bcm-sf2.ko 2023-06-20T13:12:30.080 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/mv88e6060.ko 2023-06-20T13:12:30.080 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/mv88e6xxx 2023-06-20T13:12:30.080 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-06-20T13:12:30.080 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dummy.ko 2023-06-20T13:12:30.080 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/eql.ko 2023-06-20T13:12:30.080 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet 2023-06-20T13:12:30.080 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com 2023-06-20T13:12:30.081 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-06-20T13:12:30.081 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-06-20T13:12:30.081 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-06-20T13:12:30.081 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-06-20T13:12:30.081 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390 2023-06-20T13:12:30.081 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390/8390.ko 2023-06-20T13:12:30.081 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-06-20T13:12:30.082 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-06-20T13:12:30.082 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-06-20T13:12:30.082 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/adaptec 2023-06-20T13:12:30.082 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-06-20T13:12:30.082 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/agere 2023-06-20T13:12:30.082 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/agere/et131x.ko 2023-06-20T13:12:30.082 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/alteon 2023-06-20T13:12:30.082 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-06-20T13:12:30.083 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/altera 2023-06-20T13:12:30.083 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-06-20T13:12:30.083 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/amd 2023-06-20T13:12:30.083 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-06-20T13:12:30.083 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-06-20T13:12:30.083 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-06-20T13:12:30.083 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros 2023-06-20T13:12:30.084 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/alx 2023-06-20T13:12:30.084 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-06-20T13:12:30.084 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atl1c 2023-06-20T13:12:30.084 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-06-20T13:12:30.084 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atl1e 2023-06-20T13:12:30.084 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-06-20T13:12:30.084 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atlx 2023-06-20T13:12:30.084 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-06-20T13:12:30.085 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-06-20T13:12:30.085 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom 2023-06-20T13:12:30.085 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-06-20T13:12:30.085 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-06-20T13:12:30.085 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-06-20T13:12:30.085 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-06-20T13:12:30.085 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-06-20T13:12:30.085 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/genet 2023-06-20T13:12:30.086 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-06-20T13:12:30.086 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-06-20T13:12:30.086 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/brocade 2023-06-20T13:12:30.086 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/brocade/bna 2023-06-20T13:12:30.086 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-06-20T13:12:30.086 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio 2023-06-20T13:12:30.086 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb 2023-06-20T13:12:30.086 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-06-20T13:12:30.087 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-06-20T13:12:30.087 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-06-20T13:12:30.087 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-06-20T13:12:30.087 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-06-20T13:12:30.087 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-06-20T13:12:30.087 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-06-20T13:12:30.087 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-06-20T13:12:30.088 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-06-20T13:12:30.088 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/cisco 2023-06-20T13:12:30.088 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/cisco/enic 2023-06-20T13:12:30.088 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-06-20T13:12:30.088 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec 2023-06-20T13:12:30.088 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip 2023-06-20T13:12:30.088 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-06-20T13:12:30.088 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-06-20T13:12:30.089 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-06-20T13:12:30.089 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-06-20T13:12:30.089 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-06-20T13:12:30.089 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-06-20T13:12:30.089 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dlink 2023-06-20T13:12:30.089 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-06-20T13:12:30.089 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-06-20T13:12:30.089 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dnet.ko 2023-06-20T13:12:30.090 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/emulex 2023-06-20T13:12:30.090 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/emulex/benet 2023-06-20T13:12:30.090 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-06-20T13:12:30.090 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/ethoc.ko 2023-06-20T13:12:30.090 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/fealnx.ko 2023-06-20T13:12:30.090 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel 2023-06-20T13:12:30.090 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e100.ko 2023-06-20T13:12:30.090 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e1000 2023-06-20T13:12:30.091 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-06-20T13:12:30.091 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e1000e 2023-06-20T13:12:30.091 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-06-20T13:12:30.091 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/fm10k 2023-06-20T13:12:30.091 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-06-20T13:12:30.091 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/i40e 2023-06-20T13:12:30.091 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-06-20T13:12:30.091 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/iavf 2023-06-20T13:12:30.092 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-06-20T13:12:30.092 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/igb 2023-06-20T13:12:30.092 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-06-20T13:12:30.092 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/igbvf 2023-06-20T13:12:30.092 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-06-20T13:12:30.092 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/ixgbe 2023-06-20T13:12:30.092 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-06-20T13:12:30.092 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/ixgbevf 2023-06-20T13:12:30.093 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-06-20T13:12:30.093 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/jme.ko 2023-06-20T13:12:30.093 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/marvell 2023-06-20T13:12:30.093 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-06-20T13:12:30.093 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/marvell/skge.ko 2023-06-20T13:12:30.093 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-06-20T13:12:30.093 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox 2023-06-20T13:12:30.094 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx4 2023-06-20T13:12:30.094 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-06-20T13:12:30.094 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-06-20T13:12:30.094 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx5 2023-06-20T13:12:30.094 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-06-20T13:12:30.094 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-06-20T13:12:30.094 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/micrel 2023-06-20T13:12:30.094 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-06-20T13:12:30.095 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/myricom 2023-06-20T13:12:30.095 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/myricom/myri10ge 2023-06-20T13:12:30.095 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-06-20T13:12:30.095 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/natsemi 2023-06-20T13:12:30.095 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-06-20T13:12:30.095 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-06-20T13:12:30.095 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/neterion 2023-06-20T13:12:30.095 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-06-20T13:12:30.096 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/nvidia 2023-06-20T13:12:30.096 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-06-20T13:12:30.096 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/packetengines 2023-06-20T13:12:30.096 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-06-20T13:12:30.096 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-06-20T13:12:30.096 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic 2023-06-20T13:12:30.096 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/netxen 2023-06-20T13:12:30.096 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-06-20T13:12:30.097 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-06-20T13:12:30.097 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-06-20T13:12:30.097 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-06-20T13:12:30.097 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/rdc 2023-06-20T13:12:30.097 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-06-20T13:12:30.097 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek 2023-06-20T13:12:30.097 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-06-20T13:12:30.097 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-06-20T13:12:30.098 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek/atp.ko 2023-06-20T13:12:30.098 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-06-20T13:12:30.098 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/rocker 2023-06-20T13:12:30.098 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-06-20T13:12:30.098 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sfc 2023-06-20T13:12:30.098 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-06-20T13:12:30.098 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/silan 2023-06-20T13:12:30.098 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-06-20T13:12:30.099 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sis 2023-06-20T13:12:30.099 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sis/sis190.ko 2023-06-20T13:12:30.099 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sis/sis900.ko 2023-06-20T13:12:30.099 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc 2023-06-20T13:12:30.099 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-06-20T13:12:30.099 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-06-20T13:12:30.099 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-06-20T13:12:30.099 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-06-20T13:12:30.100 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/stmicro 2023-06-20T13:12:30.100 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/stmicro/stmmac 2023-06-20T13:12:30.100 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-06-20T13:12:30.100 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-06-20T13:12:30.100 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun 2023-06-20T13:12:30.100 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun/cassini.ko 2023-06-20T13:12:30.100 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun/niu.ko 2023-06-20T13:12:30.100 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun/sungem.ko 2023-06-20T13:12:30.101 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-06-20T13:12:30.101 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/tehuti 2023-06-20T13:12:30.101 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-06-20T13:12:30.101 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/ti 2023-06-20T13:12:30.101 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/ti/tlan.ko 2023-06-20T13:12:30.101 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/via 2023-06-20T13:12:30.101 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-06-20T13:12:30.101 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-06-20T13:12:30.102 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/wiznet 2023-06-20T13:12:30.102 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-06-20T13:12:30.102 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-06-20T13:12:30.102 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/xircom 2023-06-20T13:12:30.102 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-06-20T13:12:30.102 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/geneve.ko 2023-06-20T13:12:30.102 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/hyperv 2023-06-20T13:12:30.102 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-06-20T13:12:30.103 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ieee802154 2023-06-20T13:12:30.103 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ieee802154/fakelb.ko 2023-06-20T13:12:30.103 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ifb.ko 2023-06-20T13:12:30.103 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ipvlan 2023-06-20T13:12:30.103 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ipvlan/ipvlan.ko 2023-06-20T13:12:30.103 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/macvlan.ko 2023-06-20T13:12:30.103 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/macvtap.ko 2023-06-20T13:12:30.104 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mdio 2023-06-20T13:12:30.104 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mdio.ko 2023-06-20T13:12:30.104 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-06-20T13:12:30.104 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-06-20T13:12:30.104 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mii.ko 2023-06-20T13:12:30.104 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/net_failover.ko 2023-06-20T13:12:30.104 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/netconsole.ko 2023-06-20T13:12:30.104 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/nlmon.ko 2023-06-20T13:12:30.105 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/pcs 2023-06-20T13:12:30.105 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-06-20T13:12:30.105 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-06-20T13:12:30.105 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy 2023-06-20T13:12:30.105 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/amd.ko 2023-06-20T13:12:30.105 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-06-20T13:12:30.105 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-06-20T13:12:30.105 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/bcm7xxx.ko 2023-06-20T13:12:30.106 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/bcm87xx.ko 2023-06-20T13:12:30.106 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/broadcom.ko 2023-06-20T13:12:30.106 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/cicada.ko 2023-06-20T13:12:30.106 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/davicom.ko 2023-06-20T13:12:30.106 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/dp83640.ko 2023-06-20T13:12:30.106 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/et1011c.ko 2023-06-20T13:12:30.106 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/icplus.ko 2023-06-20T13:12:30.106 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/lxt.ko 2023-06-20T13:12:30.107 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/marvell.ko 2023-06-20T13:12:30.107 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/micrel.ko 2023-06-20T13:12:30.107 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/national.ko 2023-06-20T13:12:30.107 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/phylink.ko 2023-06-20T13:12:30.107 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/qsemi.ko 2023-06-20T13:12:30.107 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/realtek.ko 2023-06-20T13:12:30.107 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/smsc.ko 2023-06-20T13:12:30.107 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/ste10Xp.ko 2023-06-20T13:12:30.108 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/vitesse.ko 2023-06-20T13:12:30.108 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp 2023-06-20T13:12:30.108 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/bsd_comp.ko 2023-06-20T13:12:30.108 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_async.ko 2023-06-20T13:12:30.108 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_deflate.ko 2023-06-20T13:12:30.108 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_generic.ko 2023-06-20T13:12:30.108 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_mppe.ko 2023-06-20T13:12:30.108 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_synctty.ko 2023-06-20T13:12:30.109 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/pppoe.ko 2023-06-20T13:12:30.109 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/pppox.ko 2023-06-20T13:12:30.109 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/pptp.ko 2023-06-20T13:12:30.109 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/slip 2023-06-20T13:12:30.109 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/slip/slhc.ko 2023-06-20T13:12:30.109 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/slip/slip.ko 2023-06-20T13:12:30.109 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/sungem_phy.ko 2023-06-20T13:12:30.109 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/tap.ko 2023-06-20T13:12:30.110 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team 2023-06-20T13:12:30.110 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team.ko 2023-06-20T13:12:30.110 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_activebackup.ko 2023-06-20T13:12:30.110 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_broadcast.ko 2023-06-20T13:12:30.110 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-06-20T13:12:30.110 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_random.ko 2023-06-20T13:12:30.110 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-06-20T13:12:30.110 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/tun.ko 2023-06-20T13:12:30.111 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/veth.ko 2023-06-20T13:12:30.111 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/virtio_net.ko 2023-06-20T13:12:30.111 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/vmxnet3 2023-06-20T13:12:30.111 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-06-20T13:12:30.111 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/vxlan 2023-06-20T13:12:30.111 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/vxlan/vxlan.ko 2023-06-20T13:12:30.111 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/xen-netback 2023-06-20T13:12:30.111 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/xen-netback/xen-netback.ko 2023-06-20T13:12:30.112 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/xen-netfront.ko 2023-06-20T13:12:30.112 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ntb 2023-06-20T13:12:30.112 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ntb/ntb.ko 2023-06-20T13:12:30.112 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/nvme 2023-06-20T13:12:30.112 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/nvme/host 2023-06-20T13:12:30.112 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/nvme/host/nvme-core.ko 2023-06-20T13:12:30.112 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/nvme/host/nvme.ko 2023-06-20T13:12:30.112 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport 2023-06-20T13:12:30.113 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport/parport.ko 2023-06-20T13:12:30.113 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport/parport_cs.ko 2023-06-20T13:12:30.113 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport/parport_pc.ko 2023-06-20T13:12:30.113 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport/parport_serial.ko 2023-06-20T13:12:30.113 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci 2023-06-20T13:12:30.113 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/hotplug 2023-06-20T13:12:30.113 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-06-20T13:12:30.113 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/pcie 2023-06-20T13:12:30.114 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/pcie/aer_inject.ko 2023-06-20T13:12:30.114 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/xen-pcifront.ko 2023-06-20T13:12:30.114 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pcmcia 2023-06-20T13:12:30.114 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pcmcia/i82092.ko 2023-06-20T13:12:30.114 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pcmcia/pd6729.ko 2023-06-20T13:12:30.114 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pcmcia/yenta_socket.ko 2023-06-20T13:12:30.114 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pinctrl 2023-06-20T13:12:30.114 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pinctrl/intel 2023-06-20T13:12:30.115 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-06-20T13:12:30.115 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform 2023-06-20T13:12:30.115 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86 2023-06-20T13:12:30.115 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/acer-wmi.ko 2023-06-20T13:12:30.115 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/acerhdf.ko 2023-06-20T13:12:30.115 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/apple-gmux.ko 2023-06-20T13:12:30.115 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/asus-laptop.ko 2023-06-20T13:12:30.115 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-06-20T13:12:30.116 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/asus-wmi.ko 2023-06-20T13:12:30.116 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/classmate-laptop.ko 2023-06-20T13:12:30.116 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-06-20T13:12:30.116 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-06-20T13:12:30.116 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-06-20T13:12:30.116 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-06-20T13:12:30.116 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/hdaps.ko 2023-06-20T13:12:30.117 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/intel 2023-06-20T13:12:30.117 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-06-20T13:12:30.117 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/intel_ips.ko 2023-06-20T13:12:30.117 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/msi-wmi.ko 2023-06-20T13:12:30.117 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/mxm-wmi.ko 2023-06-20T13:12:30.117 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-06-20T13:12:30.117 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/samsung-laptop.ko 2023-06-20T13:12:30.117 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/samsung-q10.ko 2023-06-20T13:12:30.118 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/topstar-laptop.ko 2023-06-20T13:12:30.118 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-06-20T13:12:30.118 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/toshiba_haps.ko 2023-06-20T13:12:30.118 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/wmi-bmof.ko 2023-06-20T13:12:30.118 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/wmi.ko 2023-06-20T13:12:30.118 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/powercap 2023-06-20T13:12:30.118 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/powercap/intel_rapl_common.ko 2023-06-20T13:12:30.118 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/powercap/intel_rapl_msr.ko 2023-06-20T13:12:30.119 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps 2023-06-20T13:12:30.119 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/clients 2023-06-20T13:12:30.119 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/clients/pps-gpio.ko 2023-06-20T13:12:30.119 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/clients/pps-ldisc.ko 2023-06-20T13:12:30.119 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/clients/pps_parport.ko 2023-06-20T13:12:30.119 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/pps_core.ko 2023-06-20T13:12:30.119 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ptp 2023-06-20T13:12:30.119 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ptp/ptp.ko 2023-06-20T13:12:30.120 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ptp/ptp_kvm.ko 2023-06-20T13:12:30.120 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc 2023-06-20T13:12:30.120 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-bq32k.ko 2023-06-20T13:12:30.120 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-bq4802.ko 2023-06-20T13:12:30.120 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1286.ko 2023-06-20T13:12:30.120 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1307.ko 2023-06-20T13:12:30.120 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1374.ko 2023-06-20T13:12:30.120 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1511.ko 2023-06-20T13:12:30.121 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1553.ko 2023-06-20T13:12:30.121 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1672.ko 2023-06-20T13:12:30.121 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1742.ko 2023-06-20T13:12:30.121 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds2404.ko 2023-06-20T13:12:30.121 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds3232.ko 2023-06-20T13:12:30.121 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-em3027.ko 2023-06-20T13:12:30.121 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-fm3130.ko 2023-06-20T13:12:30.121 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-isl12022.ko 2023-06-20T13:12:30.122 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-isl1208.ko 2023-06-20T13:12:30.122 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-m41t80.ko 2023-06-20T13:12:30.122 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-m48t35.ko 2023-06-20T13:12:30.122 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-m48t59.ko 2023-06-20T13:12:30.122 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-max6900.ko 2023-06-20T13:12:30.122 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-msm6242.ko 2023-06-20T13:12:30.122 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf2127.ko 2023-06-20T13:12:30.122 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf85063.ko 2023-06-20T13:12:30.123 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf8523.ko 2023-06-20T13:12:30.123 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf8563.ko 2023-06-20T13:12:30.123 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf8583.ko 2023-06-20T13:12:30.123 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rp5c01.ko 2023-06-20T13:12:30.123 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rs5c372.ko 2023-06-20T13:12:30.123 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-06-20T13:12:30.123 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rx8025.ko 2023-06-20T13:12:30.123 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rx8581.ko 2023-06-20T13:12:30.124 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-06-20T13:12:30.124 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-x1205.ko 2023-06-20T13:12:30.124 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi 2023-06-20T13:12:30.124 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/3w-9xxx.ko 2023-06-20T13:12:30.124 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/3w-sas.ko 2023-06-20T13:12:30.124 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/3w-xxxx.ko 2023-06-20T13:12:30.124 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/BusLogic.ko 2023-06-20T13:12:30.124 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/a100u2w.ko 2023-06-20T13:12:30.125 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aacraid 2023-06-20T13:12:30.125 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aacraid/aacraid.ko 2023-06-20T13:12:30.125 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/advansys.ko 2023-06-20T13:12:30.125 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aic7xxx 2023-06-20T13:12:30.125 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-06-20T13:12:30.125 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-06-20T13:12:30.125 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/am53c974.ko 2023-06-20T13:12:30.125 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/arcmsr 2023-06-20T13:12:30.126 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-06-20T13:12:30.126 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/atp870u.ko 2023-06-20T13:12:30.126 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/be2iscsi 2023-06-20T13:12:30.126 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-06-20T13:12:30.126 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bfa 2023-06-20T13:12:30.126 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bfa/bfa.ko 2023-06-20T13:12:30.126 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bnx2fc 2023-06-20T13:12:30.126 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-06-20T13:12:30.127 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bnx2i 2023-06-20T13:12:30.127 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-06-20T13:12:30.127 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/ch.ko 2023-06-20T13:12:30.127 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/csiostor 2023-06-20T13:12:30.127 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/csiostor/csiostor.ko 2023-06-20T13:12:30.127 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi 2023-06-20T13:12:30.127 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/cxgb3i 2023-06-20T13:12:30.128 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-06-20T13:12:30.128 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/cxgb4i 2023-06-20T13:12:30.128 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-06-20T13:12:30.128 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-06-20T13:12:30.128 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/dc395x.ko 2023-06-20T13:12:30.128 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler 2023-06-20T13:12:30.128 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-06-20T13:12:30.128 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-06-20T13:12:30.129 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-06-20T13:12:30.129 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-06-20T13:12:30.129 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/dmx3191d.ko 2023-06-20T13:12:30.129 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/esas2r 2023-06-20T13:12:30.129 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/esas2r/esas2r.ko 2023-06-20T13:12:30.129 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/esp_scsi.ko 2023-06-20T13:12:30.129 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fcoe 2023-06-20T13:12:30.129 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fcoe/fcoe.ko 2023-06-20T13:12:30.130 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-06-20T13:12:30.130 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fnic 2023-06-20T13:12:30.130 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fnic/fnic.ko 2023-06-20T13:12:30.130 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/hpsa.ko 2023-06-20T13:12:30.130 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/hptiop.ko 2023-06-20T13:12:30.130 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/hv_storvsc.ko 2023-06-20T13:12:30.130 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/initio.ko 2023-06-20T13:12:30.130 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/ipr.ko 2023-06-20T13:12:30.131 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/ips.ko 2023-06-20T13:12:30.131 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/isci 2023-06-20T13:12:30.131 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/isci/isci.ko 2023-06-20T13:12:30.131 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-06-20T13:12:30.131 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/iscsi_tcp.ko 2023-06-20T13:12:30.131 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libfc 2023-06-20T13:12:30.131 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libfc/libfc.ko 2023-06-20T13:12:30.131 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libiscsi.ko 2023-06-20T13:12:30.132 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libiscsi_tcp.ko 2023-06-20T13:12:30.132 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libsas 2023-06-20T13:12:30.132 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libsas/libsas.ko 2023-06-20T13:12:30.132 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/lpfc 2023-06-20T13:12:30.132 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/lpfc/lpfc.ko 2023-06-20T13:12:30.132 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid 2023-06-20T13:12:30.132 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid.ko 2023-06-20T13:12:30.132 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-06-20T13:12:30.133 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-06-20T13:12:30.133 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-06-20T13:12:30.133 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mpt3sas 2023-06-20T13:12:30.133 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-06-20T13:12:30.133 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mvsas 2023-06-20T13:12:30.133 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mvsas/mvsas.ko 2023-06-20T13:12:30.133 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mvumi.ko 2023-06-20T13:12:30.133 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/pm8001 2023-06-20T13:12:30.134 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-06-20T13:12:30.134 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/pmcraid.ko 2023-06-20T13:12:30.134 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla1280.ko 2023-06-20T13:12:30.134 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla2xxx 2023-06-20T13:12:30.134 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-06-20T13:12:30.134 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-06-20T13:12:30.134 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla4xxx 2023-06-20T13:12:30.134 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-06-20T13:12:30.135 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/raid_class.ko 2023-06-20T13:12:30.135 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_debug.ko 2023-06-20T13:12:30.135 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_fc.ko 2023-06-20T13:12:30.135 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-06-20T13:12:30.135 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_sas.ko 2023-06-20T13:12:30.135 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_spi.ko 2023-06-20T13:12:30.135 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_srp.ko 2023-06-20T13:12:30.135 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/ses.ko 2023-06-20T13:12:30.136 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/st.ko 2023-06-20T13:12:30.136 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/stex.ko 2023-06-20T13:12:30.136 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/sym53c8xx_2 2023-06-20T13:12:30.136 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-06-20T13:12:30.136 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/virtio_scsi.ko 2023-06-20T13:12:30.136 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/vmw_pvscsi.ko 2023-06-20T13:12:30.136 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/wd719x.ko 2023-06-20T13:12:30.136 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ssb 2023-06-20T13:12:30.137 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ssb/ssb.ko 2023-06-20T13:12:30.137 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target 2023-06-20T13:12:30.137 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/iscsi 2023-06-20T13:12:30.137 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-06-20T13:12:30.137 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/loopback 2023-06-20T13:12:30.137 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/loopback/tcm_loop.ko 2023-06-20T13:12:30.137 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_file.ko 2023-06-20T13:12:30.137 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_iblock.ko 2023-06-20T13:12:30.138 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_mod.ko 2023-06-20T13:12:30.138 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_pscsi.ko 2023-06-20T13:12:30.138 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_user.ko 2023-06-20T13:12:30.138 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/tcm_fc 2023-06-20T13:12:30.138 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-06-20T13:12:30.138 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal 2023-06-20T13:12:30.138 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel 2023-06-20T13:12:30.138 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal 2023-06-20T13:12:30.139 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-06-20T13:12:30.139 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-06-20T13:12:30.139 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-06-20T13:12:30.139 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-06-20T13:12:30.139 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-06-20T13:12:30.139 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-06-20T13:12:30.139 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-06-20T13:12:30.139 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-06-20T13:12:30.140 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-06-20T13:12:30.140 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-06-20T13:12:30.140 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-06-20T13:12:30.140 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-06-20T13:12:30.140 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-06-20T13:12:30.140 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-06-20T13:12:30.140 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-06-20T13:12:30.141 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty 2023-06-20T13:12:30.141 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/ipwireless 2023-06-20T13:12:30.141 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-06-20T13:12:30.141 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/n_gsm.ko 2023-06-20T13:12:30.141 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/n_hdlc.ko 2023-06-20T13:12:30.141 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/nozomi.ko 2023-06-20T13:12:30.141 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial 2023-06-20T13:12:30.141 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/8250 2023-06-20T13:12:30.142 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-06-20T13:12:30.142 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/arc_uart.ko 2023-06-20T13:12:30.142 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/jsm 2023-06-20T13:12:30.142 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/jsm/jsm.ko 2023-06-20T13:12:30.142 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/synclink_gt.ko 2023-06-20T13:12:30.142 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs 2023-06-20T13:12:30.142 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs/core 2023-06-20T13:12:30.142 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs/core/ufshcd-core.ko 2023-06-20T13:12:30.143 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs/host 2023-06-20T13:12:30.143 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-06-20T13:12:30.143 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio 2023-06-20T13:12:30.143 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio.ko 2023-06-20T13:12:30.143 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio_aec.ko 2023-06-20T13:12:30.143 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio_cif.ko 2023-06-20T13:12:30.143 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio_pci_generic.ko 2023-06-20T13:12:30.143 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio_sercos3.ko 2023-06-20T13:12:30.144 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb 2023-06-20T13:12:30.144 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class 2023-06-20T13:12:30.144 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class/cdc-acm.ko 2023-06-20T13:12:30.144 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class/cdc-wdm.ko 2023-06-20T13:12:30.144 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class/usblp.ko 2023-06-20T13:12:30.144 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class/usbtmc.ko 2023-06-20T13:12:30.144 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/host 2023-06-20T13:12:30.144 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/host/sl811-hcd.ko 2023-06-20T13:12:30.145 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/image 2023-06-20T13:12:30.145 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/image/mdc800.ko 2023-06-20T13:12:30.145 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/image/microtek.ko 2023-06-20T13:12:30.145 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc 2023-06-20T13:12:30.145 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/adutux.ko 2023-06-20T13:12:30.145 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/appledisplay.ko 2023-06-20T13:12:30.145 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/emi26.ko 2023-06-20T13:12:30.145 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/emi62.ko 2023-06-20T13:12:30.146 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/ezusb.ko 2023-06-20T13:12:30.146 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/idmouse.ko 2023-06-20T13:12:30.146 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/iowarrior.ko 2023-06-20T13:12:30.146 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/isight_firmware.ko 2023-06-20T13:12:30.146 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/ldusb.ko 2023-06-20T13:12:30.146 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/legousbtower.ko 2023-06-20T13:12:30.146 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/sisusbvga 2023-06-20T13:12:30.146 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-06-20T13:12:30.147 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/trancevibrator.ko 2023-06-20T13:12:30.147 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/usb3503.ko 2023-06-20T13:12:30.147 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/usblcd.ko 2023-06-20T13:12:30.147 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/usbsevseg.ko 2023-06-20T13:12:30.147 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/uss720.ko 2023-06-20T13:12:30.147 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/yurex.ko 2023-06-20T13:12:30.147 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/phy 2023-06-20T13:12:30.147 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/phy/phy-generic.ko 2023-06-20T13:12:30.148 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial 2023-06-20T13:12:30.148 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/aircable.ko 2023-06-20T13:12:30.148 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ark3116.ko 2023-06-20T13:12:30.148 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/belkin_sa.ko 2023-06-20T13:12:30.148 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ch341.ko 2023-06-20T13:12:30.148 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/cp210x.ko 2023-06-20T13:12:30.148 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/cyberjack.ko 2023-06-20T13:12:30.148 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/cypress_m8.ko 2023-06-20T13:12:30.149 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/digi_acceleport.ko 2023-06-20T13:12:30.149 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/empeg.ko 2023-06-20T13:12:30.149 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ftdi_sio.ko 2023-06-20T13:12:30.149 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/garmin_gps.ko 2023-06-20T13:12:30.149 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/io_edgeport.ko 2023-06-20T13:12:30.149 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/io_ti.ko 2023-06-20T13:12:30.149 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ipaq.ko 2023-06-20T13:12:30.149 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ipw.ko 2023-06-20T13:12:30.150 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ir-usb.ko 2023-06-20T13:12:30.150 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-06-20T13:12:30.150 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/keyspan.ko 2023-06-20T13:12:30.150 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/keyspan_pda.ko 2023-06-20T13:12:30.150 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/kl5kusb105.ko 2023-06-20T13:12:30.150 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/kobil_sct.ko 2023-06-20T13:12:30.150 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/mct_u232.ko 2023-06-20T13:12:30.150 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/mos7720.ko 2023-06-20T13:12:30.151 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/mos7840.ko 2023-06-20T13:12:30.151 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/navman.ko 2023-06-20T13:12:30.151 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/omninet.ko 2023-06-20T13:12:30.151 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/opticon.ko 2023-06-20T13:12:30.151 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/option.ko 2023-06-20T13:12:30.151 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/oti6858.ko 2023-06-20T13:12:30.151 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/pl2303.ko 2023-06-20T13:12:30.152 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/qcaux.ko 2023-06-20T13:12:30.152 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/qcserial.ko 2023-06-20T13:12:30.152 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/quatech2.ko 2023-06-20T13:12:30.152 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/safe_serial.ko 2023-06-20T13:12:30.152 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/sierra.ko 2023-06-20T13:12:30.152 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/spcp8x5.ko 2023-06-20T13:12:30.152 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ssu100.ko 2023-06-20T13:12:30.152 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/symbolserial.ko 2023-06-20T13:12:30.153 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-06-20T13:12:30.153 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-06-20T13:12:30.153 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/usb_debug.ko 2023-06-20T13:12:30.153 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/usb_wwan.ko 2023-06-20T13:12:30.153 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/visor.ko 2023-06-20T13:12:30.153 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/whiteheat.ko 2023-06-20T13:12:30.153 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/xsens_mt.ko 2023-06-20T13:12:30.153 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage 2023-06-20T13:12:30.154 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/uas.ko 2023-06-20T13:12:30.154 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-alauda.ko 2023-06-20T13:12:30.154 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-cypress.ko 2023-06-20T13:12:30.154 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-datafab.ko 2023-06-20T13:12:30.154 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-06-20T13:12:30.154 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-freecom.ko 2023-06-20T13:12:30.154 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-isd200.ko 2023-06-20T13:12:30.154 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-06-20T13:12:30.155 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-karma.ko 2023-06-20T13:12:30.155 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-onetouch.ko 2023-06-20T13:12:30.155 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-realtek.ko 2023-06-20T13:12:30.155 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-sddr09.ko 2023-06-20T13:12:30.155 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-sddr55.ko 2023-06-20T13:12:30.155 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-usbat.ko 2023-06-20T13:12:30.155 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/usb-storage.ko 2023-06-20T13:12:30.155 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/usbip 2023-06-20T13:12:30.156 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/usbip/usbip-core.ko 2023-06-20T13:12:30.156 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/usbip/usbip-host.ko 2023-06-20T13:12:30.156 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-06-20T13:12:30.156 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio 2023-06-20T13:12:30.156 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/pci 2023-06-20T13:12:30.156 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-06-20T13:12:30.156 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/pci/vfio-pci.ko 2023-06-20T13:12:30.157 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/vfio.ko 2023-06-20T13:12:30.157 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-06-20T13:12:30.157 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost 2023-06-20T13:12:30.157 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost/vhost.ko 2023-06-20T13:12:30.157 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost/vhost_iotlb.ko 2023-06-20T13:12:30.157 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost/vhost_net.ko 2023-06-20T13:12:30.157 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost/vhost_scsi.ko 2023-06-20T13:12:30.157 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video 2023-06-20T13:12:30.158 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video/backlight 2023-06-20T13:12:30.158 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video/backlight/apple_bl.ko 2023-06-20T13:12:30.158 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video/backlight/lcd.ko 2023-06-20T13:12:30.158 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video/backlight/platform_lcd.ko 2023-06-20T13:12:30.158 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio 2023-06-20T13:12:30.158 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio.ko 2023-06-20T13:12:30.158 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_balloon.ko 2023-06-20T13:12:30.158 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_mmio.ko 2023-06-20T13:12:30.159 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_pci.ko 2023-06-20T13:12:30.159 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-06-20T13:12:30.159 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-06-20T13:12:30.159 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_ring.ko 2023-06-20T13:12:30.159 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1 2023-06-20T13:12:30.159 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/masters 2023-06-20T13:12:30.159 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/masters/ds2482.ko 2023-06-20T13:12:30.159 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/masters/ds2490.ko 2023-06-20T13:12:30.160 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves 2023-06-20T13:12:30.160 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-06-20T13:12:30.160 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-06-20T13:12:30.160 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-06-20T13:12:30.160 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-06-20T13:12:30.160 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-06-20T13:12:30.160 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-06-20T13:12:30.160 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-06-20T13:12:30.161 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-06-20T13:12:30.161 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-06-20T13:12:30.161 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_smem.ko 2023-06-20T13:12:30.161 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_therm.ko 2023-06-20T13:12:30.161 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/wire.ko 2023-06-20T13:12:30.161 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog 2023-06-20T13:12:30.161 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/alim1535_wdt.ko 2023-06-20T13:12:30.161 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/alim7101_wdt.ko 2023-06-20T13:12:30.162 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/f71808e_wdt.ko 2023-06-20T13:12:30.162 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/hpwdt.ko 2023-06-20T13:12:30.162 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/i6300esb.ko 2023-06-20T13:12:30.162 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-06-20T13:12:30.162 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/iTCO_wdt.ko 2023-06-20T13:12:30.162 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/ib700wdt.ko 2023-06-20T13:12:30.162 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/ibmasr.ko 2023-06-20T13:12:30.162 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-06-20T13:12:30.163 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/it8712f_wdt.ko 2023-06-20T13:12:30.163 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/it87_wdt.ko 2023-06-20T13:12:30.163 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/machzwd.ko 2023-06-20T13:12:30.163 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/nv_tco.ko 2023-06-20T13:12:30.163 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/pcwd_pci.ko 2023-06-20T13:12:30.163 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/pcwd_usb.ko 2023-06-20T13:12:30.163 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-06-20T13:12:30.163 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/sch311x_wdt.ko 2023-06-20T13:12:30.164 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/softdog.ko 2023-06-20T13:12:30.164 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/sp5100_tco.ko 2023-06-20T13:12:30.164 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/via_wdt.ko 2023-06-20T13:12:30.164 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-06-20T13:12:30.164 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/w83877f_wdt.ko 2023-06-20T13:12:30.164 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/w83977f_wdt.ko 2023-06-20T13:12:30.164 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/wdt_pci.ko 2023-06-20T13:12:30.165 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/xen_wdt.ko 2023-06-20T13:12:30.165 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen 2023-06-20T13:12:30.165 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-acpi-processor.ko 2023-06-20T13:12:30.165 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-evtchn.ko 2023-06-20T13:12:30.165 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-gntalloc.ko 2023-06-20T13:12:30.165 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-gntdev.ko 2023-06-20T13:12:30.165 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-pciback 2023-06-20T13:12:30.165 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-06-20T13:12:30.166 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-privcmd.ko 2023-06-20T13:12:30.166 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xenfs 2023-06-20T13:12:30.166 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xenfs/xenfs.ko 2023-06-20T13:12:30.166 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs 2023-06-20T13:12:30.166 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/9p 2023-06-20T13:12:30.166 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/9p/9p.ko 2023-06-20T13:12:30.166 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/affs 2023-06-20T13:12:30.166 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/affs/affs.ko 2023-06-20T13:12:30.167 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/befs 2023-06-20T13:12:30.167 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/befs/befs.ko 2023-06-20T13:12:30.167 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/binfmt_misc.ko 2023-06-20T13:12:30.167 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/btrfs 2023-06-20T13:12:30.167 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/btrfs/btrfs.ko 2023-06-20T13:12:30.167 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/cachefiles 2023-06-20T13:12:30.167 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/cachefiles/cachefiles.ko 2023-06-20T13:12:30.167 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ceph 2023-06-20T13:12:30.168 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ceph/ceph.ko 2023-06-20T13:12:30.168 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/coda 2023-06-20T13:12:30.168 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/coda/coda.ko 2023-06-20T13:12:30.168 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/cramfs 2023-06-20T13:12:30.168 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/cramfs/cramfs.ko 2023-06-20T13:12:30.168 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/dlm 2023-06-20T13:12:30.168 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/dlm/dlm.ko 2023-06-20T13:12:30.168 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ecryptfs 2023-06-20T13:12:30.169 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ecryptfs/ecryptfs.ko 2023-06-20T13:12:30.169 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/f2fs 2023-06-20T13:12:30.169 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/f2fs/f2fs.ko 2023-06-20T13:12:30.169 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fat 2023-06-20T13:12:30.169 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fat/fat.ko 2023-06-20T13:12:30.169 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fat/msdos.ko 2023-06-20T13:12:30.169 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fat/vfat.ko 2023-06-20T13:12:30.169 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fscache 2023-06-20T13:12:30.170 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fscache/fscache.ko 2023-06-20T13:12:30.170 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fuse 2023-06-20T13:12:30.170 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fuse/cuse.ko 2023-06-20T13:12:30.170 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fuse/fuse.ko 2023-06-20T13:12:30.170 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/gfs2 2023-06-20T13:12:30.170 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/gfs2/gfs2.ko 2023-06-20T13:12:30.170 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/hfs 2023-06-20T13:12:30.171 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/hfs/hfs.ko 2023-06-20T13:12:30.171 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/hfsplus 2023-06-20T13:12:30.171 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/hfsplus/hfsplus.ko 2023-06-20T13:12:30.171 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/isofs 2023-06-20T13:12:30.171 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/isofs/isofs.ko 2023-06-20T13:12:30.171 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/jfs 2023-06-20T13:12:30.171 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/jfs/jfs.ko 2023-06-20T13:12:30.171 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/lockd 2023-06-20T13:12:30.172 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/lockd/lockd.ko 2023-06-20T13:12:30.172 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/minix 2023-06-20T13:12:30.172 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/minix/minix.ko 2023-06-20T13:12:30.172 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/netfs 2023-06-20T13:12:30.172 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/netfs/netfs.ko 2023-06-20T13:12:30.172 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs 2023-06-20T13:12:30.172 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/blocklayout 2023-06-20T13:12:30.173 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-06-20T13:12:30.173 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/filelayout 2023-06-20T13:12:30.173 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-06-20T13:12:30.173 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/flexfilelayout 2023-06-20T13:12:30.173 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-06-20T13:12:30.173 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/nfs.ko 2023-06-20T13:12:30.173 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/nfsv3.ko 2023-06-20T13:12:30.173 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/nfsv4.ko 2023-06-20T13:12:30.174 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs_common 2023-06-20T13:12:30.174 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs_common/grace.ko 2023-06-20T13:12:30.174 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs_common/nfs_acl.ko 2023-06-20T13:12:30.174 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfsd 2023-06-20T13:12:30.174 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfsd/nfsd.ko 2023-06-20T13:12:30.174 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nilfs2 2023-06-20T13:12:30.174 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nilfs2/nilfs2.ko 2023-06-20T13:12:30.174 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls 2023-06-20T13:12:30.175 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-celtic.ko 2023-06-20T13:12:30.175 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-centeuro.ko 2023-06-20T13:12:30.175 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-croatian.ko 2023-06-20T13:12:30.175 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-cyrillic.ko 2023-06-20T13:12:30.175 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-gaelic.ko 2023-06-20T13:12:30.175 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-greek.ko 2023-06-20T13:12:30.175 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-iceland.ko 2023-06-20T13:12:30.175 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-inuit.ko 2023-06-20T13:12:30.176 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-roman.ko 2023-06-20T13:12:30.176 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-romanian.ko 2023-06-20T13:12:30.176 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-turkish.ko 2023-06-20T13:12:30.176 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp1250.ko 2023-06-20T13:12:30.176 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp1251.ko 2023-06-20T13:12:30.176 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp1255.ko 2023-06-20T13:12:30.176 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp737.ko 2023-06-20T13:12:30.176 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp775.ko 2023-06-20T13:12:30.177 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp850.ko 2023-06-20T13:12:30.177 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp852.ko 2023-06-20T13:12:30.177 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp855.ko 2023-06-20T13:12:30.177 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp857.ko 2023-06-20T13:12:30.177 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp860.ko 2023-06-20T13:12:30.177 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp861.ko 2023-06-20T13:12:30.177 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp862.ko 2023-06-20T13:12:30.177 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp863.ko 2023-06-20T13:12:30.178 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp864.ko 2023-06-20T13:12:30.178 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp865.ko 2023-06-20T13:12:30.178 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp866.ko 2023-06-20T13:12:30.178 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp869.ko 2023-06-20T13:12:30.178 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp874.ko 2023-06-20T13:12:30.178 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp932.ko 2023-06-20T13:12:30.178 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp936.ko 2023-06-20T13:12:30.178 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp949.ko 2023-06-20T13:12:30.179 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp950.ko 2023-06-20T13:12:30.179 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_euc-jp.ko 2023-06-20T13:12:30.179 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-1.ko 2023-06-20T13:12:30.179 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-13.ko 2023-06-20T13:12:30.179 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-14.ko 2023-06-20T13:12:30.179 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-15.ko 2023-06-20T13:12:30.179 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-2.ko 2023-06-20T13:12:30.179 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-3.ko 2023-06-20T13:12:30.180 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-4.ko 2023-06-20T13:12:30.180 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-5.ko 2023-06-20T13:12:30.180 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-6.ko 2023-06-20T13:12:30.180 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-7.ko 2023-06-20T13:12:30.180 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-9.ko 2023-06-20T13:12:30.180 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_koi8-r.ko 2023-06-20T13:12:30.180 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_koi8-ru.ko 2023-06-20T13:12:30.180 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_koi8-u.ko 2023-06-20T13:12:30.181 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_utf8.ko 2023-06-20T13:12:30.181 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2 2023-06-20T13:12:30.181 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/cluster 2023-06-20T13:12:30.181 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-06-20T13:12:30.181 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/dlm 2023-06-20T13:12:30.181 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-06-20T13:12:30.181 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/dlmfs 2023-06-20T13:12:30.181 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-06-20T13:12:30.182 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/ocfs2.ko 2023-06-20T13:12:30.182 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-06-20T13:12:30.182 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-06-20T13:12:30.182 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-06-20T13:12:30.182 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/overlayfs 2023-06-20T13:12:30.182 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/overlayfs/overlay.ko 2023-06-20T13:12:30.182 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/pstore 2023-06-20T13:12:30.182 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/pstore/ramoops.ko 2023-06-20T13:12:30.183 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/reiserfs 2023-06-20T13:12:30.183 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/reiserfs/reiserfs.ko 2023-06-20T13:12:30.183 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/romfs 2023-06-20T13:12:30.183 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/romfs/romfs.ko 2023-06-20T13:12:30.183 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb 2023-06-20T13:12:30.183 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/client 2023-06-20T13:12:30.183 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/client/cifs.ko 2023-06-20T13:12:30.183 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/common 2023-06-20T13:12:30.184 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/common/cifs_arc4.ko 2023-06-20T13:12:30.184 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/common/cifs_md4.ko 2023-06-20T13:12:30.184 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/squashfs 2023-06-20T13:12:30.184 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/squashfs/squashfs.ko 2023-06-20T13:12:30.184 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/sysv 2023-06-20T13:12:30.184 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/sysv/sysv.ko 2023-06-20T13:12:30.184 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/udf 2023-06-20T13:12:30.184 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/udf/udf.ko 2023-06-20T13:12:30.185 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ufs 2023-06-20T13:12:30.185 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ufs/ufs.ko 2023-06-20T13:12:30.185 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/xfs 2023-06-20T13:12:30.185 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/xfs/xfs.ko 2023-06-20T13:12:30.185 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel 2023-06-20T13:12:30.185 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/rcu 2023-06-20T13:12:30.185 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/rcu/rcutorture.ko 2023-06-20T13:12:30.185 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/torture.ko 2023-06-20T13:12:30.186 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/trace 2023-06-20T13:12:30.186 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-06-20T13:12:30.186 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib 2023-06-20T13:12:30.186 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/asn1_encoder.ko 2023-06-20T13:12:30.186 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crc-itu-t.ko 2023-06-20T13:12:30.186 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crc8.ko 2023-06-20T13:12:30.186 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crypto 2023-06-20T13:12:30.186 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crypto/libarc4.ko 2023-06-20T13:12:30.187 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crypto/libdes.ko 2023-06-20T13:12:30.187 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/libcrc32c.ko 2023-06-20T13:12:30.187 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/lru_cache.ko 2023-06-20T13:12:30.187 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/lz4 2023-06-20T13:12:30.187 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/lz4/lz4_compress.ko 2023-06-20T13:12:30.187 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/lz4/lz4hc_compress.ko 2023-06-20T13:12:30.187 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/math 2023-06-20T13:12:30.187 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/math/cordic.ko 2023-06-20T13:12:30.188 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/raid6 2023-06-20T13:12:30.188 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/raid6/raid6_pq.ko 2023-06-20T13:12:30.188 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/reed_solomon 2023-06-20T13:12:30.188 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/reed_solomon/reed_solomon.ko 2023-06-20T13:12:30.188 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/ts_bm.ko 2023-06-20T13:12:30.188 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/ts_fsm.ko 2023-06-20T13:12:30.188 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/ts_kmp.ko 2023-06-20T13:12:30.188 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/zstd 2023-06-20T13:12:30.189 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/zstd/zstd_compress.ko 2023-06-20T13:12:30.189 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/mm 2023-06-20T13:12:30.189 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/mm/hwpoison-inject.ko 2023-06-20T13:12:30.189 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net 2023-06-20T13:12:30.189 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan 2023-06-20T13:12:30.189 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/6lowpan.ko 2023-06-20T13:12:30.189 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_dest.ko 2023-06-20T13:12:30.189 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_fragment.ko 2023-06-20T13:12:30.190 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_hop.ko 2023-06-20T13:12:30.190 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_ipv6.ko 2023-06-20T13:12:30.190 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_mobility.ko 2023-06-20T13:12:30.190 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_routing.ko 2023-06-20T13:12:30.190 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_udp.ko 2023-06-20T13:12:30.190 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802 2023-06-20T13:12:30.190 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/garp.ko 2023-06-20T13:12:30.190 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/mrp.ko 2023-06-20T13:12:30.191 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/p8022.ko 2023-06-20T13:12:30.191 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/psnap.ko 2023-06-20T13:12:30.191 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/stp.ko 2023-06-20T13:12:30.191 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/8021q 2023-06-20T13:12:30.191 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/8021q/8021q.ko 2023-06-20T13:12:30.191 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p 2023-06-20T13:12:30.191 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p/9pnet.ko 2023-06-20T13:12:30.191 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p/9pnet_fd.ko 2023-06-20T13:12:30.192 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p/9pnet_rdma.ko 2023-06-20T13:12:30.192 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p/9pnet_virtio.ko 2023-06-20T13:12:30.192 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/batman-adv 2023-06-20T13:12:30.192 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/batman-adv/batman-adv.ko 2023-06-20T13:12:30.192 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge 2023-06-20T13:12:30.192 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/br_netfilter.ko 2023-06-20T13:12:30.192 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/bridge.ko 2023-06-20T13:12:30.193 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter 2023-06-20T13:12:30.193 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-06-20T13:12:30.193 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_among.ko 2023-06-20T13:12:30.193 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_arp.ko 2023-06-20T13:12:30.193 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-06-20T13:12:30.193 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-06-20T13:12:30.193 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_ip.ko 2023-06-20T13:12:30.193 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-06-20T13:12:30.194 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_limit.ko 2023-06-20T13:12:30.194 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_log.ko 2023-06-20T13:12:30.194 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_mark.ko 2023-06-20T13:12:30.194 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-06-20T13:12:30.194 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-06-20T13:12:30.194 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-06-20T13:12:30.194 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-06-20T13:12:30.194 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_snat.ko 2023-06-20T13:12:30.194 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_stp.ko 2023-06-20T13:12:30.195 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-06-20T13:12:30.195 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-06-20T13:12:30.195 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-06-20T13:12:30.195 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-06-20T13:12:30.195 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebtables.ko 2023-06-20T13:12:30.195 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-06-20T13:12:30.195 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-06-20T13:12:30.195 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-06-20T13:12:30.196 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ceph 2023-06-20T13:12:30.196 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ceph/libceph.ko 2023-06-20T13:12:30.196 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/core 2023-06-20T13:12:30.196 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/core/failover.ko 2023-06-20T13:12:30.196 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/core/pktgen.ko 2023-06-20T13:12:30.196 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp 2023-06-20T13:12:30.196 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp/dccp.ko 2023-06-20T13:12:30.197 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp/dccp_diag.ko 2023-06-20T13:12:30.197 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp/dccp_ipv4.ko 2023-06-20T13:12:30.197 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp/dccp_ipv6.ko 2023-06-20T13:12:30.197 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dns_resolver 2023-06-20T13:12:30.197 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dns_resolver/dns_resolver.ko 2023-06-20T13:12:30.197 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa 2023-06-20T13:12:30.197 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/dsa_core.ko 2023-06-20T13:12:30.197 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/tag_brcm.ko 2023-06-20T13:12:30.198 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/tag_dsa.ko 2023-06-20T13:12:30.198 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/tag_none.ko 2023-06-20T13:12:30.198 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/tag_trailer.ko 2023-06-20T13:12:30.198 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154 2023-06-20T13:12:30.198 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154/6lowpan 2023-06-20T13:12:30.198 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-06-20T13:12:30.198 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154/ieee802154.ko 2023-06-20T13:12:30.198 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154/ieee802154_socket.ko 2023-06-20T13:12:30.199 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4 2023-06-20T13:12:30.199 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ah4.ko 2023-06-20T13:12:30.199 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/esp4.ko 2023-06-20T13:12:30.199 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/fou.ko 2023-06-20T13:12:30.199 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/gre.ko 2023-06-20T13:12:30.199 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/inet_diag.ko 2023-06-20T13:12:30.199 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ip_gre.ko 2023-06-20T13:12:30.199 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ip_tunnel.ko 2023-06-20T13:12:30.200 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ip_vti.ko 2023-06-20T13:12:30.200 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ipcomp.ko 2023-06-20T13:12:30.200 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ipip.ko 2023-06-20T13:12:30.200 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter 2023-06-20T13:12:30.200 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/arp_tables.ko 2023-06-20T13:12:30.200 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-06-20T13:12:30.200 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-06-20T13:12:30.200 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-06-20T13:12:30.201 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-06-20T13:12:30.201 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-06-20T13:12:30.201 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-06-20T13:12:30.201 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-06-20T13:12:30.201 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-06-20T13:12:30.201 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-06-20T13:12:30.201 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/iptable_security.ko 2023-06-20T13:12:30.201 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-06-20T13:12:30.202 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-06-20T13:12:30.202 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-06-20T13:12:30.202 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-06-20T13:12:30.202 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-06-20T13:12:30.202 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-06-20T13:12:30.202 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-06-20T13:12:30.202 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-06-20T13:12:30.202 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-06-20T13:12:30.203 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-06-20T13:12:30.203 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_bic.ko 2023-06-20T13:12:30.203 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_dctcp.ko 2023-06-20T13:12:30.203 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_diag.ko 2023-06-20T13:12:30.203 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_highspeed.ko 2023-06-20T13:12:30.203 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_htcp.ko 2023-06-20T13:12:30.203 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_hybla.ko 2023-06-20T13:12:30.203 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_illinois.ko 2023-06-20T13:12:30.204 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_lp.ko 2023-06-20T13:12:30.204 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_scalable.ko 2023-06-20T13:12:30.204 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_vegas.ko 2023-06-20T13:12:30.204 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_veno.ko 2023-06-20T13:12:30.204 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_westwood.ko 2023-06-20T13:12:30.204 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_yeah.ko 2023-06-20T13:12:30.204 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tunnel4.ko 2023-06-20T13:12:30.204 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/udp_diag.ko 2023-06-20T13:12:30.205 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/udp_tunnel.ko 2023-06-20T13:12:30.205 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/xfrm4_tunnel.ko 2023-06-20T13:12:30.205 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6 2023-06-20T13:12:30.205 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ah6.ko 2023-06-20T13:12:30.205 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/esp6.ko 2023-06-20T13:12:30.205 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/fou6.ko 2023-06-20T13:12:30.205 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ip6_tunnel.ko 2023-06-20T13:12:30.205 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-06-20T13:12:30.206 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ip6_vti.ko 2023-06-20T13:12:30.206 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ipcomp6.ko 2023-06-20T13:12:30.206 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter 2023-06-20T13:12:30.206 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-06-20T13:12:30.206 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-06-20T13:12:30.206 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-06-20T13:12:30.206 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-06-20T13:12:30.206 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-06-20T13:12:30.207 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-06-20T13:12:30.207 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-06-20T13:12:30.207 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-06-20T13:12:30.207 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-06-20T13:12:30.207 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-06-20T13:12:30.207 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-06-20T13:12:30.207 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-06-20T13:12:30.207 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-06-20T13:12:30.208 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-06-20T13:12:30.208 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-06-20T13:12:30.208 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-06-20T13:12:30.208 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-06-20T13:12:30.208 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-06-20T13:12:30.208 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-06-20T13:12:30.208 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-06-20T13:12:30.208 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-06-20T13:12:30.209 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-06-20T13:12:30.209 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-06-20T13:12:30.209 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-06-20T13:12:30.209 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/sit.ko 2023-06-20T13:12:30.209 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/tunnel6.ko 2023-06-20T13:12:30.209 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/xfrm6_tunnel.ko 2023-06-20T13:12:30.209 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/key 2023-06-20T13:12:30.210 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/key/af_key.ko 2023-06-20T13:12:30.210 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp 2023-06-20T13:12:30.210 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_core.ko 2023-06-20T13:12:30.210 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_debugfs.ko 2023-06-20T13:12:30.210 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_eth.ko 2023-06-20T13:12:30.210 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_ip.ko 2023-06-20T13:12:30.210 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_ip6.ko 2023-06-20T13:12:30.210 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_netlink.ko 2023-06-20T13:12:30.211 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_ppp.ko 2023-06-20T13:12:30.211 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/llc 2023-06-20T13:12:30.211 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/llc/llc.ko 2023-06-20T13:12:30.211 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/mac802154 2023-06-20T13:12:30.211 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/mac802154/mac802154.ko 2023-06-20T13:12:30.211 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/mpls 2023-06-20T13:12:30.211 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/mpls/mpls_gso.ko 2023-06-20T13:12:30.211 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter 2023-06-20T13:12:30.212 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset 2023-06-20T13:12:30.212 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set.ko 2023-06-20T13:12:30.212 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-06-20T13:12:30.212 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-06-20T13:12:30.212 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-06-20T13:12:30.212 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-06-20T13:12:30.212 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-06-20T13:12:30.212 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-06-20T13:12:30.213 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-06-20T13:12:30.213 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-06-20T13:12:30.213 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-06-20T13:12:30.213 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-06-20T13:12:30.213 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-06-20T13:12:30.213 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-06-20T13:12:30.213 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-06-20T13:12:30.213 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-06-20T13:12:30.214 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-06-20T13:12:30.214 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs 2023-06-20T13:12:30.214 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs.ko 2023-06-20T13:12:30.214 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-06-20T13:12:30.214 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-06-20T13:12:30.214 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-06-20T13:12:30.214 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-06-20T13:12:30.214 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-06-20T13:12:30.215 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-06-20T13:12:30.215 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-06-20T13:12:30.215 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-06-20T13:12:30.215 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-06-20T13:12:30.215 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-06-20T13:12:30.215 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-06-20T13:12:30.215 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-06-20T13:12:30.216 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-06-20T13:12:30.216 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conncount.ko 2023-06-20T13:12:30.216 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack.ko 2023-06-20T13:12:30.216 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-06-20T13:12:30.216 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-06-20T13:12:30.216 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-06-20T13:12:30.216 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_h323.ko 2023-06-20T13:12:30.217 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_irc.ko 2023-06-20T13:12:30.217 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-06-20T13:12:30.217 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-06-20T13:12:30.217 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-06-20T13:12:30.217 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_sane.ko 2023-06-20T13:12:30.217 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_sip.ko 2023-06-20T13:12:30.217 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-06-20T13:12:30.217 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-06-20T13:12:30.218 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_dup_netdev.ko 2023-06-20T13:12:30.218 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_flow_table.ko 2023-06-20T13:12:30.218 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_flow_table_inet.ko 2023-06-20T13:12:30.218 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_log_syslog.ko 2023-06-20T13:12:30.218 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat.ko 2023-06-20T13:12:30.218 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_amanda.ko 2023-06-20T13:12:30.218 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_ftp.ko 2023-06-20T13:12:30.219 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_irc.ko 2023-06-20T13:12:30.219 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_sip.ko 2023-06-20T13:12:30.219 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_tftp.ko 2023-06-20T13:12:30.219 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_synproxy_core.ko 2023-06-20T13:12:30.219 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_tables.ko 2023-06-20T13:12:30.219 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink.ko 2023-06-20T13:12:30.219 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink_acct.ko 2023-06-20T13:12:30.219 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink_log.ko 2023-06-20T13:12:30.220 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink_osf.ko 2023-06-20T13:12:30.220 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink_queue.ko 2023-06-20T13:12:30.220 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_chain_nat.ko 2023-06-20T13:12:30.220 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_compat.ko 2023-06-20T13:12:30.220 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_ct.ko 2023-06-20T13:12:30.220 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_dup_netdev.ko 2023-06-20T13:12:30.220 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_fib.ko 2023-06-20T13:12:30.220 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_fwd_netdev.ko 2023-06-20T13:12:30.221 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_hash.ko 2023-06-20T13:12:30.221 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_limit.ko 2023-06-20T13:12:30.221 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_log.ko 2023-06-20T13:12:30.221 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_masq.ko 2023-06-20T13:12:30.221 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_nat.ko 2023-06-20T13:12:30.221 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_numgen.ko 2023-06-20T13:12:30.221 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_queue.ko 2023-06-20T13:12:30.221 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_quota.ko 2023-06-20T13:12:30.222 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_redir.ko 2023-06-20T13:12:30.222 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_reject.ko 2023-06-20T13:12:30.222 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_reject_inet.ko 2023-06-20T13:12:30.222 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_socket.ko 2023-06-20T13:12:30.222 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_tunnel.ko 2023-06-20T13:12:30.222 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_AUDIT.ko 2023-06-20T13:12:30.222 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_CHECKSUM.ko 2023-06-20T13:12:30.222 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_CLASSIFY.ko 2023-06-20T13:12:30.223 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-06-20T13:12:30.223 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_CT.ko 2023-06-20T13:12:30.223 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_DSCP.ko 2023-06-20T13:12:30.223 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_HL.ko 2023-06-20T13:12:30.223 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_HMARK.ko 2023-06-20T13:12:30.223 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_IDLETIMER.ko 2023-06-20T13:12:30.223 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_LED.ko 2023-06-20T13:12:30.223 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_LOG.ko 2023-06-20T13:12:30.224 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_MASQUERADE.ko 2023-06-20T13:12:30.224 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_NETMAP.ko 2023-06-20T13:12:30.224 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_NFLOG.ko 2023-06-20T13:12:30.224 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_NFQUEUE.ko 2023-06-20T13:12:30.224 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_RATEEST.ko 2023-06-20T13:12:30.224 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_REDIRECT.ko 2023-06-20T13:12:30.224 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_SECMARK.ko 2023-06-20T13:12:30.224 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TCPMSS.ko 2023-06-20T13:12:30.225 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-06-20T13:12:30.225 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TEE.ko 2023-06-20T13:12:30.225 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TPROXY.ko 2023-06-20T13:12:30.225 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TRACE.ko 2023-06-20T13:12:30.225 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_addrtype.ko 2023-06-20T13:12:30.225 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_bpf.ko 2023-06-20T13:12:30.225 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_cgroup.ko 2023-06-20T13:12:30.225 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_cluster.ko 2023-06-20T13:12:30.226 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_comment.ko 2023-06-20T13:12:30.226 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_connbytes.ko 2023-06-20T13:12:30.226 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_connlabel.ko 2023-06-20T13:12:30.226 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_connlimit.ko 2023-06-20T13:12:30.226 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_connmark.ko 2023-06-20T13:12:30.226 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_conntrack.ko 2023-06-20T13:12:30.226 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_cpu.ko 2023-06-20T13:12:30.226 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_dccp.ko 2023-06-20T13:12:30.227 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_devgroup.ko 2023-06-20T13:12:30.227 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_dscp.ko 2023-06-20T13:12:30.227 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_ecn.ko 2023-06-20T13:12:30.227 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_esp.ko 2023-06-20T13:12:30.227 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_hashlimit.ko 2023-06-20T13:12:30.227 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_helper.ko 2023-06-20T13:12:30.227 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_hl.ko 2023-06-20T13:12:30.227 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_ipcomp.ko 2023-06-20T13:12:30.228 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_iprange.ko 2023-06-20T13:12:30.228 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_ipvs.ko 2023-06-20T13:12:30.228 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_l2tp.ko 2023-06-20T13:12:30.228 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_length.ko 2023-06-20T13:12:30.228 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_limit.ko 2023-06-20T13:12:30.228 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_mac.ko 2023-06-20T13:12:30.228 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_mark.ko 2023-06-20T13:12:30.229 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_multiport.ko 2023-06-20T13:12:30.229 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_nat.ko 2023-06-20T13:12:30.229 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_nfacct.ko 2023-06-20T13:12:30.229 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_osf.ko 2023-06-20T13:12:30.229 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_owner.ko 2023-06-20T13:12:30.229 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_physdev.ko 2023-06-20T13:12:30.229 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_pkttype.ko 2023-06-20T13:12:30.229 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_policy.ko 2023-06-20T13:12:30.230 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_quota.ko 2023-06-20T13:12:30.230 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_rateest.ko 2023-06-20T13:12:30.230 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_realm.ko 2023-06-20T13:12:30.230 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_recent.ko 2023-06-20T13:12:30.230 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_sctp.ko 2023-06-20T13:12:30.230 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_set.ko 2023-06-20T13:12:30.230 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_socket.ko 2023-06-20T13:12:30.230 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_state.ko 2023-06-20T13:12:30.231 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_statistic.ko 2023-06-20T13:12:30.231 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_string.ko 2023-06-20T13:12:30.231 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_tcpmss.ko 2023-06-20T13:12:30.231 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_time.ko 2023-06-20T13:12:30.231 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_u32.ko 2023-06-20T13:12:30.231 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netlink 2023-06-20T13:12:30.231 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netlink/netlink_diag.ko 2023-06-20T13:12:30.231 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/nsh 2023-06-20T13:12:30.232 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/nsh/nsh.ko 2023-06-20T13:12:30.232 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch 2023-06-20T13:12:30.232 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch/openvswitch.ko 2023-06-20T13:12:30.232 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch/vport-geneve.ko 2023-06-20T13:12:30.232 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch/vport-gre.ko 2023-06-20T13:12:30.232 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch/vport-vxlan.ko 2023-06-20T13:12:30.232 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/packet 2023-06-20T13:12:30.232 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/packet/af_packet_diag.ko 2023-06-20T13:12:30.233 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/rds 2023-06-20T13:12:30.233 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/rds/rds.ko 2023-06-20T13:12:30.233 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/rds/rds_rdma.ko 2023-06-20T13:12:30.233 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/rds/rds_tcp.ko 2023-06-20T13:12:30.233 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched 2023-06-20T13:12:30.233 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_csum.ko 2023-06-20T13:12:30.233 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_gact.ko 2023-06-20T13:12:30.233 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_ipt.ko 2023-06-20T13:12:30.234 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_mirred.ko 2023-06-20T13:12:30.234 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_nat.ko 2023-06-20T13:12:30.234 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_pedit.ko 2023-06-20T13:12:30.234 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_police.ko 2023-06-20T13:12:30.234 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_simple.ko 2023-06-20T13:12:30.234 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_skbedit.ko 2023-06-20T13:12:30.234 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_vlan.ko 2023-06-20T13:12:30.234 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_basic.ko 2023-06-20T13:12:30.235 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_bpf.ko 2023-06-20T13:12:30.235 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_flow.ko 2023-06-20T13:12:30.235 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_fw.ko 2023-06-20T13:12:30.235 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_route.ko 2023-06-20T13:12:30.235 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_u32.ko 2023-06-20T13:12:30.235 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_cmp.ko 2023-06-20T13:12:30.235 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_ipset.ko 2023-06-20T13:12:30.235 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_meta.ko 2023-06-20T13:12:30.236 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_nbyte.ko 2023-06-20T13:12:30.236 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_text.ko 2023-06-20T13:12:30.236 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_u32.ko 2023-06-20T13:12:30.236 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_choke.ko 2023-06-20T13:12:30.236 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_codel.ko 2023-06-20T13:12:30.236 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_drr.ko 2023-06-20T13:12:30.236 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_fq.ko 2023-06-20T13:12:30.236 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_gred.ko 2023-06-20T13:12:30.237 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_hfsc.ko 2023-06-20T13:12:30.237 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_hhf.ko 2023-06-20T13:12:30.237 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_htb.ko 2023-06-20T13:12:30.237 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_ingress.ko 2023-06-20T13:12:30.237 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_mqprio.ko 2023-06-20T13:12:30.237 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_mqprio_lib.ko 2023-06-20T13:12:30.237 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_multiq.ko 2023-06-20T13:12:30.237 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_netem.ko 2023-06-20T13:12:30.238 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_pie.ko 2023-06-20T13:12:30.238 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_plug.ko 2023-06-20T13:12:30.238 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_prio.ko 2023-06-20T13:12:30.238 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_qfq.ko 2023-06-20T13:12:30.238 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_red.ko 2023-06-20T13:12:30.238 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_sfb.ko 2023-06-20T13:12:30.238 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_sfq.ko 2023-06-20T13:12:30.238 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_tbf.ko 2023-06-20T13:12:30.239 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_teql.ko 2023-06-20T13:12:30.239 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sctp 2023-06-20T13:12:30.239 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sctp/sctp.ko 2023-06-20T13:12:30.239 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sctp/sctp_diag.ko 2023-06-20T13:12:30.239 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc 2023-06-20T13:12:30.239 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/auth_gss 2023-06-20T13:12:30.239 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-06-20T13:12:30.239 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-06-20T13:12:30.240 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/sunrpc.ko 2023-06-20T13:12:30.240 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/xprtrdma 2023-06-20T13:12:30.240 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-06-20T13:12:30.240 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/tipc 2023-06-20T13:12:30.240 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/tipc/diag.ko 2023-06-20T13:12:30.240 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/tipc/tipc.ko 2023-06-20T13:12:30.240 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/unix 2023-06-20T13:12:30.240 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/unix/unix_diag.ko 2023-06-20T13:12:30.241 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock 2023-06-20T13:12:30.241 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-06-20T13:12:30.241 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-06-20T13:12:30.241 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vsock.ko 2023-06-20T13:12:30.241 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vsock_diag.ko 2023-06-20T13:12:30.241 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vsock_loopback.ko 2023-06-20T13:12:30.241 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/xfrm 2023-06-20T13:12:30.242 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/xfrm/xfrm_ipcomp.ko 2023-06-20T13:12:30.242 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security 2023-06-20T13:12:30.242 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys 2023-06-20T13:12:30.242 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys/encrypted-keys 2023-06-20T13:12:30.242 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-06-20T13:12:30.242 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys/trusted-keys 2023-06-20T13:12:30.242 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys/trusted-keys/trusted.ko 2023-06-20T13:12:30.242 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/virt 2023-06-20T13:12:30.243 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/virt/lib 2023-06-20T13:12:30.243 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/virt/lib/irqbypass.ko 2023-06-20T13:12:30.243 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.alias 2023-06-20T13:12:30.243 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.alias.bin 2023-06-20T13:12:30.243 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.builtin 2023-06-20T13:12:30.243 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.builtin.bin 2023-06-20T13:12:30.243 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.builtin.modinfo 2023-06-20T13:12:30.243 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.dep 2023-06-20T13:12:30.244 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.dep.bin 2023-06-20T13:12:30.244 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.devname 2023-06-20T13:12:30.244 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.order 2023-06-20T13:12:30.244 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.softdep 2023-06-20T13:12:30.244 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.symbols 2023-06-20T13:12:30.244 INFO:teuthology.orchestra.run.smithi032.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.symbols.bin 2023-06-20T13:12:30.245 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-rc5-g1c622d92b6f1 2023-06-20T13:12:30.245 DEBUG:teuthology.orchestra.run.smithi032:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-06-20T13:12:30.274 INFO:teuthology.orchestra.run.smithi032.stdout:postinstall scriptlet (using /bin/sh): 2023-06-20T13:12:30.274 INFO:teuthology.orchestra.run.smithi032.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.4.0-rc5-g1c622d92b6f1 -a -r /boot/System.map-6.4.0-rc5-g1c622d92b6f1 ]; then 2023-06-20T13:12:30.275 INFO:teuthology.orchestra.run.smithi032.stdout:cp /boot/vmlinuz-6.4.0-rc5-g1c622d92b6f1 /boot/.vmlinuz-6.4.0-rc5-g1c622d92b6f1-rpm 2023-06-20T13:12:30.275 INFO:teuthology.orchestra.run.smithi032.stdout:cp /boot/System.map-6.4.0-rc5-g1c622d92b6f1 /boot/.System.map-6.4.0-rc5-g1c622d92b6f1-rpm 2023-06-20T13:12:30.275 INFO:teuthology.orchestra.run.smithi032.stdout:rm -f /boot/vmlinuz-6.4.0-rc5-g1c622d92b6f1 /boot/System.map-6.4.0-rc5-g1c622d92b6f1 2023-06-20T13:12:30.275 INFO:teuthology.orchestra.run.smithi032.stdout:/sbin/installkernel 6.4.0-rc5-g1c622d92b6f1 /boot/.vmlinuz-6.4.0-rc5-g1c622d92b6f1-rpm /boot/.System.map-6.4.0-rc5-g1c622d92b6f1-rpm 2023-06-20T13:12:30.275 INFO:teuthology.orchestra.run.smithi032.stdout:rm -f /boot/.vmlinuz-6.4.0-rc5-g1c622d92b6f1-rpm /boot/.System.map-6.4.0-rc5-g1c622d92b6f1-rpm 2023-06-20T13:12:30.275 INFO:teuthology.orchestra.run.smithi032.stdout:fi 2023-06-20T13:12:30.275 INFO:teuthology.orchestra.run.smithi032.stdout:preuninstall scriptlet (using /bin/sh): 2023-06-20T13:12:30.275 INFO:teuthology.orchestra.run.smithi032.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-06-20T13:12:30.276 INFO:teuthology.orchestra.run.smithi032.stdout:new-kernel-pkg --remove 6.4.0-rc5-g1c622d92b6f1 --rminitrd --initrdfile=/boot/initramfs-6.4.0-rc5-g1c622d92b6f1.img 2023-06-20T13:12:30.276 INFO:teuthology.orchestra.run.smithi032.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-06-20T13:12:30.276 INFO:teuthology.orchestra.run.smithi032.stdout:kernel-install remove 6.4.0-rc5-g1c622d92b6f1 2023-06-20T13:12:30.276 INFO:teuthology.orchestra.run.smithi032.stdout:fi 2023-06-20T13:12:30.276 INFO:teuthology.orchestra.run.smithi032.stdout:postuninstall scriptlet (using /bin/sh): 2023-06-20T13:12:30.276 INFO:teuthology.orchestra.run.smithi032.stdout:if [ -x /sbin/update-bootloader ]; then 2023-06-20T13:12:30.276 INFO:teuthology.orchestra.run.smithi032.stdout:/sbin/update-bootloader --remove 6.4.0-rc5-g1c622d92b6f1 2023-06-20T13:12:30.277 INFO:teuthology.orchestra.run.smithi032.stdout:fi 2023-06-20T13:12:30.277 DEBUG:teuthology.orchestra.run.smithi032:> sudo rpm -qi grub2-tools 2023-06-20T13:12:30.357 INFO:teuthology.orchestra.run.smithi032.stdout:Name : grub2-tools 2023-06-20T13:12:30.358 INFO:teuthology.orchestra.run.smithi032.stdout:Epoch : 1 2023-06-20T13:12:30.358 INFO:teuthology.orchestra.run.smithi032.stdout:Version : 2.02 2023-06-20T13:12:30.359 INFO:teuthology.orchestra.run.smithi032.stdout:Release : 129.el8 2023-06-20T13:12:30.359 INFO:teuthology.orchestra.run.smithi032.stdout:Architecture: x86_64 2023-06-20T13:12:30.360 INFO:teuthology.orchestra.run.smithi032.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-06-20T13:12:30.360 INFO:teuthology.orchestra.run.smithi032.stdout:Group : System Environment/Base 2023-06-20T13:12:30.361 INFO:teuthology.orchestra.run.smithi032.stdout:Size : 9265586 2023-06-20T13:12:30.361 INFO:teuthology.orchestra.run.smithi032.stdout:License : GPLv3+ 2023-06-20T13:12:30.362 INFO:teuthology.orchestra.run.smithi032.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-06-20T13:12:30.362 INFO:teuthology.orchestra.run.smithi032.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-06-20T13:12:30.362 INFO:teuthology.orchestra.run.smithi032.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-06-20T13:12:30.362 INFO:teuthology.orchestra.run.smithi032.stdout:Build Host : kbuilder.bsys.centos.org 2023-06-20T13:12:30.363 INFO:teuthology.orchestra.run.smithi032.stdout:Relocations : (not relocatable) 2023-06-20T13:12:30.363 INFO:teuthology.orchestra.run.smithi032.stdout:Packager : CentOS BuildSystem 2023-06-20T13:12:30.363 INFO:teuthology.orchestra.run.smithi032.stdout:Vendor : CentOS 2023-06-20T13:12:30.363 INFO:teuthology.orchestra.run.smithi032.stdout:URL : http://www.gnu.org/software/grub/ 2023-06-20T13:12:30.364 INFO:teuthology.orchestra.run.smithi032.stdout:Summary : Support tools for GRUB. 2023-06-20T13:12:30.364 INFO:teuthology.orchestra.run.smithi032.stdout:Description : 2023-06-20T13:12:30.364 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:12:30.364 INFO:teuthology.orchestra.run.smithi032.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-06-20T13:12:30.365 INFO:teuthology.orchestra.run.smithi032.stdout:customizable bootloader with modular architecture. It supports a rich 2023-06-20T13:12:30.365 INFO:teuthology.orchestra.run.smithi032.stdout:variety of kernel formats, file systems, computer architectures and 2023-06-20T13:12:30.365 INFO:teuthology.orchestra.run.smithi032.stdout:hardware devices. 2023-06-20T13:12:30.365 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:12:30.365 INFO:teuthology.orchestra.run.smithi032.stdout:This subpackage provides tools for support of all platforms. 2023-06-20T13:12:30.366 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-06-20T13:12:30.366 INFO:teuthology.task.kernel:Updating grub on smithi032 to boot 6.4.0-rc5-g1c622d92b6f1 2023-06-20T13:12:30.367 DEBUG:teuthology.orchestra.run.smithi032:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-06-20T13:12:34.758 INFO:teuthology.orchestra.run.smithi032.stderr:Generating grub configuration file ... 2023-06-20T13:12:36.452 INFO:teuthology.orchestra.run.smithi032.stderr:done 2023-06-20T13:12:36.453 DEBUG:teuthology.orchestra.run.smithi032:> mktemp 2023-06-20T13:12:36.490 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.z4bRrK6DzI 2023-06-20T13:12:36.491 DEBUG:teuthology.orchestra.run.smithi032:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.z4bRrK6DzI 2023-06-20T13:12:36.563 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0666 /tmp/tmp.z4bRrK6DzI 2023-06-20T13:12:36.700 DEBUG:teuthology.orchestra.remote:smithi032:/tmp/tmp.z4bRrK6DzI is 6KB 2023-06-20T13:12:36.747 DEBUG:teuthology.orchestra.run.smithi032:> rm -fr /tmp/tmp.z4bRrK6DzI 2023-06-20T13:12:36.764 DEBUG:teuthology.orchestra.run.smithi032:> sudo /bin/ls /boot/loader/entries || true 2023-06-20T13:12:36.830 INFO:teuthology.orchestra.run.smithi032.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-06-20T13:12:36.830 INFO:teuthology.orchestra.run.smithi032.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-06-20T13:12:36.830 INFO:teuthology.orchestra.run.smithi032.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-06-20T13:12:36.830 INFO:teuthology.orchestra.run.smithi032.stdout:a1b29d6c289747bdb22930598d39874a-6.4.0-rc5-g1c622d92b6f1.conf 2023-06-20T13:12:36.831 DEBUG:teuthology.orchestra.run.smithi032:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.4.0-rc5-g1c622d92b6f1 2023-06-20T13:12:36.993 DEBUG:teuthology.orchestra.run.smithi032:> sudo shutdown -r now 2023-06-20T13:13:06.996 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-06-20T13:13:06.996 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-06-20T13:13:06.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T13:13:25.360 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-06-20T13:13:55.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-06-20T13:13:55.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T13:14:10.948 DEBUG:teuthology.orchestra.run.smithi032:> true 2023-06-20T13:14:11.339 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-06-20T13:14:11.339 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.4.0-rc5-g1c622d92b6f1"... 2023-06-20T13:14:11.339 DEBUG:teuthology.orchestra.run.smithi032:> uname -r 2023-06-20T13:14:11.383 INFO:teuthology.orchestra.run.smithi032.stdout:6.4.0-rc5-g1c622d92b6f1 2023-06-20T13:14:11.383 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-rc5-g1c622d92b6f1 vs 6.4.0-rc5-g1c622d92b6f1 2023-06-20T13:14:11.384 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-20T13:14:11.384 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-06-20T13:14:12.384 DEBUG:teuthology.parallel:result is None 2023-06-20T13:14:12.385 INFO:teuthology.run_tasks:Running task internal.base... 2023-06-20T13:14:12.393 INFO:teuthology.task.internal:Creating test directory... 2023-06-20T13:14:12.393 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-20T13:14:12.398 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-20T13:14:12.448 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-06-20T13:14:12.456 INFO:teuthology.run_tasks:Running task internal.archive... 2023-06-20T13:14:12.464 INFO:teuthology.task.internal:Creating archive directory... 2023-06-20T13:14:12.464 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-20T13:14:12.468 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-20T13:14:12.529 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-06-20T13:14:12.540 INFO:teuthology.task.internal:Enabling coredump saving... 2023-06-20T13:14:12.541 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-20T13:14:12.545 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-20T13:14:12.659 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-20T13:14:12.699 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-20T13:14:12.703 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-20T13:14:12.729 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-20T13:14:12.732 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-06-20T13:14:12.739 INFO:teuthology.task.internal:Configuring sudo... 2023-06-20T13:14:12.740 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-20T13:14:12.744 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-20T13:14:12.813 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-06-20T13:14:12.822 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-06-20T13:14:12.823 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-20T13:14:12.827 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-20T13:14:12.871 DEBUG:teuthology.orchestra.run.smithi032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-20T13:14:12.986 DEBUG:teuthology.orchestra.run.smithi032:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-20T13:14:13.056 DEBUG:teuthology.orchestra.run.smithi032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-20T13:14:13.133 DEBUG:teuthology.orchestra.run.smithi032:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-20T13:14:13.218 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:14:13.219 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-20T13:14:13.288 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-20T13:14:13.365 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-20T13:14:13.448 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-20T13:14:13.523 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-20T13:14:13.591 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:14:13.592 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-20T13:14:13.661 DEBUG:teuthology.orchestra.run.smithi032:> sudo service rsyslog restart 2023-06-20T13:14:13.666 DEBUG:teuthology.orchestra.run.smithi115:> sudo service rsyslog restart 2023-06-20T13:14:13.767 INFO:teuthology.orchestra.run.smithi032.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-06-20T13:14:13.816 INFO:teuthology.orchestra.run.smithi115.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-06-20T13:14:14.303 INFO:teuthology.run_tasks:Running task internal.timer... 2023-06-20T13:14:14.312 INFO:teuthology.task.internal:Starting timer... 2023-06-20T13:14:14.312 INFO:teuthology.run_tasks:Running task pcp... 2023-06-20T13:14:14.322 INFO:teuthology.run_tasks:Running task selinux... 2023-06-20T13:14:14.358 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-06-20T13:14:14.359 DEBUG:teuthology.orchestra.run.smithi032:> sudo service auditd rotate 2023-06-20T13:14:14.495 INFO:teuthology.orchestra.run.smithi032.stdout:Rotating logs: 2023-06-20T13:14:14.498 DEBUG:teuthology.orchestra.run.smithi115:> sudo service auditd rotate 2023-06-20T13:14:14.637 INFO:teuthology.orchestra.run.smithi115.stdout:Rotating logs: 2023-06-20T13:14:14.640 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-06-20T13:14:14.641 DEBUG:teuthology.orchestra.run.smithi032:> /usr/sbin/getenforce 2023-06-20T13:14:14.693 INFO:teuthology.orchestra.run.smithi032.stdout:Permissive 2023-06-20T13:14:14.694 DEBUG:teuthology.orchestra.run.smithi115:> /usr/sbin/getenforce 2023-06-20T13:14:14.746 INFO:teuthology.orchestra.run.smithi115.stdout:Permissive 2023-06-20T13:14:14.746 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi032.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi115.front.sepia.ceph.com': 'permissive'} 2023-06-20T13:14:14.747 DEBUG:teuthology.orchestra.run.smithi032:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-06-20T13:14:14.817 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-20T13:14:14.818 DEBUG:teuthology.orchestra.run.smithi115:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-06-20T13:14:14.886 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-20T13:14:14.887 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-06-20T13:14:14.887 DEBUG:teuthology.orchestra.run.smithi032:> sudo /usr/sbin/setenforce permissive 2023-06-20T13:14:14.957 DEBUG:teuthology.orchestra.run.smithi115:> sudo /usr/sbin/setenforce permissive 2023-06-20T13:14:15.025 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-06-20T13:14:15.034 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-06-20T13:14:15.035 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-06-20T13:14:15.058 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-06-20T13:14:15.060 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi032.front.sepia.ceph.com,smithi115.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-06-20T13:24:11.635 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi032.front.sepia.ceph.com'), Remote(name='ubuntu@smithi115.front.sepia.ceph.com')] 2023-06-20T13:24:11.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-06-20T13:24:11.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T13:24:11.723 DEBUG:teuthology.orchestra.run.smithi032:> true 2023-06-20T13:24:11.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2023-06-20T13:24:11.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T13:24:11.919 DEBUG:teuthology.orchestra.run.smithi115:> true 2023-06-20T13:24:12.033 INFO:teuthology.run_tasks:Running task clock... 2023-06-20T13:24:12.045 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-06-20T13:24:12.045 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-20T13:24:12.046 DEBUG:teuthology.orchestra.run.smithi032:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-20T13:24:12.050 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-20T13:24:12.050 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-20T13:24:12.123 INFO:teuthology.orchestra.run.smithi032.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-06-20T13:24:12.148 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-06-20T13:24:12.157 INFO:teuthology.orchestra.run.smithi032.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-06-20T13:24:12.180 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-06-20T13:24:12.247 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: ntpd: command not found 2023-06-20T13:24:12.269 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: ntpd: command not found 2023-06-20T13:24:12.275 INFO:teuthology.orchestra.run.smithi032.stdout:506 Cannot talk to daemon 2023-06-20T13:24:12.296 INFO:teuthology.orchestra.run.smithi115.stdout:506 Cannot talk to daemon 2023-06-20T13:24:12.308 INFO:teuthology.orchestra.run.smithi032.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-06-20T13:24:12.327 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-06-20T13:24:12.342 INFO:teuthology.orchestra.run.smithi032.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-06-20T13:24:12.359 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-06-20T13:24:12.428 INFO:teuthology.orchestra.run.smithi032.stderr:bash: ntpq: command not found 2023-06-20T13:24:12.435 INFO:teuthology.orchestra.run.smithi032.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-06-20T13:24:12.435 INFO:teuthology.orchestra.run.smithi032.stdout:=============================================================================== 2023-06-20T13:24:12.435 INFO:teuthology.orchestra.run.smithi032.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-20T13:24:12.435 INFO:teuthology.orchestra.run.smithi032.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-20T13:24:12.435 INFO:teuthology.orchestra.run.smithi032.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-20T13:24:12.435 INFO:teuthology.orchestra.run.smithi032.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-20T13:24:12.458 INFO:teuthology.orchestra.run.smithi115.stderr:bash: ntpq: command not found 2023-06-20T13:24:12.465 INFO:teuthology.orchestra.run.smithi115.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-06-20T13:24:12.465 INFO:teuthology.orchestra.run.smithi115.stdout:=============================================================================== 2023-06-20T13:24:12.465 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-20T13:24:12.465 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-20T13:24:12.465 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-20T13:24:12.465 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-20T13:24:12.466 INFO:teuthology.run_tasks:Running task install... 2023-06-20T13:24:12.475 DEBUG:teuthology.task.install:project ceph 2023-06-20T13:24:12.475 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2016e3af238feea2bbee7eb0e99c925a041afbfb'}} 2023-06-20T13:24:12.476 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2016e3af238feea2bbee7eb0e99c925a041afbfb'} 2023-06-20T13:24:12.476 INFO:teuthology.task.install:Using flavor: default 2023-06-20T13:24:12.482 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-06-20T13:24:12.482 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-06-20T13:24:12.483 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2016e3af238feea2bbee7eb0e99c925a041afbfb', 'tag': None, 'wait_for_package': False} 2023-06-20T13:24:12.484 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2016e3af238feea2bbee7eb0e99c925a041afbfb 2023-06-20T13:24:12.486 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2016e3af238feea2bbee7eb0e99c925a041afbfb', 'tag': None, 'wait_for_package': False} 2023-06-20T13:24:12.486 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2016e3af238feea2bbee7eb0e99c925a041afbfb 2023-06-20T13:24:12.630 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230620.052303/2016e3af238feea2bbee7eb0e99c925a041afbfb/centos/8/flavors/default/ 2023-06-20T13:24:12.631 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4512.g2016e3af 2023-06-20T13:24:12.645 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230620.052303/2016e3af238feea2bbee7eb0e99c925a041afbfb/centos/8/flavors/default/ 2023-06-20T13:24:12.645 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4512.g2016e3af 2023-06-20T13:24:12.808 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230620.052303/2016e3af238feea2bbee7eb0e99c925a041afbfb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230620.052303/2016e3af238feea2bbee7eb0e99c925a041afbfb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230620.052303/2016e3af238feea2bbee7eb0e99c925a041afbfb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-06-20T13:24:12.809 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:24:12.810 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-06-20T13:24:12.822 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230620.052303/2016e3af238feea2bbee7eb0e99c925a041afbfb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230620.052303/2016e3af238feea2bbee7eb0e99c925a041afbfb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230620.052303/2016e3af238feea2bbee7eb0e99c925a041afbfb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-06-20T13:24:12.823 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:24:12.823 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-06-20T13:24:12.882 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-06-20T13:24:12.883 DEBUG:teuthology.orchestra.run.smithi032:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2016e3af238feea2bbee7eb0e99c925a041afbfb/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-06-20T13:24:12.892 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-06-20T13:24:12.893 DEBUG:teuthology.orchestra.run.smithi115:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2016e3af238feea2bbee7eb0e99c925a041afbfb/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-06-20T13:24:12.994 DEBUG:teuthology.orchestra.run.smithi032:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-06-20T13:24:13.002 DEBUG:teuthology.orchestra.run.smithi115:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-06-20T13:24:13.090 DEBUG:teuthology.orchestra.run.smithi032:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-06-20T13:24:13.094 DEBUG:teuthology.orchestra.run.smithi115:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-06-20T13:24:13.158 INFO:teuthology.orchestra.run.smithi032.stdout:check_obsoletes = 1 2023-06-20T13:24:13.161 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum clean all 2023-06-20T13:24:13.163 INFO:teuthology.orchestra.run.smithi115.stdout:check_obsoletes = 1 2023-06-20T13:24:13.166 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum clean all 2023-06-20T13:24:13.503 INFO:teuthology.orchestra.run.smithi115.stdout:67 files removed 2023-06-20T13:24:13.518 INFO:teuthology.orchestra.run.smithi032.stdout:67 files removed 2023-06-20T13:24:13.539 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-06-20T13:24:13.553 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-06-20T13:24:14.381 INFO:teuthology.orchestra.run.smithi032.stdout:ceph packages for x86_64 306 kB/s | 81 kB 00:00 2023-06-20T13:24:14.485 INFO:teuthology.orchestra.run.smithi115.stdout:ceph packages for x86_64 196 kB/s | 81 kB 00:00 2023-06-20T13:24:14.665 INFO:teuthology.orchestra.run.smithi032.stdout:ceph noarch packages 39 kB/s | 9.4 kB 00:00 2023-06-20T13:24:14.894 INFO:teuthology.orchestra.run.smithi115.stdout:ceph noarch packages 25 kB/s | 9.4 kB 00:00 2023-06-20T13:24:14.966 INFO:teuthology.orchestra.run.smithi032.stdout:ceph source packages 5.5 kB/s | 1.5 kB 00:00 2023-06-20T13:24:15.253 INFO:teuthology.orchestra.run.smithi115.stdout:ceph source packages 4.5 kB/s | 1.5 kB 00:00 2023-06-20T13:24:18.477 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 8 - AppStream 9.3 MB/s | 30 MB 00:03 2023-06-20T13:24:18.482 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 8 - AppStream 8.5 MB/s | 30 MB 00:03 2023-06-20T13:24:27.085 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 8 - BaseOS 13 MB/s | 39 MB 00:02 2023-06-20T13:24:27.283 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 8 - BaseOS 15 MB/s | 39 MB 00:02 2023-06-20T13:24:33.393 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 8 - Extras 47 kB/s | 18 kB 00:00 2023-06-20T13:24:33.969 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 8 - Extras common packages 16 kB/s | 6.6 kB 00:00 2023-06-20T13:24:34.041 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 8 - Extras 50 kB/s | 18 kB 00:00 2023-06-20T13:24:34.608 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.6 kB 00:00 2023-06-20T13:24:34.737 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 8 - PowerTools 9.6 MB/s | 6.0 MB 00:00 2023-06-20T13:24:35.527 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS Stream 8 - PowerTools 7.9 MB/s | 6.0 MB 00:00 2023-06-20T13:24:38.530 INFO:teuthology.orchestra.run.smithi115.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-06-20T13:24:38.753 INFO:teuthology.orchestra.run.smithi032.stdout:Copr repo for python3-asyncssh owned by ceph 1.9 kB/s | 3.5 kB 00:01 2023-06-20T13:24:40.420 INFO:teuthology.orchestra.run.smithi032.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2023-06-20T13:24:41.790 INFO:teuthology.orchestra.run.smithi115.stdout:Extra Packages for Enterprise Linux 5.0 MB/s | 16 MB 00:03 2023-06-20T13:24:45.012 INFO:teuthology.orchestra.run.smithi032.stdout:lab-extras 418 kB/s | 24 kB 00:00 2023-06-20T13:24:46.138 INFO:teuthology.orchestra.run.smithi115.stdout:lab-extras 197 kB/s | 24 kB 00:00 2023-06-20T13:24:49.170 INFO:teuthology.orchestra.run.smithi032.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-20T13:24:49.171 INFO:teuthology.orchestra.run.smithi032.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-20T13:24:49.184 INFO:teuthology.orchestra.run.smithi032.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-06-20T13:24:49.184 INFO:teuthology.orchestra.run.smithi032.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-06-20T13:24:49.185 INFO:teuthology.orchestra.run.smithi032.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-06-20T13:24:49.186 INFO:teuthology.orchestra.run.smithi032.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-06-20T13:24:49.187 INFO:teuthology.orchestra.run.smithi032.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-06-20T13:24:49.189 INFO:teuthology.orchestra.run.smithi032.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-06-20T13:24:49.192 INFO:teuthology.orchestra.run.smithi032.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-06-20T13:24:49.193 INFO:teuthology.orchestra.run.smithi032.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-06-20T13:24:49.394 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2023-06-20T13:24:49.409 INFO:teuthology.orchestra.run.smithi032.stdout:==================================================================================================== 2023-06-20T13:24:49.409 INFO:teuthology.orchestra.run.smithi032.stdout: Package Arch Version Repository Size 2023-06-20T13:24:49.409 INFO:teuthology.orchestra.run.smithi032.stdout:==================================================================================================== 2023-06-20T13:24:49.410 INFO:teuthology.orchestra.run.smithi032.stdout:Installing: 2023-06-20T13:24:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-06-20T13:24:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: ceph x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 6.4 k 2023-06-20T13:24:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-base x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 5.4 M 2023-06-20T13:24:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-fuse x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 848 k 2023-06-20T13:24:49.410 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 165 k 2023-06-20T13:24:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 1.5 M 2023-06-20T13:24:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 128 k 2023-06-20T13:24:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 1.7 M 2023-06-20T13:24:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 7.4 M 2023-06-20T13:24:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-rook noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 47 k 2023-06-20T13:24:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-radosgw x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 13 M 2023-06-20T13:24:49.411 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-test x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 48 M 2023-06-20T13:24:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-volume noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 258 k 2023-06-20T13:24:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: cephadm noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 164 k 2023-06-20T13:24:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: cephfs-mirror x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 258 k 2023-06-20T13:24:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: cephfs-top noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 18 k 2023-06-20T13:24:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-06-20T13:24:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-06-20T13:24:49.412 INFO:teuthology.orchestra.run.smithi032.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-06-20T13:24:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs-devel x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 31 k 2023-06-20T13:24:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs2 x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 771 k 2023-06-20T13:24:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: librados-devel x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 139 k 2023-06-20T13:24:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-06-20T13:24:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-06-20T13:24:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-06-20T13:24:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-06-20T13:24:49.413 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-06-20T13:24:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-06-20T13:24:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cephfs x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 197 k 2023-06-20T13:24:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rados x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 371 k 2023-06-20T13:24:49.414 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rbd x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 364 k 2023-06-20T13:24:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rgw x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 106 k 2023-06-20T13:24:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-fuse x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 94 k 2023-06-20T13:24:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-mirror x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 3.4 M 2023-06-20T13:24:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-nbd x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 180 k 2023-06-20T13:24:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-06-20T13:24:49.415 INFO:teuthology.orchestra.run.smithi032.stdout:Upgrading: 2023-06-20T13:24:49.415 INFO:teuthology.orchestra.run.smithi032.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-7.el8 baseos 143 k 2023-06-20T13:24:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-06-20T13:24:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-06-20T13:24:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-06-20T13:24:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-06-20T13:24:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-06-20T13:24:49.416 INFO:teuthology.orchestra.run.smithi032.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-06-20T13:24:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-06-20T13:24:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: librados2 x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 3.7 M 2023-06-20T13:24:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: librbd1 x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 3.6 M 2023-06-20T13:24:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-06-20T13:24:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-06-20T13:24:49.417 INFO:teuthology.orchestra.run.smithi032.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-06-20T13:24:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-06-20T13:24:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-06-20T13:24:49.418 INFO:teuthology.orchestra.run.smithi032.stdout:Installing dependencies: 2023-06-20T13:24:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-06-20T13:24:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-common x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 22 M 2023-06-20T13:24:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 23 k 2023-06-20T13:24:49.418 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mds x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 2.3 M 2023-06-20T13:24:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 240 k 2023-06-20T13:24:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mon x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 4.6 M 2023-06-20T13:24:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-osd x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 18 M 2023-06-20T13:24:49.419 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 15 k 2023-06-20T13:24:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-selinux x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 24 k 2023-06-20T13:24:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-06-20T13:24:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-06-20T13:24:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-06-20T13:24:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-06-20T13:24:49.420 INFO:teuthology.orchestra.run.smithi032.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-06-20T13:24:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: libcephsqlite x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 137 k 2023-06-20T13:24:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-06-20T13:24:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: libgfortran x86_64 8.5.0-19.el8 baseos 645 k 2023-06-20T13:24:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-06-20T13:24:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-06-20T13:24:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: libquadmath x86_64 8.5.0-19.el8 baseos 172 k 2023-06-20T13:24:49.421 INFO:teuthology.orchestra.run.smithi032.stdout: librabbitmq x86_64 0.9.0-3.el8 baseos 47 k 2023-06-20T13:24:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: libradosstriper1 x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 473 k 2023-06-20T13:24:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-06-20T13:24:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: librgw2 x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 6.7 M 2023-06-20T13:24:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-06-20T13:24:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-06-20T13:24:49.422 INFO:teuthology.orchestra.run.smithi032.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-06-20T13:24:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-06-20T13:24:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-06-20T13:24:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-06-20T13:24:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-06-20T13:24:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-06-20T13:24:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-06-20T13:24:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-06-20T13:24:49.423 INFO:teuthology.orchestra.run.smithi032.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-06-20T13:24:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-06-20T13:24:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-06-20T13:24:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-06-20T13:24:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-06-20T13:24:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-06-20T13:24:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-06-20T13:24:49.424 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-argparse x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 45 k 2023-06-20T13:24:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-common x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 119 k 2023-06-20T13:24:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-06-20T13:24:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-06-20T13:24:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-06-20T13:24:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-06-20T13:24:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-06-20T13:24:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-06-20T13:24:49.425 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-06-20T13:24:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-06-20T13:24:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-06-20T13:24:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-06-20T13:24:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-06-20T13:24:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-06-20T13:24:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-06-20T13:24:49.426 INFO:teuthology.orchestra.run.smithi032.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-06-20T13:24:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-06-20T13:24:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-06-20T13:24:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-06-20T13:24:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-06-20T13:24:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-06-20T13:24:49.427 INFO:teuthology.orchestra.run.smithi032.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-06-20T13:24:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-06-20T13:24:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-06-20T13:24:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-06-20T13:24:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-06-20T13:24:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-06-20T13:24:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-06-20T13:24:49.428 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-06-20T13:24:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-06-20T13:24:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-06-20T13:24:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-06-20T13:24:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-06-20T13:24:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-06-20T13:24:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-06-20T13:24:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-06-20T13:24:49.429 INFO:teuthology.orchestra.run.smithi032.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-06-20T13:24:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-06-20T13:24:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-06-20T13:24:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-06-20T13:24:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-06-20T13:24:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-06-20T13:24:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-06-20T13:24:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-06-20T13:24:49.430 INFO:teuthology.orchestra.run.smithi032.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-06-20T13:24:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-06-20T13:24:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-06-20T13:24:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-06-20T13:24:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-06-20T13:24:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-06-20T13:24:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-06-20T13:24:49.431 INFO:teuthology.orchestra.run.smithi032.stdout:Enabling module streams: 2023-06-20T13:24:49.431 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql 10 2023-06-20T13:24:49.432 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:24:49.432 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction Summary 2023-06-20T13:24:49.432 INFO:teuthology.orchestra.run.smithi032.stdout:==================================================================================================== 2023-06-20T13:24:49.432 INFO:teuthology.orchestra.run.smithi032.stdout:Install 128 Packages 2023-06-20T13:24:49.432 INFO:teuthology.orchestra.run.smithi032.stdout:Upgrade 15 Packages 2023-06-20T13:24:49.432 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:24:49.433 INFO:teuthology.orchestra.run.smithi032.stdout:Total download size: 212 M 2023-06-20T13:24:49.433 INFO:teuthology.orchestra.run.smithi032.stdout:Downloading Packages: 2023-06-20T13:24:50.003 INFO:teuthology.orchestra.run.smithi115.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-20T13:24:50.004 INFO:teuthology.orchestra.run.smithi115.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-20T13:24:50.016 INFO:teuthology.orchestra.run.smithi115.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-06-20T13:24:50.016 INFO:teuthology.orchestra.run.smithi115.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-06-20T13:24:50.017 INFO:teuthology.orchestra.run.smithi115.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-06-20T13:24:50.018 INFO:teuthology.orchestra.run.smithi115.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-06-20T13:24:50.019 INFO:teuthology.orchestra.run.smithi115.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-06-20T13:24:50.021 INFO:teuthology.orchestra.run.smithi115.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-06-20T13:24:50.023 INFO:teuthology.orchestra.run.smithi115.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-06-20T13:24:50.024 INFO:teuthology.orchestra.run.smithi115.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-06-20T13:24:50.210 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2023-06-20T13:24:50.224 INFO:teuthology.orchestra.run.smithi115.stdout:==================================================================================================== 2023-06-20T13:24:50.224 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2023-06-20T13:24:50.224 INFO:teuthology.orchestra.run.smithi115.stdout:==================================================================================================== 2023-06-20T13:24:50.224 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2023-06-20T13:24:50.225 INFO:teuthology.orchestra.run.smithi115.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-06-20T13:24:50.225 INFO:teuthology.orchestra.run.smithi115.stdout: ceph x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 6.4 k 2023-06-20T13:24:50.225 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 5.4 M 2023-06-20T13:24:50.225 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 848 k 2023-06-20T13:24:50.225 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 165 k 2023-06-20T13:24:50.225 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 1.5 M 2023-06-20T13:24:50.225 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 128 k 2023-06-20T13:24:50.226 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 1.7 M 2023-06-20T13:24:50.226 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 7.4 M 2023-06-20T13:24:50.226 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 47 k 2023-06-20T13:24:50.226 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 13 M 2023-06-20T13:24:50.226 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 48 M 2023-06-20T13:24:50.226 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-volume noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 258 k 2023-06-20T13:24:50.226 INFO:teuthology.orchestra.run.smithi115.stdout: cephadm noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 164 k 2023-06-20T13:24:50.226 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-mirror x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 258 k 2023-06-20T13:24:50.227 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-top noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 18 k 2023-06-20T13:24:50.227 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-06-20T13:24:50.227 INFO:teuthology.orchestra.run.smithi115.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-06-20T13:24:50.227 INFO:teuthology.orchestra.run.smithi115.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-06-20T13:24:50.227 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 31 k 2023-06-20T13:24:50.227 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2 x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 771 k 2023-06-20T13:24:50.227 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 139 k 2023-06-20T13:24:50.227 INFO:teuthology.orchestra.run.smithi115.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-06-20T13:24:50.228 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-06-20T13:24:50.228 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-06-20T13:24:50.228 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-06-20T13:24:50.228 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-06-20T13:24:50.228 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-06-20T13:24:50.228 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cephfs x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 197 k 2023-06-20T13:24:50.228 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 371 k 2023-06-20T13:24:50.228 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rbd x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 364 k 2023-06-20T13:24:50.229 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rgw x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 106 k 2023-06-20T13:24:50.229 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 94 k 2023-06-20T13:24:50.229 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-mirror x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 3.4 M 2023-06-20T13:24:50.229 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-nbd x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 180 k 2023-06-20T13:24:50.229 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-06-20T13:24:50.229 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrading: 2023-06-20T13:24:50.229 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-7.el8 baseos 143 k 2023-06-20T13:24:50.230 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-06-20T13:24:50.230 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-06-20T13:24:50.230 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-06-20T13:24:50.230 INFO:teuthology.orchestra.run.smithi115.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-06-20T13:24:50.230 INFO:teuthology.orchestra.run.smithi115.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-06-20T13:24:50.230 INFO:teuthology.orchestra.run.smithi115.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-06-20T13:24:50.230 INFO:teuthology.orchestra.run.smithi115.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-06-20T13:24:50.230 INFO:teuthology.orchestra.run.smithi115.stdout: librados2 x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 3.7 M 2023-06-20T13:24:50.231 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1 x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 3.6 M 2023-06-20T13:24:50.231 INFO:teuthology.orchestra.run.smithi115.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-06-20T13:24:50.231 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-06-20T13:24:50.231 INFO:teuthology.orchestra.run.smithi115.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-06-20T13:24:50.231 INFO:teuthology.orchestra.run.smithi115.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-06-20T13:24:50.231 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-06-20T13:24:50.231 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2023-06-20T13:24:50.232 INFO:teuthology.orchestra.run.smithi115.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-06-20T13:24:50.232 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 22 M 2023-06-20T13:24:50.232 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 23 k 2023-06-20T13:24:50.232 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 2.3 M 2023-06-20T13:24:50.232 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 240 k 2023-06-20T13:24:50.233 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 4.6 M 2023-06-20T13:24:50.233 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 18 M 2023-06-20T13:24:50.233 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 15 k 2023-06-20T13:24:50.233 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 24 k 2023-06-20T13:24:50.233 INFO:teuthology.orchestra.run.smithi115.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-06-20T13:24:50.233 INFO:teuthology.orchestra.run.smithi115.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-06-20T13:24:50.233 INFO:teuthology.orchestra.run.smithi115.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-06-20T13:24:50.233 INFO:teuthology.orchestra.run.smithi115.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-06-20T13:24:50.234 INFO:teuthology.orchestra.run.smithi115.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-06-20T13:24:50.234 INFO:teuthology.orchestra.run.smithi115.stdout: libcephsqlite x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 137 k 2023-06-20T13:24:50.234 INFO:teuthology.orchestra.run.smithi115.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-06-20T13:24:50.234 INFO:teuthology.orchestra.run.smithi115.stdout: libgfortran x86_64 8.5.0-19.el8 baseos 645 k 2023-06-20T13:24:50.234 INFO:teuthology.orchestra.run.smithi115.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-06-20T13:24:50.234 INFO:teuthology.orchestra.run.smithi115.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-06-20T13:24:50.234 INFO:teuthology.orchestra.run.smithi115.stdout: libquadmath x86_64 8.5.0-19.el8 baseos 172 k 2023-06-20T13:24:50.234 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq x86_64 0.9.0-3.el8 baseos 47 k 2023-06-20T13:24:50.235 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1 x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 473 k 2023-06-20T13:24:50.235 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-06-20T13:24:50.235 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2 x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 6.7 M 2023-06-20T13:24:50.235 INFO:teuthology.orchestra.run.smithi115.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-06-20T13:24:50.235 INFO:teuthology.orchestra.run.smithi115.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-06-20T13:24:50.235 INFO:teuthology.orchestra.run.smithi115.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-06-20T13:24:50.235 INFO:teuthology.orchestra.run.smithi115.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-06-20T13:24:50.235 INFO:teuthology.orchestra.run.smithi115.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-06-20T13:24:50.236 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-06-20T13:24:50.236 INFO:teuthology.orchestra.run.smithi115.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-06-20T13:24:50.236 INFO:teuthology.orchestra.run.smithi115.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-06-20T13:24:50.236 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-06-20T13:24:50.236 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-06-20T13:24:50.236 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-06-20T13:24:50.236 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-06-20T13:24:50.237 INFO:teuthology.orchestra.run.smithi115.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-06-20T13:24:50.237 INFO:teuthology.orchestra.run.smithi115.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-06-20T13:24:50.237 INFO:teuthology.orchestra.run.smithi115.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-06-20T13:24:50.237 INFO:teuthology.orchestra.run.smithi115.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-06-20T13:24:50.237 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-06-20T13:24:50.237 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 45 k 2023-06-20T13:24:50.237 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 119 k 2023-06-20T13:24:50.237 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-06-20T13:24:50.238 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-06-20T13:24:50.238 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-06-20T13:24:50.238 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-06-20T13:24:50.238 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-06-20T13:24:50.238 INFO:teuthology.orchestra.run.smithi115.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-06-20T13:24:50.238 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-06-20T13:24:50.238 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-06-20T13:24:50.238 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-06-20T13:24:50.239 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-06-20T13:24:50.239 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-06-20T13:24:50.239 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-06-20T13:24:50.239 INFO:teuthology.orchestra.run.smithi115.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-06-20T13:24:50.239 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-06-20T13:24:50.239 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-06-20T13:24:50.239 INFO:teuthology.orchestra.run.smithi115.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-06-20T13:24:50.239 INFO:teuthology.orchestra.run.smithi115.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-06-20T13:24:50.240 INFO:teuthology.orchestra.run.smithi115.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-06-20T13:24:50.240 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-06-20T13:24:50.240 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-06-20T13:24:50.240 INFO:teuthology.orchestra.run.smithi115.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-06-20T13:24:50.240 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-06-20T13:24:50.240 INFO:teuthology.orchestra.run.smithi115.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-06-20T13:24:50.240 INFO:teuthology.orchestra.run.smithi115.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-06-20T13:24:50.240 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-06-20T13:24:50.241 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-06-20T13:24:50.241 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-06-20T13:24:50.241 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-06-20T13:24:50.241 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-06-20T13:24:50.241 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-06-20T13:24:50.241 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-06-20T13:24:50.241 INFO:teuthology.orchestra.run.smithi115.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-06-20T13:24:50.241 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-06-20T13:24:50.242 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-06-20T13:24:50.242 INFO:teuthology.orchestra.run.smithi115.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-06-20T13:24:50.242 INFO:teuthology.orchestra.run.smithi115.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-06-20T13:24:50.242 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-06-20T13:24:50.242 INFO:teuthology.orchestra.run.smithi115.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-06-20T13:24:50.242 INFO:teuthology.orchestra.run.smithi115.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-06-20T13:24:50.242 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-06-20T13:24:50.243 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-06-20T13:24:50.243 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-06-20T13:24:50.243 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-06-20T13:24:50.243 INFO:teuthology.orchestra.run.smithi115.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-06-20T13:24:50.243 INFO:teuthology.orchestra.run.smithi115.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-06-20T13:24:50.243 INFO:teuthology.orchestra.run.smithi115.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-06-20T13:24:50.243 INFO:teuthology.orchestra.run.smithi115.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-06-20T13:24:50.243 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-06-20T13:24:50.244 INFO:teuthology.orchestra.run.smithi115.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-06-20T13:24:50.244 INFO:teuthology.orchestra.run.smithi115.stdout:Enabling module streams: 2023-06-20T13:24:50.244 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql 10 2023-06-20T13:24:50.244 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:24:50.244 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2023-06-20T13:24:50.244 INFO:teuthology.orchestra.run.smithi115.stdout:==================================================================================================== 2023-06-20T13:24:50.244 INFO:teuthology.orchestra.run.smithi115.stdout:Install 128 Packages 2023-06-20T13:24:50.244 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrade 15 Packages 2023-06-20T13:24:50.245 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:24:50.245 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 212 M 2023-06-20T13:24:50.245 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2023-06-20T13:24:50.247 INFO:teuthology.orchestra.run.smithi032.stdout:(1/143): ceph-18.0.0-4512.g2016e3af.el8.x86_64. 28 kB/s | 6.4 kB 00:00 2023-06-20T13:24:50.631 INFO:teuthology.orchestra.run.smithi032.stdout:(2/143): ceph-fuse-18.0.0-4512.g2016e3af.el8.x8 2.2 MB/s | 848 kB 00:00 2023-06-20T13:24:50.714 INFO:teuthology.orchestra.run.smithi032.stdout:(3/143): ceph-immutable-object-cache-18.0.0-451 2.0 MB/s | 165 kB 00:00 2023-06-20T13:24:50.780 INFO:teuthology.orchestra.run.smithi115.stdout:(1/143): ceph-18.0.0-4512.g2016e3af.el8.x86_64. 30 kB/s | 6.4 kB 00:00 2023-06-20T13:24:51.381 INFO:teuthology.orchestra.run.smithi032.stdout:(4/143): ceph-mds-18.0.0-4512.g2016e3af.el8.x86 3.4 MB/s | 2.3 MB 00:00 2023-06-20T13:24:51.589 INFO:teuthology.orchestra.run.smithi032.stdout:(5/143): ceph-base-18.0.0-4512.g2016e3af.el8.x8 3.4 MB/s | 5.4 MB 00:01 2023-06-20T13:24:51.631 INFO:teuthology.orchestra.run.smithi115.stdout:(2/143): ceph-fuse-18.0.0-4512.g2016e3af.el8.x8 998 kB/s | 848 kB 00:00 2023-06-20T13:24:51.772 INFO:teuthology.orchestra.run.smithi115.stdout:(3/143): ceph-immutable-object-cache-18.0.0-451 1.1 MB/s | 165 kB 00:00 2023-06-20T13:24:51.823 INFO:teuthology.orchestra.run.smithi032.stdout:(6/143): ceph-common-18.0.0-4512.g2016e3af.el8. 12 MB/s | 22 MB 00:01 2023-06-20T13:24:51.873 INFO:teuthology.orchestra.run.smithi032.stdout:(7/143): ceph-mgr-18.0.0-4512.g2016e3af.el8.x86 3.1 MB/s | 1.5 MB 00:00 2023-06-20T13:24:52.565 INFO:teuthology.orchestra.run.smithi032.stdout:(8/143): ceph-mon-18.0.0-4512.g2016e3af.el8.x86 4.7 MB/s | 4.6 MB 00:00 2023-06-20T13:24:52.674 INFO:teuthology.orchestra.run.smithi032.stdout:(9/143): ceph-selinux-18.0.0-4512.g2016e3af.el8 225 kB/s | 24 kB 00:00 2023-06-20T13:24:53.166 INFO:teuthology.orchestra.run.smithi032.stdout:(10/143): ceph-osd-18.0.0-4512.g2016e3af.el8.x8 13 MB/s | 18 MB 00:01 2023-06-20T13:24:53.249 INFO:teuthology.orchestra.run.smithi032.stdout:(11/143): cephfs-mirror-18.0.0-4512.g2016e3af.e 3.0 MB/s | 258 kB 00:00 2023-06-20T13:24:53.276 INFO:teuthology.orchestra.run.smithi115.stdout:(4/143): ceph-mds-18.0.0-4512.g2016e3af.el8.x86 1.5 MB/s | 2.3 MB 00:01 2023-06-20T13:24:53.316 INFO:teuthology.orchestra.run.smithi032.stdout:(12/143): libcephfs-devel-18.0.0-4512.g2016e3af 466 kB/s | 31 kB 00:00 2023-06-20T13:24:53.408 INFO:teuthology.orchestra.run.smithi032.stdout:(13/143): libcephfs2-18.0.0-4512.g2016e3af.el8. 8.2 MB/s | 771 kB 00:00 2023-06-20T13:24:53.459 INFO:teuthology.orchestra.run.smithi032.stdout:(14/143): libcephsqlite-18.0.0-4512.g2016e3af.e 2.7 MB/s | 137 kB 00:00 2023-06-20T13:24:53.509 INFO:teuthology.orchestra.run.smithi032.stdout:(15/143): librados-devel-18.0.0-4512.g2016e3af. 2.7 MB/s | 139 kB 00:00 2023-06-20T13:24:53.584 INFO:teuthology.orchestra.run.smithi032.stdout:(16/143): libradosstriper1-18.0.0-4512.g2016e3a 6.2 MB/s | 473 kB 00:00 2023-06-20T13:24:53.914 INFO:teuthology.orchestra.run.smithi115.stdout:(5/143): ceph-mgr-18.0.0-4512.g2016e3af.el8.x86 2.4 MB/s | 1.5 MB 00:00 2023-06-20T13:24:53.998 INFO:teuthology.orchestra.run.smithi115.stdout:(6/143): ceph-base-18.0.0-4512.g2016e3af.el8.x8 1.6 MB/s | 5.4 MB 00:03 2023-06-20T13:24:54.184 INFO:teuthology.orchestra.run.smithi032.stdout:(17/143): librgw2-18.0.0-4512.g2016e3af.el8.x86 11 MB/s | 6.7 MB 00:00 2023-06-20T13:24:54.251 INFO:teuthology.orchestra.run.smithi032.stdout:(18/143): python3-ceph-argparse-18.0.0-4512.g20 675 kB/s | 45 kB 00:00 2023-06-20T13:24:54.310 INFO:teuthology.orchestra.run.smithi032.stdout:(19/143): python3-ceph-common-18.0.0-4512.g2016 2.0 MB/s | 119 kB 00:00 2023-06-20T13:24:54.377 INFO:teuthology.orchestra.run.smithi032.stdout:(20/143): python3-cephfs-18.0.0-4512.g2016e3af. 2.9 MB/s | 197 kB 00:00 2023-06-20T13:24:54.444 INFO:teuthology.orchestra.run.smithi032.stdout:(21/143): python3-rados-18.0.0-4512.g2016e3af.e 5.4 MB/s | 371 kB 00:00 2023-06-20T13:24:54.519 INFO:teuthology.orchestra.run.smithi032.stdout:(22/143): python3-rbd-18.0.0-4512.g2016e3af.el8 4.8 MB/s | 364 kB 00:00 2023-06-20T13:24:54.586 INFO:teuthology.orchestra.run.smithi032.stdout:(23/143): python3-rgw-18.0.0-4512.g2016e3af.el8 1.6 MB/s | 106 kB 00:00 2023-06-20T13:24:54.645 INFO:teuthology.orchestra.run.smithi032.stdout:(24/143): rbd-fuse-18.0.0-4512.g2016e3af.el8.x8 1.6 MB/s | 94 kB 00:00 2023-06-20T13:24:54.995 INFO:teuthology.orchestra.run.smithi032.stdout:(25/143): ceph-radosgw-18.0.0-4512.g2016e3af.el 4.3 MB/s | 13 MB 00:03 2023-06-20T13:24:55.070 INFO:teuthology.orchestra.run.smithi032.stdout:(26/143): rbd-mirror-18.0.0-4512.g2016e3af.el8. 8.1 MB/s | 3.4 MB 00:00 2023-06-20T13:24:55.104 INFO:teuthology.orchestra.run.smithi032.stdout:(27/143): rbd-nbd-18.0.0-4512.g2016e3af.el8.x86 1.6 MB/s | 180 kB 00:00 2023-06-20T13:24:55.129 INFO:teuthology.orchestra.run.smithi032.stdout:(28/143): ceph-grafana-dashboards-18.0.0-4512.g 393 kB/s | 23 kB 00:00 2023-06-20T13:24:55.196 INFO:teuthology.orchestra.run.smithi032.stdout:(29/143): ceph-mgr-cephadm-18.0.0-4512.g2016e3a 1.4 MB/s | 128 kB 00:00 2023-06-20T13:24:55.322 INFO:teuthology.orchestra.run.smithi032.stdout:(30/143): ceph-mgr-dashboard-18.0.0-4512.g2016e 8.9 MB/s | 1.7 MB 00:00 2023-06-20T13:24:55.397 INFO:teuthology.orchestra.run.smithi032.stdout:(31/143): ceph-mgr-modules-core-18.0.0-4512.g20 3.1 MB/s | 240 kB 00:00 2023-06-20T13:24:55.472 INFO:teuthology.orchestra.run.smithi032.stdout:(32/143): ceph-mgr-rook-18.0.0-4512.g2016e3af.e 633 kB/s | 47 kB 00:00 2023-06-20T13:24:55.539 INFO:teuthology.orchestra.run.smithi032.stdout:(33/143): ceph-prometheus-alerts-18.0.0-4512.g2 218 kB/s | 15 kB 00:00 2023-06-20T13:24:55.573 INFO:teuthology.orchestra.run.smithi115.stdout:(7/143): ceph-mon-18.0.0-4512.g2016e3af.el8.x86 2.8 MB/s | 4.6 MB 00:01 2023-06-20T13:24:55.598 INFO:teuthology.orchestra.run.smithi032.stdout:(34/143): ceph-volume-18.0.0-4512.g2016e3af.el8 4.3 MB/s | 258 kB 00:00 2023-06-20T13:24:55.681 INFO:teuthology.orchestra.run.smithi032.stdout:(35/143): cephadm-18.0.0-4512.g2016e3af.el8.noa 1.9 MB/s | 164 kB 00:00 2023-06-20T13:24:55.765 INFO:teuthology.orchestra.run.smithi032.stdout:(36/143): cephfs-top-18.0.0-4512.g2016e3af.el8. 216 kB/s | 18 kB 00:00 2023-06-20T13:24:56.124 INFO:teuthology.orchestra.run.smithi032.stdout:(37/143): automake-1.16.1-7.el8.noarch.rpm 1.9 MB/s | 713 kB 00:00 2023-06-20T13:24:56.249 INFO:teuthology.orchestra.run.smithi032.stdout:(38/143): bison-3.0.4-10.el8.x86_64.rpm 5.4 MB/s | 688 kB 00:00 2023-06-20T13:24:56.325 INFO:teuthology.orchestra.run.smithi032.stdout:(39/143): flex-2.6.1-9.el8.x86_64.rpm 4.2 MB/s | 320 kB 00:00 2023-06-20T13:24:56.392 INFO:teuthology.orchestra.run.smithi032.stdout:(40/143): jq-1.6-7.el8.x86_64.rpm 3.0 MB/s | 202 kB 00:00 2023-06-20T13:24:56.431 INFO:teuthology.orchestra.run.smithi115.stdout:(8/143): ceph-osd-18.0.0-4512.g2016e3af.el8.x86 7.3 MB/s | 18 MB 00:02 2023-06-20T13:24:56.459 INFO:teuthology.orchestra.run.smithi032.stdout:(41/143): libpq-13.5-1.el8.x86_64.rpm 2.9 MB/s | 198 kB 00:00 2023-06-20T13:24:56.515 INFO:teuthology.orchestra.run.smithi115.stdout:(9/143): ceph-selinux-18.0.0-4512.g2016e3af.el8 293 kB/s | 24 kB 00:00 2023-06-20T13:24:56.534 INFO:teuthology.orchestra.run.smithi032.stdout:(42/143): librdkafka-0.11.4-3.el8.x86_64.rpm 4.6 MB/s | 354 kB 00:00 2023-06-20T13:24:56.709 INFO:teuthology.orchestra.run.smithi032.stdout:(43/143): ceph-mgr-diskprediction-local-18.0.0- 4.9 MB/s | 7.4 MB 00:01 2023-06-20T13:24:56.743 INFO:teuthology.orchestra.run.smithi032.stdout:(44/143): libtool-2.4.6-25.el8.x86_64.rpm 3.3 MB/s | 709 kB 00:00 2023-06-20T13:24:56.810 INFO:teuthology.orchestra.run.smithi032.stdout:(45/143): oniguruma-6.8.2-2.el8.x86_64.rpm 2.8 MB/s | 187 kB 00:00 2023-06-20T13:24:56.874 INFO:teuthology.orchestra.run.smithi115.stdout:(10/143): ceph-common-18.0.0-4512.g2016e3af.el8 3.5 MB/s | 22 MB 00:06 2023-06-20T13:24:57.040 INFO:teuthology.orchestra.run.smithi115.stdout:(11/143): cephfs-mirror-18.0.0-4512.g2016e3af.e 1.5 MB/s | 258 kB 00:00 2023-06-20T13:24:57.043 INFO:teuthology.orchestra.run.smithi032.stdout:(46/143): lttng-ust-2.8.1-11.el8.x86_64.rpm 778 kB/s | 259 kB 00:00 2023-06-20T13:24:57.141 INFO:teuthology.orchestra.run.smithi115.stdout:(12/143): libcephfs-devel-18.0.0-4512.g2016e3af 311 kB/s | 31 kB 00:00 2023-06-20T13:24:57.302 INFO:teuthology.orchestra.run.smithi032.stdout:(47/143): openblas-0.3.15-4.el8.x86_64.rpm 9.6 MB/s | 4.7 MB 00:00 2023-06-20T13:24:57.358 INFO:teuthology.orchestra.run.smithi115.stdout:(13/143): libcephfs2-18.0.0-4512.g2016e3af.el8. 3.5 MB/s | 771 kB 00:00 2023-06-20T13:24:57.483 INFO:teuthology.orchestra.run.smithi115.stdout:(14/143): libcephsqlite-18.0.0-4512.g2016e3af.e 1.1 MB/s | 137 kB 00:00 2023-06-20T13:24:57.494 INFO:teuthology.orchestra.run.smithi032.stdout:(48/143): postgresql-10.23-1.module_el8+300+2c5 8.2 MB/s | 1.6 MB 00:00 2023-06-20T13:24:57.600 INFO:teuthology.orchestra.run.smithi115.stdout:(15/143): librados-devel-18.0.0-4512.g2016e3af. 1.2 MB/s | 139 kB 00:00 2023-06-20T13:24:57.628 INFO:teuthology.orchestra.run.smithi032.stdout:(49/143): postgresql-contrib-10.23-1.module_el8 6.6 MB/s | 903 kB 00:00 2023-06-20T13:24:57.834 INFO:teuthology.orchestra.run.smithi115.stdout:(16/143): libradosstriper1-18.0.0-4512.g2016e3a 2.0 MB/s | 473 kB 00:00 2023-06-20T13:24:58.120 INFO:teuthology.orchestra.run.smithi032.stdout:(50/143): postgresql-server-10.23-1.module_el8+ 10 MB/s | 5.1 MB 00:00 2023-06-20T13:24:58.528 INFO:teuthology.orchestra.run.smithi032.stdout:(51/143): python3-babel-2.5.1-7.el8.noarch.rpm 12 MB/s | 4.8 MB 00:00 2023-06-20T13:24:58.604 INFO:teuthology.orchestra.run.smithi032.stdout:(52/143): python3-jinja2-2.10.1-3.el8.noarch.rp 7.0 MB/s | 538 kB 00:00 2023-06-20T13:24:58.679 INFO:teuthology.orchestra.run.smithi032.stdout:(53/143): python3-jsonpatch-1.21-2.el8.noarch.r 355 kB/s | 27 kB 00:00 2023-06-20T13:24:58.746 INFO:teuthology.orchestra.run.smithi032.stdout:(54/143): python3-jsonpointer-1.10-11.el8.noarc 298 kB/s | 20 kB 00:00 2023-06-20T13:24:58.871 INFO:teuthology.orchestra.run.smithi032.stdout:(55/143): openblas-threads-0.3.15-4.el8.x86_64. 2.7 MB/s | 4.9 MB 00:01 2023-06-20T13:24:58.897 INFO:teuthology.orchestra.run.smithi032.stdout:(56/143): python3-mako-1.0.6-14.el8.noarch.rpm 1.0 MB/s | 157 kB 00:00 2023-06-20T13:24:58.930 INFO:teuthology.orchestra.run.smithi032.stdout:(57/143): python3-markupsafe-0.23-19.el8.x86_64 663 kB/s | 39 kB 00:00 2023-06-20T13:24:59.014 INFO:teuthology.orchestra.run.smithi032.stdout:(58/143): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.6 MB/s | 225 kB 00:00 2023-06-20T13:24:59.089 INFO:teuthology.orchestra.run.smithi032.stdout:(59/143): python3-prettytable-0.7.2-14.el8.noar 587 kB/s | 44 kB 00:00 2023-06-20T13:24:59.189 INFO:teuthology.orchestra.run.smithi032.stdout:(60/143): python3-numpy-1.14.3-10.el8.x86_64.rp 13 MB/s | 3.7 MB 00:00 2023-06-20T13:24:59.215 INFO:teuthology.orchestra.run.smithi032.stdout:(61/143): python3-pyOpenSSL-19.0.0-1.el8.noarch 825 kB/s | 103 kB 00:00 2023-06-20T13:24:59.257 INFO:teuthology.orchestra.run.smithi032.stdout:(62/143): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.8 MB/s | 126 kB 00:00 2023-06-20T13:24:59.282 INFO:teuthology.orchestra.run.smithi032.stdout:(63/143): python3-pyasn1-modules-0.3.7-6.el8.no 1.6 MB/s | 110 kB 00:00 2023-06-20T13:24:59.308 INFO:teuthology.orchestra.run.smithi115.stdout:(17/143): librgw2-18.0.0-4512.g2016e3af.el8.x86 4.6 MB/s | 6.7 MB 00:01 2023-06-20T13:24:59.316 INFO:teuthology.orchestra.run.smithi032.stdout:(64/143): python3-pytz-2017.2-9.el8.noarch.rpm 917 kB/s | 54 kB 00:00 2023-06-20T13:24:59.383 INFO:teuthology.orchestra.run.smithi032.stdout:(65/143): python3-werkzeug-0.12.2-4.el8.noarch. 6.7 MB/s | 457 kB 00:00 2023-06-20T13:24:59.458 INFO:teuthology.orchestra.run.smithi032.stdout:(66/143): socat-1.7.4.1-1.el8.x86_64.rpm 4.2 MB/s | 323 kB 00:00 2023-06-20T13:24:59.525 INFO:teuthology.orchestra.run.smithi032.stdout:(67/143): uuid-1.6.2-43.el8.x86_64.rpm 957 kB/s | 64 kB 00:00 2023-06-20T13:24:59.592 INFO:teuthology.orchestra.run.smithi032.stdout:(68/143): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.0 MB/s | 71 kB 00:00 2023-06-20T13:24:59.651 INFO:teuthology.orchestra.run.smithi032.stdout:(69/143): elfutils-libelf-devel-0.189-2.el8.x86 1.0 MB/s | 61 kB 00:00 2023-06-20T13:24:59.709 INFO:teuthology.orchestra.run.smithi032.stdout:(70/143): fuse-2.9.7-17.el8.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2023-06-20T13:24:59.751 INFO:teuthology.orchestra.run.smithi115.stdout:(18/143): ceph-test-18.0.0-4512.g2016e3af.el8.x 15 MB/s | 48 MB 00:03 2023-06-20T13:24:59.776 INFO:teuthology.orchestra.run.smithi115.stdout:(19/143): python3-ceph-argparse-18.0.0-4512.g20 96 kB/s | 45 kB 00:00 2023-06-20T13:24:59.776 INFO:teuthology.orchestra.run.smithi032.stdout:(71/143): keyutils-libs-devel-1.5.10-9.el8.x86_ 723 kB/s | 48 kB 00:00 2023-06-20T13:24:59.852 INFO:teuthology.orchestra.run.smithi032.stdout:(72/143): krb5-devel-1.18.2-22.el8.x86_64.rpm 7.3 MB/s | 561 kB 00:00 2023-06-20T13:24:59.919 INFO:teuthology.orchestra.run.smithi032.stdout:(73/143): libaio-devel-0.3.112-1.el8.x86_64.rpm 281 kB/s | 19 kB 00:00 2023-06-20T13:24:59.934 INFO:teuthology.orchestra.run.smithi115.stdout:(20/143): ceph-radosgw-18.0.0-4512.g2016e3af.el 3.1 MB/s | 13 MB 00:04 2023-06-20T13:24:59.951 INFO:teuthology.orchestra.run.smithi115.stdout:(21/143): python3-ceph-common-18.0.0-4512.g2016 594 kB/s | 119 kB 00:00 2023-06-20T13:24:59.976 INFO:teuthology.orchestra.run.smithi115.stdout:(22/143): python3-cephfs-18.0.0-4512.g2016e3af. 986 kB/s | 197 kB 00:00 2023-06-20T13:24:59.977 INFO:teuthology.orchestra.run.smithi032.stdout:(74/143): libcom_err-devel-1.45.6-5.el8.x86_64. 667 kB/s | 39 kB 00:00 2023-06-20T13:25:00.035 INFO:teuthology.orchestra.run.smithi115.stdout:(23/143): python3-rbd-18.0.0-4512.g2016e3af.el8 4.3 MB/s | 364 kB 00:00 2023-06-20T13:25:00.060 INFO:teuthology.orchestra.run.smithi115.stdout:(24/143): python3-rgw-18.0.0-4512.g2016e3af.el8 1.2 MB/s | 106 kB 00:00 2023-06-20T13:25:00.061 INFO:teuthology.orchestra.run.smithi032.stdout:(75/143): libgfortran-8.5.0-19.el8.x86_64.rpm 7.6 MB/s | 645 kB 00:00 2023-06-20T13:25:00.085 INFO:teuthology.orchestra.run.smithi115.stdout:(25/143): python3-rados-18.0.0-4512.g2016e3af.e 2.4 MB/s | 371 kB 00:00 2023-06-20T13:25:00.111 INFO:teuthology.orchestra.run.smithi115.stdout:(26/143): rbd-fuse-18.0.0-4512.g2016e3af.el8.x8 1.2 MB/s | 94 kB 00:00 2023-06-20T13:25:00.128 INFO:teuthology.orchestra.run.smithi032.stdout:(76/143): libquadmath-8.5.0-19.el8.x86_64.rpm 2.5 MB/s | 172 kB 00:00 2023-06-20T13:25:00.190 INFO:teuthology.orchestra.run.smithi115.stdout:(27/143): rbd-nbd-18.0.0-4512.g2016e3af.el8.x86 1.7 MB/s | 180 kB 00:00 2023-06-20T13:25:00.203 INFO:teuthology.orchestra.run.smithi032.stdout:(77/143): librabbitmq-0.9.0-3.el8.x86_64.rpm 625 kB/s | 47 kB 00:00 2023-06-20T13:25:00.220 INFO:teuthology.orchestra.run.smithi115.stdout:(28/143): ceph-grafana-dashboards-18.0.0-4512.g 212 kB/s | 23 kB 00:00 2023-06-20T13:25:00.278 INFO:teuthology.orchestra.run.smithi115.stdout:(29/143): ceph-mgr-cephadm-18.0.0-4512.g2016e3a 1.4 MB/s | 128 kB 00:00 2023-06-20T13:25:00.279 INFO:teuthology.orchestra.run.smithi032.stdout:(78/143): libselinux-devel-2.9-8.el8.x86_64.rpm 2.6 MB/s | 200 kB 00:00 2023-06-20T13:25:00.362 INFO:teuthology.orchestra.run.smithi032.stdout:(79/143): libsepol-devel-2.9-3.el8.x86_64.rpm 1.0 MB/s | 87 kB 00:00 2023-06-20T13:25:00.420 INFO:teuthology.orchestra.run.smithi115.stdout:(30/143): ceph-mgr-dashboard-18.0.0-4512.g2016e 8.5 MB/s | 1.7 MB 00:00 2023-06-20T13:25:00.438 INFO:teuthology.orchestra.run.smithi032.stdout:(80/143): libuuid-devel-2.32.1-42.el8.x86_64.rp 1.3 MB/s | 99 kB 00:00 2023-06-20T13:25:00.513 INFO:teuthology.orchestra.run.smithi032.stdout:(81/143): libverto-devel-0.3.2-2.el8.x86_64.rpm 241 kB/s | 18 kB 00:00 2023-06-20T13:25:00.529 INFO:teuthology.orchestra.run.smithi115.stdout:(31/143): ceph-mgr-modules-core-18.0.0-4512.g20 2.2 MB/s | 240 kB 00:00 2023-06-20T13:25:00.588 INFO:teuthology.orchestra.run.smithi032.stdout:(82/143): libzstd-devel-1.4.4-1.el8.x86_64.rpm 586 kB/s | 44 kB 00:00 2023-06-20T13:25:00.637 INFO:teuthology.orchestra.run.smithi115.stdout:(32/143): rbd-mirror-18.0.0-4512.g2016e3af.el8. 6.0 MB/s | 3.4 MB 00:00 2023-06-20T13:25:00.662 INFO:teuthology.orchestra.run.smithi115.stdout:(33/143): ceph-mgr-rook-18.0.0-4512.g2016e3af.e 355 kB/s | 47 kB 00:00 2023-06-20T13:25:00.721 INFO:teuthology.orchestra.run.smithi115.stdout:(34/143): ceph-prometheus-alerts-18.0.0-4512.g2 175 kB/s | 15 kB 00:00 2023-06-20T13:25:00.755 INFO:teuthology.orchestra.run.smithi115.stdout:(35/143): ceph-volume-18.0.0-4512.g2016e3af.el8 2.7 MB/s | 258 kB 00:00 2023-06-20T13:25:00.814 INFO:teuthology.orchestra.run.smithi115.stdout:(36/143): cephadm-18.0.0-4512.g2016e3af.el8.noa 1.7 MB/s | 164 kB 00:00 2023-06-20T13:25:00.831 INFO:teuthology.orchestra.run.smithi115.stdout:(37/143): cephfs-top-18.0.0-4512.g2016e3af.el8. 239 kB/s | 18 kB 00:00 2023-06-20T13:25:00.855 INFO:teuthology.orchestra.run.smithi032.stdout:(83/143): openssl-devel-1.1.1k-9.el8.x86_64.rpm 12 MB/s | 3.2 MB 00:00 2023-06-20T13:25:00.947 INFO:teuthology.orchestra.run.smithi032.stdout:(84/143): pcre2-devel-10.32-3.el8.x86_64.rpm 6.5 MB/s | 605 kB 00:00 2023-06-20T13:25:01.023 INFO:teuthology.orchestra.run.smithi032.stdout:(85/143): pcre2-utf16-10.32-3.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2023-06-20T13:25:01.098 INFO:teuthology.orchestra.run.smithi032.stdout:(86/143): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.9 MB/s | 220 kB 00:00 2023-06-20T13:25:01.290 INFO:teuthology.orchestra.run.smithi032.stdout:(87/143): python3-scipy-1.0.0-21.module_el8.5.0 6.8 MB/s | 14 MB 00:02 2023-06-20T13:25:01.326 INFO:teuthology.orchestra.run.smithi032.stdout:(88/143): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.1 MB/s | 249 kB 00:00 2023-06-20T13:25:01.390 INFO:teuthology.orchestra.run.smithi032.stdout:(89/143): python3-jwt-1.6.1-2.el8.noarch.rpm 642 kB/s | 43 kB 00:00 2023-06-20T13:25:01.416 INFO:teuthology.orchestra.run.smithi032.stdout:(90/143): python3-cryptography-3.2.1-6.el8.x86_ 5.0 MB/s | 641 kB 00:00 2023-06-20T13:25:01.458 INFO:teuthology.orchestra.run.smithi032.stdout:(91/143): python3-oauthlib-2.1.0-1.el8.noarch.r 2.3 MB/s | 155 kB 00:00 2023-06-20T13:25:01.492 INFO:teuthology.orchestra.run.smithi032.stdout:(92/143): python3-pycparser-2.14-14.el8.noarch. 1.4 MB/s | 109 kB 00:00 2023-06-20T13:25:01.542 INFO:teuthology.orchestra.run.smithi032.stdout:(93/143): python3-requests-oauthlib-1.0.0-1.el8 508 kB/s | 43 kB 00:00 2023-06-20T13:25:01.567 INFO:teuthology.orchestra.run.smithi032.stdout:(94/143): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 989 kB/s | 74 kB 00:00 2023-06-20T13:25:01.609 INFO:teuthology.orchestra.run.smithi032.stdout:(95/143): zlib-devel-1.2.11-21.el8.x86_64.rpm 874 kB/s | 58 kB 00:00 2023-06-20T13:25:01.806 INFO:teuthology.orchestra.run.smithi115.stdout:(38/143): ceph-mgr-diskprediction-local-18.0.0- 4.8 MB/s | 7.4 MB 00:01 2023-06-20T13:25:01.881 INFO:teuthology.orchestra.run.smithi115.stdout:(39/143): bison-3.0.4-10.el8.x86_64.rpm 656 kB/s | 688 kB 00:01 2023-06-20T13:25:01.923 INFO:teuthology.orchestra.run.smithi115.stdout:(40/143): automake-1.16.1-7.el8.noarch.rpm 644 kB/s | 713 kB 00:01 2023-06-20T13:25:01.926 INFO:teuthology.orchestra.run.smithi032.stdout:(96/143): liboath-2.6.2-3.el8.x86_64.rpm 186 kB/s | 59 kB 00:00 2023-06-20T13:25:01.948 INFO:teuthology.orchestra.run.smithi115.stdout:(41/143): jq-1.6-7.el8.x86_64.rpm 3.0 MB/s | 202 kB 00:00 2023-06-20T13:25:01.960 INFO:teuthology.orchestra.run.smithi032.stdout:(97/143): gperftools-libs-2.7-9.el8.x86_64.rpm 781 kB/s | 306 kB 00:00 2023-06-20T13:25:02.024 INFO:teuthology.orchestra.run.smithi115.stdout:(42/143): librdkafka-0.11.4-3.el8.x86_64.rpm 4.6 MB/s | 354 kB 00:00 2023-06-20T13:25:02.049 INFO:teuthology.orchestra.run.smithi115.stdout:(43/143): libpq-13.5-1.el8.x86_64.rpm 1.5 MB/s | 198 kB 00:00 2023-06-20T13:25:02.068 INFO:teuthology.orchestra.run.smithi032.stdout:(98/143): libunwind-1.3.1-3.el8.x86_64.rpm 529 kB/s | 75 kB 00:00 2023-06-20T13:25:02.152 INFO:teuthology.orchestra.run.smithi032.stdout:(99/143): python3-asyncssh-2.7.0-2.el8.noarch.r 2.4 MB/s | 476 kB 00:00 2023-06-20T13:25:02.157 INFO:teuthology.orchestra.run.smithi115.stdout:(44/143): libtool-2.4.6-25.el8.x86_64.rpm 5.2 MB/s | 709 kB 00:00 2023-06-20T13:25:02.183 INFO:teuthology.orchestra.run.smithi115.stdout:(45/143): flex-2.6.1-9.el8.x86_64.rpm 849 kB/s | 320 kB 00:00 2023-06-20T13:25:02.208 INFO:teuthology.orchestra.run.smithi115.stdout:(46/143): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.6 MB/s | 259 kB 00:00 2023-06-20T13:25:02.211 INFO:teuthology.orchestra.run.smithi032.stdout:(100/143): python3-bcrypt-3.1.6-2.el8.1.x86_64. 307 kB/s | 44 kB 00:00 2023-06-20T13:25:02.233 INFO:teuthology.orchestra.run.smithi115.stdout:(47/143): oniguruma-6.8.2-2.el8.x86_64.rpm 2.4 MB/s | 187 kB 00:00 2023-06-20T13:25:02.244 INFO:teuthology.orchestra.run.smithi032.stdout:(101/143): python3-beautifulsoup4-4.6.3-2.el8.1 2.0 MB/s | 185 kB 00:00 2023-06-20T13:25:02.433 INFO:teuthology.orchestra.run.smithi115.stdout:(48/143): postgresql-10.23-1.module_el8+300+2c5 7.8 MB/s | 1.6 MB 00:00 2023-06-20T13:25:02.550 INFO:teuthology.orchestra.run.smithi115.stdout:(49/143): postgresql-contrib-10.23-1.module_el8 7.6 MB/s | 903 kB 00:00 2023-06-20T13:25:02.670 INFO:teuthology.orchestra.run.smithi032.stdout:(102/143): ceph-test-18.0.0-4512.g2016e3af.el8. 4.8 MB/s | 48 MB 00:09 2023-06-20T13:25:02.695 INFO:teuthology.orchestra.run.smithi032.stdout:(103/143): python3-certifi-2018.10.15-7.el8.noa 36 kB/s | 16 kB 00:00 2023-06-20T13:25:02.720 INFO:teuthology.orchestra.run.smithi032.stdout:(104/143): python3-cachetools-3.1.1-4.el8.noarc 65 kB/s | 33 kB 00:00 2023-06-20T13:25:02.862 INFO:teuthology.orchestra.run.smithi032.stdout:(105/143): python3-cherrypy-18.4.0-1.el8.noarch 2.3 MB/s | 384 kB 00:00 2023-06-20T13:25:02.913 INFO:teuthology.orchestra.run.smithi032.stdout:(106/143): python3-google-auth-1.1.1-10.el8.noa 423 kB/s | 81 kB 00:00 2023-06-20T13:25:02.963 INFO:teuthology.orchestra.run.smithi032.stdout:(107/143): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2023-06-20T13:25:02.988 INFO:teuthology.orchestra.run.smithi032.stdout:(108/143): python3-jaraco-functools-2.0-4.el8.n 234 kB/s | 18 kB 00:00 2023-06-20T13:25:03.001 INFO:teuthology.orchestra.run.smithi115.stdout:(50/143): postgresql-server-10.23-1.module_el8+ 11 MB/s | 5.1 MB 00:00 2023-06-20T13:25:03.088 INFO:teuthology.orchestra.run.smithi032.stdout:(109/143): python3-cheroot-8.5.2-1.el8.noarch.r 413 kB/s | 173 kB 00:00 2023-06-20T13:25:03.130 INFO:teuthology.orchestra.run.smithi032.stdout:(110/143): python3-logutils-0.3.5-11.el8.noarch 343 kB/s | 49 kB 00:00 2023-06-20T13:25:03.189 INFO:teuthology.orchestra.run.smithi032.stdout:(111/143): python3-kubernetes-11.0.0-6.el8.noar 5.2 MB/s | 1.2 MB 00:00 2023-06-20T13:25:03.209 INFO:teuthology.orchestra.run.smithi115.stdout:(51/143): openblas-threads-0.3.15-4.el8.x86_64. 4.9 MB/s | 4.9 MB 00:01 2023-06-20T13:25:03.214 INFO:teuthology.orchestra.run.smithi032.stdout:(112/143): python3-more-itertools-7.2.0-3.el8.n 468 kB/s | 59 kB 00:00 2023-06-20T13:25:03.239 INFO:teuthology.orchestra.run.smithi032.stdout:(113/143): python3-natsort-7.1.1-2.el8.noarch.r 554 kB/s | 60 kB 00:00 2023-06-20T13:25:03.326 INFO:teuthology.orchestra.run.smithi115.stdout:(52/143): openblas-0.3.15-4.el8.x86_64.rpm 4.1 MB/s | 4.7 MB 00:01 2023-06-20T13:25:03.331 INFO:teuthology.orchestra.run.smithi032.stdout:(114/143): python3-repoze-lru-0.7-6.el8.noarch. 369 kB/s | 34 kB 00:00 2023-06-20T13:25:03.356 INFO:teuthology.orchestra.run.smithi032.stdout:(115/143): python3-portend-2.6-1.el8.noarch.rpm 134 kB/s | 16 kB 00:00 2023-06-20T13:25:03.360 INFO:teuthology.orchestra.run.smithi115.stdout:(53/143): python3-jinja2-2.10.1-3.el8.noarch.rp 3.5 MB/s | 538 kB 00:00 2023-06-20T13:25:03.382 INFO:teuthology.orchestra.run.smithi032.stdout:(116/143): python3-pecan-1.3.2-9.el8.noarch.rpm 1.4 MB/s | 283 kB 00:00 2023-06-20T13:25:03.385 INFO:teuthology.orchestra.run.smithi115.stdout:(54/143): python3-jsonpatch-1.21-2.el8.noarch.r 456 kB/s | 27 kB 00:00 2023-06-20T13:25:03.458 INFO:teuthology.orchestra.run.smithi032.stdout:(117/143): python3-simplegeneric-0.8.1-17.el8.n 249 kB/s | 19 kB 00:00 2023-06-20T13:25:03.460 INFO:teuthology.orchestra.run.smithi115.stdout:(55/143): python3-babel-2.5.1-7.el8.noarch.rpm 10 MB/s | 4.8 MB 00:00 2023-06-20T13:25:03.483 INFO:teuthology.orchestra.run.smithi032.stdout:(118/143): python3-routes-2.4.1-12.el8.noarch.r 1.3 MB/s | 196 kB 00:00 2023-06-20T13:25:03.485 INFO:teuthology.orchestra.run.smithi115.stdout:(56/143): python3-jsonpointer-1.10-11.el8.noarc 159 kB/s | 20 kB 00:00 2023-06-20T13:25:03.511 INFO:teuthology.orchestra.run.smithi115.stdout:(57/143): python3-mako-1.0.6-14.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2023-06-20T13:25:03.516 INFO:teuthology.orchestra.run.smithi032.stdout:(119/143): python3-rsa-4.8-1.el8.noarch.rpm 386 kB/s | 61 kB 00:00 2023-06-20T13:25:03.536 INFO:teuthology.orchestra.run.smithi115.stdout:(58/143): python3-markupsafe-0.23-19.el8.x86_64 513 kB/s | 39 kB 00:00 2023-06-20T13:25:03.541 INFO:teuthology.orchestra.run.smithi032.stdout:(120/143): python3-singledispatch-3.4.0.3-18.el 286 kB/s | 24 kB 00:00 2023-06-20T13:25:03.570 INFO:teuthology.orchestra.run.smithi115.stdout:(59/143): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.8 MB/s | 225 kB 00:00 2023-06-20T13:25:03.575 INFO:teuthology.orchestra.run.smithi032.stdout:(121/143): python3-tempora-1.14.1-5.el8.noarch. 317 kB/s | 29 kB 00:00 2023-06-20T13:25:03.595 INFO:teuthology.orchestra.run.smithi115.stdout:(60/143): python3-prettytable-0.7.2-14.el8.noar 751 kB/s | 44 kB 00:00 2023-06-20T13:25:03.600 INFO:teuthology.orchestra.run.smithi032.stdout:(122/143): python3-trustme-0.6.0-4.el8.noarch.r 328 kB/s | 27 kB 00:00 2023-06-20T13:25:03.650 INFO:teuthology.orchestra.run.smithi115.stdout:(61/143): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.3 MB/s | 103 kB 00:00 2023-06-20T13:25:03.668 INFO:teuthology.orchestra.run.smithi032.stdout:(123/143): python3-waitress-1.4.3-1.el8.noarch. 2.0 MB/s | 255 kB 00:00 2023-06-20T13:25:03.679 INFO:teuthology.orchestra.run.smithi115.stdout:(62/143): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.5 MB/s | 126 kB 00:00 2023-06-20T13:25:03.693 INFO:teuthology.orchestra.run.smithi032.stdout:(124/143): python3-websocket-client-0.56.0-5.el 668 kB/s | 61 kB 00:00 2023-06-20T13:25:03.704 INFO:teuthology.orchestra.run.smithi115.stdout:(63/143): python3-pyasn1-modules-0.3.7-6.el8.no 2.0 MB/s | 110 kB 00:00 2023-06-20T13:25:03.730 INFO:teuthology.orchestra.run.smithi115.stdout:(64/143): python3-pytz-2017.2-9.el8.noarch.rpm 1.0 MB/s | 54 kB 00:00 2023-06-20T13:25:03.752 INFO:teuthology.orchestra.run.smithi032.stdout:(125/143): python3-webob-1.8.5-1.el8.1.noarch.r 1.4 MB/s | 251 kB 00:00 2023-06-20T13:25:03.777 INFO:teuthology.orchestra.run.smithi032.stdout:(126/143): python3-webtest-2.0.33-1.el8.noarch. 787 kB/s | 85 kB 00:00 2023-06-20T13:25:03.802 INFO:teuthology.orchestra.run.smithi032.stdout:(127/143): python3-zc-lockfile-2.0-2.el8.noarch 210 kB/s | 23 kB 00:00 2023-06-20T13:25:03.805 INFO:teuthology.orchestra.run.smithi115.stdout:(65/143): python3-werkzeug-0.12.2-4.el8.noarch. 6.0 MB/s | 457 kB 00:00 2023-06-20T13:25:03.872 INFO:teuthology.orchestra.run.smithi115.stdout:(66/143): socat-1.7.4.1-1.el8.x86_64.rpm 4.7 MB/s | 323 kB 00:00 2023-06-20T13:25:04.172 INFO:teuthology.orchestra.run.smithi115.stdout:(67/143): python3-numpy-1.14.3-10.el8.x86_64.rp 5.4 MB/s | 3.7 MB 00:00 2023-06-20T13:25:04.198 INFO:teuthology.orchestra.run.smithi115.stdout:(68/143): uuid-1.6.2-43.el8.x86_64.rpm 197 kB/s | 64 kB 00:00 2023-06-20T13:25:04.231 INFO:teuthology.orchestra.run.smithi115.stdout:(69/143): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.2 MB/s | 71 kB 00:00 2023-06-20T13:25:04.265 INFO:teuthology.orchestra.run.smithi115.stdout:(70/143): elfutils-libelf-devel-0.189-2.el8.x86 921 kB/s | 61 kB 00:00 2023-06-20T13:25:04.290 INFO:teuthology.orchestra.run.smithi115.stdout:(71/143): fuse-2.9.7-17.el8.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2023-06-20T13:25:04.324 INFO:teuthology.orchestra.run.smithi115.stdout:(72/143): keyutils-libs-devel-1.5.10-9.el8.x86_ 827 kB/s | 48 kB 00:00 2023-06-20T13:25:04.352 INFO:teuthology.orchestra.run.smithi032.stdout:(128/143): librados2-18.0.0-4512.g2016e3af.el8. 6.4 MB/s | 3.7 MB 00:00 2023-06-20T13:25:04.383 INFO:teuthology.orchestra.run.smithi115.stdout:(73/143): libaio-devel-0.3.112-1.el8.x86_64.rpm 320 kB/s | 19 kB 00:00 2023-06-20T13:25:04.394 INFO:teuthology.orchestra.run.smithi032.stdout:(129/143): thrift-0.13.0-2.el8.x86_64.rpm 2.7 MB/s | 1.7 MB 00:00 2023-06-20T13:25:04.441 INFO:teuthology.orchestra.run.smithi115.stdout:(74/143): krb5-devel-1.18.2-22.el8.x86_64.rpm 3.6 MB/s | 561 kB 00:00 2023-06-20T13:25:04.453 INFO:teuthology.orchestra.run.smithi032.stdout:(130/143): librbd1-18.0.0-4512.g2016e3af.el8.x8 5.5 MB/s | 3.6 MB 00:00 2023-06-20T13:25:04.466 INFO:teuthology.orchestra.run.smithi115.stdout:(75/143): libcom_err-devel-1.45.6-5.el8.x86_64. 465 kB/s | 39 kB 00:00 2023-06-20T13:25:04.512 INFO:teuthology.orchestra.run.smithi032.stdout:(131/143): NetworkManager-initscripts-updown-1. 902 kB/s | 143 kB 00:00 2023-06-20T13:25:04.525 INFO:teuthology.orchestra.run.smithi115.stdout:(76/143): libquadmath-8.5.0-19.el8.x86_64.rpm 2.9 MB/s | 172 kB 00:00 2023-06-20T13:25:04.562 INFO:teuthology.orchestra.run.smithi032.stdout:(132/143): elfutils-debuginfod-client-0.189-2.e 454 kB/s | 76 kB 00:00 2023-06-20T13:25:04.600 INFO:teuthology.orchestra.run.smithi115.stdout:(77/143): libgfortran-8.5.0-19.el8.x86_64.rpm 4.0 MB/s | 645 kB 00:00 2023-06-20T13:25:04.620 INFO:teuthology.orchestra.run.smithi032.stdout:(133/143): elfutils-libs-0.189-2.el8.x86_64.rpm 2.7 MB/s | 302 kB 00:00 2023-06-20T13:25:04.625 INFO:teuthology.orchestra.run.smithi115.stdout:(78/143): librabbitmq-0.9.0-3.el8.x86_64.rpm 469 kB/s | 47 kB 00:00 2023-06-20T13:25:04.659 INFO:teuthology.orchestra.run.smithi115.stdout:(79/143): libselinux-devel-2.9-8.el8.x86_64.rpm 3.3 MB/s | 200 kB 00:00 2023-06-20T13:25:04.676 INFO:teuthology.orchestra.run.smithi115.stdout:(80/143): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-06-20T13:25:04.687 INFO:teuthology.orchestra.run.smithi032.stdout:(134/143): libblkid-2.32.1-42.el8.x86_64.rpm 3.2 MB/s | 220 kB 00:00 2023-06-20T13:25:04.718 INFO:teuthology.orchestra.run.smithi115.stdout:(81/143): libuuid-devel-2.32.1-42.el8.x86_64.rp 1.7 MB/s | 99 kB 00:00 2023-06-20T13:25:04.721 INFO:teuthology.orchestra.run.smithi032.stdout:(135/143): elfutils-libelf-0.189-2.el8.x86_64.r 867 kB/s | 232 kB 00:00 2023-06-20T13:25:04.743 INFO:teuthology.orchestra.run.smithi115.stdout:(82/143): libverto-devel-0.3.2-2.el8.x86_64.rpm 270 kB/s | 18 kB 00:00 2023-06-20T13:25:04.763 INFO:teuthology.orchestra.run.smithi032.stdout:(136/143): iproute-6.2.0-2.el8.x86_64.rpm 4.3 MB/s | 880 kB 00:00 2023-06-20T13:25:04.785 INFO:teuthology.orchestra.run.smithi115.stdout:(83/143): libzstd-devel-1.4.4-1.el8.x86_64.rpm 659 kB/s | 44 kB 00:00 2023-06-20T13:25:04.788 INFO:teuthology.orchestra.run.smithi032.stdout:(137/143): libfdisk-2.32.1-42.el8.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2023-06-20T13:25:04.822 INFO:teuthology.orchestra.run.smithi032.stdout:(138/143): libmount-2.32.1-42.el8.x86_64.rpm 2.3 MB/s | 236 kB 00:00 2023-06-20T13:25:04.856 INFO:teuthology.orchestra.run.smithi032.stdout:(139/143): libsmartcols-2.32.1-42.el8.x86_64.rp 1.9 MB/s | 179 kB 00:00 2023-06-20T13:25:04.889 INFO:teuthology.orchestra.run.smithi032.stdout:(140/143): libuuid-2.32.1-42.el8.x86_64.rpm 977 kB/s | 98 kB 00:00 2023-06-20T13:25:04.923 INFO:teuthology.orchestra.run.smithi032.stdout:(141/143): util-linux-user-2.32.1-42.el8.x86_64 1.5 MB/s | 102 kB 00:00 2023-06-20T13:25:04.952 INFO:teuthology.orchestra.run.smithi115.stdout:(84/143): pcre2-devel-10.32-3.el8.x86_64.rpm 3.5 MB/s | 605 kB 00:00 2023-06-20T13:25:05.027 INFO:teuthology.orchestra.run.smithi115.stdout:(85/143): pcre2-utf16-10.32-3.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2023-06-20T13:25:05.056 INFO:teuthology.orchestra.run.smithi032.stdout:(142/143): xfsprogs-5.0.0-12.el8.x86_64.rpm 6.5 MB/s | 1.1 MB 00:00 2023-06-20T13:25:05.078 INFO:teuthology.orchestra.run.smithi115.stdout:(86/143): openssl-devel-1.1.1k-9.el8.x86_64.rpm 9.5 MB/s | 3.2 MB 00:00 2023-06-20T13:25:05.103 INFO:teuthology.orchestra.run.smithi115.stdout:(87/143): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.9 MB/s | 220 kB 00:00 2023-06-20T13:25:05.145 INFO:teuthology.orchestra.run.smithi115.stdout:(88/143): python3-cffi-1.11.5-6.el8.x86_64.rpm 3.6 MB/s | 249 kB 00:00 2023-06-20T13:25:05.212 INFO:teuthology.orchestra.run.smithi115.stdout:(89/143): python3-jwt-1.6.1-2.el8.noarch.rpm 641 kB/s | 43 kB 00:00 2023-06-20T13:25:05.245 INFO:teuthology.orchestra.run.smithi115.stdout:(90/143): python3-cryptography-3.2.1-6.el8.x86_ 4.4 MB/s | 641 kB 00:00 2023-06-20T13:25:05.248 INFO:teuthology.orchestra.run.smithi032.stdout:(143/143): util-linux-2.32.1-42.el8.x86_64.rpm 6.1 MB/s | 2.6 MB 00:00 2023-06-20T13:25:05.251 INFO:teuthology.orchestra.run.smithi032.stdout:-------------------------------------------------------------------------------- 2023-06-20T13:25:05.252 INFO:teuthology.orchestra.run.smithi032.stdout:Total 13 MB/s | 212 MB 00:15 2023-06-20T13:25:05.271 INFO:teuthology.orchestra.run.smithi115.stdout:(91/143): python3-oauthlib-2.1.0-1.el8.noarch.r 2.6 MB/s | 155 kB 00:00 2023-06-20T13:25:05.321 INFO:teuthology.orchestra.run.smithi115.stdout:(92/143): python3-pycparser-2.14-14.el8.noarch. 1.4 MB/s | 109 kB 00:00 2023-06-20T13:25:05.347 INFO:teuthology.orchestra.run.smithi115.stdout:(93/143): python3-requests-oauthlib-1.0.0-1.el8 564 kB/s | 43 kB 00:00 2023-06-20T13:25:05.380 INFO:teuthology.orchestra.run.smithi115.stdout:(94/143): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.3 MB/s | 74 kB 00:00 2023-06-20T13:25:05.405 INFO:teuthology.orchestra.run.smithi115.stdout:(95/143): zlib-devel-1.2.11-21.el8.x86_64.rpm 996 kB/s | 58 kB 00:00 2023-06-20T13:25:05.581 INFO:teuthology.orchestra.run.smithi115.stdout:(96/143): python3-scipy-1.0.0-21.module_el8.5.0 7.3 MB/s | 14 MB 00:01 2023-06-20T13:25:07.073 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction check 2023-06-20T13:25:07.511 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction check succeeded. 2023-06-20T13:25:07.512 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction test 2023-06-20T13:25:09.079 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction test succeeded. 2023-06-20T13:25:09.083 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction 2023-06-20T13:25:14.562 INFO:teuthology.orchestra.run.smithi032.stdout: Preparing : 1/1 2023-06-20T13:25:14.799 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-06-20T13:25:14.983 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/158 2023-06-20T13:25:15.119 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/158 2023-06-20T13:25:15.210 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/158 2023-06-20T13:25:15.419 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/158 2023-06-20T13:25:15.508 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/158 2023-06-20T13:25:15.764 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/158 2023-06-20T13:25:15.984 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/158 2023-06-20T13:25:16.212 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 6/158 2023-06-20T13:25:16.410 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/158 2023-06-20T13:25:16.899 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/158 2023-06-20T13:25:17.102 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : librados2-2:18.0.0-4512.g2016e3af.el8.x86_64 8/158 2023-06-20T13:25:17.556 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librados2-2:18.0.0-4512.g2016e3af.el8.x86_64 8/158 2023-06-20T13:25:17.777 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : librbd1-2:18.0.0-4512.g2016e3af.el8.x86_64 9/158 2023-06-20T13:25:17.929 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librbd1-2:18.0.0-4512.g2016e3af.el8.x86_64 9/158 2023-06-20T13:25:18.135 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libcephfs2-2:18.0.0-4512.g2016e3af.el8.x86_64 10/158 2023-06-20T13:25:18.256 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libcephfs2-2:18.0.0-4512.g2016e3af.el8.x86_64 10/158 2023-06-20T13:25:18.472 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-rados-2:18.0.0-4512.g2016e3af.el8.x86_64 11/158 2023-06-20T13:25:18.668 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/158 2023-06-20T13:25:18.765 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/158 2023-06-20T13:25:19.015 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/158 2023-06-20T13:25:19.230 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 14/158 2023-06-20T13:25:19.785 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libpq-13.5-1.el8.x86_64 15/158 2023-06-20T13:25:20.083 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 16/158 2023-06-20T13:25:20.243 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libcephsqlite-2:18.0.0-4512.g2016e3af.el8.x86_64 17/158 2023-06-20T13:25:20.373 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4512.g2016e3af.el8.x86_64 17/158 2023-06-20T13:25:20.560 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libradosstriper1-2:18.0.0-4512.g2016e3af.el8.x86 18/158 2023-06-20T13:25:20.816 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4512.g2016e3af.el8.x86 18/158 2023-06-20T13:25:21.035 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 19/158 2023-06-20T13:25:21.191 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 19/158 2023-06-20T13:25:21.410 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/158 2023-06-20T13:25:21.589 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/158 2023-06-20T13:25:21.735 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libquadmath-8.5.0-19.el8.x86_64 22/158 2023-06-20T13:25:21.884 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libquadmath-8.5.0-19.el8.x86_64 22/158 2023-06-20T13:25:22.043 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libgfortran-8.5.0-19.el8.x86_64 23/158 2023-06-20T13:25:22.755 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libgfortran-8.5.0-19.el8.x86_64 23/158 2023-06-20T13:25:22.993 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/158 2023-06-20T13:25:23.735 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/158 2023-06-20T13:25:23.918 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/158 2023-06-20T13:25:24.794 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/158 2023-06-20T13:25:25.135 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/158 2023-06-20T13:25:25.320 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/158 2023-06-20T13:25:25.519 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/158 2023-06-20T13:25:25.733 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/158 2023-06-20T13:25:25.951 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-ceph-common-2:18.0.0-4512.g2016e3af.el8. 30/158 2023-06-20T13:25:26.118 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-ceph-argparse-2:18.0.0-4512.g2016e3af.el 31/158 2023-06-20T13:25:26.341 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cephfs-2:18.0.0-4512.g2016e3af.el8.x86_6 32/158 2023-06-20T13:25:27.514 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/158 2023-06-20T13:25:27.876 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/158 2023-06-20T13:25:28.183 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/158 2023-06-20T13:25:28.384 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/158 2023-06-20T13:25:30.606 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/158 2023-06-20T13:25:30.899 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/158 2023-06-20T13:25:31.102 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/158 2023-06-20T13:25:31.317 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-rsa-4.8-1.el8.noarch 39/158 2023-06-20T13:25:31.517 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-rbd-2:18.0.0-4512.g2016e3af.el8.x86_64 40/158 2023-06-20T13:25:31.713 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : librados-devel-2:18.0.0-4512.g2016e3af.el8.x86_6 41/158 2023-06-20T13:25:31.900 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/158 2023-06-20T13:25:32.078 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/158 2023-06-20T13:25:32.292 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/158 2023-06-20T13:25:32.381 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/158 2023-06-20T13:25:32.575 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/158 2023-06-20T13:25:32.665 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/158 2023-06-20T13:25:32.814 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/158 2023-06-20T13:25:32.983 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/158 2023-06-20T13:25:33.601 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/158 2023-06-20T13:25:33.901 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/158 2023-06-20T13:25:33.929 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/158 2023-06-20T13:25:34.117 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/158 2023-06-20T13:25:34.381 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/158 2023-06-20T13:25:34.608 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/158 2023-06-20T13:25:34.772 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/158 2023-06-20T13:25:34.939 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/158 2023-06-20T13:25:35.151 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/158 2023-06-20T13:25:35.359 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/158 2023-06-20T13:25:35.609 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/158 2023-06-20T13:25:35.804 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/158 2023-06-20T13:25:35.950 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/158 2023-06-20T13:25:36.117 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/158 2023-06-20T13:25:36.312 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/158 2023-06-20T13:25:36.491 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/158 2023-06-20T13:25:36.665 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/158 2023-06-20T13:25:36.908 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/158 2023-06-20T13:25:37.143 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/158 2023-06-20T13:25:37.352 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/158 2023-06-20T13:25:37.700 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/158 2023-06-20T13:25:37.952 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/158 2023-06-20T13:25:38.149 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/158 2023-06-20T13:25:39.020 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/158 2023-06-20T13:25:39.232 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : librgw2-2:18.0.0-4512.g2016e3af.el8.x86_64 70/158 2023-06-20T13:25:39.328 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librgw2-2:18.0.0-4512.g2016e3af.el8.x86_64 70/158 2023-06-20T13:25:39.537 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-rgw-2:18.0.0-4512.g2016e3af.el8.x86_64 71/158 2023-06-20T13:25:39.772 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/158 2023-06-20T13:25:40.240 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/158 2023-06-20T13:25:40.491 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/158 2023-06-20T13:25:40.674 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/158 2023-06-20T13:25:40.941 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/158 2023-06-20T13:25:41.177 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/158 2023-06-20T13:25:42.522 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/158 2023-06-20T13:25:42.903 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/158 2023-06-20T13:25:43.135 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/158 2023-06-20T13:25:43.364 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/158 2023-06-20T13:25:43.664 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/158 2023-06-20T13:25:43.905 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/158 2023-06-20T13:25:44.113 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/158 2023-06-20T13:25:44.305 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/158 2023-06-20T13:25:44.647 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/158 2023-06-20T13:25:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/158 2023-06-20T13:25:45.150 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/158 2023-06-20T13:25:45.361 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/158 2023-06-20T13:25:45.701 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/158 2023-06-20T13:25:45.920 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/158 2023-06-20T13:25:46.074 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/158 2023-06-20T13:25:46.282 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/158 2023-06-20T13:25:46.482 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/158 2023-06-20T13:25:46.703 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/158 2023-06-20T13:25:46.895 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/158 2023-06-20T13:25:47.057 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/158 2023-06-20T13:25:47.183 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/158 2023-06-20T13:25:47.376 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/158 2023-06-20T13:25:47.524 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/158 2023-06-20T13:25:50.606 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-common-2:18.0.0-4512.g2016e3af.el8.x86_64 100/158 2023-06-20T13:25:51.132 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-common-2:18.0.0-4512.g2016e3af.el8.x86_64 100/158 2023-06-20T13:25:51.873 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-common-2:18.0.0-4512.g2016e3af.el8.x86_64 100/158 2023-06-20T13:25:52.189 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-base-2:18.0.0-4512.g2016e3af.el8.x86_64 101/158 2023-06-20T13:25:52.338 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-base-2:18.0.0-4512.g2016e3af.el8.x86_64 101/158 2023-06-20T13:25:52.531 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-selinux-2:18.0.0-4512.g2016e3af.el8.x86_64 102/158 2023-06-20T13:26:14.003 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4512.g2016e3af.el8.x86_64 102/158 2023-06-20T13:26:14.003 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /sys 2023-06-20T13:26:14.004 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /proc 2023-06-20T13:26:14.004 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /dev 2023-06-20T13:26:14.004 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /run 2023-06-20T13:26:14.004 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /mnt 2023-06-20T13:26:14.004 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /var/tmp 2023-06-20T13:26:14.004 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /home 2023-06-20T13:26:14.005 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /tmp 2023-06-20T13:26:14.005 INFO:teuthology.orchestra.run.smithi032.stdout:skipping the directory /dev 2023-06-20T13:26:14.005 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:26:14.412 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-volume-2:18.0.0-4512.g2016e3af.el8.noarch 103/158 2023-06-20T13:26:16.251 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-volume-2:18.0.0-4512.g2016e3af.el8.noarch 103/158 2023-06-20T13:26:16.519 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-osd-2:18.0.0-4512.g2016e3af.el8.x86_64 104/158 2023-06-20T13:26:16.803 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-osd-2:18.0.0-4512.g2016e3af.el8.x86_64 104/158 2023-06-20T13:26:16.987 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mds-2:18.0.0-4512.g2016e3af.el8.x86_64 105/158 2023-06-20T13:26:17.546 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mds-2:18.0.0-4512.g2016e3af.el8.x86_64 105/158 2023-06-20T13:26:17.757 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mon-2:18.0.0-4512.g2016e3af.el8.x86_64 106/158 2023-06-20T13:26:17.806 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mon-2:18.0.0-4512.g2016e3af.el8.x86_64 106/158 2023-06-20T13:26:18.004 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/158 2023-06-20T13:26:18.230 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/158 2023-06-20T13:26:18.386 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/158 2023-06-20T13:26:18.490 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/158 2023-06-20T13:26:18.788 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : jq-1.6-7.el8.x86_64 110/158 2023-06-20T13:26:19.020 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : automake-1.16.1-7.el8.noarch 111/158 2023-06-20T13:26:19.630 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: cephadm-2:18.0.0-4512.g2016e3af.el8.noarch 112/158 2023-06-20T13:26:19.788 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : cephadm-2:18.0.0-4512.g2016e3af.el8.noarch 112/158 2023-06-20T13:26:19.919 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4512.g2016e3af.e 113/158 2023-06-20T13:26:20.117 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4512.g2016e3af. 114/158 2023-06-20T13:26:20.335 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4512.g2016e3af.el8.noa 115/158 2023-06-20T13:26:20.607 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4512.g2016e3af.el8.noa 115/158 2023-06-20T13:26:20.851 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4512.g2016e3af.el8.n 116/158 2023-06-20T13:26:22.032 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4512.g2016e3af.el8.n 116/158 2023-06-20T13:26:22.235 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4512.g201 117/158 2023-06-20T13:26:22.368 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4512.g201 117/158 2023-06-20T13:26:22.760 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4512.g2016e3af.el 118/158 2023-06-20T13:26:22.977 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-2:18.0.0-4512.g2016e3af.el8.x86_64 119/158 2023-06-20T13:26:23.043 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4512.g2016e3af.el8.x86_64 119/158 2023-06-20T13:26:23.219 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-mgr-rook-2:18.0.0-4512.g2016e3af.el8.noarch 120/158 2023-06-20T13:26:23.246 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4512.g2016e3af.el8.noarch 120/158 2023-06-20T13:26:23.456 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-2:18.0.0-4512.g2016e3af.el8.x86_64 121/158 2023-06-20T13:26:23.602 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/158 2023-06-20T13:26:28.897 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/158 2023-06-20T13:26:30.515 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-test-2:18.0.0-4512.g2016e3af.el8.x86_64 123/158 2023-06-20T13:26:30.717 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-radosgw-2:18.0.0-4512.g2016e3af.el8.x86_64 124/158 2023-06-20T13:26:30.779 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4512.g2016e3af.el8.x86_64 124/158 2023-06-20T13:26:30.986 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4512.g2016e 125/158 2023-06-20T13:26:31.058 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4512.g2016e 125/158 2023-06-20T13:26:31.269 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : cephfs-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 126/158 2023-06-20T13:26:31.700 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 126/158 2023-06-20T13:26:31.901 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : rbd-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 127/158 2023-06-20T13:26:32.220 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 127/158 2023-06-20T13:26:32.553 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/158 2023-06-20T13:26:33.872 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ceph-fuse-2:18.0.0-4512.g2016e3af.el8.x86_64 129/158 2023-06-20T13:26:34.231 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/158 2023-06-20T13:26:34.458 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/158 2023-06-20T13:26:34.666 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/158 2023-06-20T13:26:34.814 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/158 2023-06-20T13:26:35.027 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libcephfs-devel-2:18.0.0-4512.g2016e3af.el8.x86_ 134/158 2023-06-20T13:26:36.261 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/158 2023-06-20T13:26:36.518 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/158 2023-06-20T13:26:36.555 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/158 2023-06-20T13:26:36.768 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : cephfs-top-2:18.0.0-4512.g2016e3af.el8.noarch 136/158 2023-06-20T13:26:36.977 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : rbd-fuse-2:18.0.0-4512.g2016e3af.el8.x86_64 137/158 2023-06-20T13:26:37.314 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : rbd-nbd-2:18.0.0-4512.g2016e3af.el8.x86_64 138/158 2023-06-20T13:26:37.544 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 139/158 2023-06-20T13:26:37.709 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-7.el 140/158 2023-06-20T13:26:37.749 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-7.el 140/158 2023-06-20T13:26:37.957 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 141/158 2023-06-20T13:26:38.183 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : flex-2.6.1-9.el8.x86_64 142/158 2023-06-20T13:26:38.299 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 142/158 2023-06-20T13:26:38.536 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : bison-3.0.4-10.el8.x86_64 143/158 2023-06-20T13:26:38.560 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 143/158 2023-06-20T13:26:38.752 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 144/158 2023-06-20T13:26:38.979 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 145/158 2023-06-20T13:26:38.980 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 146/158 2023-06-20T13:26:39.238 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 146/158 2023-06-20T13:26:39.239 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 147/158 2023-06-20T13:26:39.478 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 147/158 2023-06-20T13:26:39.495 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 148/158 2023-06-20T13:26:39.607 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 148/158 2023-06-20T13:26:39.607 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 149/158 2023-06-20T13:26:39.867 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 149/158 2023-06-20T13:26:40.027 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 150/158 2023-06-20T13:26:40.237 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 151/158 2023-06-20T13:26:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 152/158 2023-06-20T13:26:40.444 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 153/158 2023-06-20T13:26:40.670 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 153/158 2023-06-20T13:26:40.671 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 154/158 2023-06-20T13:26:40.895 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 154/158 2023-06-20T13:26:40.895 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 155/158 2023-06-20T13:26:41.087 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 155/158 2023-06-20T13:26:41.087 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 156/158 2023-06-20T13:26:41.303 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 156/158 2023-06-20T13:26:41.304 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 157/158 2023-06-20T13:26:41.520 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 157/158 2023-06-20T13:26:41.702 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 158/158 2023-06-20T13:26:41.937 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 158/158 2023-06-20T13:26:41.937 INFO:teuthology.orchestra.run.smithi032.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-06-20T13:26:41.937 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:26:42.671 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-2:18.0.0-4512.g2016e3af.el8.x86_64 1/158 2023-06-20T13:26:42.672 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-base-2:18.0.0-4512.g2016e3af.el8.x86_64 2/158 2023-06-20T13:26:42.672 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-common-2:18.0.0-4512.g2016e3af.el8.x86_64 3/158 2023-06-20T13:26:42.672 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-fuse-2:18.0.0-4512.g2016e3af.el8.x86_64 4/158 2023-06-20T13:26:42.672 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4512.g2016e 5/158 2023-06-20T13:26:42.672 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mds-2:18.0.0-4512.g2016e3af.el8.x86_64 6/158 2023-06-20T13:26:42.672 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-2:18.0.0-4512.g2016e3af.el8.x86_64 7/158 2023-06-20T13:26:42.673 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mon-2:18.0.0-4512.g2016e3af.el8.x86_64 8/158 2023-06-20T13:26:42.673 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-osd-2:18.0.0-4512.g2016e3af.el8.x86_64 9/158 2023-06-20T13:26:42.673 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-radosgw-2:18.0.0-4512.g2016e3af.el8.x86_64 10/158 2023-06-20T13:26:42.673 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-selinux-2:18.0.0-4512.g2016e3af.el8.x86_64 11/158 2023-06-20T13:26:42.673 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-test-2:18.0.0-4512.g2016e3af.el8.x86_64 12/158 2023-06-20T13:26:42.674 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : cephfs-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 13/158 2023-06-20T13:26:42.674 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libcephfs-devel-2:18.0.0-4512.g2016e3af.el8.x86_ 14/158 2023-06-20T13:26:42.674 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libcephfs2-2:18.0.0-4512.g2016e3af.el8.x86_64 15/158 2023-06-20T13:26:42.674 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libcephsqlite-2:18.0.0-4512.g2016e3af.el8.x86_64 16/158 2023-06-20T13:26:42.675 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librados-devel-2:18.0.0-4512.g2016e3af.el8.x86_6 17/158 2023-06-20T13:26:42.676 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libradosstriper1-2:18.0.0-4512.g2016e3af.el8.x86 18/158 2023-06-20T13:26:42.676 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librgw2-2:18.0.0-4512.g2016e3af.el8.x86_64 19/158 2023-06-20T13:26:42.676 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4512.g2016e3af.el 20/158 2023-06-20T13:26:42.677 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-ceph-common-2:18.0.0-4512.g2016e3af.el8. 21/158 2023-06-20T13:26:42.677 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cephfs-2:18.0.0-4512.g2016e3af.el8.x86_6 22/158 2023-06-20T13:26:42.677 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-rados-2:18.0.0-4512.g2016e3af.el8.x86_64 23/158 2023-06-20T13:26:42.677 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-rbd-2:18.0.0-4512.g2016e3af.el8.x86_64 24/158 2023-06-20T13:26:42.677 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-rgw-2:18.0.0-4512.g2016e3af.el8.x86_64 25/158 2023-06-20T13:26:42.687 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : rbd-fuse-2:18.0.0-4512.g2016e3af.el8.x86_64 26/158 2023-06-20T13:26:42.687 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : rbd-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 27/158 2023-06-20T13:26:42.687 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : rbd-nbd-2:18.0.0-4512.g2016e3af.el8.x86_64 28/158 2023-06-20T13:26:42.687 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4512.g2016e3af. 29/158 2023-06-20T13:26:42.687 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4512.g2016e3af.el8.noa 30/158 2023-06-20T13:26:42.687 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4512.g2016e3af.el8.n 31/158 2023-06-20T13:26:42.688 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4512.g201 32/158 2023-06-20T13:26:42.688 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4512.g2016e3af.el 33/158 2023-06-20T13:26:42.688 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4512.g2016e3af.el8.noarch 34/158 2023-06-20T13:26:42.688 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4512.g2016e3af.e 35/158 2023-06-20T13:26:42.688 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ceph-volume-2:18.0.0-4512.g2016e3af.el8.noarch 36/158 2023-06-20T13:26:42.688 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : cephadm-2:18.0.0-4512.g2016e3af.el8.noarch 37/158 2023-06-20T13:26:42.688 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : cephfs-top-2:18.0.0-4512.g2016e3af.el8.noarch 38/158 2023-06-20T13:26:42.689 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/158 2023-06-20T13:26:42.689 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/158 2023-06-20T13:26:42.689 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/158 2023-06-20T13:26:42.689 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : jq-1.6-7.el8.x86_64 42/158 2023-06-20T13:26:42.689 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/158 2023-06-20T13:26:42.689 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/158 2023-06-20T13:26:42.689 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/158 2023-06-20T13:26:42.689 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/158 2023-06-20T13:26:42.690 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/158 2023-06-20T13:26:42.690 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/158 2023-06-20T13:26:42.690 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/158 2023-06-20T13:26:42.690 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/158 2023-06-20T13:26:42.690 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/158 2023-06-20T13:26:42.691 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/158 2023-06-20T13:26:42.691 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/158 2023-06-20T13:26:42.691 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/158 2023-06-20T13:26:42.691 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/158 2023-06-20T13:26:42.691 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/158 2023-06-20T13:26:42.691 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/158 2023-06-20T13:26:42.691 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/158 2023-06-20T13:26:42.691 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/158 2023-06-20T13:26:42.692 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/158 2023-06-20T13:26:42.692 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/158 2023-06-20T13:26:42.692 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/158 2023-06-20T13:26:42.692 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/158 2023-06-20T13:26:42.692 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/158 2023-06-20T13:26:42.692 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/158 2023-06-20T13:26:42.692 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/158 2023-06-20T13:26:42.693 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/158 2023-06-20T13:26:42.693 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/158 2023-06-20T13:26:42.693 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/158 2023-06-20T13:26:42.693 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/158 2023-06-20T13:26:42.693 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/158 2023-06-20T13:26:42.693 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/158 2023-06-20T13:26:42.693 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/158 2023-06-20T13:26:42.693 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/158 2023-06-20T13:26:42.694 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/158 2023-06-20T13:26:42.694 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/158 2023-06-20T13:26:42.694 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libgfortran-8.5.0-19.el8.x86_64 77/158 2023-06-20T13:26:42.694 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libquadmath-8.5.0-19.el8.x86_64 78/158 2023-06-20T13:26:42.694 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 79/158 2023-06-20T13:26:42.694 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/158 2023-06-20T13:26:42.694 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/158 2023-06-20T13:26:42.694 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/158 2023-06-20T13:26:42.695 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/158 2023-06-20T13:26:42.695 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/158 2023-06-20T13:26:42.695 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/158 2023-06-20T13:26:42.695 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/158 2023-06-20T13:26:42.695 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/158 2023-06-20T13:26:42.695 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/158 2023-06-20T13:26:42.695 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/158 2023-06-20T13:26:42.695 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/158 2023-06-20T13:26:42.696 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/158 2023-06-20T13:26:42.696 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/158 2023-06-20T13:26:42.696 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/158 2023-06-20T13:26:42.696 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/158 2023-06-20T13:26:42.696 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/158 2023-06-20T13:26:42.696 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/158 2023-06-20T13:26:42.696 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/158 2023-06-20T13:26:42.696 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/158 2023-06-20T13:26:42.697 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/158 2023-06-20T13:26:42.697 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/158 2023-06-20T13:26:42.697 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/158 2023-06-20T13:26:42.697 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/158 2023-06-20T13:26:42.697 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/158 2023-06-20T13:26:42.697 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/158 2023-06-20T13:26:42.697 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/158 2023-06-20T13:26:42.698 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/158 2023-06-20T13:26:42.698 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/158 2023-06-20T13:26:42.698 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/158 2023-06-20T13:26:42.698 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/158 2023-06-20T13:26:42.698 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/158 2023-06-20T13:26:42.698 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/158 2023-06-20T13:26:42.698 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/158 2023-06-20T13:26:42.698 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/158 2023-06-20T13:26:42.699 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/158 2023-06-20T13:26:42.699 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/158 2023-06-20T13:26:42.699 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/158 2023-06-20T13:26:42.699 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/158 2023-06-20T13:26:42.699 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/158 2023-06-20T13:26:42.699 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/158 2023-06-20T13:26:42.699 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/158 2023-06-20T13:26:42.699 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/158 2023-06-20T13:26:42.700 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/158 2023-06-20T13:26:42.700 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/158 2023-06-20T13:26:42.700 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/158 2023-06-20T13:26:42.700 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/158 2023-06-20T13:26:42.700 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/158 2023-06-20T13:26:42.700 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/158 2023-06-20T13:26:42.700 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/158 2023-06-20T13:26:42.701 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librados2-2:18.0.0-4512.g2016e3af.el8.x86_64 129/158 2023-06-20T13:26:42.701 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/158 2023-06-20T13:26:42.701 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librbd1-2:18.0.0-4512.g2016e3af.el8.x86_64 131/158 2023-06-20T13:26:42.701 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/158 2023-06-20T13:26:42.701 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-7.el 133/158 2023-06-20T13:26:42.702 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/158 2023-06-20T13:26:42.702 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/158 2023-06-20T13:26:42.702 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/158 2023-06-20T13:26:42.702 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/158 2023-06-20T13:26:42.702 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/158 2023-06-20T13:26:42.702 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/158 2023-06-20T13:26:42.702 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/158 2023-06-20T13:26:42.703 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/158 2023-06-20T13:26:42.703 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/158 2023-06-20T13:26:42.703 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/158 2023-06-20T13:26:42.703 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/158 2023-06-20T13:26:42.703 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/158 2023-06-20T13:26:42.703 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/158 2023-06-20T13:26:42.703 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/158 2023-06-20T13:26:42.703 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/158 2023-06-20T13:26:42.704 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/158 2023-06-20T13:26:42.704 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/158 2023-06-20T13:26:42.704 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/158 2023-06-20T13:26:42.704 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/158 2023-06-20T13:26:42.704 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/158 2023-06-20T13:26:42.704 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/158 2023-06-20T13:26:42.704 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/158 2023-06-20T13:26:42.704 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/158 2023-06-20T13:26:42.705 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 157/158 2023-06-20T13:26:44.778 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 158/158 2023-06-20T13:26:44.778 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:26:44.779 INFO:teuthology.orchestra.run.smithi032.stdout:Upgraded: 2023-06-20T13:26:44.779 INFO:teuthology.orchestra.run.smithi032.stdout: NetworkManager-initscripts-updown-1:1.40.16-7.el8.noarch 2023-06-20T13:26:44.779 INFO:teuthology.orchestra.run.smithi032.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-06-20T13:26:44.779 INFO:teuthology.orchestra.run.smithi032.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-06-20T13:26:44.779 INFO:teuthology.orchestra.run.smithi032.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-06-20T13:26:44.779 INFO:teuthology.orchestra.run.smithi032.stdout: iproute-6.2.0-2.el8.x86_64 2023-06-20T13:26:44.779 INFO:teuthology.orchestra.run.smithi032.stdout: libblkid-2.32.1-42.el8.x86_64 2023-06-20T13:26:44.779 INFO:teuthology.orchestra.run.smithi032.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-06-20T13:26:44.780 INFO:teuthology.orchestra.run.smithi032.stdout: libmount-2.32.1-42.el8.x86_64 2023-06-20T13:26:44.780 INFO:teuthology.orchestra.run.smithi032.stdout: librados2-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.780 INFO:teuthology.orchestra.run.smithi032.stdout: librbd1-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.780 INFO:teuthology.orchestra.run.smithi032.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-06-20T13:26:44.780 INFO:teuthology.orchestra.run.smithi032.stdout: libuuid-2.32.1-42.el8.x86_64 2023-06-20T13:26:44.780 INFO:teuthology.orchestra.run.smithi032.stdout: util-linux-2.32.1-42.el8.x86_64 2023-06-20T13:26:44.780 INFO:teuthology.orchestra.run.smithi032.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-06-20T13:26:44.781 INFO:teuthology.orchestra.run.smithi032.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-06-20T13:26:44.781 INFO:teuthology.orchestra.run.smithi032.stdout:Installed: 2023-06-20T13:26:44.781 INFO:teuthology.orchestra.run.smithi032.stdout: automake-1.16.1-7.el8.noarch 2023-06-20T13:26:44.781 INFO:teuthology.orchestra.run.smithi032.stdout: bison-3.0.4-10.el8.x86_64 2023-06-20T13:26:44.781 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.781 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-base-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.781 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-common-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.781 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-fuse-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.782 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-grafana-dashboards-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-20T13:26:44.782 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-immutable-object-cache-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.782 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mds-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.782 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.782 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-cephadm-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-20T13:26:44.782 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-dashboard-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-20T13:26:44.782 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-20T13:26:44.782 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-modules-core-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-20T13:26:44.783 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-rook-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-20T13:26:44.783 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mon-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.783 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-osd-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.783 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-prometheus-alerts-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-20T13:26:44.783 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-radosgw-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.783 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-selinux-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.783 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-test-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.783 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-volume-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-20T13:26:44.784 INFO:teuthology.orchestra.run.smithi032.stdout: cephadm-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-20T13:26:44.784 INFO:teuthology.orchestra.run.smithi032.stdout: cephfs-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.784 INFO:teuthology.orchestra.run.smithi032.stdout: cephfs-top-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-20T13:26:44.784 INFO:teuthology.orchestra.run.smithi032.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-06-20T13:26:44.784 INFO:teuthology.orchestra.run.smithi032.stdout: flex-2.6.1-9.el8.x86_64 2023-06-20T13:26:44.784 INFO:teuthology.orchestra.run.smithi032.stdout: fuse-2.9.7-17.el8.x86_64 2023-06-20T13:26:44.784 INFO:teuthology.orchestra.run.smithi032.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-06-20T13:26:44.784 INFO:teuthology.orchestra.run.smithi032.stdout: jq-1.6-7.el8.x86_64 2023-06-20T13:26:44.785 INFO:teuthology.orchestra.run.smithi032.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-06-20T13:26:44.785 INFO:teuthology.orchestra.run.smithi032.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-06-20T13:26:44.785 INFO:teuthology.orchestra.run.smithi032.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-06-20T13:26:44.785 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs-devel-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.785 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs2-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.785 INFO:teuthology.orchestra.run.smithi032.stdout: libcephsqlite-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.785 INFO:teuthology.orchestra.run.smithi032.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-06-20T13:26:44.786 INFO:teuthology.orchestra.run.smithi032.stdout: libgfortran-8.5.0-19.el8.x86_64 2023-06-20T13:26:44.786 INFO:teuthology.orchestra.run.smithi032.stdout: liboath-2.6.2-3.el8.x86_64 2023-06-20T13:26:44.786 INFO:teuthology.orchestra.run.smithi032.stdout: libpq-13.5-1.el8.x86_64 2023-06-20T13:26:44.786 INFO:teuthology.orchestra.run.smithi032.stdout: libquadmath-8.5.0-19.el8.x86_64 2023-06-20T13:26:44.786 INFO:teuthology.orchestra.run.smithi032.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-06-20T13:26:44.786 INFO:teuthology.orchestra.run.smithi032.stdout: librados-devel-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.786 INFO:teuthology.orchestra.run.smithi032.stdout: libradosstriper1-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.786 INFO:teuthology.orchestra.run.smithi032.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-06-20T13:26:44.787 INFO:teuthology.orchestra.run.smithi032.stdout: librgw2-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.787 INFO:teuthology.orchestra.run.smithi032.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-06-20T13:26:44.787 INFO:teuthology.orchestra.run.smithi032.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-06-20T13:26:44.787 INFO:teuthology.orchestra.run.smithi032.stdout: libtool-2.4.6-25.el8.x86_64 2023-06-20T13:26:44.787 INFO:teuthology.orchestra.run.smithi032.stdout: libunwind-1.3.1-3.el8.x86_64 2023-06-20T13:26:44.787 INFO:teuthology.orchestra.run.smithi032.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-06-20T13:26:44.787 INFO:teuthology.orchestra.run.smithi032.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-06-20T13:26:44.787 INFO:teuthology.orchestra.run.smithi032.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-06-20T13:26:44.788 INFO:teuthology.orchestra.run.smithi032.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-06-20T13:26:44.788 INFO:teuthology.orchestra.run.smithi032.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-06-20T13:26:44.788 INFO:teuthology.orchestra.run.smithi032.stdout: openblas-0.3.15-4.el8.x86_64 2023-06-20T13:26:44.788 INFO:teuthology.orchestra.run.smithi032.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-06-20T13:26:44.788 INFO:teuthology.orchestra.run.smithi032.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-06-20T13:26:44.788 INFO:teuthology.orchestra.run.smithi032.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-06-20T13:26:44.788 INFO:teuthology.orchestra.run.smithi032.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-06-20T13:26:44.788 INFO:teuthology.orchestra.run.smithi032.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-06-20T13:26:44.789 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-06-20T13:26:44.789 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-06-20T13:26:44.789 INFO:teuthology.orchestra.run.smithi032.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-06-20T13:26:44.789 INFO:teuthology.orchestra.run.smithi032.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-06-20T13:26:44.789 INFO:teuthology.orchestra.run.smithi032.stdout: python3-babel-2.5.1-7.el8.noarch 2023-06-20T13:26:44.789 INFO:teuthology.orchestra.run.smithi032.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-06-20T13:26:44.789 INFO:teuthology.orchestra.run.smithi032.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-06-20T13:26:44.789 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-06-20T13:26:44.790 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-argparse-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.790 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-common-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.790 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cephfs-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.790 INFO:teuthology.orchestra.run.smithi032.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-06-20T13:26:44.790 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-06-20T13:26:44.790 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-06-20T13:26:44.790 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-06-20T13:26:44.790 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-06-20T13:26:44.791 INFO:teuthology.orchestra.run.smithi032.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-06-20T13:26:44.791 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-6.2-6.el8.noarch 2023-06-20T13:26:44.791 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-06-20T13:26:44.791 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-06-20T13:26:44.791 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-06-20T13:26:44.791 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-06-20T13:26:44.791 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-06-20T13:26:44.791 INFO:teuthology.orchestra.run.smithi032.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-06-20T13:26:44.792 INFO:teuthology.orchestra.run.smithi032.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-06-20T13:26:44.792 INFO:teuthology.orchestra.run.smithi032.stdout: python3-mako-1.0.6-14.el8.noarch 2023-06-20T13:26:44.792 INFO:teuthology.orchestra.run.smithi032.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-06-20T13:26:44.792 INFO:teuthology.orchestra.run.smithi032.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-06-20T13:26:44.792 INFO:teuthology.orchestra.run.smithi032.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-06-20T13:26:44.792 INFO:teuthology.orchestra.run.smithi032.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-06-20T13:26:44.792 INFO:teuthology.orchestra.run.smithi032.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-06-20T13:26:44.793 INFO:teuthology.orchestra.run.smithi032.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-06-20T13:26:44.793 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-06-20T13:26:44.793 INFO:teuthology.orchestra.run.smithi032.stdout: python3-portend-2.6-1.el8.noarch 2023-06-20T13:26:44.793 INFO:teuthology.orchestra.run.smithi032.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-06-20T13:26:44.793 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-06-20T13:26:44.793 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-06-20T13:26:44.793 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-06-20T13:26:44.793 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pycparser-2.14-14.el8.noarch 2023-06-20T13:26:44.794 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pytz-2017.2-9.el8.noarch 2023-06-20T13:26:44.794 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rados-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.794 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rbd-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.794 INFO:teuthology.orchestra.run.smithi032.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-06-20T13:26:44.794 INFO:teuthology.orchestra.run.smithi032.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-06-20T13:26:44.794 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rgw-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.794 INFO:teuthology.orchestra.run.smithi032.stdout: python3-routes-2.4.1-12.el8.noarch 2023-06-20T13:26:44.794 INFO:teuthology.orchestra.run.smithi032.stdout: python3-rsa-4.8-1.el8.noarch 2023-06-20T13:26:44.795 INFO:teuthology.orchestra.run.smithi032.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-06-20T13:26:44.795 INFO:teuthology.orchestra.run.smithi032.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-06-20T13:26:44.795 INFO:teuthology.orchestra.run.smithi032.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-06-20T13:26:44.795 INFO:teuthology.orchestra.run.smithi032.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-06-20T13:26:44.795 INFO:teuthology.orchestra.run.smithi032.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-06-20T13:26:44.795 INFO:teuthology.orchestra.run.smithi032.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-06-20T13:26:44.795 INFO:teuthology.orchestra.run.smithi032.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-06-20T13:26:44.795 INFO:teuthology.orchestra.run.smithi032.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-06-20T13:26:44.796 INFO:teuthology.orchestra.run.smithi032.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-06-20T13:26:44.796 INFO:teuthology.orchestra.run.smithi032.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-06-20T13:26:44.796 INFO:teuthology.orchestra.run.smithi032.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-06-20T13:26:44.796 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-fuse-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.796 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.796 INFO:teuthology.orchestra.run.smithi032.stdout: rbd-nbd-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:26:44.796 INFO:teuthology.orchestra.run.smithi032.stdout: socat-1.7.4.1-1.el8.x86_64 2023-06-20T13:26:44.796 INFO:teuthology.orchestra.run.smithi032.stdout: thrift-0.13.0-2.el8.x86_64 2023-06-20T13:26:44.797 INFO:teuthology.orchestra.run.smithi032.stdout: uuid-1.6.2-43.el8.x86_64 2023-06-20T13:26:44.797 INFO:teuthology.orchestra.run.smithi032.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-06-20T13:26:44.797 INFO:teuthology.orchestra.run.smithi032.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-06-20T13:26:44.797 INFO:teuthology.orchestra.run.smithi032.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-06-20T13:26:44.797 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:26:44.798 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2023-06-20T13:26:45.096 DEBUG:teuthology.parallel:result is None 2023-06-20T13:27:16.025 INFO:teuthology.orchestra.run.smithi115.stdout:[MIRROR] gperftools-libs-2.7-9.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/g/gperftools-libs-2.7-9.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-06-20T13:27:16.025 INFO:teuthology.orchestra.run.smithi115.stdout:[MIRROR] liboath-2.6.2-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/liboath-2.6.2-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-06-20T13:27:16.025 INFO:teuthology.orchestra.run.smithi115.stdout:[MIRROR] libunwind-1.3.1-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/libunwind-1.3.1-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-06-20T13:27:16.612 INFO:teuthology.orchestra.run.smithi115.stdout:(97/143): liboath-2.6.2-3.el8.x86_64.rpm 459 B/s | 59 kB 02:11 2023-06-20T13:27:16.629 INFO:teuthology.orchestra.run.smithi115.stdout:(98/143): libunwind-1.3.1-3.el8.x86_64.rpm 586 B/s | 75 kB 02:11 2023-06-20T13:27:16.954 INFO:teuthology.orchestra.run.smithi115.stdout:(99/143): gperftools-libs-2.7-9.el8.x86_64.rpm 2.3 kB/s | 306 kB 02:11 2023-06-20T13:27:17.263 INFO:teuthology.orchestra.run.smithi115.stdout:(100/143): python3-beautifulsoup4-4.6.3-2.el8.1 601 kB/s | 185 kB 00:00 2023-06-20T13:27:17.380 INFO:teuthology.orchestra.run.smithi115.stdout:(101/143): python3-cachetools-3.1.1-4.el8.noarc 283 kB/s | 33 kB 00:00 2023-06-20T13:27:17.497 INFO:teuthology.orchestra.run.smithi115.stdout:(102/143): python3-certifi-2018.10.15-7.el8.noa 140 kB/s | 16 kB 00:00 2023-06-20T13:27:17.780 INFO:teuthology.orchestra.run.smithi115.stdout:(103/143): python3-cheroot-8.5.2-1.el8.noarch.r 609 kB/s | 173 kB 00:00 2023-06-20T13:27:18.164 INFO:teuthology.orchestra.run.smithi115.stdout:(104/143): python3-cherrypy-18.4.0-1.el8.noarch 1.0 MB/s | 384 kB 00:00 2023-06-20T13:27:18.281 INFO:teuthology.orchestra.run.smithi115.stdout:(105/143): python3-google-auth-1.1.1-10.el8.noa 697 kB/s | 81 kB 00:00 2023-06-20T13:27:18.397 INFO:teuthology.orchestra.run.smithi115.stdout:(106/143): python3-jaraco-6.2-6.el8.noarch.rpm 95 kB/s | 11 kB 00:00 2023-06-20T13:27:18.523 INFO:teuthology.orchestra.run.smithi115.stdout:(107/143): python3-jaraco-functools-2.0-4.el8.n 141 kB/s | 18 kB 00:00 2023-06-20T13:27:18.823 INFO:teuthology.orchestra.run.smithi115.stdout:(108/143): python3-kubernetes-11.0.0-6.el8.noar 3.9 MB/s | 1.2 MB 00:00 2023-06-20T13:27:18.940 INFO:teuthology.orchestra.run.smithi115.stdout:(109/143): python3-logutils-0.3.5-11.el8.noarch 417 kB/s | 49 kB 00:00 2023-06-20T13:27:19.065 INFO:teuthology.orchestra.run.smithi115.stdout:(110/143): python3-more-itertools-7.2.0-3.el8.n 471 kB/s | 59 kB 00:00 2023-06-20T13:27:19.182 INFO:teuthology.orchestra.run.smithi115.stdout:(111/143): python3-natsort-7.1.1-2.el8.noarch.r 517 kB/s | 60 kB 00:00 2023-06-20T13:27:19.299 INFO:teuthology.orchestra.run.smithi115.stdout:(112/143): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2023-06-20T13:27:19.416 INFO:teuthology.orchestra.run.smithi115.stdout:(113/143): python3-portend-2.6-1.el8.noarch.rpm 133 kB/s | 16 kB 00:00 2023-06-20T13:27:19.533 INFO:teuthology.orchestra.run.smithi115.stdout:(114/143): python3-repoze-lru-0.7-6.el8.noarch. 289 kB/s | 34 kB 00:00 2023-06-20T13:27:19.650 INFO:teuthology.orchestra.run.smithi115.stdout:(115/143): python3-routes-2.4.1-12.el8.noarch.r 1.6 MB/s | 196 kB 00:00 2023-06-20T13:27:19.767 INFO:teuthology.orchestra.run.smithi115.stdout:(116/143): python3-rsa-4.8-1.el8.noarch.rpm 528 kB/s | 61 kB 00:00 2023-06-20T13:27:19.892 INFO:teuthology.orchestra.run.smithi115.stdout:(117/143): python3-simplegeneric-0.8.1-17.el8.n 150 kB/s | 19 kB 00:00 2023-06-20T13:27:20.009 INFO:teuthology.orchestra.run.smithi115.stdout:(118/143): python3-singledispatch-3.4.0.3-18.el 205 kB/s | 24 kB 00:00 2023-06-20T13:27:20.127 INFO:teuthology.orchestra.run.smithi115.stdout:(119/143): python3-tempora-1.14.1-5.el8.noarch. 250 kB/s | 29 kB 00:00 2023-06-20T13:27:20.243 INFO:teuthology.orchestra.run.smithi115.stdout:(120/143): python3-trustme-0.6.0-4.el8.noarch.r 236 kB/s | 27 kB 00:00 2023-06-20T13:27:20.360 INFO:teuthology.orchestra.run.smithi115.stdout:(121/143): python3-waitress-1.4.3-1.el8.noarch. 2.1 MB/s | 255 kB 00:00 2023-06-20T13:27:20.468 INFO:teuthology.orchestra.run.smithi115.stdout:(122/143): python3-webob-1.8.5-1.el8.1.noarch.r 2.3 MB/s | 251 kB 00:00 2023-06-20T13:27:20.585 INFO:teuthology.orchestra.run.smithi115.stdout:(123/143): python3-websocket-client-0.56.0-5.el 525 kB/s | 61 kB 00:00 2023-06-20T13:27:20.702 INFO:teuthology.orchestra.run.smithi115.stdout:(124/143): python3-webtest-2.0.33-1.el8.noarch. 732 kB/s | 85 kB 00:00 2023-06-20T13:27:20.819 INFO:teuthology.orchestra.run.smithi115.stdout:(125/143): python3-zc-lockfile-2.0-2.el8.noarch 197 kB/s | 23 kB 00:00 2023-06-20T13:27:21.136 INFO:teuthology.orchestra.run.smithi115.stdout:(126/143): thrift-0.13.0-2.el8.x86_64.rpm 5.5 MB/s | 1.7 MB 00:00 2023-06-20T13:27:22.119 INFO:teuthology.orchestra.run.smithi115.stdout:(127/143): librados2-18.0.0-4512.g2016e3af.el8. 3.7 MB/s | 3.7 MB 00:00 2023-06-20T13:27:22.611 INFO:teuthology.orchestra.run.smithi115.stdout:(128/143): librbd1-18.0.0-4512.g2016e3af.el8.x8 7.3 MB/s | 3.6 MB 00:00 2023-06-20T13:27:22.803 INFO:teuthology.orchestra.run.smithi115.stdout:(129/143): NetworkManager-initscripts-updown-1. 748 kB/s | 143 kB 00:00 2023-06-20T13:27:22.862 INFO:teuthology.orchestra.run.smithi115.stdout:(130/143): elfutils-debuginfod-client-0.189-2.e 1.3 MB/s | 76 kB 00:00 2023-06-20T13:27:22.954 INFO:teuthology.orchestra.run.smithi115.stdout:(131/143): elfutils-libelf-0.189-2.el8.x86_64.r 2.5 MB/s | 232 kB 00:00 2023-06-20T13:27:23.079 INFO:teuthology.orchestra.run.smithi115.stdout:(132/143): elfutils-libs-0.189-2.el8.x86_64.rpm 2.4 MB/s | 302 kB 00:00 2023-06-20T13:27:23.321 INFO:teuthology.orchestra.run.smithi115.stdout:(133/143): iproute-6.2.0-2.el8.x86_64.rpm 3.6 MB/s | 880 kB 00:00 2023-06-20T13:27:23.412 INFO:teuthology.orchestra.run.smithi115.stdout:(134/143): libblkid-2.32.1-42.el8.x86_64.rpm 2.4 MB/s | 220 kB 00:00 2023-06-20T13:27:23.505 INFO:teuthology.orchestra.run.smithi115.stdout:(135/143): libfdisk-2.32.1-42.el8.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2023-06-20T13:27:23.588 INFO:teuthology.orchestra.run.smithi115.stdout:(136/143): libmount-2.32.1-42.el8.x86_64.rpm 2.8 MB/s | 236 kB 00:00 2023-06-20T13:27:23.672 INFO:teuthology.orchestra.run.smithi115.stdout:(137/143): libsmartcols-2.32.1-42.el8.x86_64.rp 2.1 MB/s | 179 kB 00:00 2023-06-20T13:27:23.731 INFO:teuthology.orchestra.run.smithi115.stdout:(138/143): libuuid-2.32.1-42.el8.x86_64.rpm 1.6 MB/s | 98 kB 00:00 2023-06-20T13:27:24.214 INFO:teuthology.orchestra.run.smithi115.stdout:(139/143): util-linux-2.32.1-42.el8.x86_64.rpm 5.4 MB/s | 2.6 MB 00:00 2023-06-20T13:27:24.272 INFO:teuthology.orchestra.run.smithi115.stdout:(140/143): util-linux-user-2.32.1-42.el8.x86_64 1.7 MB/s | 102 kB 00:00 2023-06-20T13:27:24.464 INFO:teuthology.orchestra.run.smithi115.stdout:(141/143): xfsprogs-5.0.0-12.el8.x86_64.rpm 5.6 MB/s | 1.1 MB 00:00 2023-06-20T13:29:27.096 INFO:teuthology.orchestra.run.smithi115.stdout:[MIRROR] python3-asyncssh-2.7.0-2.el8.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/p/python3-asyncssh-2.7.0-2.el8.noarch.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-06-20T13:29:27.097 INFO:teuthology.orchestra.run.smithi115.stdout:[MIRROR] python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/p/python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-06-20T13:29:27.705 INFO:teuthology.orchestra.run.smithi115.stdout:(142/143): python3-bcrypt-3.1.6-2.el8.1.x86_64. 340 B/s | 44 kB 02:11 2023-06-20T13:29:28.272 INFO:teuthology.orchestra.run.smithi115.stdout:(143/143): python3-asyncssh-2.7.0-2.el8.noarch. 3.6 kB/s | 476 kB 02:11 2023-06-20T13:29:28.274 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2023-06-20T13:29:28.274 INFO:teuthology.orchestra.run.smithi115.stdout:Total 780 kB/s | 212 MB 04:38 2023-06-20T13:29:30.058 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2023-06-20T13:29:30.468 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2023-06-20T13:29:30.468 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2023-06-20T13:29:31.942 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2023-06-20T13:29:31.946 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2023-06-20T13:29:37.160 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2023-06-20T13:29:37.393 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-06-20T13:29:37.571 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/158 2023-06-20T13:29:37.724 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/158 2023-06-20T13:29:37.816 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/158 2023-06-20T13:29:38.032 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/158 2023-06-20T13:29:38.113 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/158 2023-06-20T13:29:38.322 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/158 2023-06-20T13:29:38.538 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/158 2023-06-20T13:29:38.761 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 6/158 2023-06-20T13:29:38.957 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/158 2023-06-20T13:29:39.428 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/158 2023-06-20T13:29:39.632 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : librados2-2:18.0.0-4512.g2016e3af.el8.x86_64 8/158 2023-06-20T13:29:40.088 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados2-2:18.0.0-4512.g2016e3af.el8.x86_64 8/158 2023-06-20T13:29:40.299 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : librbd1-2:18.0.0-4512.g2016e3af.el8.x86_64 9/158 2023-06-20T13:29:40.438 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librbd1-2:18.0.0-4512.g2016e3af.el8.x86_64 9/158 2023-06-20T13:29:40.631 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephfs2-2:18.0.0-4512.g2016e3af.el8.x86_64 10/158 2023-06-20T13:29:40.742 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephfs2-2:18.0.0-4512.g2016e3af.el8.x86_64 10/158 2023-06-20T13:29:40.966 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rados-2:18.0.0-4512.g2016e3af.el8.x86_64 11/158 2023-06-20T13:29:41.148 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/158 2023-06-20T13:29:41.236 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/158 2023-06-20T13:29:41.506 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/158 2023-06-20T13:29:41.724 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 14/158 2023-06-20T13:29:42.178 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libpq-13.5-1.el8.x86_64 15/158 2023-06-20T13:29:42.420 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 16/158 2023-06-20T13:29:42.556 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephsqlite-2:18.0.0-4512.g2016e3af.el8.x86_64 17/158 2023-06-20T13:29:42.675 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4512.g2016e3af.el8.x86_64 17/158 2023-06-20T13:29:42.839 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libradosstriper1-2:18.0.0-4512.g2016e3af.el8.x86 18/158 2023-06-20T13:29:43.066 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4512.g2016e3af.el8.x86 18/158 2023-06-20T13:29:43.256 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 19/158 2023-06-20T13:29:43.400 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 19/158 2023-06-20T13:29:43.629 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/158 2023-06-20T13:29:43.821 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/158 2023-06-20T13:29:43.981 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libquadmath-8.5.0-19.el8.x86_64 22/158 2023-06-20T13:29:44.137 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libquadmath-8.5.0-19.el8.x86_64 22/158 2023-06-20T13:29:44.306 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libgfortran-8.5.0-19.el8.x86_64 23/158 2023-06-20T13:29:44.975 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libgfortran-8.5.0-19.el8.x86_64 23/158 2023-06-20T13:29:45.189 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/158 2023-06-20T13:29:45.869 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/158 2023-06-20T13:29:46.022 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/158 2023-06-20T13:29:46.844 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/158 2023-06-20T13:29:47.198 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/158 2023-06-20T13:29:47.389 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/158 2023-06-20T13:29:47.570 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/158 2023-06-20T13:29:47.782 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/158 2023-06-20T13:29:47.996 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ceph-common-2:18.0.0-4512.g2016e3af.el8. 30/158 2023-06-20T13:29:48.118 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ceph-argparse-2:18.0.0-4512.g2016e3af.el 31/158 2023-06-20T13:29:48.362 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cephfs-2:18.0.0-4512.g2016e3af.el8.x86_6 32/158 2023-06-20T13:29:49.465 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/158 2023-06-20T13:29:49.822 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/158 2023-06-20T13:29:50.116 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/158 2023-06-20T13:29:50.321 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/158 2023-06-20T13:29:52.413 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/158 2023-06-20T13:29:52.700 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/158 2023-06-20T13:29:52.921 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/158 2023-06-20T13:29:53.100 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rsa-4.8-1.el8.noarch 39/158 2023-06-20T13:29:53.286 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rbd-2:18.0.0-4512.g2016e3af.el8.x86_64 40/158 2023-06-20T13:29:53.466 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librados-devel-2:18.0.0-4512.g2016e3af.el8.x86_6 41/158 2023-06-20T13:29:53.651 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/158 2023-06-20T13:29:53.814 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/158 2023-06-20T13:29:54.037 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/158 2023-06-20T13:29:54.132 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/158 2023-06-20T13:29:54.311 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/158 2023-06-20T13:29:54.393 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/158 2023-06-20T13:29:54.541 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/158 2023-06-20T13:29:54.720 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/158 2023-06-20T13:29:55.300 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/158 2023-06-20T13:29:55.613 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/158 2023-06-20T13:29:55.640 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/158 2023-06-20T13:29:55.853 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/158 2023-06-20T13:29:56.146 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/158 2023-06-20T13:29:56.386 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/158 2023-06-20T13:29:56.542 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/158 2023-06-20T13:29:56.699 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/158 2023-06-20T13:29:56.884 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/158 2023-06-20T13:29:57.078 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/158 2023-06-20T13:29:57.292 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/158 2023-06-20T13:29:57.473 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/158 2023-06-20T13:29:57.626 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/158 2023-06-20T13:29:57.775 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/158 2023-06-20T13:29:57.978 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/158 2023-06-20T13:29:58.166 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/158 2023-06-20T13:29:58.340 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/158 2023-06-20T13:29:58.608 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/158 2023-06-20T13:29:58.827 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/158 2023-06-20T13:29:59.464 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/158 2023-06-20T13:29:59.814 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/158 2023-06-20T13:30:00.054 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/158 2023-06-20T13:30:00.268 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/158 2023-06-20T13:30:01.094 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/158 2023-06-20T13:30:01.285 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librgw2-2:18.0.0-4512.g2016e3af.el8.x86_64 70/158 2023-06-20T13:30:01.372 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librgw2-2:18.0.0-4512.g2016e3af.el8.x86_64 70/158 2023-06-20T13:30:01.588 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rgw-2:18.0.0-4512.g2016e3af.el8.x86_64 71/158 2023-06-20T13:30:01.839 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/158 2023-06-20T13:30:02.254 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/158 2023-06-20T13:30:02.509 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/158 2023-06-20T13:30:02.683 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/158 2023-06-20T13:30:02.932 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/158 2023-06-20T13:30:03.162 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/158 2023-06-20T13:30:04.459 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/158 2023-06-20T13:30:04.833 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/158 2023-06-20T13:30:05.053 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/158 2023-06-20T13:30:05.288 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/158 2023-06-20T13:30:05.637 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/158 2023-06-20T13:30:05.932 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/158 2023-06-20T13:30:06.147 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/158 2023-06-20T13:30:06.331 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/158 2023-06-20T13:30:06.662 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/158 2023-06-20T13:30:06.873 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/158 2023-06-20T13:30:07.044 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/158 2023-06-20T13:30:07.261 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/158 2023-06-20T13:30:07.586 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/158 2023-06-20T13:30:07.797 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/158 2023-06-20T13:30:07.949 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/158 2023-06-20T13:30:08.147 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/158 2023-06-20T13:30:08.367 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/158 2023-06-20T13:30:08.578 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/158 2023-06-20T13:30:08.804 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/158 2023-06-20T13:30:09.000 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/158 2023-06-20T13:30:09.123 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/158 2023-06-20T13:30:09.301 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/158 2023-06-20T13:30:09.434 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/158 2023-06-20T13:30:12.418 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-common-2:18.0.0-4512.g2016e3af.el8.x86_64 100/158 2023-06-20T13:30:12.684 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-common-2:18.0.0-4512.g2016e3af.el8.x86_64 100/158 2023-06-20T13:30:13.380 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-common-2:18.0.0-4512.g2016e3af.el8.x86_64 100/158 2023-06-20T13:30:13.681 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-base-2:18.0.0-4512.g2016e3af.el8.x86_64 101/158 2023-06-20T13:30:13.817 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-base-2:18.0.0-4512.g2016e3af.el8.x86_64 101/158 2023-06-20T13:30:14.016 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-selinux-2:18.0.0-4512.g2016e3af.el8.x86_64 102/158 2023-06-20T13:30:34.671 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4512.g2016e3af.el8.x86_64 102/158 2023-06-20T13:30:34.672 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /sys 2023-06-20T13:30:34.672 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /proc 2023-06-20T13:30:34.672 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /dev 2023-06-20T13:30:34.672 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /run 2023-06-20T13:30:34.672 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /mnt 2023-06-20T13:30:34.672 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /var/tmp 2023-06-20T13:30:34.673 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /home 2023-06-20T13:30:34.673 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /tmp 2023-06-20T13:30:34.673 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /dev 2023-06-20T13:30:34.673 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:30:35.070 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-volume-2:18.0.0-4512.g2016e3af.el8.noarch 103/158 2023-06-20T13:30:36.793 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-volume-2:18.0.0-4512.g2016e3af.el8.noarch 103/158 2023-06-20T13:30:37.026 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-osd-2:18.0.0-4512.g2016e3af.el8.x86_64 104/158 2023-06-20T13:30:37.292 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-osd-2:18.0.0-4512.g2016e3af.el8.x86_64 104/158 2023-06-20T13:30:37.494 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mds-2:18.0.0-4512.g2016e3af.el8.x86_64 105/158 2023-06-20T13:30:38.018 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mds-2:18.0.0-4512.g2016e3af.el8.x86_64 105/158 2023-06-20T13:30:38.257 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mon-2:18.0.0-4512.g2016e3af.el8.x86_64 106/158 2023-06-20T13:30:38.307 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mon-2:18.0.0-4512.g2016e3af.el8.x86_64 106/158 2023-06-20T13:30:38.494 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/158 2023-06-20T13:30:39.217 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/158 2023-06-20T13:30:39.217 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/158 2023-06-20T13:30:39.217 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/158 2023-06-20T13:30:39.305 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : jq-1.6-7.el8.x86_64 110/158 2023-06-20T13:30:39.527 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : automake-1.16.1-7.el8.noarch 111/158 2023-06-20T13:30:40.108 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: cephadm-2:18.0.0-4512.g2016e3af.el8.noarch 112/158 2023-06-20T13:30:40.320 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephadm-2:18.0.0-4512.g2016e3af.el8.noarch 112/158 2023-06-20T13:30:40.443 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4512.g2016e3af.e 113/158 2023-06-20T13:30:40.660 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4512.g2016e3af. 114/158 2023-06-20T13:30:40.884 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4512.g2016e3af.el8.noa 115/158 2023-06-20T13:30:41.146 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4512.g2016e3af.el8.noa 115/158 2023-06-20T13:30:41.374 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4512.g2016e3af.el8.n 116/158 2023-06-20T13:30:42.492 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4512.g2016e3af.el8.n 116/158 2023-06-20T13:30:42.684 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4512.g201 117/158 2023-06-20T13:30:42.814 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4512.g201 117/158 2023-06-20T13:30:43.191 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4512.g2016e3af.el 118/158 2023-06-20T13:30:43.416 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-2:18.0.0-4512.g2016e3af.el8.x86_64 119/158 2023-06-20T13:30:43.485 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4512.g2016e3af.el8.x86_64 119/158 2023-06-20T13:30:43.672 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-rook-2:18.0.0-4512.g2016e3af.el8.noarch 120/158 2023-06-20T13:30:43.702 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4512.g2016e3af.el8.noarch 120/158 2023-06-20T13:30:43.901 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-2:18.0.0-4512.g2016e3af.el8.x86_64 121/158 2023-06-20T13:30:44.067 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/158 2023-06-20T13:30:49.093 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/158 2023-06-20T13:30:50.617 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-test-2:18.0.0-4512.g2016e3af.el8.x86_64 123/158 2023-06-20T13:30:50.931 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-radosgw-2:18.0.0-4512.g2016e3af.el8.x86_64 124/158 2023-06-20T13:30:50.993 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4512.g2016e3af.el8.x86_64 124/158 2023-06-20T13:30:51.204 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4512.g2016e 125/158 2023-06-20T13:30:51.273 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4512.g2016e 125/158 2023-06-20T13:30:51.500 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephfs-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 126/158 2023-06-20T13:30:51.908 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 126/158 2023-06-20T13:30:52.149 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 127/158 2023-06-20T13:30:52.436 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 127/158 2023-06-20T13:30:52.762 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/158 2023-06-20T13:30:54.050 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-fuse-2:18.0.0-4512.g2016e3af.el8.x86_64 129/158 2023-06-20T13:30:54.412 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/158 2023-06-20T13:30:54.605 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/158 2023-06-20T13:30:54.812 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/158 2023-06-20T13:30:54.986 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/158 2023-06-20T13:30:55.182 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephfs-devel-2:18.0.0-4512.g2016e3af.el8.x86_ 134/158 2023-06-20T13:30:56.388 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/158 2023-06-20T13:30:56.674 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/158 2023-06-20T13:30:56.709 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/158 2023-06-20T13:30:56.974 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephfs-top-2:18.0.0-4512.g2016e3af.el8.noarch 136/158 2023-06-20T13:30:57.208 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-fuse-2:18.0.0-4512.g2016e3af.el8.x86_64 137/158 2023-06-20T13:30:57.569 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-nbd-2:18.0.0-4512.g2016e3af.el8.x86_64 138/158 2023-06-20T13:30:57.817 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 139/158 2023-06-20T13:30:57.973 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-7.el 140/158 2023-06-20T13:30:58.004 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-7.el 140/158 2023-06-20T13:30:58.201 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 141/158 2023-06-20T13:30:58.439 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flex-2.6.1-9.el8.x86_64 142/158 2023-06-20T13:30:58.543 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 142/158 2023-06-20T13:30:58.772 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : bison-3.0.4-10.el8.x86_64 143/158 2023-06-20T13:30:58.797 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 143/158 2023-06-20T13:30:58.974 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 144/158 2023-06-20T13:30:59.158 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 145/158 2023-06-20T13:30:59.158 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 146/158 2023-06-20T13:30:59.410 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 146/158 2023-06-20T13:30:59.411 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 147/158 2023-06-20T13:30:59.650 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 147/158 2023-06-20T13:30:59.665 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 148/158 2023-06-20T13:30:59.778 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 148/158 2023-06-20T13:30:59.779 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 149/158 2023-06-20T13:31:00.037 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 149/158 2023-06-20T13:31:00.225 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 150/158 2023-06-20T13:31:00.388 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 151/158 2023-06-20T13:31:00.615 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 152/158 2023-06-20T13:31:00.616 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 153/158 2023-06-20T13:31:00.834 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 153/158 2023-06-20T13:31:00.835 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 154/158 2023-06-20T13:31:01.083 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 154/158 2023-06-20T13:31:01.084 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 155/158 2023-06-20T13:31:01.300 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 155/158 2023-06-20T13:31:01.300 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 156/158 2023-06-20T13:31:01.525 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 156/158 2023-06-20T13:31:01.525 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 157/158 2023-06-20T13:31:01.750 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 157/158 2023-06-20T13:31:01.923 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 158/158 2023-06-20T13:31:02.137 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 158/158 2023-06-20T13:31:02.137 INFO:teuthology.orchestra.run.smithi115.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-06-20T13:31:02.137 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:02.866 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-2:18.0.0-4512.g2016e3af.el8.x86_64 1/158 2023-06-20T13:31:02.867 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-base-2:18.0.0-4512.g2016e3af.el8.x86_64 2/158 2023-06-20T13:31:02.867 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-common-2:18.0.0-4512.g2016e3af.el8.x86_64 3/158 2023-06-20T13:31:02.867 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-fuse-2:18.0.0-4512.g2016e3af.el8.x86_64 4/158 2023-06-20T13:31:02.867 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4512.g2016e 5/158 2023-06-20T13:31:02.867 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mds-2:18.0.0-4512.g2016e3af.el8.x86_64 6/158 2023-06-20T13:31:02.868 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-2:18.0.0-4512.g2016e3af.el8.x86_64 7/158 2023-06-20T13:31:02.868 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mon-2:18.0.0-4512.g2016e3af.el8.x86_64 8/158 2023-06-20T13:31:02.868 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-osd-2:18.0.0-4512.g2016e3af.el8.x86_64 9/158 2023-06-20T13:31:02.868 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-radosgw-2:18.0.0-4512.g2016e3af.el8.x86_64 10/158 2023-06-20T13:31:02.868 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-selinux-2:18.0.0-4512.g2016e3af.el8.x86_64 11/158 2023-06-20T13:31:02.868 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-test-2:18.0.0-4512.g2016e3af.el8.x86_64 12/158 2023-06-20T13:31:02.868 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephfs-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 13/158 2023-06-20T13:31:02.869 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephfs-devel-2:18.0.0-4512.g2016e3af.el8.x86_ 14/158 2023-06-20T13:31:02.869 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephfs2-2:18.0.0-4512.g2016e3af.el8.x86_64 15/158 2023-06-20T13:31:02.869 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephsqlite-2:18.0.0-4512.g2016e3af.el8.x86_64 16/158 2023-06-20T13:31:02.869 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados-devel-2:18.0.0-4512.g2016e3af.el8.x86_6 17/158 2023-06-20T13:31:02.869 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libradosstriper1-2:18.0.0-4512.g2016e3af.el8.x86 18/158 2023-06-20T13:31:02.869 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librgw2-2:18.0.0-4512.g2016e3af.el8.x86_64 19/158 2023-06-20T13:31:02.869 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4512.g2016e3af.el 20/158 2023-06-20T13:31:02.870 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ceph-common-2:18.0.0-4512.g2016e3af.el8. 21/158 2023-06-20T13:31:02.870 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cephfs-2:18.0.0-4512.g2016e3af.el8.x86_6 22/158 2023-06-20T13:31:02.870 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rados-2:18.0.0-4512.g2016e3af.el8.x86_64 23/158 2023-06-20T13:31:02.871 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rbd-2:18.0.0-4512.g2016e3af.el8.x86_64 24/158 2023-06-20T13:31:02.871 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rgw-2:18.0.0-4512.g2016e3af.el8.x86_64 25/158 2023-06-20T13:31:02.871 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-fuse-2:18.0.0-4512.g2016e3af.el8.x86_64 26/158 2023-06-20T13:31:02.871 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 27/158 2023-06-20T13:31:02.871 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-nbd-2:18.0.0-4512.g2016e3af.el8.x86_64 28/158 2023-06-20T13:31:02.872 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4512.g2016e3af. 29/158 2023-06-20T13:31:02.872 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4512.g2016e3af.el8.noa 30/158 2023-06-20T13:31:02.872 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4512.g2016e3af.el8.n 31/158 2023-06-20T13:31:02.873 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4512.g201 32/158 2023-06-20T13:31:02.873 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4512.g2016e3af.el 33/158 2023-06-20T13:31:02.873 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4512.g2016e3af.el8.noarch 34/158 2023-06-20T13:31:02.873 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4512.g2016e3af.e 35/158 2023-06-20T13:31:02.874 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-volume-2:18.0.0-4512.g2016e3af.el8.noarch 36/158 2023-06-20T13:31:02.874 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephadm-2:18.0.0-4512.g2016e3af.el8.noarch 37/158 2023-06-20T13:31:02.874 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephfs-top-2:18.0.0-4512.g2016e3af.el8.noarch 38/158 2023-06-20T13:31:02.874 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/158 2023-06-20T13:31:02.875 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/158 2023-06-20T13:31:02.875 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/158 2023-06-20T13:31:02.875 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : jq-1.6-7.el8.x86_64 42/158 2023-06-20T13:31:02.876 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/158 2023-06-20T13:31:02.876 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/158 2023-06-20T13:31:02.876 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/158 2023-06-20T13:31:02.876 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/158 2023-06-20T13:31:02.877 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/158 2023-06-20T13:31:02.877 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/158 2023-06-20T13:31:02.878 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/158 2023-06-20T13:31:02.878 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/158 2023-06-20T13:31:02.878 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/158 2023-06-20T13:31:02.879 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/158 2023-06-20T13:31:02.879 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/158 2023-06-20T13:31:02.879 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/158 2023-06-20T13:31:02.879 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/158 2023-06-20T13:31:02.880 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/158 2023-06-20T13:31:02.880 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/158 2023-06-20T13:31:02.880 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/158 2023-06-20T13:31:02.880 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/158 2023-06-20T13:31:02.881 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/158 2023-06-20T13:31:02.881 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/158 2023-06-20T13:31:02.881 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/158 2023-06-20T13:31:02.882 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/158 2023-06-20T13:31:02.882 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/158 2023-06-20T13:31:02.882 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/158 2023-06-20T13:31:02.882 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/158 2023-06-20T13:31:02.883 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/158 2023-06-20T13:31:02.883 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/158 2023-06-20T13:31:02.883 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/158 2023-06-20T13:31:02.884 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/158 2023-06-20T13:31:02.884 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/158 2023-06-20T13:31:02.884 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/158 2023-06-20T13:31:02.885 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/158 2023-06-20T13:31:02.885 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/158 2023-06-20T13:31:02.885 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/158 2023-06-20T13:31:02.886 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/158 2023-06-20T13:31:02.886 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libgfortran-8.5.0-19.el8.x86_64 77/158 2023-06-20T13:31:02.886 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libquadmath-8.5.0-19.el8.x86_64 78/158 2023-06-20T13:31:02.887 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 79/158 2023-06-20T13:31:02.887 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/158 2023-06-20T13:31:02.887 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/158 2023-06-20T13:31:02.887 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/158 2023-06-20T13:31:02.888 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/158 2023-06-20T13:31:02.888 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/158 2023-06-20T13:31:02.888 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/158 2023-06-20T13:31:02.888 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/158 2023-06-20T13:31:02.889 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/158 2023-06-20T13:31:02.889 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/158 2023-06-20T13:31:02.889 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/158 2023-06-20T13:31:02.889 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/158 2023-06-20T13:31:02.889 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/158 2023-06-20T13:31:02.889 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/158 2023-06-20T13:31:02.889 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/158 2023-06-20T13:31:02.889 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/158 2023-06-20T13:31:02.890 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/158 2023-06-20T13:31:02.890 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/158 2023-06-20T13:31:02.890 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/158 2023-06-20T13:31:02.890 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/158 2023-06-20T13:31:02.890 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/158 2023-06-20T13:31:02.890 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/158 2023-06-20T13:31:02.890 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/158 2023-06-20T13:31:02.890 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/158 2023-06-20T13:31:02.891 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/158 2023-06-20T13:31:02.891 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/158 2023-06-20T13:31:02.891 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/158 2023-06-20T13:31:02.891 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/158 2023-06-20T13:31:02.891 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/158 2023-06-20T13:31:02.891 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/158 2023-06-20T13:31:02.891 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/158 2023-06-20T13:31:02.891 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/158 2023-06-20T13:31:02.892 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/158 2023-06-20T13:31:02.892 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/158 2023-06-20T13:31:02.892 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/158 2023-06-20T13:31:02.892 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/158 2023-06-20T13:31:02.892 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/158 2023-06-20T13:31:02.892 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/158 2023-06-20T13:31:02.892 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/158 2023-06-20T13:31:02.893 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/158 2023-06-20T13:31:02.893 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/158 2023-06-20T13:31:02.893 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/158 2023-06-20T13:31:02.893 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/158 2023-06-20T13:31:02.893 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/158 2023-06-20T13:31:02.893 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/158 2023-06-20T13:31:02.893 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/158 2023-06-20T13:31:02.893 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/158 2023-06-20T13:31:02.894 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/158 2023-06-20T13:31:02.894 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/158 2023-06-20T13:31:02.894 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/158 2023-06-20T13:31:02.894 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados2-2:18.0.0-4512.g2016e3af.el8.x86_64 129/158 2023-06-20T13:31:02.894 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/158 2023-06-20T13:31:02.894 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librbd1-2:18.0.0-4512.g2016e3af.el8.x86_64 131/158 2023-06-20T13:31:02.894 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/158 2023-06-20T13:31:02.894 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-7.el 133/158 2023-06-20T13:31:02.895 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/158 2023-06-20T13:31:02.895 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/158 2023-06-20T13:31:02.895 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/158 2023-06-20T13:31:02.895 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/158 2023-06-20T13:31:02.895 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/158 2023-06-20T13:31:02.895 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/158 2023-06-20T13:31:02.895 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/158 2023-06-20T13:31:02.895 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/158 2023-06-20T13:31:02.896 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/158 2023-06-20T13:31:02.896 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/158 2023-06-20T13:31:02.896 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/158 2023-06-20T13:31:02.896 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/158 2023-06-20T13:31:02.896 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/158 2023-06-20T13:31:02.896 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/158 2023-06-20T13:31:02.896 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/158 2023-06-20T13:31:02.896 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/158 2023-06-20T13:31:02.897 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/158 2023-06-20T13:31:02.897 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/158 2023-06-20T13:31:02.897 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/158 2023-06-20T13:31:02.897 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/158 2023-06-20T13:31:02.897 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/158 2023-06-20T13:31:02.897 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/158 2023-06-20T13:31:02.897 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/158 2023-06-20T13:31:02.897 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 157/158 2023-06-20T13:31:04.973 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 158/158 2023-06-20T13:31:04.974 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:04.974 INFO:teuthology.orchestra.run.smithi115.stdout:Upgraded: 2023-06-20T13:31:04.975 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-initscripts-updown-1:1.40.16-7.el8.noarch 2023-06-20T13:31:04.977 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-06-20T13:31:04.977 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-06-20T13:31:04.977 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-06-20T13:31:04.977 INFO:teuthology.orchestra.run.smithi115.stdout: iproute-6.2.0-2.el8.x86_64 2023-06-20T13:31:04.977 INFO:teuthology.orchestra.run.smithi115.stdout: libblkid-2.32.1-42.el8.x86_64 2023-06-20T13:31:04.978 INFO:teuthology.orchestra.run.smithi115.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-06-20T13:31:04.978 INFO:teuthology.orchestra.run.smithi115.stdout: libmount-2.32.1-42.el8.x86_64 2023-06-20T13:31:04.978 INFO:teuthology.orchestra.run.smithi115.stdout: librados2-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:04.978 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:04.978 INFO:teuthology.orchestra.run.smithi115.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-06-20T13:31:04.978 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid-2.32.1-42.el8.x86_64 2023-06-20T13:31:04.978 INFO:teuthology.orchestra.run.smithi115.stdout: util-linux-2.32.1-42.el8.x86_64 2023-06-20T13:31:04.978 INFO:teuthology.orchestra.run.smithi115.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-06-20T13:31:04.979 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-06-20T13:31:04.979 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2023-06-20T13:31:04.979 INFO:teuthology.orchestra.run.smithi115.stdout: automake-1.16.1-7.el8.noarch 2023-06-20T13:31:04.979 INFO:teuthology.orchestra.run.smithi115.stdout: bison-3.0.4-10.el8.x86_64 2023-06-20T13:31:04.979 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:04.979 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:04.979 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:04.980 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:04.980 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-20T13:31:04.980 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-immutable-object-cache-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:04.980 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:04.980 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:04.980 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-cephadm-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-20T13:31:04.980 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-20T13:31:04.981 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-20T13:31:04.981 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-20T13:31:04.981 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-20T13:31:04.981 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:04.981 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:04.981 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-prometheus-alerts-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-20T13:31:04.982 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:04.982 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:04.982 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:04.983 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-volume-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-20T13:31:04.983 INFO:teuthology.orchestra.run.smithi115.stdout: cephadm-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-20T13:31:04.983 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:04.983 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-top-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-20T13:31:04.983 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-06-20T13:31:04.983 INFO:teuthology.orchestra.run.smithi115.stdout: flex-2.6.1-9.el8.x86_64 2023-06-20T13:31:04.983 INFO:teuthology.orchestra.run.smithi115.stdout: fuse-2.9.7-17.el8.x86_64 2023-06-20T13:31:04.984 INFO:teuthology.orchestra.run.smithi115.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-06-20T13:31:04.984 INFO:teuthology.orchestra.run.smithi115.stdout: jq-1.6-7.el8.x86_64 2023-06-20T13:31:04.984 INFO:teuthology.orchestra.run.smithi115.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-06-20T13:31:04.984 INFO:teuthology.orchestra.run.smithi115.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-06-20T13:31:04.985 INFO:teuthology.orchestra.run.smithi115.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-06-20T13:31:04.985 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:04.985 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:04.985 INFO:teuthology.orchestra.run.smithi115.stdout: libcephsqlite-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:04.985 INFO:teuthology.orchestra.run.smithi115.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-06-20T13:31:04.986 INFO:teuthology.orchestra.run.smithi115.stdout: libgfortran-8.5.0-19.el8.x86_64 2023-06-20T13:31:04.986 INFO:teuthology.orchestra.run.smithi115.stdout: liboath-2.6.2-3.el8.x86_64 2023-06-20T13:31:04.987 INFO:teuthology.orchestra.run.smithi115.stdout: libpq-13.5-1.el8.x86_64 2023-06-20T13:31:04.987 INFO:teuthology.orchestra.run.smithi115.stdout: libquadmath-8.5.0-19.el8.x86_64 2023-06-20T13:31:04.987 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-06-20T13:31:04.987 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:04.987 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:04.987 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-06-20T13:31:04.987 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:04.988 INFO:teuthology.orchestra.run.smithi115.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-06-20T13:31:04.988 INFO:teuthology.orchestra.run.smithi115.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-06-20T13:31:04.988 INFO:teuthology.orchestra.run.smithi115.stdout: libtool-2.4.6-25.el8.x86_64 2023-06-20T13:31:04.989 INFO:teuthology.orchestra.run.smithi115.stdout: libunwind-1.3.1-3.el8.x86_64 2023-06-20T13:31:04.989 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-06-20T13:31:04.989 INFO:teuthology.orchestra.run.smithi115.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-06-20T13:31:04.989 INFO:teuthology.orchestra.run.smithi115.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-06-20T13:31:04.989 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-06-20T13:31:04.989 INFO:teuthology.orchestra.run.smithi115.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-06-20T13:31:04.989 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-0.3.15-4.el8.x86_64 2023-06-20T13:31:04.989 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-06-20T13:31:04.990 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-06-20T13:31:04.990 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-06-20T13:31:04.990 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-06-20T13:31:04.990 INFO:teuthology.orchestra.run.smithi115.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-06-20T13:31:04.990 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-06-20T13:31:04.990 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-06-20T13:31:04.990 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-06-20T13:31:04.990 INFO:teuthology.orchestra.run.smithi115.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-06-20T13:31:04.991 INFO:teuthology.orchestra.run.smithi115.stdout: python3-babel-2.5.1-7.el8.noarch 2023-06-20T13:31:04.991 INFO:teuthology.orchestra.run.smithi115.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-06-20T13:31:04.991 INFO:teuthology.orchestra.run.smithi115.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-06-20T13:31:04.991 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-06-20T13:31:04.991 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:04.991 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:04.991 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cephfs-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:04.992 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-06-20T13:31:04.992 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-06-20T13:31:04.992 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-06-20T13:31:04.992 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-06-20T13:31:04.992 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-06-20T13:31:04.993 INFO:teuthology.orchestra.run.smithi115.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-06-20T13:31:04.993 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-6.2-6.el8.noarch 2023-06-20T13:31:04.993 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-06-20T13:31:04.993 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-06-20T13:31:04.993 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-06-20T13:31:04.993 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-06-20T13:31:04.993 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-06-20T13:31:04.994 INFO:teuthology.orchestra.run.smithi115.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-06-20T13:31:04.994 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-06-20T13:31:04.994 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako-1.0.6-14.el8.noarch 2023-06-20T13:31:04.994 INFO:teuthology.orchestra.run.smithi115.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-06-20T13:31:04.994 INFO:teuthology.orchestra.run.smithi115.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-06-20T13:31:04.995 INFO:teuthology.orchestra.run.smithi115.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-06-20T13:31:04.995 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-06-20T13:31:04.995 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-06-20T13:31:04.995 INFO:teuthology.orchestra.run.smithi115.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-06-20T13:31:04.995 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-06-20T13:31:04.995 INFO:teuthology.orchestra.run.smithi115.stdout: python3-portend-2.6-1.el8.noarch 2023-06-20T13:31:04.996 INFO:teuthology.orchestra.run.smithi115.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-06-20T13:31:04.996 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-06-20T13:31:04.996 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-06-20T13:31:04.996 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-06-20T13:31:04.996 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pycparser-2.14-14.el8.noarch 2023-06-20T13:31:04.996 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pytz-2017.2-9.el8.noarch 2023-06-20T13:31:04.996 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:04.997 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rbd-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:04.997 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-06-20T13:31:04.997 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-06-20T13:31:04.997 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rgw-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:04.998 INFO:teuthology.orchestra.run.smithi115.stdout: python3-routes-2.4.1-12.el8.noarch 2023-06-20T13:31:04.998 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rsa-4.8-1.el8.noarch 2023-06-20T13:31:04.998 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-06-20T13:31:04.998 INFO:teuthology.orchestra.run.smithi115.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-06-20T13:31:04.998 INFO:teuthology.orchestra.run.smithi115.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-06-20T13:31:04.998 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-06-20T13:31:04.998 INFO:teuthology.orchestra.run.smithi115.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-06-20T13:31:04.999 INFO:teuthology.orchestra.run.smithi115.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-06-20T13:31:04.999 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-06-20T13:31:04.999 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-06-20T13:31:04.999 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-06-20T13:31:04.999 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-06-20T13:31:05.000 INFO:teuthology.orchestra.run.smithi115.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-06-20T13:31:05.000 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:05.000 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:05.000 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-nbd-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-20T13:31:05.000 INFO:teuthology.orchestra.run.smithi115.stdout: socat-1.7.4.1-1.el8.x86_64 2023-06-20T13:31:05.000 INFO:teuthology.orchestra.run.smithi115.stdout: thrift-0.13.0-2.el8.x86_64 2023-06-20T13:31:05.000 INFO:teuthology.orchestra.run.smithi115.stdout: uuid-1.6.2-43.el8.x86_64 2023-06-20T13:31:05.001 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-06-20T13:31:05.001 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-06-20T13:31:05.001 INFO:teuthology.orchestra.run.smithi115.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-06-20T13:31:05.001 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:05.002 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2023-06-20T13:31:05.267 DEBUG:teuthology.parallel:result is None 2023-06-20T13:31:05.269 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2016e3af238feea2bbee7eb0e99c925a041afbfb 2023-06-20T13:31:05.409 DEBUG:teuthology.orchestra.run.smithi032:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-06-20T13:31:05.473 INFO:teuthology.orchestra.run.smithi032.stdout:18.0.0-4512.g2016e3af.el8 2023-06-20T13:31:05.473 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4512.g2016e3af.el8 2023-06-20T13:31:05.474 INFO:teuthology.task.install:The correct ceph version 18.0.0-4512.g2016e3af is installed. 2023-06-20T13:31:05.474 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2016e3af238feea2bbee7eb0e99c925a041afbfb 2023-06-20T13:31:05.685 DEBUG:teuthology.orchestra.run.smithi115:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-06-20T13:31:05.742 INFO:teuthology.orchestra.run.smithi115.stdout:18.0.0-4512.g2016e3af.el8 2023-06-20T13:31:05.742 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4512.g2016e3af.el8 2023-06-20T13:31:05.743 INFO:teuthology.task.install:The correct ceph version 18.0.0-4512.g2016e3af is installed. 2023-06-20T13:31:05.743 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-06-20T13:31:05.744 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:31:05.744 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-20T13:31:05.825 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:31:05.825 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-20T13:31:05.899 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-06-20T13:31:05.899 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:31:05.900 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/daemon-helper 2023-06-20T13:31:05.974 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-20T13:31:06.083 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:31:06.084 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/daemon-helper 2023-06-20T13:31:06.155 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-20T13:31:06.265 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-06-20T13:31:06.265 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:31:06.265 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-20T13:31:06.335 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-20T13:31:06.444 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:31:06.444 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-20T13:31:06.512 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-20T13:31:06.623 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-06-20T13:31:06.624 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:31:06.624 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/stdin-killer 2023-06-20T13:31:06.694 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-20T13:31:06.803 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:31:06.803 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/stdin-killer 2023-06-20T13:31:06.874 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-20T13:31:06.984 INFO:teuthology.run_tasks:Running task ceph... 2023-06-20T13:31:07.060 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-06-20T13:31:07.060 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 777 /var/log/ceph 2023-06-20T13:31:07.065 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 777 /var/log/ceph 2023-06-20T13:31:07.134 INFO:tasks.ceph:Disabling ceph logrotate... 2023-06-20T13:31:07.134 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-20T13:31:07.138 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-20T13:31:07.208 INFO:tasks.ceph:Creating extra log directories... 2023-06-20T13:31:07.208 DEBUG:teuthology.orchestra.run.smithi032:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-20T13:31:07.213 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-20T13:31:07.291 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-06-20T13:31:07.291 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-06-20T13:31:07.292 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-06-20T13:31:07.292 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:31:07.292 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-20T13:31:07.337 DEBUG:teuthology.orchestra.run.smithi032:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-20T13:31:07.550 DEBUG:teuthology.orchestra.run.smithi032:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-06-20T13:31:07.620 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:31:07.621 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-20T13:31:07.665 DEBUG:teuthology.orchestra.run.smithi115:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-20T13:31:07.871 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-06-20T13:31:07.946 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-06-20T13:31:07.947 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-06-20T13:31:07.947 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-06-20_10:07:44-fs-wip-vshankar-testing-20230620.052303-testing-default-smithi/7308866', 'branch': 'wip-vshankar-testing-20230620.052303', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7308866', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '1c622d92b6f18ce44a7c33802686ff61c3c273ab'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-06-20_10:07:44-fs-wip-vshankar-testing-20230620.052303-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20230620.052303'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '2016e3af238feea2bbee7eb0e99c925a041afbfb'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2016e3af238feea2bbee7eb0e99c925a041afbfb'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20230620.052303', 'sha1': '2016e3af238feea2bbee7eb0e99c925a041afbfb'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': '2016e3af238feea2bbee7eb0e99c925a041afbfb', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20230620.052303', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_2016e3af238feea2bbee7eb0e99c925a041afbfb/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '2016e3af238feea2bbee7eb0e99c925a041afbfb', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi032.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfGIZ045wxjthMA1GwwiZt8rM4+vpUQY0mHp6dMWLKzsuOapYB0EzMBhmtny3IZ9bYC5V5bA1V6kcYFDFUNRsFPd933Zx9GMm/vbH6N5fmwjn8NcELiBtSe0rTzCJc7eDoYe+2WnTiF9jH62aQ3TmtuiPxom3Fv1Am/A/MmvrsKaTZJwKLOVkS6xeV/1c7EJRaLtd8Tksk+BOBGBKSOTE8LeeC05W5ndLnujbTfFZAjhcqaz8iQe2luB2rB7wVUp5cfmrkJcOAxie5RWSZexRIOm9CcA/eJPMWoK4tjHSlpE+TCw6OutxicChQCjPeW3s6ACsTFhdRKkzriz3R7Ah9i75ZzV5OMoNXmYIZPsy9ngsggo8TOuXAaVwXDuj5531n3ASmtD4LUSV14BfvZnWX60ydTcTQYyL7ZYNoNO03kpyObrqjrMIhjnHTD4/F4Yz27mo/HVeJAr11Q9DeC8taOEuysfwTwz113HlQm2nWlhpFDDYgyk275TQ4gmKFWz8=', 'smithi115.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMYn8Z9x/5poa1T2GUnxve/ePo+iDzmTqU0yfOxTEuX38Q6juJkqGkc+JQtoZfwuMwlhLRVF51G2Ba34Jn1qHH7dxYMq1Wl3b/7mDXNk51Ua02nMReGnuN+dVW5nGP/h+Yz9dyvmIzeX2KS8AE5ei7i/IfdNU1tZckOhw+FSgGKYJnenvpvUW3pNj0wakJqkyZqPo/6IHdvg425od/zdYOgca8MTdxqGR736M5wYzpcl5Q94tPIsOMSK+1dd19pHJauUFvtfQeqYBkGJE+jWu0iTLyeLmfMH8JI9DpUygGmlFidKzAsF8TNgiey6e4nL20P9rfj5OOa+qdw2NtXbQwV4YNhQE2VLRRV2g5KzmGaGpvxD8byOyaz4wQNHPuIjcb5hruH8nJLHgOySaT6hJA/aTxAQEFQZHX1P8+MpYQbiiO98AA7EjAUDkLFvwmlZ+95ayPQGi3A+U0G5yFhi0QOmqU/L6eewGo7DTOgJltlIsgB8ONwuY8XkvUANdoTbE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '1c622d92b6f18ce44a7c33802686ff61c3c273ab'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2016e3af238feea2bbee7eb0e99c925a041afbfb'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '076bbebc42a14f7d568aaa78eabb0038327bcb23', 'timestamp': '2023-06-20_10:07:44', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-06-20T13:31:07.948 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-20T13:31:07.952 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-20T13:31:08.001 DEBUG:teuthology.orchestra.run.smithi032:> sudo install -d -m0777 -- /var/run/ceph 2023-06-20T13:31:08.038 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m0777 -- /var/run/ceph 2023-06-20T13:31:08.113 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:31:08.113 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/scratch_devs of=/dev/stdout 2023-06-20T13:31:08.159 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-20T13:31:08.159 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_1 2023-06-20T13:31:08.245 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-20T13:31:08.245 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-20T13:31:08.245 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 444 Links: 1 2023-06-20T13:31:08.246 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-20T13:31:08.246 INFO:teuthology.orchestra.run.smithi032.stdout:Context: system_u:object_r:device_t:s0 2023-06-20T13:31:08.246 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2023-06-20 13:26:42.159403239 +0000 2023-06-20T13:31:08.246 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2023-06-20 13:23:31.494594684 +0000 2023-06-20T13:31:08.247 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2023-06-20 13:23:31.494594684 +0000 2023-06-20T13:31:08.247 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: 2023-06-20 13:23:31.473595100 +0000 2023-06-20T13:31:08.247 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-20T13:31:08.351 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2023-06-20T13:31:08.351 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2023-06-20T13:31:08.352 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000195921 s, 2.6 MB/s 2023-06-20T13:31:08.354 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-20T13:31:08.402 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_2 2023-06-20T13:31:08.447 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-20T13:31:08.447 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-20T13:31:08.448 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 450 Links: 1 2023-06-20T13:31:08.448 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-20T13:31:08.448 INFO:teuthology.orchestra.run.smithi032.stdout:Context: system_u:object_r:device_t:s0 2023-06-20T13:31:08.448 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2023-06-20 13:26:42.160403219 +0000 2023-06-20T13:31:08.448 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2023-06-20 13:23:32.337577977 +0000 2023-06-20T13:31:08.448 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2023-06-20 13:23:32.337577977 +0000 2023-06-20T13:31:08.449 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: 2023-06-20 13:23:32.316578394 +0000 2023-06-20T13:31:08.451 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-20T13:31:08.557 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2023-06-20T13:31:08.558 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2023-06-20T13:31:08.558 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000175293 s, 2.9 MB/s 2023-06-20T13:31:08.559 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-20T13:31:08.606 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_3 2023-06-20T13:31:08.692 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-20T13:31:08.692 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-20T13:31:08.692 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 456 Links: 1 2023-06-20T13:31:08.692 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-20T13:31:08.693 INFO:teuthology.orchestra.run.smithi032.stdout:Context: system_u:object_r:device_t:s0 2023-06-20T13:31:08.693 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2023-06-20 13:26:42.160403219 +0000 2023-06-20T13:31:08.693 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2023-06-20 13:23:33.168561509 +0000 2023-06-20T13:31:08.693 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2023-06-20 13:23:33.168561509 +0000 2023-06-20T13:31:08.693 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: 2023-06-20 13:23:33.149561885 +0000 2023-06-20T13:31:08.693 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-20T13:31:08.798 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2023-06-20T13:31:08.798 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2023-06-20T13:31:08.798 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000185396 s, 2.8 MB/s 2023-06-20T13:31:08.800 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-20T13:31:08.848 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_4 2023-06-20T13:31:08.893 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-20T13:31:08.894 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-20T13:31:08.894 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 462 Links: 1 2023-06-20T13:31:08.894 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-20T13:31:08.894 INFO:teuthology.orchestra.run.smithi032.stdout:Context: system_u:object_r:device_t:s0 2023-06-20T13:31:08.894 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2023-06-20 13:26:42.160403219 +0000 2023-06-20T13:31:08.894 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2023-06-20 13:23:34.030544426 +0000 2023-06-20T13:31:08.894 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2023-06-20 13:23:34.030544426 +0000 2023-06-20T13:31:08.895 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: 2023-06-20 13:23:34.009544842 +0000 2023-06-20T13:31:08.895 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-20T13:31:09.000 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2023-06-20T13:31:09.000 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2023-06-20T13:31:09.000 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000173477 s, 3.0 MB/s 2023-06-20T13:31:09.002 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-20T13:31:09.049 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-20T13:31:09.050 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:31:09.050 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/scratch_devs of=/dev/stdout 2023-06-20T13:31:09.100 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-20T13:31:09.101 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_1 2023-06-20T13:31:09.147 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-20T13:31:09.148 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-20T13:31:09.148 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-06-20T13:31:09.148 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-20T13:31:09.148 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2023-06-20T13:31:09.149 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2023-06-20 13:31:02.340260519 +0000 2023-06-20T13:31:09.149 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2023-06-20 13:23:23.097782047 +0000 2023-06-20T13:31:09.149 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2023-06-20 13:23:23.097782047 +0000 2023-06-20T13:31:09.150 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2023-06-20 13:23:23.071782527 +0000 2023-06-20T13:31:09.150 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-20T13:31:09.215 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-06-20T13:31:09.216 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-06-20T13:31:09.216 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000257296 s, 2.0 MB/s 2023-06-20T13:31:09.218 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-20T13:31:09.264 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_2 2023-06-20T13:31:09.309 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-20T13:31:09.310 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-20T13:31:09.310 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-06-20T13:31:09.310 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-20T13:31:09.310 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2023-06-20T13:31:09.310 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2023-06-20 13:31:02.340260519 +0000 2023-06-20T13:31:09.310 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2023-06-20 13:23:23.940766471 +0000 2023-06-20T13:31:09.311 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2023-06-20 13:23:23.940766471 +0000 2023-06-20T13:31:09.311 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2023-06-20 13:23:23.917766896 +0000 2023-06-20T13:31:09.311 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-20T13:31:09.415 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-06-20T13:31:09.415 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-06-20T13:31:09.415 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000293884 s, 1.7 MB/s 2023-06-20T13:31:09.417 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-20T13:31:09.466 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_3 2023-06-20T13:31:09.514 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-20T13:31:09.515 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-20T13:31:09.515 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-06-20T13:31:09.515 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-20T13:31:09.515 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2023-06-20T13:31:09.515 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2023-06-20 13:31:02.340260519 +0000 2023-06-20T13:31:09.515 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2023-06-20 13:23:24.764751247 +0000 2023-06-20T13:31:09.515 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2023-06-20 13:23:24.764751247 +0000 2023-06-20T13:31:09.516 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2023-06-20 13:23:24.741751672 +0000 2023-06-20T13:31:09.516 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-20T13:31:09.585 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-06-20T13:31:09.604 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-06-20T13:31:09.604 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000263906 s, 1.9 MB/s 2023-06-20T13:31:09.606 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-20T13:31:09.654 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_4 2023-06-20T13:31:09.746 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-20T13:31:09.746 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-20T13:31:09.746 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-06-20T13:31:09.746 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-20T13:31:09.746 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2023-06-20T13:31:09.747 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2023-06-20 13:31:02.341260500 +0000 2023-06-20T13:31:09.747 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2023-06-20 13:23:25.604735727 +0000 2023-06-20T13:31:09.747 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2023-06-20 13:23:25.604735727 +0000 2023-06-20T13:31:09.747 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2023-06-20 13:23:25.581736152 +0000 2023-06-20T13:31:09.747 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-20T13:31:09.857 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2023-06-20T13:31:09.858 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2023-06-20T13:31:09.858 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000281646 s, 1.8 MB/s 2023-06-20T13:31:09.860 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-20T13:31:09.910 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-20T13:31:09.910 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi032.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi115.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-20T13:31:09.910 INFO:tasks.ceph:Generating config... 2023-06-20T13:31:09.912 INFO:tasks.ceph:[client] client mount timeout = 600 2023-06-20T13:31:09.912 INFO:tasks.ceph:[client] debug client = 20 2023-06-20T13:31:09.912 INFO:tasks.ceph:[client] debug ms = 1 2023-06-20T13:31:09.912 INFO:tasks.ceph:[client] pid file = 2023-06-20T13:31:09.913 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-06-20T13:31:09.913 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-06-20T13:31:09.913 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-06-20T13:31:09.913 INFO:tasks.ceph:[mds] debug mds = 20 2023-06-20T13:31:09.913 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-06-20T13:31:09.914 INFO:tasks.ceph:[mds] debug ms = 1 2023-06-20T13:31:09.914 INFO:tasks.ceph:[mds] mds debug frag = True 2023-06-20T13:31:09.914 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-06-20T13:31:09.914 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-06-20T13:31:09.914 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-06-20T13:31:09.915 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-06-20T13:31:09.915 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-06-20T13:31:09.915 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-06-20T13:31:09.915 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-06-20T13:31:09.915 INFO:tasks.ceph:[mgr] debug ms = 1 2023-06-20T13:31:09.916 INFO:tasks.ceph:[mon] debug mon = 20 2023-06-20T13:31:09.916 INFO:tasks.ceph:[mon] debug ms = 1 2023-06-20T13:31:09.916 INFO:tasks.ceph:[mon] debug paxos = 20 2023-06-20T13:31:09.916 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-06-20T13:31:09.916 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-06-20T13:31:09.917 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-06-20T13:31:09.917 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-06-20T13:31:09.917 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-06-20T13:31:09.917 INFO:tasks.ceph:[osd] debug ms = 1 2023-06-20T13:31:09.918 INFO:tasks.ceph:[osd] debug osd = 20 2023-06-20T13:31:09.918 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-06-20T13:31:09.918 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-06-20T13:31:09.918 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-06-20T13:31:09.918 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-06-20T13:31:09.919 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-06-20T13:31:09.920 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-06-20T13:31:09.920 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-06-20T13:31:09.920 INFO:tasks.ceph:Setting up mon.a... 2023-06-20T13:31:09.921 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-06-20T13:31:10.033 INFO:teuthology.orchestra.run.smithi032.stdout:creating /etc/ceph/ceph.keyring 2023-06-20T13:31:10.039 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-06-20T13:31:10.142 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-20T13:31:10.212 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.32'), ('mon.b', '172.21.15.115'), ('mon.c', '[v2:172.21.15.115:3301,v1:172.21.15.115:6790]')] 2023-06-20T13:31:10.212 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.32,172.21.15.115,[v2:172.21.15.115:3301,v1:172.21.15.115:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-06-20T13:31:10.214 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:31:10.214 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-06-20T13:31:10.259 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.32 --add b 172.21.15.115 --addv c '[v2:172.21.15.115:3301,v1:172.21.15.115:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-06-20T13:31:10.392 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-06-20T13:31:10.392 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: generated fsid 8ec09bdb-4968-488f-bf51-7b0f1e92355f 2023-06-20T13:31:10.392 INFO:teuthology.orchestra.run.smithi032.stdout:setting min_mon_release = pacific 2023-06-20T13:31:10.392 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 0 2023-06-20T13:31:10.393 INFO:teuthology.orchestra.run.smithi032.stdout:fsid 8ec09bdb-4968-488f-bf51-7b0f1e92355f 2023-06-20T13:31:10.393 INFO:teuthology.orchestra.run.smithi032.stdout:last_changed 2023-06-20T13:31:10.390872+0000 2023-06-20T13:31:10.393 INFO:teuthology.orchestra.run.smithi032.stdout:created 2023-06-20T13:31:10.390872+0000 2023-06-20T13:31:10.393 INFO:teuthology.orchestra.run.smithi032.stdout:min_mon_release 16 (pacific) 2023-06-20T13:31:10.393 INFO:teuthology.orchestra.run.smithi032.stdout:election_strategy: 1 2023-06-20T13:31:10.393 INFO:teuthology.orchestra.run.smithi032.stdout:0: [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] mon.a 2023-06-20T13:31:10.393 INFO:teuthology.orchestra.run.smithi032.stdout:1: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.b 2023-06-20T13:31:10.394 INFO:teuthology.orchestra.run.smithi032.stdout:2: [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] mon.c 2023-06-20T13:31:10.394 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-06-20T13:31:10.395 DEBUG:teuthology.orchestra.run.smithi032:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-06-20T13:31:10.440 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 8ec09bdb-4968-488f-bf51-7b0f1e92355f... 2023-06-20T13:31:10.441 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-20T13:31:10.484 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-20T13:31:10.599 INFO:teuthology.orchestra.run.smithi032.stdout:[global] 2023-06-20T13:31:10.599 INFO:teuthology.orchestra.run.smithi032.stdout: chdir = "" 2023-06-20T13:31:10.600 INFO:teuthology.orchestra.run.smithi032.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-20T13:31:10.600 INFO:teuthology.orchestra.run.smithi032.stdout: auth supported = cephx 2023-06-20T13:31:10.600 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:10.600 INFO:teuthology.orchestra.run.smithi032.stdout: filestore xattr use omap = true 2023-06-20T13:31:10.600 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:10.600 INFO:teuthology.orchestra.run.smithi032.stdout: mon clock drift allowed = 1.000 2023-06-20T13:31:10.601 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:10.601 INFO:teuthology.orchestra.run.smithi032.stdout: osd crush chooseleaf type = 0 2023-06-20T13:31:10.601 INFO:teuthology.orchestra.run.smithi032.stdout: auth debug = true 2023-06-20T13:31:10.601 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:10.601 INFO:teuthology.orchestra.run.smithi032.stdout: ms die on old message = true 2023-06-20T13:31:10.601 INFO:teuthology.orchestra.run.smithi032.stdout: ms die on bug = true 2023-06-20T13:31:10.601 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:10.601 INFO:teuthology.orchestra.run.smithi032.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-20T13:31:10.602 INFO:teuthology.orchestra.run.smithi032.stdout: mon pg warn max object skew = 0 2023-06-20T13:31:10.602 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:10.602 INFO:teuthology.orchestra.run.smithi032.stdout: # disable pg_autoscaler by default for new pools 2023-06-20T13:31:10.602 INFO:teuthology.orchestra.run.smithi032.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-20T13:31:10.602 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:10.602 INFO:teuthology.orchestra.run.smithi032.stdout: osd pool default size = 2 2023-06-20T13:31:10.602 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:10.602 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd allow primary affinity = true 2023-06-20T13:31:10.603 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd allow pg remap = true 2023-06-20T13:31:10.603 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on legacy crush tunables = false 2023-06-20T13:31:10.603 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on crush straw calc version zero = false 2023-06-20T13:31:10.603 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on no sortbitwise = false 2023-06-20T13:31:10.603 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on osd down out interval zero = false 2023-06-20T13:31:10.603 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on too few osds = false 2023-06-20T13:31:10.603 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-20T13:31:10.603 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-20T13:31:10.604 INFO:teuthology.orchestra.run.smithi032.stdout: mon_allow_pool_size_one = true 2023-06-20T13:31:10.604 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:10.604 INFO:teuthology.orchestra.run.smithi032.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-20T13:31:10.604 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:10.604 INFO:teuthology.orchestra.run.smithi032.stdout: osd default data pool replay window = 5 2023-06-20T13:31:10.604 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:10.604 INFO:teuthology.orchestra.run.smithi032.stdout: mon allow pool delete = true 2023-06-20T13:31:10.604 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:10.605 INFO:teuthology.orchestra.run.smithi032.stdout: mon cluster log file level = debug 2023-06-20T13:31:10.605 INFO:teuthology.orchestra.run.smithi032.stdout: debug asserts on shutdown = true 2023-06-20T13:31:10.605 INFO:teuthology.orchestra.run.smithi032.stdout: mon health detail to clog = false 2023-06-20T13:31:10.605 INFO:teuthology.orchestra.run.smithi032.stdout: mon host = "172.21.15.32,172.21.15.115,[v2:172.21.15.115:3301,v1:172.21.15.115:6790]" 2023-06-20T13:31:10.605 INFO:teuthology.orchestra.run.smithi032.stdout: ms die on skipped message = False 2023-06-20T13:31:10.605 INFO:teuthology.orchestra.run.smithi032.stdout: fsid = 8ec09bdb-4968-488f-bf51-7b0f1e92355f 2023-06-20T13:31:10.605 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:10.606 INFO:teuthology.orchestra.run.smithi032.stdout:[osd] 2023-06-20T13:31:10.606 INFO:teuthology.orchestra.run.smithi032.stdout: osd journal size = 100 2023-06-20T13:31:10.606 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:10.606 INFO:teuthology.orchestra.run.smithi032.stdout: osd scrub load threshold = 5.0 2023-06-20T13:31:10.606 INFO:teuthology.orchestra.run.smithi032.stdout: osd scrub max interval = 600 2023-06-20T13:31:10.606 INFO:teuthology.orchestra.run.smithi032.stdout: osd mclock profile = high_recovery_ops 2023-06-20T13:31:10.607 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:10.607 INFO:teuthology.orchestra.run.smithi032.stdout: osd recover clone overlap = true 2023-06-20T13:31:10.607 INFO:teuthology.orchestra.run.smithi032.stdout: osd recovery max chunk = 1048576 2023-06-20T13:31:10.607 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:10.607 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug shutdown = true 2023-06-20T13:31:10.607 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug op order = true 2023-06-20T13:31:10.607 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug verify stray on activate = true 2023-06-20T13:31:10.607 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:10.608 INFO:teuthology.orchestra.run.smithi032.stdout: osd open classes on start = true 2023-06-20T13:31:10.608 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug pg log writeout = true 2023-06-20T13:31:10.608 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:10.608 INFO:teuthology.orchestra.run.smithi032.stdout: osd deep scrub update digest min age = 30 2023-06-20T13:31:10.608 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:10.608 INFO:teuthology.orchestra.run.smithi032.stdout: osd map max advance = 10 2023-06-20T13:31:10.608 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:10.608 INFO:teuthology.orchestra.run.smithi032.stdout: journal zero on create = true 2023-06-20T13:31:10.609 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:10.609 INFO:teuthology.orchestra.run.smithi032.stdout: filestore ondisk finisher threads = 3 2023-06-20T13:31:10.609 INFO:teuthology.orchestra.run.smithi032.stdout: filestore apply finisher threads = 3 2023-06-20T13:31:10.609 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:10.609 INFO:teuthology.orchestra.run.smithi032.stdout: bdev debug aio = true 2023-06-20T13:31:10.609 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug misdirected ops = true 2023-06-20T13:31:10.609 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore block size = 96636764160 2023-06-20T13:31:10.609 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore fsck on mount = True 2023-06-20T13:31:10.610 INFO:teuthology.orchestra.run.smithi032.stdout: debug bluefs = 20 2023-06-20T13:31:10.610 INFO:teuthology.orchestra.run.smithi032.stdout: debug bluestore = 20 2023-06-20T13:31:10.610 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2023-06-20T13:31:10.610 INFO:teuthology.orchestra.run.smithi032.stdout: debug osd = 20 2023-06-20T13:31:10.610 INFO:teuthology.orchestra.run.smithi032.stdout: debug rocksdb = 10 2023-06-20T13:31:10.610 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd backfillfull_ratio = 0.85 2023-06-20T13:31:10.610 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd full ratio = 0.9 2023-06-20T13:31:10.610 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd nearfull ratio = 0.8 2023-06-20T13:31:10.611 INFO:teuthology.orchestra.run.smithi032.stdout: osd failsafe full ratio = 0.95 2023-06-20T13:31:10.611 INFO:teuthology.orchestra.run.smithi032.stdout: osd objectstore = bluestore 2023-06-20T13:31:10.611 INFO:teuthology.orchestra.run.smithi032.stdout: osd op complaint time = 180 2023-06-20T13:31:10.611 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:10.611 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr] 2023-06-20T13:31:10.611 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2023-06-20T13:31:10.611 INFO:teuthology.orchestra.run.smithi032.stdout: debug mgr = 20 2023-06-20T13:31:10.611 INFO:teuthology.orchestra.run.smithi032.stdout: debug mon = 20 2023-06-20T13:31:10.612 INFO:teuthology.orchestra.run.smithi032.stdout: debug auth = 20 2023-06-20T13:31:10.612 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min pgs per osd = 4 2023-06-20T13:31:10.612 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min bytes per osd = 10 2023-06-20T13:31:10.612 INFO:teuthology.orchestra.run.smithi032.stdout: mgr/telemetry/nag = false 2023-06-20T13:31:10.612 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:10.612 INFO:teuthology.orchestra.run.smithi032.stdout:[mon] 2023-06-20T13:31:10.612 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2023-06-20T13:31:10.612 INFO:teuthology.orchestra.run.smithi032.stdout: debug mon = 20 2023-06-20T13:31:10.613 INFO:teuthology.orchestra.run.smithi032.stdout: debug paxos = 20 2023-06-20T13:31:10.613 INFO:teuthology.orchestra.run.smithi032.stdout: debug auth = 20 2023-06-20T13:31:10.613 INFO:teuthology.orchestra.run.smithi032.stdout: mon data avail warn = 5 2023-06-20T13:31:10.613 INFO:teuthology.orchestra.run.smithi032.stdout: mon mgr mkfs grace = 240 2023-06-20T13:31:10.613 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min pgs per osd = 4 2023-06-20T13:31:10.613 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd reporter subtree level = osd 2023-06-20T13:31:10.613 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd prime pg temp = true 2023-06-20T13:31:10.613 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min bytes per osd = 10 2023-06-20T13:31:10.614 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:10.614 INFO:teuthology.orchestra.run.smithi032.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-20T13:31:10.614 INFO:teuthology.orchestra.run.smithi032.stdout: auth mon ticket ttl = 660 # 11m 2023-06-20T13:31:10.614 INFO:teuthology.orchestra.run.smithi032.stdout: auth service ticket ttl = 240 # 4m 2023-06-20T13:31:10.614 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:10.614 INFO:teuthology.orchestra.run.smithi032.stdout: # don't complain about insecure global_id in the test suite 2023-06-20T13:31:10.614 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-20T13:31:10.614 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-20T13:31:10.615 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:10.615 INFO:teuthology.orchestra.run.smithi032.stdout: # 1m isn't quite enough 2023-06-20T13:31:10.615 INFO:teuthology.orchestra.run.smithi032.stdout: mon_down_mkfs_grace = 2m 2023-06-20T13:31:10.615 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:10.615 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_filestore_osds = false 2023-06-20T13:31:10.615 INFO:teuthology.orchestra.run.smithi032.stdout: mon op complaint time = 120 2023-06-20T13:31:10.615 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:10.615 INFO:teuthology.orchestra.run.smithi032.stdout:[client] 2023-06-20T13:31:10.616 INFO:teuthology.orchestra.run.smithi032.stdout: rgw cache enabled = true 2023-06-20T13:31:10.616 INFO:teuthology.orchestra.run.smithi032.stdout: rgw enable ops log = true 2023-06-20T13:31:10.616 INFO:teuthology.orchestra.run.smithi032.stdout: rgw enable usage log = true 2023-06-20T13:31:10.616 INFO:teuthology.orchestra.run.smithi032.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-20T13:31:10.616 INFO:teuthology.orchestra.run.smithi032.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-20T13:31:10.616 INFO:teuthology.orchestra.run.smithi032.stdout: client mount timeout = 600 2023-06-20T13:31:10.616 INFO:teuthology.orchestra.run.smithi032.stdout: debug client = 20 2023-06-20T13:31:10.616 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2023-06-20T13:31:10.618 INFO:teuthology.orchestra.run.smithi032.stdout: pid file = "" 2023-06-20T13:31:10.618 INFO:teuthology.orchestra.run.smithi032.stdout: rados mon op timeout = 900 2023-06-20T13:31:10.618 INFO:teuthology.orchestra.run.smithi032.stdout: rados osd op timeout = 900 2023-06-20T13:31:10.619 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.a] 2023-06-20T13:31:10.619 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.b] 2023-06-20T13:31:10.619 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.c] 2023-06-20T13:31:10.619 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.a] 2023-06-20T13:31:10.619 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.c] 2023-06-20T13:31:10.619 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.b] 2023-06-20T13:31:10.619 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.d] 2023-06-20T13:31:10.619 INFO:teuthology.orchestra.run.smithi032.stdout:[mds] 2023-06-20T13:31:10.620 INFO:teuthology.orchestra.run.smithi032.stdout: debug mds = 20 2023-06-20T13:31:10.620 INFO:teuthology.orchestra.run.smithi032.stdout: debug mds balancer = 20 2023-06-20T13:31:10.620 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2023-06-20T13:31:10.620 INFO:teuthology.orchestra.run.smithi032.stdout: mds debug frag = True 2023-06-20T13:31:10.620 INFO:teuthology.orchestra.run.smithi032.stdout: mds debug scatterstat = True 2023-06-20T13:31:10.620 INFO:teuthology.orchestra.run.smithi032.stdout: mds op complaint time = 180 2023-06-20T13:31:10.620 INFO:teuthology.orchestra.run.smithi032.stdout: mds verify scatter = True 2023-06-20T13:31:10.621 INFO:teuthology.orchestra.run.smithi032.stdout: osd op complaint time = 180 2023-06-20T13:31:10.621 INFO:teuthology.orchestra.run.smithi032.stdout: rados mon op timeout = 900 2023-06-20T13:31:10.621 INFO:teuthology.orchestra.run.smithi032.stdout: rados osd op timeout = 900 2023-06-20T13:31:10.621 INFO:teuthology.orchestra.run.smithi115.stdout:[global] 2023-06-20T13:31:10.622 INFO:teuthology.orchestra.run.smithi115.stdout: chdir = "" 2023-06-20T13:31:10.622 INFO:teuthology.orchestra.run.smithi115.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-20T13:31:10.622 INFO:teuthology.orchestra.run.smithi115.stdout: auth supported = cephx 2023-06-20T13:31:10.622 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:10.622 INFO:teuthology.orchestra.run.smithi115.stdout: filestore xattr use omap = true 2023-06-20T13:31:10.622 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:10.622 INFO:teuthology.orchestra.run.smithi115.stdout: mon clock drift allowed = 1.000 2023-06-20T13:31:10.622 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:10.623 INFO:teuthology.orchestra.run.smithi115.stdout: osd crush chooseleaf type = 0 2023-06-20T13:31:10.623 INFO:teuthology.orchestra.run.smithi115.stdout: auth debug = true 2023-06-20T13:31:10.623 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:10.623 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on old message = true 2023-06-20T13:31:10.623 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on bug = true 2023-06-20T13:31:10.623 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:10.623 INFO:teuthology.orchestra.run.smithi115.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-20T13:31:10.624 INFO:teuthology.orchestra.run.smithi115.stdout: mon pg warn max object skew = 0 2023-06-20T13:31:10.624 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:10.624 INFO:teuthology.orchestra.run.smithi115.stdout: # disable pg_autoscaler by default for new pools 2023-06-20T13:31:10.624 INFO:teuthology.orchestra.run.smithi115.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-20T13:31:10.624 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:10.624 INFO:teuthology.orchestra.run.smithi115.stdout: osd pool default size = 2 2023-06-20T13:31:10.624 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:10.624 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd allow primary affinity = true 2023-06-20T13:31:10.625 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd allow pg remap = true 2023-06-20T13:31:10.625 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on legacy crush tunables = false 2023-06-20T13:31:10.625 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on crush straw calc version zero = false 2023-06-20T13:31:10.625 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on no sortbitwise = false 2023-06-20T13:31:10.625 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on osd down out interval zero = false 2023-06-20T13:31:10.625 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on too few osds = false 2023-06-20T13:31:10.625 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-20T13:31:10.625 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-20T13:31:10.626 INFO:teuthology.orchestra.run.smithi115.stdout: mon_allow_pool_size_one = true 2023-06-20T13:31:10.626 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:10.626 INFO:teuthology.orchestra.run.smithi115.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-20T13:31:10.626 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:10.626 INFO:teuthology.orchestra.run.smithi115.stdout: osd default data pool replay window = 5 2023-06-20T13:31:10.626 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:10.626 INFO:teuthology.orchestra.run.smithi115.stdout: mon allow pool delete = true 2023-06-20T13:31:10.626 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:10.627 INFO:teuthology.orchestra.run.smithi115.stdout: mon cluster log file level = debug 2023-06-20T13:31:10.627 INFO:teuthology.orchestra.run.smithi115.stdout: debug asserts on shutdown = true 2023-06-20T13:31:10.627 INFO:teuthology.orchestra.run.smithi115.stdout: mon health detail to clog = false 2023-06-20T13:31:10.627 INFO:teuthology.orchestra.run.smithi115.stdout: mon host = "172.21.15.32,172.21.15.115,[v2:172.21.15.115:3301,v1:172.21.15.115:6790]" 2023-06-20T13:31:10.627 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on skipped message = False 2023-06-20T13:31:10.627 INFO:teuthology.orchestra.run.smithi115.stdout: fsid = 8ec09bdb-4968-488f-bf51-7b0f1e92355f 2023-06-20T13:31:10.627 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:10.628 INFO:teuthology.orchestra.run.smithi115.stdout:[osd] 2023-06-20T13:31:10.628 INFO:teuthology.orchestra.run.smithi115.stdout: osd journal size = 100 2023-06-20T13:31:10.628 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:10.628 INFO:teuthology.orchestra.run.smithi115.stdout: osd scrub load threshold = 5.0 2023-06-20T13:31:10.628 INFO:teuthology.orchestra.run.smithi115.stdout: osd scrub max interval = 600 2023-06-20T13:31:10.628 INFO:teuthology.orchestra.run.smithi115.stdout: osd mclock profile = high_recovery_ops 2023-06-20T13:31:10.628 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:10.629 INFO:teuthology.orchestra.run.smithi115.stdout: osd recover clone overlap = true 2023-06-20T13:31:10.629 INFO:teuthology.orchestra.run.smithi115.stdout: osd recovery max chunk = 1048576 2023-06-20T13:31:10.629 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:10.629 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug shutdown = true 2023-06-20T13:31:10.629 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug op order = true 2023-06-20T13:31:10.629 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug verify stray on activate = true 2023-06-20T13:31:10.629 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:10.629 INFO:teuthology.orchestra.run.smithi115.stdout: osd open classes on start = true 2023-06-20T13:31:10.630 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug pg log writeout = true 2023-06-20T13:31:10.630 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:10.630 INFO:teuthology.orchestra.run.smithi115.stdout: osd deep scrub update digest min age = 30 2023-06-20T13:31:10.630 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:10.630 INFO:teuthology.orchestra.run.smithi115.stdout: osd map max advance = 10 2023-06-20T13:31:10.630 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:10.630 INFO:teuthology.orchestra.run.smithi115.stdout: journal zero on create = true 2023-06-20T13:31:10.630 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:10.631 INFO:teuthology.orchestra.run.smithi115.stdout: filestore ondisk finisher threads = 3 2023-06-20T13:31:10.631 INFO:teuthology.orchestra.run.smithi115.stdout: filestore apply finisher threads = 3 2023-06-20T13:31:10.631 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:10.631 INFO:teuthology.orchestra.run.smithi115.stdout: bdev debug aio = true 2023-06-20T13:31:10.631 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug misdirected ops = true 2023-06-20T13:31:10.631 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore block size = 96636764160 2023-06-20T13:31:10.631 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore fsck on mount = True 2023-06-20T13:31:10.631 INFO:teuthology.orchestra.run.smithi115.stdout: debug bluefs = 20 2023-06-20T13:31:10.632 INFO:teuthology.orchestra.run.smithi115.stdout: debug bluestore = 20 2023-06-20T13:31:10.632 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2023-06-20T13:31:10.632 INFO:teuthology.orchestra.run.smithi115.stdout: debug osd = 20 2023-06-20T13:31:10.632 INFO:teuthology.orchestra.run.smithi115.stdout: debug rocksdb = 10 2023-06-20T13:31:10.632 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd backfillfull_ratio = 0.85 2023-06-20T13:31:10.632 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd full ratio = 0.9 2023-06-20T13:31:10.632 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd nearfull ratio = 0.8 2023-06-20T13:31:10.632 INFO:teuthology.orchestra.run.smithi115.stdout: osd failsafe full ratio = 0.95 2023-06-20T13:31:10.633 INFO:teuthology.orchestra.run.smithi115.stdout: osd objectstore = bluestore 2023-06-20T13:31:10.633 INFO:teuthology.orchestra.run.smithi115.stdout: osd op complaint time = 180 2023-06-20T13:31:10.633 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:10.633 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr] 2023-06-20T13:31:10.633 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2023-06-20T13:31:10.633 INFO:teuthology.orchestra.run.smithi115.stdout: debug mgr = 20 2023-06-20T13:31:10.633 INFO:teuthology.orchestra.run.smithi115.stdout: debug mon = 20 2023-06-20T13:31:10.633 INFO:teuthology.orchestra.run.smithi115.stdout: debug auth = 20 2023-06-20T13:31:10.634 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min pgs per osd = 4 2023-06-20T13:31:10.634 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min bytes per osd = 10 2023-06-20T13:31:10.634 INFO:teuthology.orchestra.run.smithi115.stdout: mgr/telemetry/nag = false 2023-06-20T13:31:10.634 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:10.634 INFO:teuthology.orchestra.run.smithi115.stdout:[mon] 2023-06-20T13:31:10.634 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2023-06-20T13:31:10.634 INFO:teuthology.orchestra.run.smithi115.stdout: debug mon = 20 2023-06-20T13:31:10.634 INFO:teuthology.orchestra.run.smithi115.stdout: debug paxos = 20 2023-06-20T13:31:10.635 INFO:teuthology.orchestra.run.smithi115.stdout: debug auth = 20 2023-06-20T13:31:10.635 INFO:teuthology.orchestra.run.smithi115.stdout: mon data avail warn = 5 2023-06-20T13:31:10.635 INFO:teuthology.orchestra.run.smithi115.stdout: mon mgr mkfs grace = 240 2023-06-20T13:31:10.635 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min pgs per osd = 4 2023-06-20T13:31:10.635 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd reporter subtree level = osd 2023-06-20T13:31:10.635 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd prime pg temp = true 2023-06-20T13:31:10.635 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min bytes per osd = 10 2023-06-20T13:31:10.635 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:10.636 INFO:teuthology.orchestra.run.smithi115.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-20T13:31:10.636 INFO:teuthology.orchestra.run.smithi115.stdout: auth mon ticket ttl = 660 # 11m 2023-06-20T13:31:10.636 INFO:teuthology.orchestra.run.smithi115.stdout: auth service ticket ttl = 240 # 4m 2023-06-20T13:31:10.636 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:10.636 INFO:teuthology.orchestra.run.smithi115.stdout: # don't complain about insecure global_id in the test suite 2023-06-20T13:31:10.636 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-20T13:31:10.636 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-20T13:31:10.636 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:10.637 INFO:teuthology.orchestra.run.smithi115.stdout: # 1m isn't quite enough 2023-06-20T13:31:10.637 INFO:teuthology.orchestra.run.smithi115.stdout: mon_down_mkfs_grace = 2m 2023-06-20T13:31:10.637 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:10.637 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_filestore_osds = false 2023-06-20T13:31:10.637 INFO:teuthology.orchestra.run.smithi115.stdout: mon op complaint time = 120 2023-06-20T13:31:10.637 INFO:teuthology.orchestra.run.smithi115.stdout: 2023-06-20T13:31:10.637 INFO:teuthology.orchestra.run.smithi115.stdout:[client] 2023-06-20T13:31:10.637 INFO:teuthology.orchestra.run.smithi115.stdout: rgw cache enabled = true 2023-06-20T13:31:10.638 INFO:teuthology.orchestra.run.smithi115.stdout: rgw enable ops log = true 2023-06-20T13:31:10.638 INFO:teuthology.orchestra.run.smithi115.stdout: rgw enable usage log = true 2023-06-20T13:31:10.638 INFO:teuthology.orchestra.run.smithi115.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-20T13:31:10.638 INFO:teuthology.orchestra.run.smithi115.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-20T13:31:10.638 INFO:teuthology.orchestra.run.smithi115.stdout: client mount timeout = 600 2023-06-20T13:31:10.638 INFO:teuthology.orchestra.run.smithi115.stdout: debug client = 20 2023-06-20T13:31:10.638 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2023-06-20T13:31:10.638 INFO:teuthology.orchestra.run.smithi115.stdout: pid file = "" 2023-06-20T13:31:10.639 INFO:teuthology.orchestra.run.smithi115.stdout: rados mon op timeout = 900 2023-06-20T13:31:10.639 INFO:teuthology.orchestra.run.smithi115.stdout: rados osd op timeout = 900 2023-06-20T13:31:10.639 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.a] 2023-06-20T13:31:10.639 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.b] 2023-06-20T13:31:10.639 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.c] 2023-06-20T13:31:10.639 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.a] 2023-06-20T13:31:10.639 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.c] 2023-06-20T13:31:10.639 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.b] 2023-06-20T13:31:10.640 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.d] 2023-06-20T13:31:10.640 INFO:teuthology.orchestra.run.smithi115.stdout:[mds] 2023-06-20T13:31:10.640 INFO:teuthology.orchestra.run.smithi115.stdout: debug mds = 20 2023-06-20T13:31:10.640 INFO:teuthology.orchestra.run.smithi115.stdout: debug mds balancer = 20 2023-06-20T13:31:10.640 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2023-06-20T13:31:10.640 INFO:teuthology.orchestra.run.smithi115.stdout: mds debug frag = True 2023-06-20T13:31:10.640 INFO:teuthology.orchestra.run.smithi115.stdout: mds debug scatterstat = True 2023-06-20T13:31:10.640 INFO:teuthology.orchestra.run.smithi115.stdout: mds op complaint time = 180 2023-06-20T13:31:10.641 INFO:teuthology.orchestra.run.smithi115.stdout: mds verify scatter = True 2023-06-20T13:31:10.641 INFO:teuthology.orchestra.run.smithi115.stdout: osd op complaint time = 180 2023-06-20T13:31:10.641 INFO:teuthology.orchestra.run.smithi115.stdout: rados mon op timeout = 900 2023-06-20T13:31:10.641 INFO:teuthology.orchestra.run.smithi115.stdout: rados osd op timeout = 900 2023-06-20T13:31:10.642 INFO:tasks.ceph:Creating admin key on mon.a... 2023-06-20T13:31:10.643 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-06-20T13:31:10.757 INFO:tasks.ceph:Copying monmap to all nodes... 2023-06-20T13:31:10.758 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:31:10.758 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-06-20T13:31:10.806 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:31:10.807 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-06-20T13:31:10.890 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi032.front.sepia.ceph.com 2023-06-20T13:31:10.891 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:31:10.891 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-20T13:31:10.891 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-20T13:31:11.025 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:31:11.026 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-20T13:31:11.110 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi115.front.sepia.ceph.com 2023-06-20T13:31:11.110 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:31:11.110 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-20T13:31:11.111 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-20T13:31:11.208 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:31:11.209 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-20T13:31:11.297 INFO:tasks.ceph:Setting up mon nodes... 2023-06-20T13:31:11.298 INFO:tasks.ceph:Setting up mgr nodes... 2023-06-20T13:31:11.299 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-06-20T13:31:11.423 INFO:teuthology.orchestra.run.smithi032.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-06-20T13:31:11.429 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-06-20T13:31:11.564 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-06-20T13:31:11.572 INFO:tasks.ceph:Setting up mds nodes... 2023-06-20T13:31:11.573 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-06-20T13:31:11.697 INFO:teuthology.orchestra.run.smithi032.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-06-20T13:31:11.703 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-06-20T13:31:11.773 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-06-20T13:31:11.897 INFO:teuthology.orchestra.run.smithi032.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-06-20T13:31:11.902 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-06-20T13:31:11.973 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-06-20T13:31:12.093 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-06-20T13:31:12.098 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-06-20T13:31:12.166 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-06-20T13:31:12.286 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-06-20T13:31:12.293 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-06-20T13:31:12.361 INFO:tasks.ceph_client:Setting up client nodes... 2023-06-20T13:31:12.361 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-06-20T13:31:12.460 INFO:teuthology.orchestra.run.smithi032.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-06-20T13:31:12.492 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-06-20T13:31:12.589 INFO:teuthology.orchestra.run.smithi032.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-06-20T13:31:12.620 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-06-20T13:31:12.716 INFO:teuthology.orchestra.run.smithi115.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-06-20T13:31:12.746 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-06-20T13:31:12.840 INFO:teuthology.orchestra.run.smithi115.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-06-20T13:31:12.870 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-06-20T13:31:12.870 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi032.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi115.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-20T13:31:12.871 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-06-20T13:31:12.940 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-20T13:31:12.941 INFO:tasks.ceph:role: osd.0 2023-06-20T13:31:12.941 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi032.front.sepia.ceph.com 2023-06-20T13:31:12.942 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-20T13:31:13.010 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-20T13:31:13.011 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-20T13:31:13.011 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-20T13:31:13.011 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-20T13:31:13.011 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-20T13:31:13.011 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2023-06-20T13:31:13.011 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-20T13:31:13.012 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-20T13:31:13.012 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-20T13:31:13.012 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-20T13:31:13.034 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2023-06-20T13:31:13.039 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2023-06-20T13:31:13.039 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-06-20T13:31:13.149 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-06-20T13:31:13.225 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-06-20T13:31:13.295 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-20T13:31:13.296 INFO:tasks.ceph:role: osd.1 2023-06-20T13:31:13.296 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi032.front.sepia.ceph.com 2023-06-20T13:31:13.296 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-20T13:31:13.366 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-20T13:31:13.367 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-20T13:31:13.367 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-20T13:31:13.367 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-20T13:31:13.367 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-20T13:31:13.367 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2023-06-20T13:31:13.367 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-20T13:31:13.367 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-20T13:31:13.368 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-20T13:31:13.368 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-20T13:31:13.390 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2023-06-20T13:31:13.393 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2023-06-20T13:31:13.393 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-06-20T13:31:13.498 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-06-20T13:31:13.575 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-06-20T13:31:13.644 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-20T13:31:13.644 INFO:tasks.ceph:role: osd.2 2023-06-20T13:31:13.645 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi032.front.sepia.ceph.com 2023-06-20T13:31:13.645 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-20T13:31:13.714 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-20T13:31:13.715 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-20T13:31:13.715 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-20T13:31:13.715 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-20T13:31:13.715 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-20T13:31:13.715 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2023-06-20T13:31:13.716 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-20T13:31:13.716 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-20T13:31:13.716 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-20T13:31:13.716 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-20T13:31:13.740 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2023-06-20T13:31:13.742 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2023-06-20T13:31:13.743 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-06-20T13:31:13.848 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-06-20T13:31:13.924 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-06-20T13:31:13.994 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-20T13:31:13.994 INFO:tasks.ceph:role: osd.3 2023-06-20T13:31:13.994 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi032.front.sepia.ceph.com 2023-06-20T13:31:13.994 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-20T13:31:14.062 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-20T13:31:14.063 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-20T13:31:14.063 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-20T13:31:14.063 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-20T13:31:14.063 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-20T13:31:14.063 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2023-06-20T13:31:14.063 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-20T13:31:14.064 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-20T13:31:14.064 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-20T13:31:14.064 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-20T13:31:14.086 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2023-06-20T13:31:14.089 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2023-06-20T13:31:14.090 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-06-20T13:31:14.194 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-06-20T13:31:14.270 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-20T13:31:14.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:14.393+0000 7f4596f2c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-06-20T13:31:14.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:14.394+0000 7f4596f2c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-06-20T13:31:14.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:14.394+0000 7f4596f2c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-20T13:31:14.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:14.394+0000 7f4596f2c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-20T13:31:14.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:14.394+0000 7f4596f2c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-20T13:31:14.398 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:14.396+0000 7f4596f2c640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-06-20T13:31:17.277 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-06-20T13:31:17.351 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-20T13:31:17.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:17.456+0000 7fa54653a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-06-20T13:31:17.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:17.456+0000 7fa54653a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-06-20T13:31:17.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:17.456+0000 7fa54653a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-20T13:31:17.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:17.456+0000 7fa54653a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-20T13:31:17.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:17.456+0000 7fa54653a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-20T13:31:17.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:17.457+0000 7fa54653a640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-06-20T13:31:20.344 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-06-20T13:31:20.420 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-20T13:31:20.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:20.526+0000 7fdb20400640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-06-20T13:31:20.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:20.527+0000 7fdb20400640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-06-20T13:31:20.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:20.527+0000 7fdb20400640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-20T13:31:20.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:20.527+0000 7fdb20400640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-20T13:31:20.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:20.527+0000 7fdb20400640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-20T13:31:20.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:20.528+0000 7fdb20400640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-06-20T13:31:23.404 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-06-20T13:31:23.480 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-20T13:31:23.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:23.587+0000 7f80615bd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-06-20T13:31:23.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:23.587+0000 7f80615bd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-06-20T13:31:23.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:23.587+0000 7f80615bd640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-20T13:31:23.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:23.587+0000 7f80615bd640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-20T13:31:23.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:23.587+0000 7f80615bd640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-20T13:31:23.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:23.589+0000 7f80615bd640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-06-20T13:31:26.470 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-06-20T13:31:26.546 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-06-20T13:31:26.623 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-20T13:31:26.623 INFO:tasks.ceph:role: osd.4 2023-06-20T13:31:26.624 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi115.front.sepia.ceph.com 2023-06-20T13:31:26.624 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-20T13:31:26.702 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-20T13:31:26.703 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-20T13:31:26.703 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-20T13:31:26.703 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-20T13:31:26.703 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-20T13:31:26.703 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2023-06-20T13:31:26.703 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-20T13:31:26.704 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-20T13:31:26.704 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-20T13:31:26.704 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-20T13:31:27.139 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2023-06-20T13:31:27.143 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2023-06-20T13:31:27.143 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-06-20T13:31:27.346 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-06-20T13:31:27.422 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-06-20T13:31:27.490 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-20T13:31:27.490 INFO:tasks.ceph:role: osd.5 2023-06-20T13:31:27.491 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi115.front.sepia.ceph.com 2023-06-20T13:31:27.491 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-20T13:31:27.567 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-20T13:31:27.568 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-20T13:31:27.568 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-20T13:31:27.568 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-20T13:31:27.568 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-20T13:31:27.568 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2023-06-20T13:31:27.568 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-20T13:31:27.568 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-20T13:31:27.569 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-20T13:31:27.569 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-20T13:31:27.982 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2023-06-20T13:31:27.986 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2023-06-20T13:31:27.986 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-06-20T13:31:28.125 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-06-20T13:31:28.201 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-06-20T13:31:28.269 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-20T13:31:28.269 INFO:tasks.ceph:role: osd.6 2023-06-20T13:31:28.269 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi115.front.sepia.ceph.com 2023-06-20T13:31:28.270 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-20T13:31:28.345 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-20T13:31:28.346 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-20T13:31:28.346 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-20T13:31:28.346 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-20T13:31:28.346 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-20T13:31:28.346 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2023-06-20T13:31:28.346 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-20T13:31:28.346 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-20T13:31:28.347 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-20T13:31:28.347 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-20T13:31:28.788 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2023-06-20T13:31:28.793 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2023-06-20T13:31:28.793 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-06-20T13:31:28.990 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-06-20T13:31:29.065 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-06-20T13:31:29.133 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-20T13:31:29.133 INFO:tasks.ceph:role: osd.7 2023-06-20T13:31:29.134 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi115.front.sepia.ceph.com 2023-06-20T13:31:29.134 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-20T13:31:29.209 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-20T13:31:29.209 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-20T13:31:29.209 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-20T13:31:29.209 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-20T13:31:29.210 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-20T13:31:29.210 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2023-06-20T13:31:29.210 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-20T13:31:29.210 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-20T13:31:29.210 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-20T13:31:29.210 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-20T13:31:29.642 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2023-06-20T13:31:29.646 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2023-06-20T13:31:29.646 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-06-20T13:31:29.778 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-06-20T13:31:29.853 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-20T13:31:29.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:29.987+0000 7fe412e75640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-06-20T13:31:29.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:29.987+0000 7fe412e75640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-06-20T13:31:29.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:29.987+0000 7fe412e75640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-20T13:31:29.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:29.987+0000 7fe412e75640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-20T13:31:29.992 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:29.987+0000 7fe412e75640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-20T13:31:29.993 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:29.989+0000 7fe412e75640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-06-20T13:31:32.883 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-06-20T13:31:32.953 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-20T13:31:33.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:33.054+0000 7f484afa0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-06-20T13:31:33.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:33.054+0000 7f484afa0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-06-20T13:31:33.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:33.054+0000 7f484afa0640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-20T13:31:33.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:33.054+0000 7f484afa0640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-20T13:31:33.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:33.054+0000 7f484afa0640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-20T13:31:33.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:33.056+0000 7f484afa0640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-06-20T13:31:35.937 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-06-20T13:31:36.007 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-20T13:31:36.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:36.109+0000 7f5c3bca1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-06-20T13:31:36.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:36.109+0000 7f5c3bca1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-06-20T13:31:36.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:36.109+0000 7f5c3bca1640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-20T13:31:36.112 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:36.109+0000 7f5c3bca1640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-20T13:31:36.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:36.109+0000 7f5c3bca1640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-20T13:31:36.113 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:36.111+0000 7f5c3bca1640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-06-20T13:31:37.949 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:31:37.954 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:31:38.998 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-06-20T13:31:39.068 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-20T13:31:39.171 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:39.169+0000 7f6f583d2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-06-20T13:31:39.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:39.169+0000 7f6f583d2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-06-20T13:31:39.172 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:39.169+0000 7f6f583d2640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-20T13:31:39.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:39.169+0000 7f6f583d2640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-20T13:31:39.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:39.169+0000 7f6f583d2640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-20T13:31:39.173 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:39.172+0000 7f6f583d2640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-06-20T13:31:42.047 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-06-20T13:31:42.115 INFO:tasks.ceph:Reading keys from all nodes... 2023-06-20T13:31:42.116 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:31:42.116 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-06-20T13:31:42.192 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:31:42.193 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-06-20T13:31:42.265 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:31:42.265 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-06-20T13:31:42.375 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:31:42.375 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-06-20T13:31:42.483 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:31:42.483 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-06-20T13:31:42.592 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:31:42.592 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-06-20T13:31:42.701 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:31:42.701 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-06-20T13:31:42.810 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:31:42.810 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-06-20T13:31:42.883 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:31:42.883 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-06-20T13:31:42.953 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:31:42.953 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-06-20T13:31:43.065 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:31:43.065 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-06-20T13:31:43.168 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:31:43.169 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-06-20T13:31:43.277 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:31:43.277 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-06-20T13:31:43.385 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:31:43.385 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-06-20T13:31:43.493 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:31:43.494 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-06-20T13:31:43.543 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:31:43.544 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-06-20T13:31:43.590 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:31:43.591 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-06-20T13:31:43.635 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:31:43.636 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-06-20T13:31:43.719 INFO:tasks.ceph:Adding keys to all mons... 2023-06-20T13:31:43.720 DEBUG:teuthology.orchestra.run.smithi032:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-20T13:31:43.724 DEBUG:teuthology.orchestra.run.smithi115:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-20T13:31:43.788 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr.y] 2023-06-20T13:31:43.788 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAfqpFk32kwGRAANc0nhK56zfZ74dA5eOJGYQ== 2023-06-20T13:31:43.788 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.a] 2023-06-20T13:31:43.789 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAfqpFkM16FKRAA8QcmTCS8fBq+3SiK6BU9PA== 2023-06-20T13:31:43.789 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.c] 2023-06-20T13:31:43.789 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAfqpFkCVxyNRAAz1fUAMK+Sue96mAvTt2V5w== 2023-06-20T13:31:43.789 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.0] 2023-06-20T13:31:43.789 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAiqpFkuXyJFxAA6sxIDdmmSE/1UMenB0ElUg== 2023-06-20T13:31:43.789 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.1] 2023-06-20T13:31:43.789 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAlqpFkZiJBGxAAwMVC0DmyKhjwzOfzb2J4Vw== 2023-06-20T13:31:43.790 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.2] 2023-06-20T13:31:43.790 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAoqpFk0RR5HxAAXx0vVBC6fLD5bGUhhHbXCw== 2023-06-20T13:31:43.790 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.3] 2023-06-20T13:31:43.790 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQArqpFkF3wTIxAAzzrTDc4NfRMWNpU8KjIIiA== 2023-06-20T13:31:43.790 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr.x] 2023-06-20T13:31:43.790 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAfqpFkEDGbIRAAztYtbP68oFJEn/+OX19Z9A== 2023-06-20T13:31:43.790 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.b] 2023-06-20T13:31:43.790 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAgqpFkz/uFBRAA/iPte8VV4JP6h8P7ytGK+A== 2023-06-20T13:31:43.791 INFO:teuthology.orchestra.run.smithi032.stdout:[mds.d] 2023-06-20T13:31:43.791 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAgqpFkUDsAERAAfLpa27zj64NOo20efZa5ow== 2023-06-20T13:31:43.791 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.4] 2023-06-20T13:31:43.791 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAxqpFkoanvOhAAV0mSlBoQWiw3PSNci4A1Yg== 2023-06-20T13:31:43.791 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.5] 2023-06-20T13:31:43.792 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQA1qpFkrt9VAxAAYcQMhl0UBMpriukyYvDBxg== 2023-06-20T13:31:43.792 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.6] 2023-06-20T13:31:43.792 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQA4qpFkVdOaBhAAoS/lnK+Up+kYuKyXVrMK0w== 2023-06-20T13:31:43.793 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.7] 2023-06-20T13:31:43.793 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQA7qpFk1N4uChAAZYE8l4QoUnpU+TdVEc41GQ== 2023-06-20T13:31:43.793 INFO:teuthology.orchestra.run.smithi032.stdout:[client.0] 2023-06-20T13:31:43.793 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAgqpFkKA1jGxAA7ykwu3Vv2LeMgJEJ1ebfpA== 2023-06-20T13:31:43.794 INFO:teuthology.orchestra.run.smithi032.stdout:[client.2] 2023-06-20T13:31:43.794 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAgqpFkkmESIxAAr+atYIDDJRTNcxYgiGuI8A== 2023-06-20T13:31:43.794 INFO:teuthology.orchestra.run.smithi032.stdout:[client.1] 2023-06-20T13:31:43.794 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAgqpFk8ramKhAA9N7jU+F4wIXMxvs54mCzWQ== 2023-06-20T13:31:43.795 INFO:teuthology.orchestra.run.smithi032.stdout:[client.3] 2023-06-20T13:31:43.795 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAgqpFkI8QCMhAAv86O0vCMhMADLo03CFH8eQ== 2023-06-20T13:31:43.824 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr.y] 2023-06-20T13:31:43.824 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAfqpFk32kwGRAANc0nhK56zfZ74dA5eOJGYQ== 2023-06-20T13:31:43.824 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.a] 2023-06-20T13:31:43.824 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAfqpFkM16FKRAA8QcmTCS8fBq+3SiK6BU9PA== 2023-06-20T13:31:43.824 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.c] 2023-06-20T13:31:43.825 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAfqpFkCVxyNRAAz1fUAMK+Sue96mAvTt2V5w== 2023-06-20T13:31:43.825 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.0] 2023-06-20T13:31:43.825 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAiqpFkuXyJFxAA6sxIDdmmSE/1UMenB0ElUg== 2023-06-20T13:31:43.825 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.1] 2023-06-20T13:31:43.825 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAlqpFkZiJBGxAAwMVC0DmyKhjwzOfzb2J4Vw== 2023-06-20T13:31:43.825 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.2] 2023-06-20T13:31:43.825 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAoqpFk0RR5HxAAXx0vVBC6fLD5bGUhhHbXCw== 2023-06-20T13:31:43.826 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.3] 2023-06-20T13:31:43.826 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQArqpFkF3wTIxAAzzrTDc4NfRMWNpU8KjIIiA== 2023-06-20T13:31:43.826 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr.x] 2023-06-20T13:31:43.826 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAfqpFkEDGbIRAAztYtbP68oFJEn/+OX19Z9A== 2023-06-20T13:31:43.826 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.b] 2023-06-20T13:31:43.826 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAgqpFkz/uFBRAA/iPte8VV4JP6h8P7ytGK+A== 2023-06-20T13:31:43.827 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.d] 2023-06-20T13:31:43.827 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAgqpFkUDsAERAAfLpa27zj64NOo20efZa5ow== 2023-06-20T13:31:43.827 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.4] 2023-06-20T13:31:43.828 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAxqpFkoanvOhAAV0mSlBoQWiw3PSNci4A1Yg== 2023-06-20T13:31:43.828 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.5] 2023-06-20T13:31:43.828 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQA1qpFkrt9VAxAAYcQMhl0UBMpriukyYvDBxg== 2023-06-20T13:31:43.828 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.6] 2023-06-20T13:31:43.829 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQA4qpFkVdOaBhAAoS/lnK+Up+kYuKyXVrMK0w== 2023-06-20T13:31:43.829 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.7] 2023-06-20T13:31:43.829 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQA7qpFk1N4uChAAZYE8l4QoUnpU+TdVEc41GQ== 2023-06-20T13:31:43.829 INFO:teuthology.orchestra.run.smithi115.stdout:[client.0] 2023-06-20T13:31:43.829 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAgqpFkKA1jGxAA7ykwu3Vv2LeMgJEJ1ebfpA== 2023-06-20T13:31:43.829 INFO:teuthology.orchestra.run.smithi115.stdout:[client.2] 2023-06-20T13:31:43.829 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAgqpFkkmESIxAAr+atYIDDJRTNcxYgiGuI8A== 2023-06-20T13:31:43.830 INFO:teuthology.orchestra.run.smithi115.stdout:[client.1] 2023-06-20T13:31:43.830 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAgqpFk8ramKhAA9N7jU+F4wIXMxvs54mCzWQ== 2023-06-20T13:31:43.830 INFO:teuthology.orchestra.run.smithi115.stdout:[client.3] 2023-06-20T13:31:43.830 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAgqpFkI8QCMhAAv86O0vCMhMADLo03CFH8eQ== 2023-06-20T13:31:43.831 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-20T13:31:43.841 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-20T13:31:43.978 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-20T13:31:43.983 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-20T13:31:44.096 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-20T13:31:44.101 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-20T13:31:44.211 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-20T13:31:44.216 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-20T13:31:44.323 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-20T13:31:44.327 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-20T13:31:44.434 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-20T13:31:44.439 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-20T13:31:44.546 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-20T13:31:44.551 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-20T13:31:44.658 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-20T13:31:44.662 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-20T13:31:44.770 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-20T13:31:44.775 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-20T13:31:44.885 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-20T13:31:44.889 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-20T13:31:44.999 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-20T13:31:45.004 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-20T13:31:45.110 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-20T13:31:45.114 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-20T13:31:45.222 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-20T13:31:45.226 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-20T13:31:45.333 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-20T13:31:45.339 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-20T13:31:45.445 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-20T13:31:45.450 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-20T13:31:45.561 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-20T13:31:45.565 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-20T13:31:45.674 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-20T13:31:45.679 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-20T13:31:45.790 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-20T13:31:45.794 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-20T13:31:45.905 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-06-20T13:31:45.906 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-06-20T13:31:45.975 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-20T13:31:46.099 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-06-20T13:31:46.170 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-06-20T13:31:46.239 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-20T13:31:46.360 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-06-20T13:31:46.431 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-06-20T13:31:46.498 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-20T13:31:46.620 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-06-20T13:31:46.687 DEBUG:teuthology.orchestra.run.smithi032:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-20T13:31:46.691 DEBUG:teuthology.orchestra.run.smithi115:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-20T13:31:46.735 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-06-20T13:31:46.736 INFO:tasks.ceph.mon.a:Restarting daemon 2023-06-20T13:31:46.736 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-06-20T13:31:46.778 INFO:tasks.ceph.mon.a:Started 2023-06-20T13:31:46.779 INFO:tasks.ceph.mon.b:Restarting daemon 2023-06-20T13:31:46.779 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-06-20T13:31:46.783 INFO:tasks.ceph.mon.b:Started 2023-06-20T13:31:46.783 INFO:tasks.ceph.mon.c:Restarting daemon 2023-06-20T13:31:46.784 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-06-20T13:31:46.787 INFO:tasks.ceph.mon.c:Started 2023-06-20T13:31:46.788 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-06-20T13:31:46.788 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-06-20T13:31:46.788 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-06-20T13:31:46.792 INFO:tasks.ceph.mgr.y:Started 2023-06-20T13:31:46.793 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-06-20T13:31:46.793 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-06-20T13:31:46.799 INFO:tasks.ceph.mgr.x:Started 2023-06-20T13:31:46.799 INFO:tasks.ceph:Setting crush tunables to default 2023-06-20T13:31:46.800 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph osd crush tunables default 2023-06-20T13:31:47.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:47.001+0000 7f545f1ff700 1 Processor -- start 2023-06-20T13:31:47.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:47.001+0000 7f545f1ff700 1 -- start start 2023-06-20T13:31:47.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:47.002+0000 7f545f1ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f545806d8a0 0x7f545815d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:47.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:47.002+0000 7f545f1ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f545815a790 con 0x7f545806dc70 2023-06-20T13:31:47.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:47.002+0000 7f545f1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f545815dd00 con 0x7f5458159760 2023-06-20T13:31:47.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:47.003+0000 7f545f1ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5458159c10 con 0x7f545806d8a0 2023-06-20T13:31:47.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:47.003+0000 7f5457fff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f5458159760 0x7f545814fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.32:34756/0 (socket says 172.21.15.32:34756) 2023-06-20T13:31:47.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:47.003+0000 7f5457fff700 1 -- 172.21.15.32:0/4095844932 learned_addr learned my addr 172.21.15.32:0/4095844932 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:31:47.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:47.003+0000 7f545cf9b700 1 --2- 172.21.15.32:0/4095844932 >> v2:172.21.15.32:3300/0 conn(0x7f545806d8a0 0x7f545815d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:47.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:47.003+0000 7f545cf9b700 1 -- 172.21.15.32:0/4095844932 >> v2:172.21.15.32:3300/0 conn(0x7f545806d8a0 msgr2=0x7f545815d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-20T13:31:47.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:47.003+0000 7f545cf9b700 1 -- 172.21.15.32:0/4095844932 >> v2:172.21.15.32:3300/0 conn(0x7f545806d8a0 msgr2=0x7f545815d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-20T13:31:47.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:47.003+0000 7f545cf9b700 1 --2- 172.21.15.32:0/4095844932 >> v2:172.21.15.32:3300/0 conn(0x7f545806d8a0 0x7f545815d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-20T13:31:47.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:47.004+0000 7f545cf9b700 1 --2- 172.21.15.32:0/4095844932 >> v2:172.21.15.32:3300/0 conn(0x7f545806d8a0 0x7f545815d7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-20T13:31:47.206 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:47.205+0000 7f545cf9b700 1 --2- 172.21.15.32:0/4095844932 >> v2:172.21.15.32:3300/0 conn(0x7f545806d8a0 0x7f545815d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:47.207 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:47.205+0000 7f545cf9b700 1 -- 172.21.15.32:0/4095844932 >> v2:172.21.15.32:3300/0 conn(0x7f545806d8a0 msgr2=0x7f545815d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-20T13:31:47.207 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:47.205+0000 7f545cf9b700 1 -- 172.21.15.32:0/4095844932 >> v2:172.21.15.32:3300/0 conn(0x7f545806d8a0 msgr2=0x7f545815d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-20T13:31:47.207 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:47.205+0000 7f545cf9b700 1 --2- 172.21.15.32:0/4095844932 >> v2:172.21.15.32:3300/0 conn(0x7f545806d8a0 0x7f545815d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-20T13:31:47.207 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:47.205+0000 7f545cf9b700 1 --2- 172.21.15.32:0/4095844932 >> v2:172.21.15.32:3300/0 conn(0x7f545806d8a0 0x7f545815d7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-06-20T13:31:47.608 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:47.606+0000 7f545cf9b700 1 --2- 172.21.15.32:0/4095844932 >> v2:172.21.15.32:3300/0 conn(0x7f545806d8a0 0x7f545815d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:47.608 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:47.606+0000 7f545cf9b700 1 -- 172.21.15.32:0/4095844932 >> v2:172.21.15.32:3300/0 conn(0x7f545806d8a0 msgr2=0x7f545815d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-20T13:31:47.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:47.606+0000 7f545cf9b700 1 -- 172.21.15.32:0/4095844932 >> v2:172.21.15.32:3300/0 conn(0x7f545806d8a0 msgr2=0x7f545815d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-20T13:31:47.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:47.606+0000 7f545cf9b700 1 --2- 172.21.15.32:0/4095844932 >> v2:172.21.15.32:3300/0 conn(0x7f545806d8a0 0x7f545815d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-20T13:31:47.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:47.606+0000 7f545cf9b700 1 --2- 172.21.15.32:0/4095844932 >> v2:172.21.15.32:3300/0 conn(0x7f545806d8a0 0x7f545815d7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-06-20T13:31:48.409 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:48.407+0000 7f545cf9b700 1 --2- 172.21.15.32:0/4095844932 >> v2:172.21.15.32:3300/0 conn(0x7f545806d8a0 0x7f545815d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:48.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:48.407+0000 7f545cf9b700 1 -- 172.21.15.32:0/4095844932 >> v2:172.21.15.32:3300/0 conn(0x7f545806d8a0 msgr2=0x7f545815d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-20T13:31:48.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:48.407+0000 7f545cf9b700 1 -- 172.21.15.32:0/4095844932 >> v2:172.21.15.32:3300/0 conn(0x7f545806d8a0 msgr2=0x7f545815d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-20T13:31:48.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:48.407+0000 7f545cf9b700 1 --2- 172.21.15.32:0/4095844932 >> v2:172.21.15.32:3300/0 conn(0x7f545806d8a0 0x7f545815d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-20T13:31:48.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:48.407+0000 7f545cf9b700 1 --2- 172.21.15.32:0/4095844932 >> v2:172.21.15.32:3300/0 conn(0x7f545806d8a0 0x7f545815d7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-06-20T13:31:50.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.003+0000 7f54567fc700 1 -- 172.21.15.32:0/4095844932 >> v2:172.21.15.32:3300/0 conn(0x7f545806d8a0 msgr2=0x7f545815d7c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-20T13:31:50.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.003+0000 7f54567fc700 1 --2- 172.21.15.32:0/4095844932 >> v2:172.21.15.32:3300/0 conn(0x7f545806d8a0 0x7f545815d7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:50.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.003+0000 7f54567fc700 1 -- 172.21.15.32:0/4095844932 >> v1:172.21.15.115:6789/0 conn(0x7f5458159760 legacy=0x7f545814fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:50.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.003+0000 7f54567fc700 1 -- 172.21.15.32:0/4095844932 >> v1:172.21.15.32:6789/0 conn(0x7f545806dc70 legacy=0x7f54580ae6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:50.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.003+0000 7f54567fc700 1 --2- 172.21.15.32:0/4095844932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f543c0037a0 0x7f543c005be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:50.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.003+0000 7f54567fc700 1 --2- 172.21.15.32:0/4095844932 >> v2:172.21.15.115:3300/0 conn(0x7f543c006270 0x7f543c008700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:50.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.003+0000 7f54567fc700 1 -- 172.21.15.32:0/4095844932 --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5458159c10 con 0x7f543c006270 2023-06-20T13:31:50.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.003+0000 7f54567fc700 1 -- 172.21.15.32:0/4095844932 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f543c008db0 con 0x7f543c0037a0 2023-06-20T13:31:50.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.003+0000 7f545cf9b700 1 --2- 172.21.15.32:0/4095844932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f543c0037a0 0x7f543c005be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:50.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.003+0000 7f5457fff700 1 --2- 172.21.15.32:0/4095844932 >> v2:172.21.15.115:3300/0 conn(0x7f543c006270 0x7f543c008700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:50.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.003+0000 7f545cf9b700 1 -- 172.21.15.32:0/4095844932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f543c0037a0 msgr2=0x7f543c005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-20T13:31:50.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.004+0000 7f545cf9b700 1 -- 172.21.15.32:0/4095844932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f543c0037a0 msgr2=0x7f543c005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-20T13:31:50.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.004+0000 7f545cf9b700 1 --2- 172.21.15.32:0/4095844932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f543c0037a0 0x7f543c005be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-20T13:31:50.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.004+0000 7f5457fff700 1 -- 172.21.15.32:0/4095844932 >> v2:172.21.15.115:3300/0 conn(0x7f543c006270 msgr2=0x7f543c008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-20T13:31:50.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.004+0000 7f5457fff700 1 -- 172.21.15.32:0/4095844932 >> v2:172.21.15.115:3300/0 conn(0x7f543c006270 msgr2=0x7f543c008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-20T13:31:50.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.004+0000 7f5457fff700 1 --2- 172.21.15.32:0/4095844932 >> v2:172.21.15.115:3300/0 conn(0x7f543c006270 0x7f543c008700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-20T13:31:50.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.004+0000 7f545cf9b700 1 --2- 172.21.15.32:0/4095844932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f543c0037a0 0x7f543c005be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-20T13:31:50.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.004+0000 7f5457fff700 1 --2- 172.21.15.32:0/4095844932 >> v2:172.21.15.115:3300/0 conn(0x7f543c006270 0x7f543c008700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-20T13:31:50.207 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.205+0000 7f5457fff700 1 --2- 172.21.15.32:0/4095844932 >> v2:172.21.15.115:3300/0 conn(0x7f543c006270 0x7f543c008700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:50.207 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.205+0000 7f5457fff700 1 -- 172.21.15.32:0/4095844932 >> v2:172.21.15.115:3300/0 conn(0x7f543c006270 msgr2=0x7f543c008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-20T13:31:50.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.205+0000 7f5457fff700 1 -- 172.21.15.32:0/4095844932 >> v2:172.21.15.115:3300/0 conn(0x7f543c006270 msgr2=0x7f543c008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-20T13:31:50.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.205+0000 7f5457fff700 1 --2- 172.21.15.32:0/4095844932 >> v2:172.21.15.115:3300/0 conn(0x7f543c006270 0x7f543c008700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-20T13:31:50.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.205+0000 7f5457fff700 1 --2- 172.21.15.32:0/4095844932 >> v2:172.21.15.115:3300/0 conn(0x7f543c006270 0x7f543c008700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-06-20T13:31:50.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.205+0000 7f545cf9b700 1 --2- 172.21.15.32:0/4095844932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f543c0037a0 0x7f543c005be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:50.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.205+0000 7f545cf9b700 1 -- 172.21.15.32:0/4095844932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f543c0037a0 msgr2=0x7f543c005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-20T13:31:50.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.205+0000 7f545cf9b700 1 -- 172.21.15.32:0/4095844932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f543c0037a0 msgr2=0x7f543c005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-20T13:31:50.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.205+0000 7f545cf9b700 1 --2- 172.21.15.32:0/4095844932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f543c0037a0 0x7f543c005be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-20T13:31:50.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.205+0000 7f545cf9b700 1 --2- 172.21.15.32:0/4095844932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f543c0037a0 0x7f543c005be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-06-20T13:31:50.608 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.606+0000 7f5457fff700 1 --2- 172.21.15.32:0/4095844932 >> v2:172.21.15.115:3300/0 conn(0x7f543c006270 0x7f543c008700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:50.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.606+0000 7f545cf9b700 1 --2- 172.21.15.32:0/4095844932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f543c0037a0 0x7f543c005be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:50.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.606+0000 7f5457fff700 1 -- 172.21.15.32:0/4095844932 >> v2:172.21.15.115:3300/0 conn(0x7f543c006270 msgr2=0x7f543c008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-20T13:31:50.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.606+0000 7f5457fff700 1 -- 172.21.15.32:0/4095844932 >> v2:172.21.15.115:3300/0 conn(0x7f543c006270 msgr2=0x7f543c008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-20T13:31:50.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.606+0000 7f5457fff700 1 --2- 172.21.15.32:0/4095844932 >> v2:172.21.15.115:3300/0 conn(0x7f543c006270 0x7f543c008700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-20T13:31:50.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.606+0000 7f5457fff700 1 --2- 172.21.15.32:0/4095844932 >> v2:172.21.15.115:3300/0 conn(0x7f543c006270 0x7f543c008700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-06-20T13:31:50.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.606+0000 7f545cf9b700 1 -- 172.21.15.32:0/4095844932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f543c0037a0 msgr2=0x7f543c005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-20T13:31:50.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.606+0000 7f545cf9b700 1 -- 172.21.15.32:0/4095844932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f543c0037a0 msgr2=0x7f543c005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-20T13:31:50.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.606+0000 7f545cf9b700 1 --2- 172.21.15.32:0/4095844932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f543c0037a0 0x7f543c005be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-20T13:31:50.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:50.606+0000 7f545cf9b700 1 --2- 172.21.15.32:0/4095844932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f543c0037a0 0x7f543c005be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-06-20T13:31:51.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:51.408+0000 7f545cf9b700 1 --2- 172.21.15.32:0/4095844932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f543c0037a0 0x7f543c005be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:51.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:51.408+0000 7f5457fff700 1 --2- 172.21.15.32:0/4095844932 >> v2:172.21.15.115:3300/0 conn(0x7f543c006270 0x7f543c008700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:51.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:51.408+0000 7f545cf9b700 1 -- 172.21.15.32:0/4095844932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f543c0037a0 msgr2=0x7f543c005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-20T13:31:51.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:51.408+0000 7f545cf9b700 1 -- 172.21.15.32:0/4095844932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f543c0037a0 msgr2=0x7f543c005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-20T13:31:51.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:51.408+0000 7f5457fff700 1 -- 172.21.15.32:0/4095844932 >> v2:172.21.15.115:3300/0 conn(0x7f543c006270 msgr2=0x7f543c008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-20T13:31:51.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:51.408+0000 7f5457fff700 1 -- 172.21.15.32:0/4095844932 >> v2:172.21.15.115:3300/0 conn(0x7f543c006270 msgr2=0x7f543c008700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-20T13:31:51.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:51.408+0000 7f545cf9b700 1 --2- 172.21.15.32:0/4095844932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f543c0037a0 0x7f543c005be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-20T13:31:51.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:51.408+0000 7f5457fff700 1 --2- 172.21.15.32:0/4095844932 >> v2:172.21.15.115:3300/0 conn(0x7f543c006270 0x7f543c008700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-20T13:31:51.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:51.408+0000 7f545cf9b700 1 --2- 172.21.15.32:0/4095844932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f543c0037a0 0x7f543c005be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-06-20T13:31:51.412 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:51.408+0000 7f5457fff700 1 --2- 172.21.15.32:0/4095844932 >> v2:172.21.15.115:3300/0 conn(0x7f543c006270 0x7f543c008700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-06-20T13:31:52.181 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-06-20T13:31:52.179+0000 7fef46bc5200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-20T13:31:52.410 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-06-20T13:31:52.408+0000 7fef46bc5200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-20T13:31:52.821 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-06-20T13:31:52.819+0000 7fef46bc5200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-20T13:31:53.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.003+0000 7f54567fc700 1 -- 172.21.15.32:0/4095844932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f543c0037a0 msgr2=0x7f543c005be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-20T13:31:53.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.003+0000 7f54567fc700 1 --2- 172.21.15.32:0/4095844932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f543c0037a0 0x7f543c005be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:53.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.003+0000 7f54567fc700 1 -- 172.21.15.32:0/4095844932 >> v2:172.21.15.115:3300/0 conn(0x7f543c006270 msgr2=0x7f543c008700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-20T13:31:53.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.003+0000 7f54567fc700 1 --2- 172.21.15.32:0/4095844932 >> v2:172.21.15.115:3300/0 conn(0x7f543c006270 0x7f543c008700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:53.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.003+0000 7f54567fc700 1 --2- 172.21.15.32:0/4095844932 >> v2:172.21.15.32:3300/0 conn(0x7f545806d8a0 0x7f543c00b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:53.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.003+0000 7f545d79c700 1 -- 172.21.15.32:0/4095844932 reap_dead start 2023-06-20T13:31:53.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.003+0000 7f54567fc700 1 -- 172.21.15.32:0/4095844932 --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5458159ef0 con 0x7f543c003bd0 2023-06-20T13:31:53.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.003+0000 7f54567fc700 1 -- 172.21.15.32:0/4095844932 --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f543c007ea0 con 0x7f5458159760 2023-06-20T13:31:53.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.003+0000 7f54567fc700 1 -- 172.21.15.32:0/4095844932 --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5458159c10 con 0x7f545806d8a0 2023-06-20T13:31:53.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.003+0000 7f545cf9b700 1 --2- 172.21.15.32:0/4095844932 >> v2:172.21.15.32:3300/0 conn(0x7f545806d8a0 0x7f543c00b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:53.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.004+0000 7f545cf9b700 1 -- 172.21.15.32:0/4095844932 >> v1:172.21.15.115:6789/0 conn(0x7f5458159760 legacy=0x7f543c00d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:53.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.004+0000 7f545cf9b700 1 -- 172.21.15.32:0/4095844932 >> v1:172.21.15.32:6789/0 conn(0x7f543c003bd0 legacy=0x7f543c0066d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:53.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.004+0000 7f545cf9b700 1 -- 172.21.15.32:0/4095844932 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543c008050 con 0x7f545806d8a0 2023-06-20T13:31:53.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.004+0000 7f545cf9b700 1 --2- 172.21.15.32:0/4095844932 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f545806d8a0 0x7f543c00b1c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f544c009100 tx=0x7f544c01be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc654d21cbc486dc server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:31:53.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.004+0000 7f54577fe700 1 -- 172.21.15.32:0/4095844932 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c020070 con 0x7f545806d8a0 2023-06-20T13:31:53.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.004+0000 7f54577fe700 1 -- 172.21.15.32:0/4095844932 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544c00c040 con 0x7f545806d8a0 2023-06-20T13:31:53.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.004+0000 7f54577fe700 1 -- 172.21.15.32:0/4095844932 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c01b310 con 0x7f545806d8a0 2023-06-20T13:31:53.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.005+0000 7f545f1ff700 1 -- 172.21.15.32:0/4095844932 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f545806d8a0 msgr2=0x7f543c00b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:53.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.005+0000 7f545f1ff700 1 --2- 172.21.15.32:0/4095844932 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f545806d8a0 0x7f543c00b1c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f544c009100 tx=0x7f544c01be90 comp rx=0 tx=0).stop 2023-06-20T13:31:53.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.005+0000 7f545f1ff700 1 -- 172.21.15.32:0/4095844932 shutdown_connections 2023-06-20T13:31:53.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.005+0000 7f545f1ff700 1 --2- 172.21.15.32:0/4095844932 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f545806d8a0 0x7f543c00b1c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:53.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.005+0000 7f545f1ff700 1 -- 172.21.15.32:0/4095844932 >> 172.21.15.32:0/4095844932 conn(0x7f5458069f30 msgr2=0x7f545806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:31:53.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.005+0000 7f545f1ff700 1 -- 172.21.15.32:0/4095844932 shutdown_connections 2023-06-20T13:31:53.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.005+0000 7f545f1ff700 1 -- 172.21.15.32:0/4095844932 wait complete. 2023-06-20T13:31:53.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.007+0000 7f545f1ff700 1 Processor -- start 2023-06-20T13:31:53.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.007+0000 7f545f1ff700 1 -- start start 2023-06-20T13:31:53.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.008+0000 7f545f1ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f543c003bd0 0x7f545814acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:53.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.008+0000 7f545f1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f545806d8a0 0x7f5458157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:53.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.008+0000 7f545f1ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5458159760 0x7f54580b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:53.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.008+0000 7f545f1ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54581f2070 con 0x7f543c003bd0 2023-06-20T13:31:53.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.008+0000 7f545f1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545814fba0 con 0x7f545806d8a0 2023-06-20T13:31:53.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.008+0000 7f545f1ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545814b200 con 0x7f5458159760 2023-06-20T13:31:53.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.009+0000 7f545cf9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f543c003bd0 0x7f545814acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:53.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.009+0000 7f545cf9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f543c003bd0 0x7f545814acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55318/0 (socket says 172.21.15.32:55318) 2023-06-20T13:31:53.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.009+0000 7f545cf9b700 1 -- 172.21.15.32:0/2789077753 learned_addr learned my addr 172.21.15.32:0/2789077753 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:31:53.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.009+0000 7f5457fff700 1 --2- 172.21.15.32:0/2789077753 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f545806d8a0 0x7f5458157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:53.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.009+0000 7f545d79c700 1 --2- 172.21.15.32:0/2789077753 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5458159760 0x7f54580b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:53.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.009+0000 7f545cf9b700 1 -- 172.21.15.32:0/2789077753 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5458159760 msgr2=0x7f54580b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:53.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.009+0000 7f545cf9b700 1 --2- 172.21.15.32:0/2789077753 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5458159760 0x7f54580b04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:53.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.009+0000 7f545cf9b700 1 -- 172.21.15.32:0/2789077753 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f545806d8a0 msgr2=0x7f5458157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:53.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.009+0000 7f545cf9b700 1 --2- 172.21.15.32:0/2789077753 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f545806d8a0 0x7f5458157530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:53.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.009+0000 7f545cf9b700 1 -- 172.21.15.32:0/2789077753 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f544c00e040 con 0x7f543c003bd0 2023-06-20T13:31:53.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.009+0000 7f545cf9b700 1 --2- 172.21.15.32:0/2789077753 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f543c003bd0 0x7f545814acc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f544c01bfd0 tx=0x7f544c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:31:53.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.010+0000 7f54557fa700 1 -- 172.21.15.32:0/2789077753 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c004020 con 0x7f543c003bd0 2023-06-20T13:31:53.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.010+0000 7f54557fa700 1 -- 172.21.15.32:0/2789077753 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544c004180 con 0x7f543c003bd0 2023-06-20T13:31:53.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.010+0000 7f545f1ff700 1 -- 172.21.15.32:0/2789077753 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f545814eb00 con 0x7f543c003bd0 2023-06-20T13:31:53.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.010+0000 7f54557fa700 1 -- 172.21.15.32:0/2789077753 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c004510 con 0x7f543c003bd0 2023-06-20T13:31:53.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.010+0000 7f545f1ff700 1 -- 172.21.15.32:0/2789077753 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f545814f0c0 con 0x7f543c003bd0 2023-06-20T13:31:53.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.010+0000 7f54557fa700 1 -- 172.21.15.32:0/2789077753 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f544c0036a0 con 0x7f543c003bd0 2023-06-20T13:31:53.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.010+0000 7f54557fa700 1 -- 172.21.15.32:0/2789077753 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f544c018cd0 con 0x7f543c003bd0 2023-06-20T13:31:53.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.011+0000 7f545f1ff700 1 -- 172.21.15.32:0/2789077753 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f545815a180 con 0x7f543c003bd0 2023-06-20T13:31:53.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.014+0000 7f54557fa700 1 -- 172.21.15.32:0/2789077753 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f544c00f040 con 0x7f543c003bd0 2023-06-20T13:31:53.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.093+0000 7f545f1ff700 1 -- 172.21.15.32:0/2789077753 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f545804ea60 con 0x7f543c003bd0 2023-06-20T13:31:53.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.096+0000 7f54557fa700 1 -- 172.21.15.32:0/2789077753 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f544c003a90 con 0x7f543c003bd0 2023-06-20T13:31:53.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.097+0000 7f545f1ff700 1 -- 172.21.15.32:0/2789077753 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f543c003bd0 msgr2=0x7f545814acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:53.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.097+0000 7f545f1ff700 1 --2- 172.21.15.32:0/2789077753 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f543c003bd0 0x7f545814acc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f544c01bfd0 tx=0x7f544c004750 comp rx=0 tx=0).stop 2023-06-20T13:31:53.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.097+0000 7f545f1ff700 1 -- 172.21.15.32:0/2789077753 shutdown_connections 2023-06-20T13:31:53.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.097+0000 7f545f1ff700 1 --2- 172.21.15.32:0/2789077753 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5458159760 0x7f54580b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:53.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.097+0000 7f545f1ff700 1 --2- 172.21.15.32:0/2789077753 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f543c003bd0 0x7f545814acc0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:53.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.097+0000 7f545f1ff700 1 --2- 172.21.15.32:0/2789077753 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f545806d8a0 0x7f5458157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:53.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.097+0000 7f545f1ff700 1 -- 172.21.15.32:0/2789077753 >> 172.21.15.32:0/2789077753 conn(0x7f5458069f30 msgr2=0x7f5458070d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:31:53.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.097+0000 7f545f1ff700 1 -- 172.21.15.32:0/2789077753 shutdown_connections 2023-06-20T13:31:53.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:53.097+0000 7f545f1ff700 1 -- 172.21.15.32:0/2789077753 wait complete. 2023-06-20T13:31:53.105 INFO:teuthology.orchestra.run.smithi032.stderr:adjusted tunables profile to default 2023-06-20T13:31:53.117 INFO:tasks.ceph:check_enable_crimson: False 2023-06-20T13:31:53.117 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-06-20T13:31:53.118 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:31:53.118 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-06-20T13:31:53.122 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-06-20T13:31:53.121+0000 7f36df876200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-20T13:31:53.195 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:31:53.196 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-06-20T13:31:53.265 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:31:53.265 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-06-20T13:31:53.330 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-06-20T13:31:53.328+0000 7f36df876200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-20T13:31:53.376 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:31:53.376 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-06-20T13:31:53.485 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-06-20T13:31:53.482+0000 7fef46bc5200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-06-20T13:31:53.493 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:31:53.493 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-06-20T13:31:53.562 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:31:53.563 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-06-20T13:31:53.670 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:31:53.670 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-06-20T13:31:53.722 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-06-20T13:31:53.721+0000 7f36df876200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-20T13:31:53.726 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-06-20T13:31:53.724+0000 7fef46bc5200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-06-20T13:31:53.779 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:31:53.779 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-06-20T13:31:53.887 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 06beff51-eef0-4858-98db-b93e76a3024e 0 2023-06-20T13:31:54.119 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.117+0000 7f62f99ff700 1 Processor -- start 2023-06-20T13:31:54.120 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.118+0000 7f62f99ff700 1 -- start start 2023-06-20T13:31:54.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.119+0000 7f62f99ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62f40b4d20 0x7f62f40cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:54.123 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.119+0000 7f62f99ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f62f40d25c0 0x7f62f40d0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:54.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.119+0000 7f62f99ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f4160a00 con 0x7f62f40b8260 2023-06-20T13:31:54.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.119+0000 7f62f99ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f4160ce0 con 0x7f62f40d25c0 2023-06-20T13:31:54.124 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.119+0000 7f62f99ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f40cd280 con 0x7f62f40b4d20 2023-06-20T13:31:54.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.119+0000 7f62ebfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62f40b4d20 0x7f62f40cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:54.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.119+0000 7f62f2ffd700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f62f40b8260 0x7f62f40b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54412/0 (socket says 172.21.15.115:54412) 2023-06-20T13:31:54.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.119+0000 7f62f2ffd700 1 -- 172.21.15.115:0/3937805884 learned_addr learned my addr 172.21.15.115:0/3937805884 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-06-20T13:31:54.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.119+0000 7f62f37fe700 1 --2- 172.21.15.115:0/3937805884 >> v2:172.21.15.115:3300/0 conn(0x7f62f40d25c0 0x7f62f40d0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:54.125 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.120+0000 7f62ebfff700 1 -- 172.21.15.115:0/3937805884 >> v2:172.21.15.115:3300/0 conn(0x7f62f40d25c0 msgr2=0x7f62f40d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:31:54.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.120+0000 7f62ebfff700 1 --2- 172.21.15.115:0/3937805884 >> v2:172.21.15.115:3300/0 conn(0x7f62f40d25c0 0x7f62f40d0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:54.126 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.120+0000 7f62ebfff700 1 -- 172.21.15.115:0/3937805884 >> v1:172.21.15.115:6789/0 conn(0x7f62f40b8260 legacy=0x7f62f40b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:54.130 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.120+0000 7f62ebfff700 1 -- 172.21.15.115:0/3937805884 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f40cd560 con 0x7f62f40b4d20 2023-06-20T13:31:54.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.120+0000 7f62f37fe700 1 --2- 172.21.15.115:0/3937805884 >> v2:172.21.15.115:3300/0 conn(0x7f62f40d25c0 0x7f62f40d0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:31:54.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.120+0000 7f62ebfff700 1 --2- 172.21.15.115:0/3937805884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62f40b4d20 0x7f62f40cede0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009840 tx=0x7f62dc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8589d2b8a0ada75a server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:31:54.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.120+0000 7f62f27fc700 1 -- 172.21.15.115:0/3937805884 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc011830 con 0x7f62f40b4d20 2023-06-20T13:31:54.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.120+0000 7f62f27fc700 1 -- 172.21.15.115:0/3937805884 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62dc011990 con 0x7f62f40b4d20 2023-06-20T13:31:54.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.120+0000 7f62f27fc700 1 -- 172.21.15.115:0/3937805884 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc011d20 con 0x7f62f40b4d20 2023-06-20T13:31:54.131 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.121+0000 7f62f99ff700 1 -- 172.21.15.115:0/3937805884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62f40b4d20 msgr2=0x7f62f40cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:54.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.121+0000 7f62f99ff700 1 --2- 172.21.15.115:0/3937805884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62f40b4d20 0x7f62f40cede0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009840 tx=0x7f62dc009b50 comp rx=0 tx=0).stop 2023-06-20T13:31:54.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.121+0000 7f62f99ff700 1 -- 172.21.15.115:0/3937805884 shutdown_connections 2023-06-20T13:31:54.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.121+0000 7f62f99ff700 1 --2- 172.21.15.115:0/3937805884 >> v2:172.21.15.115:3300/0 conn(0x7f62f40d25c0 0x7f62f40d0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:54.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.121+0000 7f62f99ff700 1 --2- 172.21.15.115:0/3937805884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62f40b4d20 0x7f62f40cede0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:54.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.121+0000 7f62f99ff700 1 -- 172.21.15.115:0/3937805884 >> 172.21.15.115:0/3937805884 conn(0x7f62f40722b0 msgr2=0x7f62f40cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:31:54.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.121+0000 7f62f99ff700 1 -- 172.21.15.115:0/3937805884 shutdown_connections 2023-06-20T13:31:54.132 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.121+0000 7f62f99ff700 1 -- 172.21.15.115:0/3937805884 wait complete. 2023-06-20T13:31:54.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.123+0000 7f62f99ff700 1 Processor -- start 2023-06-20T13:31:54.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.123+0000 7f62f99ff700 1 -- start start 2023-06-20T13:31:54.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.124+0000 7f62f99ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62f40b8260 0x7f62f4158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:54.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.124+0000 7f62f99ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62f40d25c0 0x7f62f41e6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:54.135 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.124+0000 7f62f99ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62f41e6a80 0x7f62f415ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:54.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.124+0000 7f62f99ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f415e570 con 0x7f62f40b8260 2023-06-20T13:31:54.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.124+0000 7f62f99ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f41e6f90 con 0x7f62f41e6a80 2023-06-20T13:31:54.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.124+0000 7f62f99ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f41e7270 con 0x7f62f40d25c0 2023-06-20T13:31:54.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.124+0000 7f62ebfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62f40d25c0 0x7f62f41e6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:54.136 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.124+0000 7f62ebfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62f40d25c0 0x7f62f41e6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:42448/0 (socket says 172.21.15.115:42448) 2023-06-20T13:31:54.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.124+0000 7f62ebfff700 1 -- 172.21.15.115:0/1500868486 learned_addr learned my addr 172.21.15.115:0/1500868486 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-06-20T13:31:54.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.124+0000 7f62f37fe700 1 --2- 172.21.15.115:0/1500868486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62f41e6a80 0x7f62f415ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:54.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.124+0000 7f62f2ffd700 1 --2- 172.21.15.115:0/1500868486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62f40b8260 0x7f62f4158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:54.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.124+0000 7f62ebfff700 1 -- 172.21.15.115:0/1500868486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62f41e6a80 msgr2=0x7f62f415ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:54.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.124+0000 7f62ebfff700 1 --2- 172.21.15.115:0/1500868486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62f41e6a80 0x7f62f415ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:54.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.124+0000 7f62ebfff700 1 -- 172.21.15.115:0/1500868486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62f40b8260 msgr2=0x7f62f4158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:54.137 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.124+0000 7f62ebfff700 1 --2- 172.21.15.115:0/1500868486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62f40b8260 0x7f62f4158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:54.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.124+0000 7f62ebfff700 1 -- 172.21.15.115:0/1500868486 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ec009a70 con 0x7f62f40d25c0 2023-06-20T13:31:54.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.124+0000 7f62f2ffd700 1 --2- 172.21.15.115:0/1500868486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62f40b8260 0x7f62f4158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:31:54.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.125+0000 7f62ebfff700 1 --2- 172.21.15.115:0/1500868486 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62f40d25c0 0x7f62f41e6540 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0090b0 tx=0x7f62dc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:31:54.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.125+0000 7f62f0ff9700 1 -- 172.21.15.115:0/1500868486 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc0036a0 con 0x7f62f40d25c0 2023-06-20T13:31:54.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.125+0000 7f62f0ff9700 1 -- 172.21.15.115:0/1500868486 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62dc01f070 con 0x7f62f40d25c0 2023-06-20T13:31:54.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.125+0000 7f62f0ff9700 1 -- 172.21.15.115:0/1500868486 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc003a60 con 0x7f62f40d25c0 2023-06-20T13:31:54.138 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.125+0000 7f62f99ff700 1 -- 172.21.15.115:0/1500868486 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62dc0094a0 con 0x7f62f40d25c0 2023-06-20T13:31:54.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.125+0000 7f62f99ff700 1 -- 172.21.15.115:0/1500868486 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f415e200 con 0x7f62f40d25c0 2023-06-20T13:31:54.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.126+0000 7f62f0ff9700 1 -- 172.21.15.115:0/1500868486 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f62dc026480 con 0x7f62f40d25c0 2023-06-20T13:31:54.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.126+0000 7f62f0ff9700 1 -- 172.21.15.115:0/1500868486 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f62dc021070 con 0x7f62f40d25c0 2023-06-20T13:31:54.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.126+0000 7f62f99ff700 1 -- 172.21.15.115:0/1500868486 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f415e060 con 0x7f62f40d25c0 2023-06-20T13:31:54.139 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.129+0000 7f62f0ff9700 1 -- 172.21.15.115:0/1500868486 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f62f415e060 con 0x7f62f40d25c0 2023-06-20T13:31:54.181 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-06-20T13:31:54.179+0000 7fef46bc5200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-20T13:31:54.216 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.215+0000 7f62f99ff700 1 -- 172.21.15.115:0/1500868486 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "06beff51-eef0-4858-98db-b93e76a3024e", "id": 0} v 0) v1 -- 0x7f62f415e390 con 0x7f62f40d25c0 2023-06-20T13:31:54.220 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.219+0000 7f62f0ff9700 1 -- 172.21.15.115:0/1500868486 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "06beff51-eef0-4858-98db-b93e76a3024e", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f62dc02b020 con 0x7f62f40d25c0 2023-06-20T13:31:54.221 INFO:teuthology.orchestra.run.smithi115.stdout:0 2023-06-20T13:31:54.222 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.220+0000 7f62f99ff700 1 -- 172.21.15.115:0/1500868486 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62f40d25c0 msgr2=0x7f62f41e6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:54.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.220+0000 7f62f99ff700 1 --2- 172.21.15.115:0/1500868486 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62f40d25c0 0x7f62f41e6540 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0090b0 tx=0x7f62dc004750 comp rx=0 tx=0).stop 2023-06-20T13:31:54.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.220+0000 7f62f99ff700 1 -- 172.21.15.115:0/1500868486 shutdown_connections 2023-06-20T13:31:54.223 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.220+0000 7f62f99ff700 1 --2- 172.21.15.115:0/1500868486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f62f41e6a80 0x7f62f415ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:54.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.220+0000 7f62f99ff700 1 --2- 172.21.15.115:0/1500868486 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f62f40b8260 0x7f62f4158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:54.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.220+0000 7f62f99ff700 1 --2- 172.21.15.115:0/1500868486 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f62f40d25c0 0x7f62f41e6540 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:54.224 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.220+0000 7f62f99ff700 1 -- 172.21.15.115:0/1500868486 >> 172.21.15.115:0/1500868486 conn(0x7f62f40b4d20 msgr2=0x7f62f406b360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:31:54.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.220+0000 7f62f99ff700 1 -- 172.21.15.115:0/1500868486 shutdown_connections 2023-06-20T13:31:54.225 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.220+0000 7f62f99ff700 1 -- 172.21.15.115:0/1500868486 wait complete. 2023-06-20T13:31:54.239 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 1d692926-34ad-4a3c-840d-78a47f84b527 1 2023-06-20T13:31:54.372 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-06-20T13:31:54.371+0000 7f36df876200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-06-20T13:31:54.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.425+0000 7fa3957ff700 1 Processor -- start 2023-06-20T13:31:54.427 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.426+0000 7fa3957ff700 1 -- start start 2023-06-20T13:31:54.429 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.427+0000 7fa3957ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3900b4d20 0x7fa3900cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:54.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.428+0000 7fa3957ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa3900d25c0 0x7fa3900d0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:54.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.428+0000 7fa3957ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa390160a00 con 0x7fa3900b8260 2023-06-20T13:31:54.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.428+0000 7fa3957ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa390160ce0 con 0x7fa3900d25c0 2023-06-20T13:31:54.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.428+0000 7fa3957ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3900cd280 con 0x7fa3900b4d20 2023-06-20T13:31:54.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.428+0000 7fa387fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3900b4d20 0x7fa3900cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:54.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.428+0000 7fa38f7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa3900d25c0 0x7fa3900d0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:54.430 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.428+0000 7fa387fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3900b4d20 0x7fa3900cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:42452/0 (socket says 172.21.15.115:42452) 2023-06-20T13:31:54.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.428+0000 7fa387fff700 1 -- 172.21.15.115:0/821312971 learned_addr learned my addr 172.21.15.115:0/821312971 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-06-20T13:31:54.431 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.428+0000 7fa38effd700 1 --1- 172.21.15.115:0/821312971 >> v1:172.21.15.115:6789/0 conn(0x7fa3900b8260 0x7fa3900b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54418/0 (socket says 172.21.15.115:54418) 2023-06-20T13:31:54.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.428+0000 7fa38f7fe700 1 -- 172.21.15.115:0/821312971 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3900b4d20 msgr2=0x7fa3900cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:31:54.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.428+0000 7fa38f7fe700 1 --2- 172.21.15.115:0/821312971 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3900b4d20 0x7fa3900cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:54.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.428+0000 7fa38f7fe700 1 -- 172.21.15.115:0/821312971 >> v1:172.21.15.115:6789/0 conn(0x7fa3900b8260 legacy=0x7fa3900b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:54.432 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.428+0000 7fa38f7fe700 1 -- 172.21.15.115:0/821312971 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3900cd560 con 0x7fa3900d25c0 2023-06-20T13:31:54.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.428+0000 7fa387fff700 1 --2- 172.21.15.115:0/821312971 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3900b4d20 0x7fa3900cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:31:54.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.429+0000 7fa38f7fe700 1 --2- 172.21.15.115:0/821312971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3900d25c0 0x7fa3900d0a00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa388009d90 tx=0x7fa38800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14be16e0c4a816f8 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:31:54.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.429+0000 7fa38e7fc700 1 -- 172.21.15.115:0/821312971 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38800e070 con 0x7fa3900d25c0 2023-06-20T13:31:54.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.429+0000 7fa38e7fc700 1 -- 172.21.15.115:0/821312971 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38800bb20 con 0x7fa3900d25c0 2023-06-20T13:31:54.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.429+0000 7fa38e7fc700 1 -- 172.21.15.115:0/821312971 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa388012430 con 0x7fa3900d25c0 2023-06-20T13:31:54.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.430+0000 7fa3957ff700 1 -- 172.21.15.115:0/821312971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3900d25c0 msgr2=0x7fa3900d0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:54.433 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.430+0000 7fa3957ff700 1 --2- 172.21.15.115:0/821312971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3900d25c0 0x7fa3900d0a00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa388009d90 tx=0x7fa38800b330 comp rx=0 tx=0).stop 2023-06-20T13:31:54.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.430+0000 7fa3957ff700 1 -- 172.21.15.115:0/821312971 shutdown_connections 2023-06-20T13:31:54.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.430+0000 7fa3957ff700 1 --2- 172.21.15.115:0/821312971 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3900d25c0 0x7fa3900d0a00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:54.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.430+0000 7fa3957ff700 1 --2- 172.21.15.115:0/821312971 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3900b4d20 0x7fa3900cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:54.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.430+0000 7fa3957ff700 1 -- 172.21.15.115:0/821312971 >> 172.21.15.115:0/821312971 conn(0x7fa3900722b0 msgr2=0x7fa3900cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:31:54.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.430+0000 7fa3957ff700 1 -- 172.21.15.115:0/821312971 shutdown_connections 2023-06-20T13:31:54.434 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.430+0000 7fa3957ff700 1 -- 172.21.15.115:0/821312971 wait complete. 2023-06-20T13:31:54.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.433+0000 7fa3957ff700 1 Processor -- start 2023-06-20T13:31:54.435 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.433+0000 7fa3957ff700 1 -- start start 2023-06-20T13:31:54.436 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.434+0000 7fa3957ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3900b8260 0x7fa39015b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:54.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.434+0000 7fa3957ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3900d25c0 0x7fa390148010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:54.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.434+0000 7fa3957ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa39014a7f0 0x7fa3900b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:54.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.434+0000 7fa3957ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa390148550 con 0x7fa39014a7f0 2023-06-20T13:31:54.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.435+0000 7fa3957ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa390148ad0 con 0x7fa3900b8260 2023-06-20T13:31:54.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.435+0000 7fa3957ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3901487a0 con 0x7fa3900d25c0 2023-06-20T13:31:54.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.435+0000 7fa38effd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3900b8260 0x7fa39015b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:54.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.435+0000 7fa387fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3900d25c0 0x7fa390148010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:54.437 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.435+0000 7fa387fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3900d25c0 0x7fa390148010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:42462/0 (socket says 172.21.15.115:42462) 2023-06-20T13:31:54.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.435+0000 7fa387fff700 1 -- 172.21.15.115:0/1067171535 learned_addr learned my addr 172.21.15.115:0/1067171535 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-06-20T13:31:54.438 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.435+0000 7fa38f7fe700 1 --2- 172.21.15.115:0/1067171535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa39014a7f0 0x7fa3900b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:54.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.435+0000 7fa38effd700 1 -- 172.21.15.115:0/1067171535 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3900d25c0 msgr2=0x7fa390148010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:54.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.435+0000 7fa38effd700 1 --2- 172.21.15.115:0/1067171535 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3900d25c0 0x7fa390148010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:54.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.435+0000 7fa38effd700 1 -- 172.21.15.115:0/1067171535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa39014a7f0 msgr2=0x7fa3900b65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:54.439 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.435+0000 7fa38effd700 1 --2- 172.21.15.115:0/1067171535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa39014a7f0 0x7fa3900b65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:54.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.435+0000 7fa38effd700 1 -- 172.21.15.115:0/1067171535 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa378009550 con 0x7fa3900b8260 2023-06-20T13:31:54.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.435+0000 7fa387fff700 1 --2- 172.21.15.115:0/1067171535 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3900d25c0 0x7fa390148010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:31:54.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.435+0000 7fa38effd700 1 --2- 172.21.15.115:0/1067171535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3900b8260 0x7fa39015b8a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa38000c480 tx=0x7fa38000c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:31:54.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.436+0000 7fa3877fe700 1 -- 172.21.15.115:0/1067171535 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa380005cb0 con 0x7fa3900b8260 2023-06-20T13:31:54.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.436+0000 7fa3877fe700 1 -- 172.21.15.115:0/1067171535 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa380005e10 con 0x7fa3900b8260 2023-06-20T13:31:54.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.436+0000 7fa3957ff700 1 -- 172.21.15.115:0/1067171535 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa388009a70 con 0x7fa3900b8260 2023-06-20T13:31:54.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.436+0000 7fa3877fe700 1 -- 172.21.15.115:0/1067171535 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3800072d0 con 0x7fa3900b8260 2023-06-20T13:31:54.440 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.436+0000 7fa3957ff700 1 -- 172.21.15.115:0/1067171535 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa39014b360 con 0x7fa3900b8260 2023-06-20T13:31:54.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.436+0000 7fa3877fe700 1 -- 172.21.15.115:0/1067171535 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa38001c440 con 0x7fa3900b8260 2023-06-20T13:31:54.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.436+0000 7fa3877fe700 1 -- 172.21.15.115:0/1067171535 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fa3800127b0 con 0x7fa3900b8260 2023-06-20T13:31:54.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.437+0000 7fa3957ff700 1 -- 172.21.15.115:0/1067171535 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa39004ea60 con 0x7fa3900b8260 2023-06-20T13:31:54.441 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.440+0000 7fa3877fe700 1 -- 172.21.15.115:0/1067171535 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fa380021060 con 0x7fa3900b8260 2023-06-20T13:31:54.528 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.526+0000 7fa3957ff700 1 -- 172.21.15.115:0/1067171535 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1d692926-34ad-4a3c-840d-78a47f84b527", "id": 1} v 0) v1 -- 0x7fa390160140 con 0x7fa3900b8260 2023-06-20T13:31:54.532 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.531+0000 7fa3877fe700 1 -- 172.21.15.115:0/1067171535 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1d692926-34ad-4a3c-840d-78a47f84b527", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa380017070 con 0x7fa3900b8260 2023-06-20T13:31:54.533 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-06-20T13:31:54.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.532+0000 7fa3957ff700 1 -- 172.21.15.115:0/1067171535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3900b8260 msgr2=0x7fa39015b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:54.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.532+0000 7fa3957ff700 1 --2- 172.21.15.115:0/1067171535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3900b8260 0x7fa39015b8a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa38000c480 tx=0x7fa38000c790 comp rx=0 tx=0).stop 2023-06-20T13:31:54.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.532+0000 7fa3957ff700 1 -- 172.21.15.115:0/1067171535 shutdown_connections 2023-06-20T13:31:54.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.532+0000 7fa3957ff700 1 --2- 172.21.15.115:0/1067171535 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa39014a7f0 0x7fa3900b65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:54.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.532+0000 7fa3957ff700 1 --2- 172.21.15.115:0/1067171535 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3900b8260 0x7fa39015b8a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:54.534 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.532+0000 7fa3957ff700 1 --2- 172.21.15.115:0/1067171535 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3900d25c0 0x7fa390148010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:54.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.532+0000 7fa3957ff700 1 -- 172.21.15.115:0/1067171535 >> 172.21.15.115:0/1067171535 conn(0x7fa3900b4d20 msgr2=0x7fa3900b75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:31:54.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.532+0000 7fa3957ff700 1 -- 172.21.15.115:0/1067171535 shutdown_connections 2023-06-20T13:31:54.535 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.532+0000 7fa3957ff700 1 -- 172.21.15.115:0/1067171535 wait complete. 2023-06-20T13:31:54.550 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 14963a08-538e-4893-a4b5-b52d385489e3 2 2023-06-20T13:31:54.620 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-06-20T13:31:54.618+0000 7f36df876200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-06-20T13:31:54.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.739+0000 7f2b8b3ff700 1 Processor -- start 2023-06-20T13:31:54.741 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.739+0000 7f2b8b3ff700 1 -- start start 2023-06-20T13:31:54.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.741+0000 7f2b8b3ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2b841513a0 0x7f2b8406c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:54.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.741+0000 7f2b8b3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2b840b0720 0x7f2b840b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:54.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.741+0000 7f2b8b3ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8415ae50 con 0x7f2b8415a8d0 2023-06-20T13:31:54.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.741+0000 7f2b8b3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b840b10e0 con 0x7f2b840b0720 2023-06-20T13:31:54.743 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.741+0000 7f2b8b3ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8415b130 con 0x7f2b841513a0 2023-06-20T13:31:54.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.741+0000 7f2b8999c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2b840b0720 0x7f2b840b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:54.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.741+0000 7f2b8919b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2b841513a0 0x7f2b8406c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:54.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.741+0000 7f2b8999c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2b840b0720 0x7f2b840b0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51184/0 (socket says 172.21.15.115:51184) 2023-06-20T13:31:54.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.741+0000 7f2b8899a700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f2b8415a8d0 0x7f2b8415e8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.115:60316/0 (socket says 172.21.15.115:60316) 2023-06-20T13:31:54.744 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.741+0000 7f2b8999c700 1 -- 172.21.15.115:0/3689763952 learned_addr learned my addr 172.21.15.115:0/3689763952 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-06-20T13:31:54.745 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.741+0000 7f2b8919b700 1 -- 172.21.15.115:0/3689763952 >> v2:172.21.15.115:3300/0 conn(0x7f2b840b0720 msgr2=0x7f2b840b0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:31:54.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.741+0000 7f2b8919b700 1 --2- 172.21.15.115:0/3689763952 >> v2:172.21.15.115:3300/0 conn(0x7f2b840b0720 0x7f2b840b0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:54.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.741+0000 7f2b8919b700 1 -- 172.21.15.115:0/3689763952 >> v1:172.21.15.32:6789/0 conn(0x7f2b8415a8d0 legacy=0x7f2b8415e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:54.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.741+0000 7f2b7bfff700 1 -- 172.21.15.115:0/3689763952 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416040620 0 0) 0x7f2b8415ae50 con 0x7f2b8415a8d0 2023-06-20T13:31:54.746 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.741+0000 7f2b8919b700 1 -- 172.21.15.115:0/3689763952 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8415b410 con 0x7f2b841513a0 2023-06-20T13:31:54.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.742+0000 7f2b8919b700 1 --2- 172.21.15.115:0/3689763952 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2b841513a0 0x7f2b8406c9f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009840 tx=0x7f2b80009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf7022ac582bb0a2 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:31:54.747 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.742+0000 7f2b7bfff700 1 -- 172.21.15.115:0/3689763952 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b80011830 con 0x7f2b841513a0 2023-06-20T13:31:54.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.742+0000 7f2b7bfff700 1 -- 172.21.15.115:0/3689763952 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b80011990 con 0x7f2b841513a0 2023-06-20T13:31:54.748 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.742+0000 7f2b7bfff700 1 -- 172.21.15.115:0/3689763952 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b80011d20 con 0x7f2b841513a0 2023-06-20T13:31:54.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.742+0000 7f2b8b3ff700 1 -- 172.21.15.115:0/3689763952 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2b841513a0 msgr2=0x7f2b8406c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:54.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.742+0000 7f2b8b3ff700 1 --2- 172.21.15.115:0/3689763952 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2b841513a0 0x7f2b8406c9f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009840 tx=0x7f2b80009b50 comp rx=0 tx=0).stop 2023-06-20T13:31:54.749 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.743+0000 7f2b8b3ff700 1 -- 172.21.15.115:0/3689763952 shutdown_connections 2023-06-20T13:31:54.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.743+0000 7f2b8b3ff700 1 --2- 172.21.15.115:0/3689763952 >> v2:172.21.15.115:3300/0 conn(0x7f2b840b0720 0x7f2b840b0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:54.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.743+0000 7f2b8b3ff700 1 --2- 172.21.15.115:0/3689763952 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2b841513a0 0x7f2b8406c9f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:54.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.743+0000 7f2b8b3ff700 1 -- 172.21.15.115:0/3689763952 >> 172.21.15.115:0/3689763952 conn(0x7f2b84069f30 msgr2=0x7f2b8406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:31:54.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.743+0000 7f2b8b3ff700 1 -- 172.21.15.115:0/3689763952 shutdown_connections 2023-06-20T13:31:54.750 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.743+0000 7f2b8b3ff700 1 -- 172.21.15.115:0/3689763952 wait complete. 2023-06-20T13:31:54.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.744+0000 7f2b8b3ff700 1 Processor -- start 2023-06-20T13:31:54.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.744+0000 7f2b8b3ff700 1 -- start start 2023-06-20T13:31:54.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.745+0000 7f2b8b3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b840b0720 0x7f2b8414c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:54.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.745+0000 7f2b8b3ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b841513a0 0x7f2b8414ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:54.752 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.745+0000 7f2b8b3ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2b8415a8d0 0x7f2b8414f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:54.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.745+0000 7f2b8b3ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8414d360 con 0x7f2b841513a0 2023-06-20T13:31:54.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.745+0000 7f2b8b3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8414d640 con 0x7f2b840b0720 2023-06-20T13:31:54.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.745+0000 7f2b8b3ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8414d920 con 0x7f2b8415a8d0 2023-06-20T13:31:54.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.746+0000 7f2b8919b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b840b0720 0x7f2b8414c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:54.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.746+0000 7f2b8899a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b841513a0 0x7f2b8414ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:54.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.746+0000 7f2b8919b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b840b0720 0x7f2b8414c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51190/0 (socket says 172.21.15.115:51190) 2023-06-20T13:31:54.753 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.746+0000 7f2b8919b700 1 -- 172.21.15.115:0/3714580943 learned_addr learned my addr 172.21.15.115:0/3714580943 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-06-20T13:31:54.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.746+0000 7f2b8999c700 1 --2- 172.21.15.115:0/3714580943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2b8415a8d0 0x7f2b8414f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:54.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.746+0000 7f2b8919b700 1 -- 172.21.15.115:0/3714580943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2b8415a8d0 msgr2=0x7f2b8414f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:54.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.746+0000 7f2b8919b700 1 --2- 172.21.15.115:0/3714580943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2b8415a8d0 0x7f2b8414f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:54.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.746+0000 7f2b8919b700 1 -- 172.21.15.115:0/3714580943 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b841513a0 msgr2=0x7f2b8414ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:54.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.746+0000 7f2b8919b700 1 --2- 172.21.15.115:0/3714580943 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b841513a0 0x7f2b8414ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:54.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.746+0000 7f2b8919b700 1 -- 172.21.15.115:0/3714580943 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b800094a0 con 0x7f2b840b0720 2023-06-20T13:31:54.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.746+0000 7f2b8919b700 1 --2- 172.21.15.115:0/3714580943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b840b0720 0x7f2b8414c6e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009fd0 tx=0x7f2b80004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:31:54.754 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.747+0000 7f2b79ffb700 1 -- 172.21.15.115:0/3714580943 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b800036a0 con 0x7f2b840b0720 2023-06-20T13:31:54.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.747+0000 7f2b79ffb700 1 -- 172.21.15.115:0/3714580943 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8001f070 con 0x7f2b840b0720 2023-06-20T13:31:54.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.747+0000 7f2b79ffb700 1 -- 172.21.15.115:0/3714580943 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b80003a60 con 0x7f2b840b0720 2023-06-20T13:31:54.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.747+0000 7f2b8b3ff700 1 -- 172.21.15.115:0/3714580943 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8414dc00 con 0x7f2b840b0720 2023-06-20T13:31:54.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.747+0000 7f2b8b3ff700 1 -- 172.21.15.115:0/3714580943 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8414d030 con 0x7f2b840b0720 2023-06-20T13:31:54.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.747+0000 7f2b79ffb700 1 -- 172.21.15.115:0/3714580943 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2b80026480 con 0x7f2b840b0720 2023-06-20T13:31:54.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.747+0000 7f2b79ffb700 1 -- 172.21.15.115:0/3714580943 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f2b80021070 con 0x7f2b840b0720 2023-06-20T13:31:54.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.748+0000 7f2b8b3ff700 1 -- 172.21.15.115:0/3714580943 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b8406aec0 con 0x7f2b840b0720 2023-06-20T13:31:54.755 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.750+0000 7f2b79ffb700 1 -- 172.21.15.115:0/3714580943 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f2b80045b00 con 0x7f2b840b0720 2023-06-20T13:31:54.839 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.835+0000 7f2b8b3ff700 1 -- 172.21.15.115:0/3714580943 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd new", "uuid": "14963a08-538e-4893-a4b5-b52d385489e3", "id": 2} v 0) v1 -- 0x7f2b8404ea60 con 0x7f2b840b0720 2023-06-20T13:31:54.841 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.839+0000 7f2b79ffb700 1 -- 172.21.15.115:0/3714580943 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "14963a08-538e-4893-a4b5-b52d385489e3", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2b80034030 con 0x7f2b840b0720 2023-06-20T13:31:54.842 INFO:teuthology.orchestra.run.smithi115.stdout:2 2023-06-20T13:31:54.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.840+0000 7f2b8b3ff700 1 -- 172.21.15.115:0/3714580943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b840b0720 msgr2=0x7f2b8414c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:54.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.840+0000 7f2b8b3ff700 1 --2- 172.21.15.115:0/3714580943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b840b0720 0x7f2b8414c6e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009fd0 tx=0x7f2b80004750 comp rx=0 tx=0).stop 2023-06-20T13:31:54.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.840+0000 7f2b8b3ff700 1 -- 172.21.15.115:0/3714580943 shutdown_connections 2023-06-20T13:31:54.843 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.840+0000 7f2b8b3ff700 1 --2- 172.21.15.115:0/3714580943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2b8415a8d0 0x7f2b8414f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:54.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.840+0000 7f2b8b3ff700 1 --2- 172.21.15.115:0/3714580943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b840b0720 0x7f2b8414c6e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:54.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.840+0000 7f2b8b3ff700 1 --2- 172.21.15.115:0/3714580943 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2b841513a0 0x7f2b8414ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:54.846 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.840+0000 7f2b8b3ff700 1 -- 172.21.15.115:0/3714580943 >> 172.21.15.115:0/3714580943 conn(0x7f2b84069f30 msgr2=0x7f2b8415dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:31:54.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.840+0000 7f2b8b3ff700 1 -- 172.21.15.115:0/3714580943 shutdown_connections 2023-06-20T13:31:54.847 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:54.841+0000 7f2b8b3ff700 1 -- 172.21.15.115:0/3714580943 wait complete. 2023-06-20T13:31:54.860 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 2aa828fc-ed09-4aa4-bcb7-36007ab5d730 3 2023-06-20T13:31:55.010 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-06-20T13:31:55.008+0000 7fef46bc5200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-20T13:31:55.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.053+0000 7f08fbbff700 1 Processor -- start 2023-06-20T13:31:55.055 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.053+0000 7f08fbbff700 1 -- start start 2023-06-20T13:31:55.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.054+0000 7f08fbbff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f40b8260 0x7f08f40cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:55.057 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.054+0000 7f08fbbff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f4160a00 con 0x7f08f40b4d20 2023-06-20T13:31:55.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.054+0000 7f08fbbff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f4160ce0 con 0x7f08f40d25c0 2023-06-20T13:31:55.058 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.054+0000 7f08fbbff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f40cd280 con 0x7f08f40b8260 2023-06-20T13:31:55.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.054+0000 7f08f999b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f40b8260 0x7f08f40cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:55.059 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.054+0000 7f08f919a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f08f40d25c0 0x7f08f40b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54424/0 (socket says 172.21.15.115:54424) 2023-06-20T13:31:55.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.054+0000 7f08f919a700 1 -- 172.21.15.115:0/3657521444 learned_addr learned my addr 172.21.15.115:0/3657521444 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-06-20T13:31:55.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.055+0000 7f08f8999700 1 -- 172.21.15.115:0/3657521444 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1807062078 0 0) 0x7f08f4160ce0 con 0x7f08f40d25c0 2023-06-20T13:31:55.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.055+0000 7f08f8999700 1 -- 172.21.15.115:0/3657521444 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08e00035b0 con 0x7f08f40d25c0 2023-06-20T13:31:55.060 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.055+0000 7f08f8999700 1 -- 172.21.15.115:0/3657521444 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3909417659 0 0) 0x7f08f4160a00 con 0x7f08f40b4d20 2023-06-20T13:31:55.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.055+0000 7f08f999b700 1 -- 172.21.15.115:0/3657521444 >> v1:172.21.15.115:6789/0 conn(0x7f08f40d25c0 legacy=0x7f08f40b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:55.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.055+0000 7f08f999b700 1 -- 172.21.15.115:0/3657521444 >> v1:172.21.15.32:6789/0 conn(0x7f08f40b4d20 legacy=0x7f08f40d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:55.061 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.055+0000 7f08f999b700 1 -- 172.21.15.115:0/3657521444 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f40cd560 con 0x7f08f40b8260 2023-06-20T13:31:55.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.055+0000 7f08f999b700 1 --2- 172.21.15.115:0/3657521444 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f40b8260 0x7f08f40cede0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009870 tx=0x7f08f0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64195aa568b8519d server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:31:55.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.055+0000 7f08f8999700 1 -- 172.21.15.115:0/3657521444 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0011830 con 0x7f08f40b8260 2023-06-20T13:31:55.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.055+0000 7f08f8999700 1 -- 172.21.15.115:0/3657521444 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f0011990 con 0x7f08f40b8260 2023-06-20T13:31:55.062 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.055+0000 7f08f8999700 1 -- 172.21.15.115:0/3657521444 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0011d20 con 0x7f08f40b8260 2023-06-20T13:31:55.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.056+0000 7f08fbbff700 1 -- 172.21.15.115:0/3657521444 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f40b8260 msgr2=0x7f08f40cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:55.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.056+0000 7f08fbbff700 1 --2- 172.21.15.115:0/3657521444 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f40b8260 0x7f08f40cede0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009870 tx=0x7f08f0009b80 comp rx=0 tx=0).stop 2023-06-20T13:31:55.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.056+0000 7f08fbbff700 1 -- 172.21.15.115:0/3657521444 shutdown_connections 2023-06-20T13:31:55.065 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.056+0000 7f08fbbff700 1 --2- 172.21.15.115:0/3657521444 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f40b8260 0x7f08f40cede0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:55.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.056+0000 7f08fbbff700 1 -- 172.21.15.115:0/3657521444 >> 172.21.15.115:0/3657521444 conn(0x7f08f40722b0 msgr2=0x7f08f40cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:31:55.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.056+0000 7f08fbbff700 1 -- 172.21.15.115:0/3657521444 shutdown_connections 2023-06-20T13:31:55.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.056+0000 7f08fbbff700 1 -- 172.21.15.115:0/3657521444 wait complete. 2023-06-20T13:31:55.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.058+0000 7f08fbbff700 1 Processor -- start 2023-06-20T13:31:55.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.058+0000 7f08fbbff700 1 -- start start 2023-06-20T13:31:55.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.059+0000 7f08fbbff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08f40b8260 0x7f08f4157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:55.066 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.059+0000 7f08fbbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08f40d25c0 0x7f08f4155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:55.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.059+0000 7f08fbbff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f41f1970 0x7f08f41f1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:55.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.059+0000 7f08fbbff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f415cda0 con 0x7f08f40b8260 2023-06-20T13:31:55.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.059+0000 7f08fbbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f4158330 con 0x7f08f40d25c0 2023-06-20T13:31:55.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.059+0000 7f08fbbff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f4156530 con 0x7f08f41f1970 2023-06-20T13:31:55.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.059+0000 7f08f919a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08f40d25c0 0x7f08f4155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:55.067 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.059+0000 7f08f999b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08f40b8260 0x7f08f4157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:55.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.059+0000 7f08f999b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08f40b8260 0x7f08f4157df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.115:43194/0 (socket says 172.21.15.115:43194) 2023-06-20T13:31:55.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.059+0000 7f08f919a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08f40d25c0 0x7f08f4155ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51200/0 (socket says 172.21.15.115:51200) 2023-06-20T13:31:55.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.059+0000 7f08f999b700 1 -- 172.21.15.115:0/3998715954 learned_addr learned my addr 172.21.15.115:0/3998715954 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-06-20T13:31:55.068 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.059+0000 7f08fa19c700 1 --2- 172.21.15.115:0/3998715954 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f41f1970 0x7f08f41f1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:55.069 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.060+0000 7f08f999b700 1 -- 172.21.15.115:0/3998715954 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f41f1970 msgr2=0x7f08f41f1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:55.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.060+0000 7f08f999b700 1 --2- 172.21.15.115:0/3998715954 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f41f1970 0x7f08f41f1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:55.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.060+0000 7f08f999b700 1 -- 172.21.15.115:0/3998715954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08f40d25c0 msgr2=0x7f08f4155ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:55.070 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.060+0000 7f08f999b700 1 --2- 172.21.15.115:0/3998715954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08f40d25c0 0x7f08f4155ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:55.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.060+0000 7f08f999b700 1 -- 172.21.15.115:0/3998715954 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f00094a0 con 0x7f08f40b8260 2023-06-20T13:31:55.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.060+0000 7f08f999b700 1 --2- 172.21.15.115:0/3998715954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08f40b8260 0x7f08f4157df0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009bc0 tx=0x7f08f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:31:55.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.060+0000 7f08ea7fc700 1 -- 172.21.15.115:0/3998715954 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f001a7e0 con 0x7f08f40b8260 2023-06-20T13:31:55.071 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.061+0000 7f08ea7fc700 1 -- 172.21.15.115:0/3998715954 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f001a940 con 0x7f08f40b8260 2023-06-20T13:31:55.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.061+0000 7f08ea7fc700 1 -- 172.21.15.115:0/3998715954 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f001acf0 con 0x7f08f40b8260 2023-06-20T13:31:55.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.061+0000 7f08fbbff700 1 -- 172.21.15.115:0/3998715954 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f41f2410 con 0x7f08f40b8260 2023-06-20T13:31:55.072 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.061+0000 7f08fbbff700 1 -- 172.21.15.115:0/3998715954 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f41f29d0 con 0x7f08f40b8260 2023-06-20T13:31:55.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.061+0000 7f08ea7fc700 1 -- 172.21.15.115:0/3998715954 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f08f0022070 con 0x7f08f40b8260 2023-06-20T13:31:55.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.061+0000 7f08ea7fc700 1 -- 172.21.15.115:0/3998715954 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f08f0024bb0 con 0x7f08f40b8260 2023-06-20T13:31:55.073 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.062+0000 7f08fbbff700 1 -- 172.21.15.115:0/3998715954 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f404ea60 con 0x7f08f40b8260 2023-06-20T13:31:55.074 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.065+0000 7f08ea7fc700 1 -- 172.21.15.115:0/3998715954 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f08f0029070 con 0x7f08f40b8260 2023-06-20T13:31:55.086 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-06-20T13:31:55.085+0000 7f36df876200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-20T13:31:55.106 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-06-20T13:31:55.103+0000 7fef46bc5200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-20T13:31:55.152 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.150+0000 7f08fbbff700 1 -- 172.21.15.115:0/3998715954 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2aa828fc-ed09-4aa4-bcb7-36007ab5d730", "id": 3} v 0) v1 -- 0x7f08f40cfed0 con 0x7f08f40b8260 2023-06-20T13:31:55.156 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.153+0000 7f08ea7fc700 1 -- 172.21.15.115:0/3998715954 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2aa828fc-ed09-4aa4-bcb7-36007ab5d730", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f08f0015020 con 0x7f08f40b8260 2023-06-20T13:31:55.157 INFO:teuthology.orchestra.run.smithi115.stdout:3 2023-06-20T13:31:55.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.154+0000 7f08fbbff700 1 -- 172.21.15.115:0/3998715954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08f40b8260 msgr2=0x7f08f4157df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:55.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.154+0000 7f08fbbff700 1 --2- 172.21.15.115:0/3998715954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08f40b8260 0x7f08f4157df0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009bc0 tx=0x7f08f0004750 comp rx=0 tx=0).stop 2023-06-20T13:31:55.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.154+0000 7f08fbbff700 1 -- 172.21.15.115:0/3998715954 shutdown_connections 2023-06-20T13:31:55.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.154+0000 7f08fbbff700 1 --2- 172.21.15.115:0/3998715954 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f41f1970 0x7f08f41f1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:55.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.154+0000 7f08fbbff700 1 --2- 172.21.15.115:0/3998715954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08f40b8260 0x7f08f4157df0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:55.158 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.155+0000 7f08fbbff700 1 --2- 172.21.15.115:0/3998715954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08f40d25c0 0x7f08f4155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:55.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.155+0000 7f08fbbff700 1 -- 172.21.15.115:0/3998715954 >> 172.21.15.115:0/3998715954 conn(0x7f08f40b4d20 msgr2=0x7f08f406b360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:31:55.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.155+0000 7f08fbbff700 1 -- 172.21.15.115:0/3998715954 shutdown_connections 2023-06-20T13:31:55.159 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.155+0000 7f08fbbff700 1 -- 172.21.15.115:0/3998715954 wait complete. 2023-06-20T13:31:55.173 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 240d7e02-12ad-4700-a12d-c337cde8cfab 4 2023-06-20T13:31:55.279 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-06-20T13:31:55.277+0000 7fef46bc5200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-20T13:31:55.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.361+0000 7f90177ff700 1 Processor -- start 2023-06-20T13:31:55.363 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.361+0000 7f90177ff700 1 -- start start 2023-06-20T13:31:55.364 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.363+0000 7f90177ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90100b4d20 0x7f90100cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:55.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.363+0000 7f90177ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f90100d25c0 0x7f90100d0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:55.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.363+0000 7f90177ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9010160a00 con 0x7f90100b8260 2023-06-20T13:31:55.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.363+0000 7f90177ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9010160ce0 con 0x7f90100d25c0 2023-06-20T13:31:55.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.363+0000 7f90177ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90100cd280 con 0x7f90100b4d20 2023-06-20T13:31:55.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.363+0000 7f901559b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f90100b8260 0x7f90100b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54430/0 (socket says 172.21.15.115:54430) 2023-06-20T13:31:55.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.363+0000 7f901559b700 1 -- 172.21.15.115:0/140251350 learned_addr learned my addr 172.21.15.115:0/140251350 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-06-20T13:31:55.365 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.363+0000 7f9014d9a700 1 --2- 172.21.15.115:0/140251350 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90100b4d20 0x7f90100cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:55.366 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.363+0000 7f9015d9c700 1 --2- 172.21.15.115:0/140251350 >> v2:172.21.15.32:3300/0 conn(0x7f90100d25c0 0x7f90100d0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:55.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.363+0000 7f9007fff700 1 -- 172.21.15.115:0/140251350 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304371642 0 0) 0x7f9010160a00 con 0x7f90100b8260 2023-06-20T13:31:55.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.363+0000 7f9007fff700 1 -- 172.21.15.115:0/140251350 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ffc0035b0 con 0x7f90100b8260 2023-06-20T13:31:55.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.363+0000 7f9014d9a700 1 -- 172.21.15.115:0/140251350 >> v2:172.21.15.32:3300/0 conn(0x7f90100d25c0 msgr2=0x7f90100d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:31:55.367 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.363+0000 7f9014d9a700 1 --2- 172.21.15.115:0/140251350 >> v2:172.21.15.32:3300/0 conn(0x7f90100d25c0 0x7f90100d0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:55.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.363+0000 7f9014d9a700 1 -- 172.21.15.115:0/140251350 >> v1:172.21.15.115:6789/0 conn(0x7f90100b8260 legacy=0x7f90100b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:55.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.363+0000 7f9014d9a700 1 -- 172.21.15.115:0/140251350 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90100cd560 con 0x7f90100b4d20 2023-06-20T13:31:55.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.364+0000 7f9014d9a700 1 --2- 172.21.15.115:0/140251350 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90100b4d20 0x7f90100cede0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9000009840 tx=0x7f9000009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e3549555ff050a1 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:31:55.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.364+0000 7f9007fff700 1 -- 172.21.15.115:0/140251350 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9000011830 con 0x7f90100b4d20 2023-06-20T13:31:55.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.364+0000 7f9007fff700 1 -- 172.21.15.115:0/140251350 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9000011990 con 0x7f90100b4d20 2023-06-20T13:31:55.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.364+0000 7f9007fff700 1 -- 172.21.15.115:0/140251350 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9000011d20 con 0x7f90100b4d20 2023-06-20T13:31:55.368 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.364+0000 7f90177ff700 1 -- 172.21.15.115:0/140251350 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90100b4d20 msgr2=0x7f90100cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:55.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.365+0000 7f90177ff700 1 --2- 172.21.15.115:0/140251350 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90100b4d20 0x7f90100cede0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9000009840 tx=0x7f9000009b50 comp rx=0 tx=0).stop 2023-06-20T13:31:55.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.365+0000 7f90177ff700 1 -- 172.21.15.115:0/140251350 shutdown_connections 2023-06-20T13:31:55.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.365+0000 7f90177ff700 1 --2- 172.21.15.115:0/140251350 >> v2:172.21.15.32:3300/0 conn(0x7f90100d25c0 0x7f90100d0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:55.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.365+0000 7f90177ff700 1 --2- 172.21.15.115:0/140251350 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90100b4d20 0x7f90100cede0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:55.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.365+0000 7f90177ff700 1 -- 172.21.15.115:0/140251350 >> 172.21.15.115:0/140251350 conn(0x7f90100722b0 msgr2=0x7f90100cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:31:55.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.365+0000 7f90177ff700 1 -- 172.21.15.115:0/140251350 shutdown_connections 2023-06-20T13:31:55.369 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.365+0000 7f90177ff700 1 -- 172.21.15.115:0/140251350 wait complete. 2023-06-20T13:31:55.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.366+0000 7f90177ff700 1 Processor -- start 2023-06-20T13:31:55.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.367+0000 7f90177ff700 1 -- start start 2023-06-20T13:31:55.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.367+0000 7f90177ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90100b8260 0x7f90100cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:55.371 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.368+0000 7f90177ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90100d25c0 0x7f90100cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:55.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.368+0000 7f90177ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9010155a70 0x7f90100cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:55.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.368+0000 7f90177ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901015fcc0 con 0x7f90100b8260 2023-06-20T13:31:55.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.368+0000 7f90177ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90100cc470 con 0x7f9010155a70 2023-06-20T13:31:55.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.368+0000 7f90177ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901015f700 con 0x7f90100d25c0 2023-06-20T13:31:55.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.368+0000 7f901559b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90100b8260 0x7f90100cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:55.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.368+0000 7f9015d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9010155a70 0x7f90100cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:55.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.368+0000 7f9014d9a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90100d25c0 0x7f90100cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:55.372 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.368+0000 7f9015d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9010155a70 0x7f90100cbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51214/0 (socket says 172.21.15.115:51214) 2023-06-20T13:31:55.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.368+0000 7f901559b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90100b8260 0x7f90100cb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.115:43212/0 (socket says 172.21.15.115:43212) 2023-06-20T13:31:55.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.368+0000 7f9015d9c700 1 -- 172.21.15.115:0/3708729522 learned_addr learned my addr 172.21.15.115:0/3708729522 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-06-20T13:31:55.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.368+0000 7f9015d9c700 1 -- 172.21.15.115:0/3708729522 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90100d25c0 msgr2=0x7f90100cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:55.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.368+0000 7f9015d9c700 1 --2- 172.21.15.115:0/3708729522 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90100d25c0 0x7f90100cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:55.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.368+0000 7f9015d9c700 1 -- 172.21.15.115:0/3708729522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90100b8260 msgr2=0x7f90100cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:55.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.368+0000 7f9015d9c700 1 --2- 172.21.15.115:0/3708729522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90100b8260 0x7f90100cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:55.373 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.368+0000 7f9015d9c700 1 -- 172.21.15.115:0/3708729522 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90000094a0 con 0x7f9010155a70 2023-06-20T13:31:55.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.368+0000 7f901559b700 1 --2- 172.21.15.115:0/3708729522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90100b8260 0x7f90100cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:31:55.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.368+0000 7f9015d9c700 1 --2- 172.21.15.115:0/3708729522 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9010155a70 0x7f90100cbf30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f900800efc0 tx=0x7f900800c0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:31:55.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.369+0000 7f9005ffb700 1 -- 172.21.15.115:0/3708729522 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900800cad0 con 0x7f9010155a70 2023-06-20T13:31:55.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.369+0000 7f9005ffb700 1 -- 172.21.15.115:0/3708729522 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900800f040 con 0x7f9010155a70 2023-06-20T13:31:55.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.369+0000 7f90177ff700 1 -- 172.21.15.115:0/3708729522 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f901015f9e0 con 0x7f9010155a70 2023-06-20T13:31:55.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.369+0000 7f9005ffb700 1 -- 172.21.15.115:0/3708729522 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900800ce70 con 0x7f9010155a70 2023-06-20T13:31:55.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.369+0000 7f90177ff700 1 -- 172.21.15.115:0/3708729522 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90100c7b70 con 0x7f9010155a70 2023-06-20T13:31:55.374 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.369+0000 7f9005ffb700 1 -- 172.21.15.115:0/3708729522 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9008014780 con 0x7f9010155a70 2023-06-20T13:31:55.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.369+0000 7f9005ffb700 1 -- 172.21.15.115:0/3708729522 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f900801ddc0 con 0x7f9010155a70 2023-06-20T13:31:55.375 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-06-20T13:31:55.370+0000 7fef46bc5200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-20T13:31:55.375 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.370+0000 7f90177ff700 1 -- 172.21.15.115:0/3708729522 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90100c76f0 con 0x7f9010155a70 2023-06-20T13:31:55.376 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.372+0000 7f9005ffb700 1 -- 172.21.15.115:0/3708729522 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f900803bb00 con 0x7f9010155a70 2023-06-20T13:31:55.459 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.457+0000 7f90177ff700 1 -- 172.21.15.115:0/3708729522 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd new", "uuid": "240d7e02-12ad-4700-a12d-c337cde8cfab", "id": 4} v 0) v1 -- 0x7f90100c7d90 con 0x7f9010155a70 2023-06-20T13:31:55.463 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.461+0000 7f9005ffb700 1 -- 172.21.15.115:0/3708729522 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "240d7e02-12ad-4700-a12d-c337cde8cfab", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f900802a030 con 0x7f9010155a70 2023-06-20T13:31:55.463 INFO:teuthology.orchestra.run.smithi115.stdout:4 2023-06-20T13:31:55.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.462+0000 7f90177ff700 1 -- 172.21.15.115:0/3708729522 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9010155a70 msgr2=0x7f90100cbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:55.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.462+0000 7f90177ff700 1 --2- 172.21.15.115:0/3708729522 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9010155a70 0x7f90100cbf30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f900800efc0 tx=0x7f900800c0c0 comp rx=0 tx=0).stop 2023-06-20T13:31:55.464 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.462+0000 7f90177ff700 1 -- 172.21.15.115:0/3708729522 shutdown_connections 2023-06-20T13:31:55.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.462+0000 7f90177ff700 1 --2- 172.21.15.115:0/3708729522 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9010155a70 0x7f90100cbf30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:55.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.462+0000 7f90177ff700 1 --2- 172.21.15.115:0/3708729522 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f90100b8260 0x7f90100cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:55.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.462+0000 7f90177ff700 1 --2- 172.21.15.115:0/3708729522 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f90100d25c0 0x7f90100cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:55.465 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.462+0000 7f90177ff700 1 -- 172.21.15.115:0/3708729522 >> 172.21.15.115:0/3708729522 conn(0x7f90100b4d20 msgr2=0x7f90100d0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:31:55.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.462+0000 7f90177ff700 1 -- 172.21.15.115:0/3708729522 shutdown_connections 2023-06-20T13:31:55.466 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.462+0000 7f90177ff700 1 -- 172.21.15.115:0/3708729522 wait complete. 2023-06-20T13:31:55.480 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 00276e97-2dce-4d81-8f9c-118a2db95a02 5 2023-06-20T13:31:55.595 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-06-20T13:31:55.593+0000 7fef46bc5200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-20T13:31:55.670 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.669+0000 7f58859ff700 1 Processor -- start 2023-06-20T13:31:55.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.669+0000 7f58859ff700 1 -- start start 2023-06-20T13:31:55.671 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.670+0000 7f58859ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f588015f8f0 0x7f58800d2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:55.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.670+0000 7f58859ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58800cd430 0x7f58800b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:55.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.670+0000 7f58859ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f588015fcc0 con 0x7f58800b4be0 2023-06-20T13:31:55.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.670+0000 7f58859ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58800b5060 con 0x7f588015f8f0 2023-06-20T13:31:55.672 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.670+0000 7f58859ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58800cedd0 con 0x7f58800cd430 2023-06-20T13:31:55.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.670+0000 7f587e7fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58800cd430 0x7f58800b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:55.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.670+0000 7f587effd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f588015f8f0 0x7f58800d2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:55.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.670+0000 7f587effd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f588015f8f0 0x7f58800d2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51224/0 (socket says 172.21.15.115:51224) 2023-06-20T13:31:55.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.670+0000 7f587e7fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58800cd430 0x7f58800b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:42514/0 (socket says 172.21.15.115:42514) 2023-06-20T13:31:55.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.670+0000 7f587effd700 1 -- 172.21.15.115:0/575100025 learned_addr learned my addr 172.21.15.115:0/575100025 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-06-20T13:31:55.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.671+0000 7f587dffb700 1 -- 172.21.15.115:0/575100025 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 163295436 0 0) 0x7f588015fcc0 con 0x7f58800b4be0 2023-06-20T13:31:55.674 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.671+0000 7f587dffb700 1 -- 172.21.15.115:0/575100025 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58680035b0 con 0x7f58800b4be0 2023-06-20T13:31:55.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.671+0000 7f587effd700 1 -- 172.21.15.115:0/575100025 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58800cd430 msgr2=0x7f58800b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:31:55.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.671+0000 7f587effd700 1 --2- 172.21.15.115:0/575100025 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58800cd430 0x7f58800b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:55.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.671+0000 7f587effd700 1 -- 172.21.15.115:0/575100025 >> v1:172.21.15.32:6789/0 conn(0x7f58800b4be0 legacy=0x7f58800d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:55.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.671+0000 7f587effd700 1 -- 172.21.15.115:0/575100025 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58800d2a20 con 0x7f588015f8f0 2023-06-20T13:31:55.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.671+0000 7f587e7fc700 1 --2- 172.21.15.115:0/575100025 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58800cd430 0x7f58800b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:31:55.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.671+0000 7f587effd700 1 --2- 172.21.15.115:0/575100025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f588015f8f0 0x7f58800d2320 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5870006fd0 tx=0x7f5870009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31d81ffa80d72456 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:31:55.675 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.671+0000 7f587dffb700 1 -- 172.21.15.115:0/575100025 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870005e30 con 0x7f588015f8f0 2023-06-20T13:31:55.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.671+0000 7f587dffb700 1 -- 172.21.15.115:0/575100025 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5870004030 con 0x7f588015f8f0 2023-06-20T13:31:55.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.671+0000 7f587dffb700 1 -- 172.21.15.115:0/575100025 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58700043e0 con 0x7f588015f8f0 2023-06-20T13:31:55.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.672+0000 7f58859ff700 1 -- 172.21.15.115:0/575100025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f588015f8f0 msgr2=0x7f58800d2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:55.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.672+0000 7f58859ff700 1 --2- 172.21.15.115:0/575100025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f588015f8f0 0x7f58800d2320 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5870006fd0 tx=0x7f5870009bd0 comp rx=0 tx=0).stop 2023-06-20T13:31:55.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.672+0000 7f58859ff700 1 -- 172.21.15.115:0/575100025 shutdown_connections 2023-06-20T13:31:55.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.672+0000 7f58859ff700 1 --2- 172.21.15.115:0/575100025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f588015f8f0 0x7f58800d2320 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:55.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.672+0000 7f58859ff700 1 --2- 172.21.15.115:0/575100025 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58800cd430 0x7f58800b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:55.676 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.672+0000 7f58859ff700 1 -- 172.21.15.115:0/575100025 >> 172.21.15.115:0/575100025 conn(0x7f5880071660 msgr2=0x7f5880071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:31:55.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.672+0000 7f58859ff700 1 -- 172.21.15.115:0/575100025 shutdown_connections 2023-06-20T13:31:55.677 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.672+0000 7f58859ff700 1 -- 172.21.15.115:0/575100025 wait complete. 2023-06-20T13:31:55.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.674+0000 7f58859ff700 1 Processor -- start 2023-06-20T13:31:55.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.674+0000 7f58859ff700 1 -- start start 2023-06-20T13:31:55.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.675+0000 7f58859ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58800b4be0 0x7f58800a9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:55.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.675+0000 7f58859ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58800cd430 0x7f58801f1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:55.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.675+0000 7f58859ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f588015f8f0 0x7f58801f1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:55.679 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.675+0000 7f58859ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588015b0c0 con 0x7f58800b4be0 2023-06-20T13:31:55.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.675+0000 7f58859ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58800aa2c0 con 0x7f588015f8f0 2023-06-20T13:31:55.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.675+0000 7f58859ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f588015a440 con 0x7f58800cd430 2023-06-20T13:31:55.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.675+0000 7f587e7fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58800cd430 0x7f58801f1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:55.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.675+0000 7f587e7fc700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58800cd430 0x7f58801f1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:42518/0 (socket says 172.21.15.115:42518) 2023-06-20T13:31:55.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.675+0000 7f587effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58800b4be0 0x7f58800a9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:55.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.675+0000 7f587e7fc700 1 -- 172.21.15.115:0/4009302889 learned_addr learned my addr 172.21.15.115:0/4009302889 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-06-20T13:31:55.680 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.676+0000 7f587e7fc700 1 -- 172.21.15.115:0/4009302889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f588015f8f0 msgr2=0x7f58801f1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:55.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.676+0000 7f587f7fe700 1 --2- 172.21.15.115:0/4009302889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f588015f8f0 0x7f58801f1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:55.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.676+0000 7f587e7fc700 1 --2- 172.21.15.115:0/4009302889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f588015f8f0 0x7f58801f1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:55.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.676+0000 7f587e7fc700 1 -- 172.21.15.115:0/4009302889 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58800b4be0 msgr2=0x7f58800a9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:55.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.676+0000 7f587e7fc700 1 --2- 172.21.15.115:0/4009302889 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58800b4be0 0x7f58800a9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:55.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.676+0000 7f587e7fc700 1 -- 172.21.15.115:0/4009302889 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58740094a0 con 0x7f58800cd430 2023-06-20T13:31:55.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.676+0000 7f587effd700 1 --2- 172.21.15.115:0/4009302889 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58800b4be0 0x7f58800a9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:31:55.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.676+0000 7f587f7fe700 1 --2- 172.21.15.115:0/4009302889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f588015f8f0 0x7f58801f1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:31:55.681 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.676+0000 7f587e7fc700 1 --2- 172.21.15.115:0/4009302889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58800cd430 0x7f58801f1a80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f587400ebe0 tx=0x7f587400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:31:55.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.676+0000 7f5867fff700 1 -- 172.21.15.115:0/4009302889 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5874009800 con 0x7f58800cd430 2023-06-20T13:31:55.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.676+0000 7f5867fff700 1 -- 172.21.15.115:0/4009302889 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587400c910 con 0x7f58800cd430 2023-06-20T13:31:55.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.676+0000 7f5867fff700 1 -- 172.21.15.115:0/4009302889 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587400cc80 con 0x7f58800cd430 2023-06-20T13:31:55.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.676+0000 7f58859ff700 1 -- 172.21.15.115:0/4009302889 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5870009500 con 0x7f58800cd430 2023-06-20T13:31:55.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.676+0000 7f58859ff700 1 -- 172.21.15.115:0/4009302889 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f588015aa00 con 0x7f58800cd430 2023-06-20T13:31:55.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.677+0000 7f5867fff700 1 -- 172.21.15.115:0/4009302889 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5874005d20 con 0x7f58800cd430 2023-06-20T13:31:55.682 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.677+0000 7f5867fff700 1 -- 172.21.15.115:0/4009302889 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f58740068e0 con 0x7f58800cd430 2023-06-20T13:31:55.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.678+0000 7f58859ff700 1 -- 172.21.15.115:0/4009302889 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58801f2c70 con 0x7f58800cd430 2023-06-20T13:31:55.683 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.680+0000 7f5867fff700 1 -- 172.21.15.115:0/4009302889 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f58801f2c70 con 0x7f58800cd430 2023-06-20T13:31:55.698 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-06-20T13:31:55.696+0000 7fef46bc5200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-20T13:31:55.768 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.767+0000 7f58859ff700 1 -- 172.21.15.115:0/4009302889 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00276e97-2dce-4d81-8f9c-118a2db95a02", "id": 5} v 0) v1 -- 0x7f588004ea60 con 0x7f58800cd430 2023-06-20T13:31:55.773 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.771+0000 7f5867fff700 1 -- 172.21.15.115:0/4009302889 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00276e97-2dce-4d81-8f9c-118a2db95a02", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5874029020 con 0x7f58800cd430 2023-06-20T13:31:55.774 INFO:teuthology.orchestra.run.smithi115.stdout:5 2023-06-20T13:31:55.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.772+0000 7f58859ff700 1 -- 172.21.15.115:0/4009302889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58800cd430 msgr2=0x7f58801f1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:55.775 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.772+0000 7f58859ff700 1 --2- 172.21.15.115:0/4009302889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58800cd430 0x7f58801f1a80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f587400ebe0 tx=0x7f587400eef0 comp rx=0 tx=0).stop 2023-06-20T13:31:55.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.772+0000 7f58859ff700 1 -- 172.21.15.115:0/4009302889 shutdown_connections 2023-06-20T13:31:55.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.772+0000 7f58859ff700 1 --2- 172.21.15.115:0/4009302889 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f588015f8f0 0x7f58801f1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:55.776 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.772+0000 7f58859ff700 1 --2- 172.21.15.115:0/4009302889 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f58800b4be0 0x7f58800a9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:55.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.772+0000 7f58859ff700 1 --2- 172.21.15.115:0/4009302889 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f58800cd430 0x7f58801f1a80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:55.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.772+0000 7f58859ff700 1 -- 172.21.15.115:0/4009302889 >> 172.21.15.115:0/4009302889 conn(0x7f5880071660 msgr2=0x7f58800d1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:31:55.777 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.772+0000 7f58859ff700 1 -- 172.21.15.115:0/4009302889 shutdown_connections 2023-06-20T13:31:55.778 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.772+0000 7f58859ff700 1 -- 172.21.15.115:0/4009302889 wait complete. 2023-06-20T13:31:55.791 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new c7699199-2e94-49d1-8473-ebb243767a94 6 2023-06-20T13:31:55.799 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-06-20T13:31:55.797+0000 7fef46bc5200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-20T13:31:55.913 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-06-20T13:31:55.911+0000 7fef46bc5200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-20T13:31:55.939 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-06-20T13:31:55.934+0000 7f36df876200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-20T13:31:55.980 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.978+0000 7f2d221ff700 1 Processor -- start 2023-06-20T13:31:55.981 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.979+0000 7f2d221ff700 1 -- start start 2023-06-20T13:31:55.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.980+0000 7f2d221ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d1c0b4d20 0x7f2d1c0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:55.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.980+0000 7f2d221ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d1c160a00 con 0x7f2d1c0d25c0 2023-06-20T13:31:55.985 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.980+0000 7f2d221ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d1c160ce0 con 0x7f2d1c0b8260 2023-06-20T13:31:55.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.980+0000 7f2d221ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c0cd280 con 0x7f2d1c0b4d20 2023-06-20T13:31:55.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.980+0000 7f2d1b7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f2d1c0b8260 0x7f2d1c0b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54446/0 (socket says 172.21.15.115:54446) 2023-06-20T13:31:55.986 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.980+0000 7f2d1b7fe700 1 -- 172.21.15.115:0/1451693103 learned_addr learned my addr 172.21.15.115:0/1451693103 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-06-20T13:31:55.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.980+0000 7f2d1affd700 1 --2- 172.21.15.115:0/1451693103 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d1c0b4d20 0x7f2d1c0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:55.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.980+0000 7f2d1a7fc700 1 -- 172.21.15.115:0/1451693103 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3194245182 0 0) 0x7f2d1c160ce0 con 0x7f2d1c0b8260 2023-06-20T13:31:55.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.981+0000 7f2d1affd700 1 -- 172.21.15.115:0/1451693103 >> v1:172.21.15.115:6789/0 conn(0x7f2d1c0b8260 legacy=0x7f2d1c0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:55.987 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.981+0000 7f2d1affd700 1 -- 172.21.15.115:0/1451693103 >> v1:172.21.15.32:6789/0 conn(0x7f2d1c0d25c0 legacy=0x7f2d1c0d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:55.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.981+0000 7f2d1affd700 1 -- 172.21.15.115:0/1451693103 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1c0cd560 con 0x7f2d1c0b4d20 2023-06-20T13:31:55.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.981+0000 7f2d1affd700 1 --2- 172.21.15.115:0/1451693103 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d1c0b4d20 0x7f2d1c0cede0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2d10009870 tx=0x7f2d10009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c75fa21a919bc828 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:31:55.988 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.981+0000 7f2d1a7fc700 1 -- 172.21.15.115:0/1451693103 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d10004230 con 0x7f2d1c0b4d20 2023-06-20T13:31:55.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.981+0000 7f2d1a7fc700 1 -- 172.21.15.115:0/1451693103 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d10004390 con 0x7f2d1c0b4d20 2023-06-20T13:31:55.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.981+0000 7f2d1a7fc700 1 -- 172.21.15.115:0/1451693103 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d100036a0 con 0x7f2d1c0b4d20 2023-06-20T13:31:55.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.982+0000 7f2d221ff700 1 -- 172.21.15.115:0/1451693103 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d1c0b4d20 msgr2=0x7f2d1c0cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:55.989 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.982+0000 7f2d221ff700 1 --2- 172.21.15.115:0/1451693103 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d1c0b4d20 0x7f2d1c0cede0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2d10009870 tx=0x7f2d10009b80 comp rx=0 tx=0).stop 2023-06-20T13:31:55.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.982+0000 7f2d221ff700 1 -- 172.21.15.115:0/1451693103 shutdown_connections 2023-06-20T13:31:55.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.982+0000 7f2d221ff700 1 --2- 172.21.15.115:0/1451693103 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d1c0b4d20 0x7f2d1c0cede0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:55.990 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.982+0000 7f2d221ff700 1 -- 172.21.15.115:0/1451693103 >> 172.21.15.115:0/1451693103 conn(0x7f2d1c0722b0 msgr2=0x7f2d1c0cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:31:55.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.982+0000 7f2d221ff700 1 -- 172.21.15.115:0/1451693103 shutdown_connections 2023-06-20T13:31:55.991 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.982+0000 7f2d221ff700 1 -- 172.21.15.115:0/1451693103 wait complete. 2023-06-20T13:31:55.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.984+0000 7f2d221ff700 1 Processor -- start 2023-06-20T13:31:55.995 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.984+0000 7f2d221ff700 1 -- start start 2023-06-20T13:31:55.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.985+0000 7f2d221ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d1c0b8260 0x7f2d1c1585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:55.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.985+0000 7f2d221ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d1c0d25c0 0x7f2d1c156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:55.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.985+0000 7f2d221ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d1c0d0c70 0x7f2d1c145f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:55.996 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.985+0000 7f2d221ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c159910 con 0x7f2d1c0b8260 2023-06-20T13:31:55.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.985+0000 7f2d221ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c159d30 con 0x7f2d1c0d25c0 2023-06-20T13:31:55.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.985+0000 7f2d221ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c158c90 con 0x7f2d1c0d0c70 2023-06-20T13:31:55.997 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.985+0000 7f2d1affd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d1c0d25c0 0x7f2d1c156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:55.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.985+0000 7f2d1b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d1c0b8260 0x7f2d1c1585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:55.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.985+0000 7f2d1affd700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d1c0d25c0 0x7f2d1c156af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:51234/0 (socket says 172.21.15.115:51234) 2023-06-20T13:31:55.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.985+0000 7f2d1affd700 1 -- 172.21.15.115:0/3240475552 learned_addr learned my addr 172.21.15.115:0/3240475552 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-06-20T13:31:55.998 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.985+0000 7f2d1bfff700 1 --2- 172.21.15.115:0/3240475552 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d1c0d0c70 0x7f2d1c145f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:55.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.985+0000 7f2d1affd700 1 -- 172.21.15.115:0/3240475552 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d1c0d0c70 msgr2=0x7f2d1c145f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:55.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.985+0000 7f2d1affd700 1 --2- 172.21.15.115:0/3240475552 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d1c0d0c70 0x7f2d1c145f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:55.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.985+0000 7f2d1affd700 1 -- 172.21.15.115:0/3240475552 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d1c0b8260 msgr2=0x7f2d1c1585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:55.999 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.985+0000 7f2d1affd700 1 --2- 172.21.15.115:0/3240475552 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d1c0b8260 0x7f2d1c1585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:56.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.985+0000 7f2d1affd700 1 -- 172.21.15.115:0/3240475552 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d100094a0 con 0x7f2d1c0d25c0 2023-06-20T13:31:56.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.985+0000 7f2d1b7fe700 1 --2- 172.21.15.115:0/3240475552 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d1c0b8260 0x7f2d1c1585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:31:56.000 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.986+0000 7f2d1affd700 1 --2- 172.21.15.115:0/3240475552 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d1c0d25c0 0x7f2d1c156af0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2d100090b0 tx=0x7f2d10004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:31:56.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.986+0000 7f2d03fff700 1 -- 172.21.15.115:0/3240475552 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d10011630 con 0x7f2d1c0d25c0 2023-06-20T13:31:56.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.986+0000 7f2d03fff700 1 -- 172.21.15.115:0/3240475552 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d100117b0 con 0x7f2d1c0d25c0 2023-06-20T13:31:56.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.986+0000 7f2d221ff700 1 -- 172.21.15.115:0/3240475552 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d1c158f70 con 0x7f2d1c0d25c0 2023-06-20T13:31:56.001 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.986+0000 7f2d03fff700 1 -- 172.21.15.115:0/3240475552 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d10011b60 con 0x7f2d1c0d25c0 2023-06-20T13:31:56.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.986+0000 7f2d221ff700 1 -- 172.21.15.115:0/3240475552 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1c159530 con 0x7f2d1c0d25c0 2023-06-20T13:31:56.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.986+0000 7f2d03fff700 1 -- 172.21.15.115:0/3240475552 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2d10021070 con 0x7f2d1c0d25c0 2023-06-20T13:31:56.002 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.986+0000 7f2d03fff700 1 -- 172.21.15.115:0/3240475552 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f2d10024bf0 con 0x7f2d1c0d25c0 2023-06-20T13:31:56.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.987+0000 7f2d221ff700 1 -- 172.21.15.115:0/3240475552 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d1c159a50 con 0x7f2d1c0d25c0 2023-06-20T13:31:56.003 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:55.989+0000 7f2d03fff700 1 -- 172.21.15.115:0/3240475552 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f2d10043b00 con 0x7f2d1c0d25c0 2023-06-20T13:31:56.037 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-06-20T13:31:56.035+0000 7f36df876200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-20T13:31:56.077 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.076+0000 7f2d221ff700 1 -- 172.21.15.115:0/3240475552 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c7699199-2e94-49d1-8473-ebb243767a94", "id": 6} v 0) v1 -- 0x7f2d1c0cd8d0 con 0x7f2d1c0d25c0 2023-06-20T13:31:56.083 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.082+0000 7f2d03fff700 1 -- 172.21.15.115:0/3240475552 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c7699199-2e94-49d1-8473-ebb243767a94", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2d10032030 con 0x7f2d1c0d25c0 2023-06-20T13:31:56.084 INFO:teuthology.orchestra.run.smithi115.stdout:6 2023-06-20T13:31:56.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.083+0000 7f2d221ff700 1 -- 172.21.15.115:0/3240475552 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d1c0d25c0 msgr2=0x7f2d1c156af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:56.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.083+0000 7f2d221ff700 1 --2- 172.21.15.115:0/3240475552 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d1c0d25c0 0x7f2d1c156af0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2d100090b0 tx=0x7f2d10004750 comp rx=0 tx=0).stop 2023-06-20T13:31:56.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.083+0000 7f2d221ff700 1 -- 172.21.15.115:0/3240475552 shutdown_connections 2023-06-20T13:31:56.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.083+0000 7f2d221ff700 1 --2- 172.21.15.115:0/3240475552 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d1c0d0c70 0x7f2d1c145f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:56.085 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.083+0000 7f2d221ff700 1 --2- 172.21.15.115:0/3240475552 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d1c0b8260 0x7f2d1c1585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:56.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.083+0000 7f2d221ff700 1 --2- 172.21.15.115:0/3240475552 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d1c0d25c0 0x7f2d1c156af0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:56.086 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.083+0000 7f2d221ff700 1 -- 172.21.15.115:0/3240475552 >> 172.21.15.115:0/3240475552 conn(0x7f2d1c0b4d20 msgr2=0x7f2d1c0b6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:31:56.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.083+0000 7f2d221ff700 1 -- 172.21.15.115:0/3240475552 shutdown_connections 2023-06-20T13:31:56.087 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.083+0000 7f2d221ff700 1 -- 172.21.15.115:0/3240475552 wait complete. 2023-06-20T13:31:56.102 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 835f84b1-3eed-44be-9c04-3b779a9dc7d4 7 2023-06-20T13:31:56.148 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-06-20T13:31:56.146+0000 7fef46bc5200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-20T13:31:56.214 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-06-20T13:31:56.212+0000 7f36df876200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-20T13:31:56.254 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-06-20T13:31:56.252+0000 7fef46bc5200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-20T13:31:56.294 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.293+0000 7f18b29ff700 1 Processor -- start 2023-06-20T13:31:56.295 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.293+0000 7f18b29ff700 1 -- start start 2023-06-20T13:31:56.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.294+0000 7f18b29ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f18ac0b8260 0x7f18ac0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:56.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.294+0000 7f18b29ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18ac0d25c0 0x7f18ac0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:56.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.294+0000 7f18b29ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18ac160a00 con 0x7f18ac0b4b50 2023-06-20T13:31:56.296 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.294+0000 7f18b29ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18ac0b4fd0 con 0x7f18ac0b8260 2023-06-20T13:31:56.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.294+0000 7f18b29ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac160ce0 con 0x7f18ac0d25c0 2023-06-20T13:31:56.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.294+0000 7f18a3fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18ac0d25c0 0x7f18ac0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:56.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.294+0000 7f18b0f9c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f18ac0b4b50 0x7f18ac06b360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:54454/0 (socket says 172.21.15.115:54454) 2023-06-20T13:31:56.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.294+0000 7f18b0f9c700 1 -- 172.21.15.115:0/3121823139 learned_addr learned my addr 172.21.15.115:0/3121823139 (peer_addr_for_me v1:172.21.15.115:0/0) 2023-06-20T13:31:56.297 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.294+0000 7f18abfff700 1 --2- 172.21.15.115:0/3121823139 >> v2:172.21.15.32:3300/0 conn(0x7f18ac0b8260 0x7f18ac0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:56.298 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.295+0000 7f18a3fff700 1 -- 172.21.15.115:0/3121823139 >> v2:172.21.15.32:3300/0 conn(0x7f18ac0b8260 msgr2=0x7f18ac0cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:31:56.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.295+0000 7f18a3fff700 1 --2- 172.21.15.115:0/3121823139 >> v2:172.21.15.32:3300/0 conn(0x7f18ac0b8260 0x7f18ac0cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:56.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.295+0000 7f18a3fff700 1 -- 172.21.15.115:0/3121823139 >> v1:172.21.15.115:6789/0 conn(0x7f18ac0b4b50 legacy=0x7f18ac06b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:56.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.295+0000 7f18a3fff700 1 -- 172.21.15.115:0/3121823139 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ac0cd280 con 0x7f18ac0d25c0 2023-06-20T13:31:56.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.295+0000 7f18ab7fe700 1 -- 172.21.15.115:0/3121823139 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2009912043 0 0) 0x7f18ac160a00 con 0x7f18ac0b4b50 2023-06-20T13:31:56.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.295+0000 7f18a3fff700 1 --2- 172.21.15.115:0/3121823139 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18ac0d25c0 0x7f18ac0b4610 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1894009840 tx=0x7f1894009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5568d886571cc896 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:31:56.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.295+0000 7f18ab7fe700 1 -- 172.21.15.115:0/3121823139 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1894011830 con 0x7f18ac0d25c0 2023-06-20T13:31:56.299 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.295+0000 7f18ab7fe700 1 -- 172.21.15.115:0/3121823139 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1894011990 con 0x7f18ac0d25c0 2023-06-20T13:31:56.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.295+0000 7f18ab7fe700 1 -- 172.21.15.115:0/3121823139 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1894011d20 con 0x7f18ac0d25c0 2023-06-20T13:31:56.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.296+0000 7f18b29ff700 1 -- 172.21.15.115:0/3121823139 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18ac0d25c0 msgr2=0x7f18ac0b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:56.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.296+0000 7f18b29ff700 1 --2- 172.21.15.115:0/3121823139 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18ac0d25c0 0x7f18ac0b4610 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1894009840 tx=0x7f1894009b50 comp rx=0 tx=0).stop 2023-06-20T13:31:56.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.296+0000 7f18b29ff700 1 -- 172.21.15.115:0/3121823139 shutdown_connections 2023-06-20T13:31:56.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.296+0000 7f18b29ff700 1 --2- 172.21.15.115:0/3121823139 >> v2:172.21.15.32:3300/0 conn(0x7f18ac0b8260 0x7f18ac0cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:56.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.296+0000 7f18b29ff700 1 --2- 172.21.15.115:0/3121823139 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18ac0d25c0 0x7f18ac0b4610 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:56.300 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.296+0000 7f18b29ff700 1 -- 172.21.15.115:0/3121823139 >> 172.21.15.115:0/3121823139 conn(0x7f18ac0722b0 msgr2=0x7f18ac0cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:31:56.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.296+0000 7f18b29ff700 1 -- 172.21.15.115:0/3121823139 shutdown_connections 2023-06-20T13:31:56.301 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.296+0000 7f18b29ff700 1 -- 172.21.15.115:0/3121823139 wait complete. 2023-06-20T13:31:56.302 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.298+0000 7f18b29ff700 1 Processor -- start 2023-06-20T13:31:56.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.298+0000 7f18b29ff700 1 -- start start 2023-06-20T13:31:56.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.299+0000 7f18b29ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18ac0b8260 0x7f18ac1f12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:56.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.299+0000 7f18b29ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18ac0d25c0 0x7f18ac15f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:56.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.299+0000 7f18b29ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18ac0b22e0 0x7f18ac0b2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:56.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.299+0000 7f18b29ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac0b2cc0 con 0x7f18ac0d25c0 2023-06-20T13:31:56.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.299+0000 7f18b29ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac15cdd0 con 0x7f18ac0b22e0 2023-06-20T13:31:56.303 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.299+0000 7f18b29ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18ac15c1c0 con 0x7f18ac0b8260 2023-06-20T13:31:56.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.299+0000 7f18abfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18ac0b8260 0x7f18ac1f12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:56.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.299+0000 7f18abfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18ac0b8260 0x7f18ac1f12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:42554/0 (socket says 172.21.15.115:42554) 2023-06-20T13:31:56.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.299+0000 7f18abfff700 1 -- 172.21.15.115:0/1005766361 learned_addr learned my addr 172.21.15.115:0/1005766361 (peer_addr_for_me v2:172.21.15.115:0/0) 2023-06-20T13:31:56.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.299+0000 7f18b0f9c700 1 --2- 172.21.15.115:0/1005766361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18ac0b22e0 0x7f18ac0b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:56.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.299+0000 7f18a3fff700 1 --2- 172.21.15.115:0/1005766361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18ac0d25c0 0x7f18ac15f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:56.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.300+0000 7f18a3fff700 1 -- 172.21.15.115:0/1005766361 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18ac0b8260 msgr2=0x7f18ac1f12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:56.304 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.300+0000 7f18a3fff700 1 --2- 172.21.15.115:0/1005766361 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18ac0b8260 0x7f18ac1f12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:56.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.300+0000 7f18a3fff700 1 -- 172.21.15.115:0/1005766361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18ac0b22e0 msgr2=0x7f18ac0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:56.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.300+0000 7f18a3fff700 1 --2- 172.21.15.115:0/1005766361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18ac0b22e0 0x7f18ac0b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:56.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.300+0000 7f18a3fff700 1 -- 172.21.15.115:0/1005766361 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18940094a0 con 0x7f18ac0d25c0 2023-06-20T13:31:56.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.300+0000 7f18abfff700 1 --2- 172.21.15.115:0/1005766361 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18ac0b8260 0x7f18ac1f12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:31:56.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.300+0000 7f18a3fff700 1 --2- 172.21.15.115:0/1005766361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18ac0d25c0 0x7f18ac15f160 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f18ac0cf5c0 tx=0x7f1894004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:31:56.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.300+0000 7f18a97fa700 1 -- 172.21.15.115:0/1005766361 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18940036a0 con 0x7f18ac0d25c0 2023-06-20T13:31:56.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.300+0000 7f18a97fa700 1 -- 172.21.15.115:0/1005766361 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189401e070 con 0x7f18ac0d25c0 2023-06-20T13:31:56.305 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.300+0000 7f18b29ff700 1 -- 172.21.15.115:0/1005766361 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ac15c4a0 con 0x7f18ac0d25c0 2023-06-20T13:31:56.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.300+0000 7f18a97fa700 1 -- 172.21.15.115:0/1005766361 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1894003a40 con 0x7f18ac0d25c0 2023-06-20T13:31:56.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.300+0000 7f18b29ff700 1 -- 172.21.15.115:0/1005766361 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18ac15ca60 con 0x7f18ac0d25c0 2023-06-20T13:31:56.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.301+0000 7f18a97fa700 1 -- 172.21.15.115:0/1005766361 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f189402d450 con 0x7f18ac0d25c0 2023-06-20T13:31:56.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.301+0000 7f18a97fa700 1 -- 172.21.15.115:0/1005766361 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f189401a420 con 0x7f18ac0d25c0 2023-06-20T13:31:56.306 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.301+0000 7f18b29ff700 1 -- 172.21.15.115:0/1005766361 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18ac15cf80 con 0x7f18ac0d25c0 2023-06-20T13:31:56.307 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.304+0000 7f18a97fa700 1 -- 172.21.15.115:0/1005766361 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f1894044b00 con 0x7f18ac0d25c0 2023-06-20T13:31:56.308 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-06-20T13:31:56.307+0000 7f36df876200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-20T13:31:56.391 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.390+0000 7f18b29ff700 1 -- 172.21.15.115:0/1005766361 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd new", "uuid": "835f84b1-3eed-44be-9c04-3b779a9dc7d4", "id": 7} v 0) v1 -- 0x7f18ac15d160 con 0x7f18ac0d25c0 2023-06-20T13:31:56.394 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.393+0000 7f18a97fa700 1 -- 172.21.15.115:0/1005766361 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "835f84b1-3eed-44be-9c04-3b779a9dc7d4", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f18ac15d160 con 0x7f18ac0d25c0 2023-06-20T13:31:56.395 INFO:teuthology.orchestra.run.smithi115.stdout:7 2023-06-20T13:31:56.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.394+0000 7f18b29ff700 1 -- 172.21.15.115:0/1005766361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18ac0d25c0 msgr2=0x7f18ac15f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:56.396 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.394+0000 7f18b29ff700 1 --2- 172.21.15.115:0/1005766361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18ac0d25c0 0x7f18ac15f160 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f18ac0cf5c0 tx=0x7f1894004750 comp rx=0 tx=0).stop 2023-06-20T13:31:56.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.395+0000 7f18b29ff700 1 -- 172.21.15.115:0/1005766361 shutdown_connections 2023-06-20T13:31:56.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.395+0000 7f18b29ff700 1 --2- 172.21.15.115:0/1005766361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18ac0b22e0 0x7f18ac0b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:56.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.395+0000 7f18b29ff700 1 --2- 172.21.15.115:0/1005766361 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18ac0b8260 0x7f18ac1f12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:56.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.395+0000 7f18b29ff700 1 --2- 172.21.15.115:0/1005766361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18ac0d25c0 0x7f18ac15f160 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:56.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.395+0000 7f18b29ff700 1 -- 172.21.15.115:0/1005766361 >> 172.21.15.115:0/1005766361 conn(0x7f18ac0b4b50 msgr2=0x7f18ac0b4240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:31:56.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.395+0000 7f18b29ff700 1 -- 172.21.15.115:0/1005766361 shutdown_connections 2023-06-20T13:31:56.397 INFO:teuthology.orchestra.run.smithi115.stderr:2023-06-20T13:31:56.395+0000 7f18b29ff700 1 -- 172.21.15.115:0/1005766361 wait complete. 2023-06-20T13:31:56.415 INFO:tasks.ceph.osd.0:Restarting daemon 2023-06-20T13:31:56.415 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-06-20T13:31:56.420 INFO:tasks.ceph.osd.0:Started 2023-06-20T13:31:56.421 INFO:tasks.ceph.osd.1:Restarting daemon 2023-06-20T13:31:56.421 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-06-20T13:31:56.426 INFO:tasks.ceph.osd.1:Started 2023-06-20T13:31:56.427 INFO:tasks.ceph.osd.2:Restarting daemon 2023-06-20T13:31:56.427 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-06-20T13:31:56.432 INFO:tasks.ceph.osd.2:Started 2023-06-20T13:31:56.432 INFO:tasks.ceph.osd.3:Restarting daemon 2023-06-20T13:31:56.433 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-06-20T13:31:56.438 INFO:tasks.ceph.osd.3:Started 2023-06-20T13:31:56.439 INFO:tasks.ceph.osd.4:Restarting daemon 2023-06-20T13:31:56.439 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-06-20T13:31:56.444 INFO:tasks.ceph.osd.4:Started 2023-06-20T13:31:56.444 INFO:tasks.ceph.osd.5:Restarting daemon 2023-06-20T13:31:56.444 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-06-20T13:31:56.448 INFO:tasks.ceph.osd.5:Started 2023-06-20T13:31:56.449 INFO:tasks.ceph.osd.6:Restarting daemon 2023-06-20T13:31:56.449 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-06-20T13:31:56.455 INFO:tasks.ceph.osd.6:Started 2023-06-20T13:31:56.455 INFO:tasks.ceph.osd.7:Restarting daemon 2023-06-20T13:31:56.456 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-06-20T13:31:56.461 INFO:tasks.ceph.osd.7:Started 2023-06-20T13:31:56.462 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:31:56.557 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-06-20T13:31:56.555+0000 7f36df876200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-20T13:31:56.671 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-06-20T13:31:56.669+0000 7f36df876200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-20T13:31:56.673 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-06-20T13:31:56.670+0000 7fef46bc5200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-20T13:31:56.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.733+0000 7fe5121ff700 1 Processor -- start 2023-06-20T13:31:56.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.734+0000 7fe5121ff700 1 -- start start 2023-06-20T13:31:56.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.735+0000 7fe5121ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe50c15fe00 0x7fe50c0cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:56.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.735+0000 7fe5121ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe50c1601d0 0x7fe50c160620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:56.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.735+0000 7fe5121ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50c0d29b0 0x7fe50c0d2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:56.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.735+0000 7fe5121ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe50c0cd930 con 0x7fe50c1601d0 2023-06-20T13:31:56.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.735+0000 7fe5121ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe50c0d06a0 con 0x7fe50c15fe00 2023-06-20T13:31:56.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.735+0000 7fe5121ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c0cd120 con 0x7fe50c0d29b0 2023-06-20T13:31:56.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.735+0000 7fe50affd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe50c1601d0 0x7fe50c160620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:56.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.735+0000 7fe50affd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe50c1601d0 0x7fe50c160620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55354/0 (socket says 172.21.15.32:55354) 2023-06-20T13:31:56.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.735+0000 7fe50affd700 1 -- 172.21.15.32:0/834475394 learned_addr learned my addr 172.21.15.32:0/834475394 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:31:56.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.735+0000 7fe50bfff700 1 --2- 172.21.15.32:0/834475394 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50c0d29b0 0x7fe50c0d2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:56.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.735+0000 7fe50b7fe700 1 --2- 172.21.15.32:0/834475394 >> v2:172.21.15.115:3300/0 conn(0x7fe50c15fe00 0x7fe50c0cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:56.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.736+0000 7fe50affd700 1 -- 172.21.15.32:0/834475394 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50c0d29b0 msgr2=0x7fe50c0d2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:31:56.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.736+0000 7fe50affd700 1 --2- 172.21.15.32:0/834475394 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50c0d29b0 0x7fe50c0d2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:56.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.736+0000 7fe50affd700 1 -- 172.21.15.32:0/834475394 >> v2:172.21.15.115:3300/0 conn(0x7fe50c15fe00 msgr2=0x7fe50c0cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:31:56.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.736+0000 7fe50affd700 1 --2- 172.21.15.32:0/834475394 >> v2:172.21.15.115:3300/0 conn(0x7fe50c15fe00 0x7fe50c0cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:56.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.736+0000 7fe50affd700 1 -- 172.21.15.32:0/834475394 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50c0d0940 con 0x7fe50c1601d0 2023-06-20T13:31:56.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.736+0000 7fe50affd700 1 --2- 172.21.15.32:0/834475394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe50c1601d0 0x7fe50c160620 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe50c08bdb0 tx=0x7fe500009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97bae9f481e91ff server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:31:56.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.736+0000 7fe50a7fc700 1 -- 172.21.15.32:0/834475394 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe500011830 con 0x7fe50c1601d0 2023-06-20T13:31:56.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.736+0000 7fe50a7fc700 1 -- 172.21.15.32:0/834475394 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe500011990 con 0x7fe50c1601d0 2023-06-20T13:31:56.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.736+0000 7fe50a7fc700 1 -- 172.21.15.32:0/834475394 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe500011d20 con 0x7fe50c1601d0 2023-06-20T13:31:56.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.737+0000 7fe5121ff700 1 -- 172.21.15.32:0/834475394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe50c1601d0 msgr2=0x7fe50c160620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:56.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.737+0000 7fe5121ff700 1 --2- 172.21.15.32:0/834475394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe50c1601d0 0x7fe50c160620 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe50c08bdb0 tx=0x7fe500009bd0 comp rx=0 tx=0).stop 2023-06-20T13:31:56.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.737+0000 7fe5121ff700 1 -- 172.21.15.32:0/834475394 shutdown_connections 2023-06-20T13:31:56.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.737+0000 7fe5121ff700 1 --2- 172.21.15.32:0/834475394 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50c0d29b0 0x7fe50c0d2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:56.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.737+0000 7fe5121ff700 1 --2- 172.21.15.32:0/834475394 >> v2:172.21.15.115:3300/0 conn(0x7fe50c15fe00 0x7fe50c0cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:56.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.737+0000 7fe5121ff700 1 --2- 172.21.15.32:0/834475394 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe50c1601d0 0x7fe50c160620 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:56.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.737+0000 7fe5121ff700 1 -- 172.21.15.32:0/834475394 >> 172.21.15.32:0/834475394 conn(0x7fe50c071660 msgr2=0x7fe50c071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:31:56.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.737+0000 7fe5121ff700 1 -- 172.21.15.32:0/834475394 shutdown_connections 2023-06-20T13:31:56.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.737+0000 7fe5121ff700 1 -- 172.21.15.32:0/834475394 wait complete. 2023-06-20T13:31:56.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.739+0000 7fe5121ff700 1 Processor -- start 2023-06-20T13:31:56.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.739+0000 7fe5121ff700 1 -- start start 2023-06-20T13:31:56.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.740+0000 7fe5121ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe50c0d29b0 0x7fe50c148510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:56.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.740+0000 7fe5121ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe50c15fe00 0x7fe50c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:56.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.740+0000 7fe5121ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50c1601d0 0x7fe50c15b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:56.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.740+0000 7fe5121ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c0cb070 con 0x7fe50c0d29b0 2023-06-20T13:31:56.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.740+0000 7fe5121ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c0cb200 con 0x7fe50c15fe00 2023-06-20T13:31:56.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.740+0000 7fe5121ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c148a50 con 0x7fe50c1601d0 2023-06-20T13:31:56.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.740+0000 7fe50b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe50c0d29b0 0x7fe50c148510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:56.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.740+0000 7fe50b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe50c0d29b0 0x7fe50c148510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55360/0 (socket says 172.21.15.32:55360) 2023-06-20T13:31:56.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.740+0000 7fe50b7fe700 1 -- 172.21.15.32:0/2476495392 learned_addr learned my addr 172.21.15.32:0/2476495392 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:31:56.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.740+0000 7fe50affd700 1 --2- 172.21.15.32:0/2476495392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe50c15fe00 0x7fe50c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:56.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.740+0000 7fe50bfff700 1 --2- 172.21.15.32:0/2476495392 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50c1601d0 0x7fe50c15b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:56.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.741+0000 7fe50b7fe700 1 -- 172.21.15.32:0/2476495392 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50c1601d0 msgr2=0x7fe50c15b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:56.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.741+0000 7fe50b7fe700 1 --2- 172.21.15.32:0/2476495392 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50c1601d0 0x7fe50c15b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:56.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.741+0000 7fe50b7fe700 1 -- 172.21.15.32:0/2476495392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe50c15fe00 msgr2=0x7fe50c15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:56.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.741+0000 7fe50b7fe700 1 --2- 172.21.15.32:0/2476495392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe50c15fe00 0x7fe50c15d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:56.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.741+0000 7fe50b7fe700 1 -- 172.21.15.32:0/2476495392 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe500009550 con 0x7fe50c0d29b0 2023-06-20T13:31:56.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.741+0000 7fe50bfff700 1 --2- 172.21.15.32:0/2476495392 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50c1601d0 0x7fe50c15b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:31:56.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.741+0000 7fe50b7fe700 1 --2- 172.21.15.32:0/2476495392 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe50c0d29b0 0x7fe50c148510 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc00e870 tx=0x7fe4fc00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:31:56.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.741+0000 7fe4f3fff700 1 -- 172.21.15.32:0/2476495392 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc009590 con 0x7fe50c0d29b0 2023-06-20T13:31:56.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.741+0000 7fe4f3fff700 1 -- 172.21.15.32:0/2476495392 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4fc013680 con 0x7fe50c0d29b0 2023-06-20T13:31:56.748 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.741+0000 7fe4f3fff700 1 -- 172.21.15.32:0/2476495392 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc0139f0 con 0x7fe50c0d29b0 2023-06-20T13:31:56.748 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.741+0000 7fe5121ff700 1 -- 172.21.15.32:0/2476495392 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe50c15e310 con 0x7fe50c0d29b0 2023-06-20T13:31:56.748 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.742+0000 7fe5121ff700 1 -- 172.21.15.32:0/2476495392 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe50c15e8d0 con 0x7fe50c0d29b0 2023-06-20T13:31:56.748 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.742+0000 7fe4f3fff700 1 -- 172.21.15.32:0/2476495392 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe4fc01c450 con 0x7fe50c0d29b0 2023-06-20T13:31:56.748 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.742+0000 7fe4f3fff700 1 -- 172.21.15.32:0/2476495392 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fe4fc01cdd0 con 0x7fe50c0d29b0 2023-06-20T13:31:56.748 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.743+0000 7fe5121ff700 1 -- 172.21.15.32:0/2476495392 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe50c04ea60 con 0x7fe50c0d29b0 2023-06-20T13:31:56.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.745+0000 7fe4f3fff700 1 -- 172.21.15.32:0/2476495392 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fe4fc021060 con 0x7fe50c0d29b0 2023-06-20T13:31:56.768 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-06-20T13:31:56.767+0000 7f36df876200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-20T13:31:56.769 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-06-20T13:31:56.767+0000 7fef46bc5200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-20T13:31:56.821 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.819+0000 7fe5121ff700 1 -- 172.21.15.32:0/2476495392 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe50c0c6380 con 0x7fe50c0d29b0 2023-06-20T13:31:56.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.820+0000 7fe4f3fff700 1 -- 172.21.15.32:0/2476495392 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fe4fc02a090 con 0x7fe50c0d29b0 2023-06-20T13:31:56.822 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:31:56.822 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":10,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:31:56.391375+0000","last_up_change":"0.000000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:31:56.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.821+0000 7fe5121ff700 1 -- 172.21.15.32:0/2476495392 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe50c0d29b0 msgr2=0x7fe50c148510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:56.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.821+0000 7fe5121ff700 1 --2- 172.21.15.32:0/2476495392 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe50c0d29b0 0x7fe50c148510 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc00e870 tx=0x7fe4fc00eb80 comp rx=0 tx=0).stop 2023-06-20T13:31:56.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.821+0000 7fe5121ff700 1 -- 172.21.15.32:0/2476495392 shutdown_connections 2023-06-20T13:31:56.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.821+0000 7fe5121ff700 1 --2- 172.21.15.32:0/2476495392 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50c1601d0 0x7fe50c15b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:56.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.821+0000 7fe5121ff700 1 --2- 172.21.15.32:0/2476495392 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe50c0d29b0 0x7fe50c148510 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:56.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.821+0000 7fe5121ff700 1 --2- 172.21.15.32:0/2476495392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe50c15fe00 0x7fe50c15d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:56.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.821+0000 7fe5121ff700 1 -- 172.21.15.32:0/2476495392 >> 172.21.15.32:0/2476495392 conn(0x7fe50c071660 msgr2=0x7fe50c0d2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:31:56.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.821+0000 7fe5121ff700 1 -- 172.21.15.32:0/2476495392 shutdown_connections 2023-06-20T13:31:56.825 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:31:56.821+0000 7fe5121ff700 1 -- 172.21.15.32:0/2476495392 wait complete. 2023-06-20T13:31:56.841 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-06-20T13:31:56.842 INFO:tasks.ceph:Waiting for OSDs to come up 2023-06-20T13:31:56.878 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-06-20T13:31:56.876+0000 7f36df876200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-20T13:31:57.105 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-06-20T13:31:57.103+0000 7f36df876200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-20T13:31:57.126 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-06-20T13:31:57.125+0000 7f859f535640 -1 Falling back to public interface 2023-06-20T13:31:57.152 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-06-20T13:31:57.150+0000 7f35ee5f0640 -1 Falling back to public interface 2023-06-20T13:31:57.158 INFO:tasks.ceph.osd.0.smithi032.stderr:2023-06-20T13:31:57.156+0000 7f7fab786640 -1 Falling back to public interface 2023-06-20T13:31:57.160 INFO:tasks.ceph.osd.2.smithi032.stderr:2023-06-20T13:31:57.156+0000 7f9cddeae640 -1 Falling back to public interface 2023-06-20T13:31:57.160 INFO:tasks.ceph.osd.2.smithi032.stderr:2023-06-20T13:31:57.156+0000 7f9ccfdfd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2023-06-20T13:31:57.160 INFO:tasks.ceph.osd.2.smithi032.stderr:2023-06-20T13:31:57.156+0000 7f9ccfdfd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2023-06-20T13:31:57.164 INFO:tasks.ceph.osd.3.smithi032.stderr:2023-06-20T13:31:57.161+0000 7f596bd91640 -1 Falling back to public interface 2023-06-20T13:31:57.172 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-06-20T13:31:57.168+0000 7f21b8236640 -1 Falling back to public interface 2023-06-20T13:31:57.174 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-06-20T13:31:57.173+0000 7f0ed4eb7640 -1 Falling back to public interface 2023-06-20T13:31:57.175 INFO:tasks.ceph.osd.1.smithi032.stderr:2023-06-20T13:31:57.173+0000 7fe6ab902640 -1 Falling back to public interface 2023-06-20T13:31:57.214 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-06-20T13:31:57.213+0000 7f36df876200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-20T13:31:57.426 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-06-20T13:31:57.424+0000 7fef46bc5200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-20T13:31:57.566 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-06-20T13:31:57.564+0000 7f36df876200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-20T13:31:57.647 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-20T13:31:57.656 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-06-20T13:31:57.654+0000 7f36df876200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-20T13:31:57.821 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-06-20T13:31:57.819+0000 7fef46bc5200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-20T13:31:57.829 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.827+0000 7f25e5fff700 1 Processor -- start 2023-06-20T13:31:57.829 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.827+0000 7f25e5fff700 1 -- start start 2023-06-20T13:31:57.830 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.828+0000 7f25e5fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f25e00d3200 0x7f25e00d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:57.830 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.828+0000 7f25e5fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f25e00d1290 0x7f25e00b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:57.830 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.828+0000 7f25e5fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e00cd570 con 0x7f25e00d0980 2023-06-20T13:31:57.830 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.828+0000 7f25e5fff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e00b4fd0 con 0x7f25e00d1290 2023-06-20T13:31:57.831 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.828+0000 7f25e5fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e00d2720 con 0x7f25e00d3200 2023-06-20T13:31:57.833 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.828+0000 7f25dffff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f25e00d1290 0x7f25e00b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:57.833 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.828+0000 7f25deffd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f25e00d3200 0x7f25e00d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:57.833 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.828+0000 7f25dffff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f25e00d1290 0x7f25e00b5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55362/0 (socket says 172.21.15.32:55362) 2023-06-20T13:31:57.833 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.828+0000 7f25dffff700 1 -- 172.21.15.32:0/2022063488 learned_addr learned my addr 172.21.15.32:0/2022063488 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:31:57.833 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.829+0000 7f25dffff700 1 -- 172.21.15.32:0/2022063488 >> v2:172.21.15.115:3300/0 conn(0x7f25e00d3200 msgr2=0x7f25e00d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:31:57.833 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.829+0000 7f25dffff700 1 --2- 172.21.15.32:0/2022063488 >> v2:172.21.15.115:3300/0 conn(0x7f25e00d3200 0x7f25e00d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:57.833 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.829+0000 7f25dffff700 1 -- 172.21.15.32:0/2022063488 >> v1:172.21.15.115:6789/0 conn(0x7f25e00d0980 legacy=0x7f25e00cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:57.834 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.829+0000 7f25dffff700 1 -- 172.21.15.32:0/2022063488 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e00d2a00 con 0x7f25e00d1290 2023-06-20T13:31:57.834 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.829+0000 7f25dffff700 1 --2- 172.21.15.32:0/2022063488 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25e00d1290 0x7f25e00b5990 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f25e00d06c0 tx=0x7f25d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a1ef367238c59e server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:31:57.834 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.829+0000 7f25de7fc700 1 -- 172.21.15.32:0/2022063488 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d800e070 con 0x7f25e00d1290 2023-06-20T13:31:57.834 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.829+0000 7f25de7fc700 1 -- 172.21.15.32:0/2022063488 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d800b910 con 0x7f25e00d1290 2023-06-20T13:31:57.834 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.829+0000 7f25de7fc700 1 -- 172.21.15.32:0/2022063488 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d800bcc0 con 0x7f25e00d1290 2023-06-20T13:31:57.834 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.830+0000 7f25e5fff700 1 -- 172.21.15.32:0/2022063488 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25e00d1290 msgr2=0x7f25e00b5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:57.834 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.830+0000 7f25e5fff700 1 --2- 172.21.15.32:0/2022063488 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25e00d1290 0x7f25e00b5990 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f25e00d06c0 tx=0x7f25d800b330 comp rx=0 tx=0).stop 2023-06-20T13:31:57.835 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.830+0000 7f25e5fff700 1 -- 172.21.15.32:0/2022063488 shutdown_connections 2023-06-20T13:31:57.835 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.830+0000 7f25e5fff700 1 --2- 172.21.15.32:0/2022063488 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25e00d1290 0x7f25e00b5990 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:57.835 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.830+0000 7f25e5fff700 1 --2- 172.21.15.32:0/2022063488 >> v2:172.21.15.115:3300/0 conn(0x7f25e00d3200 0x7f25e00d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:57.835 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.830+0000 7f25e5fff700 1 -- 172.21.15.32:0/2022063488 >> 172.21.15.32:0/2022063488 conn(0x7f25e006b3f0 msgr2=0x7f25e006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:31:57.835 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.830+0000 7f25e5fff700 1 -- 172.21.15.32:0/2022063488 shutdown_connections 2023-06-20T13:31:57.835 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.830+0000 7f25e5fff700 1 -- 172.21.15.32:0/2022063488 wait complete. 2023-06-20T13:31:57.837 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.832+0000 7f25e5fff700 1 Processor -- start 2023-06-20T13:31:57.837 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.832+0000 7f25e5fff700 1 -- start start 2023-06-20T13:31:57.837 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.833+0000 7f25e5fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25e00d0980 0x7f25e01f53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:57.838 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.833+0000 7f25e5fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25e00d1290 0x7f25e0156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:57.838 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.833+0000 7f25e5fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25e00d3200 0x7f25e00cc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:31:57.838 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.833+0000 7f25e5fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e01f1ec0 con 0x7f25e00d0980 2023-06-20T13:31:57.838 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.833+0000 7f25e5fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e01f59d0 con 0x7f25e00d1290 2023-06-20T13:31:57.838 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.833+0000 7f25e5fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e01f5cb0 con 0x7f25e00d3200 2023-06-20T13:31:57.838 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.833+0000 7f25df7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25e00d0980 0x7f25e01f53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:57.838 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.833+0000 7f25df7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25e00d0980 0x7f25e01f53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:55372/0 (socket says 172.21.15.32:55372) 2023-06-20T13:31:57.839 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.833+0000 7f25df7fe700 1 -- 172.21.15.32:0/3802287718 learned_addr learned my addr 172.21.15.32:0/3802287718 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:31:57.839 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.833+0000 7f25deffd700 1 --2- 172.21.15.32:0/3802287718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25e00d1290 0x7f25e0156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:57.839 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.833+0000 7f25dffff700 1 --2- 172.21.15.32:0/3802287718 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25e00d3200 0x7f25e00cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:31:57.839 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.834+0000 7f25df7fe700 1 -- 172.21.15.32:0/3802287718 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25e00d3200 msgr2=0x7f25e00cc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:57.839 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.834+0000 7f25df7fe700 1 --2- 172.21.15.32:0/3802287718 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25e00d3200 0x7f25e00cc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:57.839 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.834+0000 7f25df7fe700 1 -- 172.21.15.32:0/3802287718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25e00d1290 msgr2=0x7f25e0156cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:57.839 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.834+0000 7f25df7fe700 1 --2- 172.21.15.32:0/3802287718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25e00d1290 0x7f25e0156cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:57.840 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.834+0000 7f25df7fe700 1 -- 172.21.15.32:0/3802287718 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d8009b30 con 0x7f25e00d0980 2023-06-20T13:31:57.840 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.834+0000 7f25df7fe700 1 --2- 172.21.15.32:0/3802287718 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25e00d0980 0x7f25e01f53a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f25d000c450 tx=0x7f25d000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:31:57.840 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.834+0000 7f25c7fff700 1 -- 172.21.15.32:0/3802287718 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d00052d0 con 0x7f25e00d0980 2023-06-20T13:31:57.840 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.834+0000 7f25c7fff700 1 -- 172.21.15.32:0/3802287718 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d0005430 con 0x7f25e00d0980 2023-06-20T13:31:57.840 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.834+0000 7f25e5fff700 1 -- 172.21.15.32:0/3802287718 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e01f5f90 con 0x7f25e00d0980 2023-06-20T13:31:57.840 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.834+0000 7f25c7fff700 1 -- 172.21.15.32:0/3802287718 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d00038c0 con 0x7f25e00d0980 2023-06-20T13:31:57.840 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.834+0000 7f25e5fff700 1 -- 172.21.15.32:0/3802287718 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e0157230 con 0x7f25e00d0980 2023-06-20T13:31:57.841 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.834+0000 7f25c7fff700 1 -- 172.21.15.32:0/3802287718 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f25d0003d20 con 0x7f25e00d0980 2023-06-20T13:31:57.841 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.835+0000 7f25c7fff700 1 -- 172.21.15.32:0/3802287718 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f25d0011cc0 con 0x7f25e00d0980 2023-06-20T13:31:57.841 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.835+0000 7f25e5fff700 1 -- 172.21.15.32:0/3802287718 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e00d24f0 con 0x7f25e00d0980 2023-06-20T13:31:57.842 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.840+0000 7f25c7fff700 1 -- 172.21.15.32:0/3802287718 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f25d0017070 con 0x7f25e00d0980 2023-06-20T13:31:57.915 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.913+0000 7f25e5fff700 1 -- 172.21.15.32:0/3802287718 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25e01f2090 con 0x7f25e00d0980 2023-06-20T13:31:57.916 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.914+0000 7f25c7fff700 1 -- 172.21.15.32:0/3802287718 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f25d0011590 con 0x7f25e00d0980 2023-06-20T13:31:57.916 INFO:teuthology.misc.health.smithi032.stdout: 2023-06-20T13:31:57.917 INFO:teuthology.misc.health.smithi032.stdout:{"epoch":10,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:31:56.391375+0000","last_up_change":"0.000000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:31:57.918 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.915+0000 7f25e5fff700 1 -- 172.21.15.32:0/3802287718 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25e00d0980 msgr2=0x7f25e01f53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:31:57.918 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.915+0000 7f25e5fff700 1 --2- 172.21.15.32:0/3802287718 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25e00d0980 0x7f25e01f53a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f25d000c450 tx=0x7f25d000c760 comp rx=0 tx=0).stop 2023-06-20T13:31:57.918 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.915+0000 7f25e5fff700 1 -- 172.21.15.32:0/3802287718 shutdown_connections 2023-06-20T13:31:57.918 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.915+0000 7f25e5fff700 1 --2- 172.21.15.32:0/3802287718 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f25e00d3200 0x7f25e00cc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:57.918 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.915+0000 7f25e5fff700 1 --2- 172.21.15.32:0/3802287718 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f25e00d0980 0x7f25e01f53a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:57.918 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.915+0000 7f25e5fff700 1 --2- 172.21.15.32:0/3802287718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25e00d1290 0x7f25e0156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:31:57.919 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.915+0000 7f25e5fff700 1 -- 172.21.15.32:0/3802287718 >> 172.21.15.32:0/3802287718 conn(0x7f25e006b3f0 msgr2=0x7f25e00b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:31:57.919 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.915+0000 7f25e5fff700 1 -- 172.21.15.32:0/3802287718 shutdown_connections 2023-06-20T13:31:57.919 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:31:57.915+0000 7f25e5fff700 1 -- 172.21.15.32:0/3802287718 wait complete. 2023-06-20T13:31:57.932 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-06-20T13:31:58.015 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-06-20T13:31:58.013+0000 7fef46bc5200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-20T13:31:58.284 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-06-20T13:31:58.282+0000 7f36df876200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-20T13:31:58.476 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-06-20T13:31:58.473+0000 7fef46bc5200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-20T13:31:58.664 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-06-20T13:31:58.662+0000 7f36df876200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-20T13:31:58.666 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-06-20T13:31:58.664+0000 7fef46bc5200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-20T13:31:58.847 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-06-20T13:31:58.845+0000 7f36df876200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-20T13:31:58.865 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-06-20T13:31:58.863+0000 7fef46bc5200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-20T13:31:59.239 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-06-20T13:31:59.237+0000 7fef46bc5200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-20T13:31:59.299 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-06-20T13:31:59.297+0000 7f36df876200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-20T13:31:59.485 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-06-20T13:31:59.483+0000 7f36df876200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-20T13:31:59.693 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-06-20T13:31:59.691+0000 7f36df876200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-20T13:32:00.085 INFO:tasks.ceph.mgr.x.smithi115.stderr:2023-06-20T13:32:00.083+0000 7f36df876200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-20T13:32:00.258 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-06-20T13:32:00.257+0000 7fef005fa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-06-20T13:32:00.259 INFO:tasks.ceph.mgr.y.smithi032.stderr:2023-06-20T13:32:00.257+0000 7fef005fa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-06-20T13:32:00.679 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-06-20T13:32:00.677+0000 7f859f535640 -1 osd.4 0 log_to_monitors true 2023-06-20T13:32:00.714 INFO:tasks.ceph.osd.2.smithi032.stderr:2023-06-20T13:32:00.713+0000 7f9cddeae640 -1 osd.2 0 log_to_monitors true 2023-06-20T13:32:00.738 INFO:tasks.ceph.osd.3.smithi032.stderr:2023-06-20T13:32:00.737+0000 7f596bd91640 -1 osd.3 0 log_to_monitors true 2023-06-20T13:32:00.742 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-06-20T13:32:00.741+0000 7f0ed4eb7640 -1 osd.7 0 log_to_monitors true 2023-06-20T13:32:00.933 INFO:tasks.ceph.osd.0.smithi032.stderr:2023-06-20T13:32:00.932+0000 7f7fab786640 -1 osd.0 0 log_to_monitors true 2023-06-20T13:32:00.944 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-06-20T13:32:00.943+0000 7f35ee5f0640 -1 osd.6 0 log_to_monitors true 2023-06-20T13:32:00.986 INFO:tasks.ceph.osd.1.smithi032.stderr:2023-06-20T13:32:00.985+0000 7fe6ab902640 -1 osd.1 0 log_to_monitors true 2023-06-20T13:32:00.995 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-06-20T13:32:00.994+0000 7f21b8236640 -1 osd.5 0 log_to_monitors true 2023-06-20T13:32:03.692 INFO:tasks.ceph.osd.2.smithi032.stderr:2023-06-20T13:32:03.691+0000 7f9cccdf7700 -1 osd.2 0 waiting for initial osdmap 2023-06-20T13:32:03.710 INFO:tasks.ceph.osd.2.smithi032.stderr:2023-06-20T13:32:03.709+0000 7f9cc45fa700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-20T13:32:03.716 INFO:tasks.ceph.osd.1.smithi032.stderr:2023-06-20T13:32:03.715+0000 7fe69a7f7700 -1 osd.1 0 waiting for initial osdmap 2023-06-20T13:32:03.736 INFO:tasks.ceph.osd.3.smithi032.stderr:2023-06-20T13:32:03.735+0000 7f595abf7700 -1 osd.3 0 waiting for initial osdmap 2023-06-20T13:32:03.737 INFO:tasks.ceph.osd.1.smithi032.stderr:2023-06-20T13:32:03.736+0000 7fe691ffa700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-20T13:32:03.753 INFO:tasks.ceph.osd.3.smithi032.stderr:2023-06-20T13:32:03.752+0000 7f59523fa700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-20T13:32:04.165 INFO:tasks.ceph.osd.0.smithi032.stderr:2023-06-20T13:32:04.164+0000 7f7f9adf8700 -1 osd.0 0 waiting for initial osdmap 2023-06-20T13:32:04.178 INFO:tasks.ceph.osd.0.smithi032.stderr:2023-06-20T13:32:04.177+0000 7f7f91dfa700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-20T13:32:04.510 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-06-20T13:32:04.508+0000 7f858e3f7700 -1 osd.4 0 waiting for initial osdmap 2023-06-20T13:32:04.511 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-06-20T13:32:04.507+0000 7f35dd3f7700 -1 osd.6 0 waiting for initial osdmap 2023-06-20T13:32:04.519 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-06-20T13:32:04.514+0000 7f21a71f7700 -1 osd.5 0 waiting for initial osdmap 2023-06-20T13:32:04.528 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-06-20T13:32:04.527+0000 7f35d4bfa700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-20T13:32:04.532 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-06-20T13:32:04.531+0000 7f219e9fa700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-20T13:32:04.533 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-06-20T13:32:04.532+0000 7f8585bfa700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-20T13:32:04.739 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-20T13:32:04.778 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-06-20T13:32:04.776+0000 7f0ec3df7700 -1 osd.7 0 waiting for initial osdmap 2023-06-20T13:32:04.793 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-06-20T13:32:04.791+0000 7f0ebb5fa700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-20T13:32:04.919 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.916+0000 7f30c43ff700 1 Processor -- start 2023-06-20T13:32:04.919 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.917+0000 7f30c43ff700 1 -- start start 2023-06-20T13:32:04.920 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.918+0000 7f30c43ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f30bc0d3200 0x7f30bc0d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:04.920 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.918+0000 7f30c43ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30bc0d1290 0x7f30bc0b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:04.921 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.918+0000 7f30c43ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30bc0cd570 con 0x7f30bc0d0980 2023-06-20T13:32:04.921 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.918+0000 7f30c43ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30bc0b4fd0 con 0x7f30bc0d3200 2023-06-20T13:32:04.921 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.918+0000 7f30c43ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc0d2720 con 0x7f30bc0d1290 2023-06-20T13:32:04.921 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.918+0000 7f30c199a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f30bc0d3200 0x7f30bc0d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:04.921 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.918+0000 7f30c199a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f30bc0d3200 0x7f30bc0d0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52904/0 (socket says 172.21.15.32:52904) 2023-06-20T13:32:04.921 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.918+0000 7f30c199a700 1 -- 172.21.15.32:0/2769788499 learned_addr learned my addr 172.21.15.32:0/2769788499 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:04.921 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.918+0000 7f30c299c700 1 --2- 172.21.15.32:0/2769788499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30bc0d1290 0x7f30bc0b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:04.922 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.918+0000 7f30c199a700 1 -- 172.21.15.32:0/2769788499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30bc0d1290 msgr2=0x7f30bc0b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:04.922 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.918+0000 7f30c199a700 1 --2- 172.21.15.32:0/2769788499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30bc0d1290 0x7f30bc0b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:04.922 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.918+0000 7f30c199a700 1 -- 172.21.15.32:0/2769788499 >> v1:172.21.15.115:6789/0 conn(0x7f30bc0d0980 legacy=0x7f30bc0cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:04.922 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.918+0000 7f30c199a700 1 -- 172.21.15.32:0/2769788499 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30bc0d2a00 con 0x7f30bc0d3200 2023-06-20T13:32:04.922 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.918+0000 7f30c299c700 1 --2- 172.21.15.32:0/2769788499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30bc0d1290 0x7f30bc0b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:32:04.923 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.919+0000 7f30c199a700 1 --2- 172.21.15.32:0/2769788499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30bc0d3200 0x7f30bc0d0d50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f30ac0098f0 tx=0x7f30ac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef67c9c3507a058 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:04.923 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.919+0000 7f30c1199700 1 -- 172.21.15.32:0/2769788499 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac00b8a0 con 0x7f30bc0d3200 2023-06-20T13:32:04.924 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.919+0000 7f30c1199700 1 -- 172.21.15.32:0/2769788499 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ac00ba00 con 0x7f30bc0d3200 2023-06-20T13:32:04.924 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.919+0000 7f30c1199700 1 -- 172.21.15.32:0/2769788499 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac00bd90 con 0x7f30bc0d3200 2023-06-20T13:32:04.924 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.919+0000 7f30c43ff700 1 -- 172.21.15.32:0/2769788499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30bc0d3200 msgr2=0x7f30bc0d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:04.924 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.919+0000 7f30c43ff700 1 --2- 172.21.15.32:0/2769788499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30bc0d3200 0x7f30bc0d0d50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f30ac0098f0 tx=0x7f30ac009c00 comp rx=0 tx=0).stop 2023-06-20T13:32:04.924 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.919+0000 7f30c43ff700 1 -- 172.21.15.32:0/2769788499 shutdown_connections 2023-06-20T13:32:04.924 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.919+0000 7f30c43ff700 1 --2- 172.21.15.32:0/2769788499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30bc0d1290 0x7f30bc0b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:04.924 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.919+0000 7f30c43ff700 1 --2- 172.21.15.32:0/2769788499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30bc0d3200 0x7f30bc0d0d50 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:04.925 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.919+0000 7f30c43ff700 1 -- 172.21.15.32:0/2769788499 >> 172.21.15.32:0/2769788499 conn(0x7f30bc06b3f0 msgr2=0x7f30bc06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:04.925 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.919+0000 7f30c43ff700 1 -- 172.21.15.32:0/2769788499 shutdown_connections 2023-06-20T13:32:04.925 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.920+0000 7f30c43ff700 1 -- 172.21.15.32:0/2769788499 wait complete. 2023-06-20T13:32:04.925 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.921+0000 7f30c43ff700 1 Processor -- start 2023-06-20T13:32:04.925 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.921+0000 7f30c43ff700 1 -- start start 2023-06-20T13:32:04.926 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.922+0000 7f30c43ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30bc0d0980 0x7f30bc1e7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:04.927 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.922+0000 7f30c43ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30bc0d1290 0x7f30bc0c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:04.927 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.922+0000 7f30c43ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30bc0d3200 0x7f30bc0c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:04.927 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.922+0000 7f30c43ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc0c9a70 con 0x7f30bc0d1290 2023-06-20T13:32:04.927 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.922+0000 7f30c43ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc147cb0 con 0x7f30bc0d0980 2023-06-20T13:32:04.927 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.922+0000 7f30c43ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc1e4d90 con 0x7f30bc0d3200 2023-06-20T13:32:04.927 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.923+0000 7f30c199a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30bc0d1290 0x7f30bc0c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:04.927 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.923+0000 7f30c199a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30bc0d1290 0x7f30bc0c8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:52906/0 (socket says 172.21.15.32:52906) 2023-06-20T13:32:04.928 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.923+0000 7f30c199a700 1 -- 172.21.15.32:0/4004869393 learned_addr learned my addr 172.21.15.32:0/4004869393 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:04.928 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.923+0000 7f30c219b700 1 --2- 172.21.15.32:0/4004869393 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30bc0d0980 0x7f30bc1e7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:04.928 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.923+0000 7f30c299c700 1 --2- 172.21.15.32:0/4004869393 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30bc0d3200 0x7f30bc0c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:04.928 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.923+0000 7f30c199a700 1 -- 172.21.15.32:0/4004869393 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30bc0d3200 msgr2=0x7f30bc0c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:04.928 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.923+0000 7f30c199a700 1 --2- 172.21.15.32:0/4004869393 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30bc0d3200 0x7f30bc0c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:04.928 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.923+0000 7f30c199a700 1 -- 172.21.15.32:0/4004869393 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30bc0d0980 msgr2=0x7f30bc1e7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:04.928 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.923+0000 7f30c199a700 1 --2- 172.21.15.32:0/4004869393 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30bc0d0980 0x7f30bc1e7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:04.929 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.923+0000 7f30c199a700 1 -- 172.21.15.32:0/4004869393 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ac009550 con 0x7f30bc0d1290 2023-06-20T13:32:04.929 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.923+0000 7f30c199a700 1 --2- 172.21.15.32:0/4004869393 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30bc0d1290 0x7f30bc0c8ff0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f30ac014040 tx=0x7f30ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:04.929 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.923+0000 7f30b2ffd700 1 -- 172.21.15.32:0/4004869393 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac004300 con 0x7f30bc0d1290 2023-06-20T13:32:04.929 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.923+0000 7f30b2ffd700 1 -- 172.21.15.32:0/4004869393 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ac01f070 con 0x7f30bc0d1290 2023-06-20T13:32:04.929 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.924+0000 7f30c43ff700 1 -- 172.21.15.32:0/4004869393 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30bc15e580 con 0x7f30bc0d1290 2023-06-20T13:32:04.929 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.924+0000 7f30b2ffd700 1 -- 172.21.15.32:0/4004869393 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac0036a0 con 0x7f30bc0d1290 2023-06-20T13:32:04.929 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.924+0000 7f30c43ff700 1 -- 172.21.15.32:0/4004869393 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30bc1481e0 con 0x7f30bc0d1290 2023-06-20T13:32:04.929 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.924+0000 7f30c43ff700 1 -- 172.21.15.32:0/4004869393 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30bc073970 con 0x7f30bc0d1290 2023-06-20T13:32:04.930 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.926+0000 7f30b2ffd700 1 -- 172.21.15.32:0/4004869393 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f30ac021030 con 0x7f30bc0d1290 2023-06-20T13:32:04.930 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.926+0000 7f30b2ffd700 1 --2- 172.21.15.32:0/4004869393 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f30a006ac50 0x7f30a006d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:04.930 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.927+0000 7f30b2ffd700 1 -- 172.21.15.32:0/4004869393 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3351+0+0 (secure 0 0 0) 0x7f30ac089c10 con 0x7f30bc0d1290 2023-06-20T13:32:04.931 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.927+0000 7f30c219b700 1 --2- 172.21.15.32:0/4004869393 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f30a006ac50 0x7f30a006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:04.931 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.927+0000 7f30c219b700 1 --2- 172.21.15.32:0/4004869393 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f30a006ac50 0x7f30a006d100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f30b8007fd0 tx=0x7f30b8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:04.933 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:04.931+0000 7f30b2ffd700 1 -- 172.21.15.32:0/4004869393 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f30ac055820 con 0x7f30bc0d1290 2023-06-20T13:32:05.142 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:05.140+0000 7f30c43ff700 1 -- 172.21.15.32:0/4004869393 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30bc0b8a30 con 0x7f30bc0d1290 2023-06-20T13:32:05.143 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:05.141+0000 7f30b2ffd700 1 -- 172.21.15.32:0/4004869393 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+8964 (secure 0 0 0) 0x7f30ac058e40 con 0x7f30bc0d1290 2023-06-20T13:32:05.143 INFO:teuthology.misc.health.smithi032.stdout: 2023-06-20T13:32:05.143 INFO:teuthology.misc.health.smithi032.stdout:{"epoch":13,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:32:04.396683+0000","last_up_change":"2023-06-20T13:32:04.396683+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:32:05.145 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:05.143+0000 7f30c43ff700 1 -- 172.21.15.32:0/4004869393 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f30a006ac50 msgr2=0x7f30a006d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:05.146 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:05.143+0000 7f30c43ff700 1 --2- 172.21.15.32:0/4004869393 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f30a006ac50 0x7f30a006d100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f30b8007fd0 tx=0x7f30b8009040 comp rx=0 tx=0).stop 2023-06-20T13:32:05.146 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:05.143+0000 7f30c43ff700 1 -- 172.21.15.32:0/4004869393 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30bc0d1290 msgr2=0x7f30bc0c8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:05.146 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:05.143+0000 7f30c43ff700 1 --2- 172.21.15.32:0/4004869393 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30bc0d1290 0x7f30bc0c8ff0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f30ac014040 tx=0x7f30ac004750 comp rx=0 tx=0).stop 2023-06-20T13:32:05.146 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:05.143+0000 7f30c43ff700 1 -- 172.21.15.32:0/4004869393 shutdown_connections 2023-06-20T13:32:05.146 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:05.143+0000 7f30c43ff700 1 --2- 172.21.15.32:0/4004869393 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f30a006ac50 0x7f30a006d100 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:05.146 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:05.143+0000 7f30c43ff700 1 --2- 172.21.15.32:0/4004869393 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30bc0d3200 0x7f30bc0c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:05.146 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:05.143+0000 7f30c43ff700 1 --2- 172.21.15.32:0/4004869393 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30bc0d0980 0x7f30bc1e7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:05.146 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:05.143+0000 7f30c43ff700 1 --2- 172.21.15.32:0/4004869393 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f30bc0d1290 0x7f30bc0c8ff0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:05.147 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:05.143+0000 7f30c43ff700 1 -- 172.21.15.32:0/4004869393 >> 172.21.15.32:0/4004869393 conn(0x7f30bc06b3f0 msgr2=0x7f30bc0d1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:05.147 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:05.143+0000 7f30c43ff700 1 -- 172.21.15.32:0/4004869393 shutdown_connections 2023-06-20T13:32:05.147 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:05.143+0000 7f30c43ff700 1 -- 172.21.15.32:0/4004869393 wait complete. 2023-06-20T13:32:05.160 DEBUG:teuthology.misc:4 of 8 OSDs are up 2023-06-20T13:32:08.073 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:32:08.079 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:32:11.966 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-20T13:32:12.155 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.152+0000 7fdd331ff700 1 Processor -- start 2023-06-20T13:32:12.156 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.153+0000 7fdd331ff700 1 -- start start 2023-06-20T13:32:12.159 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.154+0000 7fdd331ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdd2c0d3670 0x7fdd2c0b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:12.159 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.154+0000 7fdd331ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd2c0cd570 con 0x7fdd2c0d0980 2023-06-20T13:32:12.159 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.154+0000 7fdd331ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd2c0d2720 con 0x7fdd2c0d3200 2023-06-20T13:32:12.160 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.154+0000 7fdd331ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd2c0b4fd0 con 0x7fdd2c0d3670 2023-06-20T13:32:12.160 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.154+0000 7fdd30f9b700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fdd2c0d0980 0x7fdd2c0cf8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47316/0 (socket says 172.21.15.32:47316) 2023-06-20T13:32:12.160 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.154+0000 7fdd30f9b700 1 -- 172.21.15.32:0/2784677514 learned_addr learned my addr 172.21.15.32:0/2784677514 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:12.160 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.154+0000 7fdd3179c700 1 --2- 172.21.15.32:0/2784677514 >> v2:172.21.15.32:3300/0 conn(0x7fdd2c0d3670 0x7fdd2c0b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:12.161 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.154+0000 7fdd2b7fe700 1 -- 172.21.15.32:0/2784677514 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1007174980 0 0) 0x7fdd2c0cd570 con 0x7fdd2c0d0980 2023-06-20T13:32:12.161 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.154+0000 7fdd2b7fe700 1 -- 172.21.15.32:0/2784677514 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd1c0035b0 con 0x7fdd2c0d0980 2023-06-20T13:32:12.161 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.155+0000 7fdd3179c700 1 -- 172.21.15.32:0/2784677514 >> v1:172.21.15.115:6789/0 conn(0x7fdd2c0d3200 legacy=0x7fdd2c0d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:12.162 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.155+0000 7fdd3179c700 1 -- 172.21.15.32:0/2784677514 >> v1:172.21.15.32:6789/0 conn(0x7fdd2c0d0980 legacy=0x7fdd2c0cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:12.162 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.155+0000 7fdd3179c700 1 -- 172.21.15.32:0/2784677514 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2c0d2a00 con 0x7fdd2c0d3670 2023-06-20T13:32:12.162 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.155+0000 7fdd3179c700 1 --2- 172.21.15.32:0/2784677514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd2c0d3670 0x7fdd2c0b5990 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdd24009d90 tx=0x7fdd2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92920e561b9088bf server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:12.162 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.155+0000 7fdd2b7fe700 1 -- 172.21.15.32:0/2784677514 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2400e070 con 0x7fdd2c0d3670 2023-06-20T13:32:12.163 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.155+0000 7fdd2b7fe700 1 -- 172.21.15.32:0/2784677514 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2400bae0 con 0x7fdd2c0d3670 2023-06-20T13:32:12.163 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.155+0000 7fdd2b7fe700 1 -- 172.21.15.32:0/2784677514 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2400be90 con 0x7fdd2c0d3670 2023-06-20T13:32:12.163 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.156+0000 7fdd331ff700 1 -- 172.21.15.32:0/2784677514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd2c0d3670 msgr2=0x7fdd2c0b5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:12.163 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.156+0000 7fdd331ff700 1 --2- 172.21.15.32:0/2784677514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd2c0d3670 0x7fdd2c0b5990 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdd24009d90 tx=0x7fdd2400b330 comp rx=0 tx=0).stop 2023-06-20T13:32:12.164 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.156+0000 7fdd331ff700 1 -- 172.21.15.32:0/2784677514 shutdown_connections 2023-06-20T13:32:12.164 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.156+0000 7fdd331ff700 1 --2- 172.21.15.32:0/2784677514 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd2c0d3670 0x7fdd2c0b5990 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:12.164 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.156+0000 7fdd331ff700 1 -- 172.21.15.32:0/2784677514 >> 172.21.15.32:0/2784677514 conn(0x7fdd2c06b3f0 msgr2=0x7fdd2c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:12.164 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.156+0000 7fdd331ff700 1 -- 172.21.15.32:0/2784677514 shutdown_connections 2023-06-20T13:32:12.165 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.156+0000 7fdd331ff700 1 -- 172.21.15.32:0/2784677514 wait complete. 2023-06-20T13:32:12.167 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.157+0000 7fdd331ff700 1 Processor -- start 2023-06-20T13:32:12.167 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.158+0000 7fdd331ff700 1 -- start start 2023-06-20T13:32:12.167 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.159+0000 7fdd331ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd2c0d0980 0x7fdd2c156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:12.168 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.159+0000 7fdd331ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd2c0d3200 0x7fdd2c159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:12.168 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.159+0000 7fdd331ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd2c0d3670 0x7fdd2c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:12.168 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.159+0000 7fdd331ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c158490 con 0x7fdd2c0d3670 2023-06-20T13:32:12.168 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.159+0000 7fdd331ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c159cc0 con 0x7fdd2c0d0980 2023-06-20T13:32:12.168 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.159+0000 7fdd331ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c1586e0 con 0x7fdd2c0d3200 2023-06-20T13:32:12.168 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.159+0000 7fdd3179c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd2c0d3670 0x7fdd2c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:12.169 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.159+0000 7fdd3179c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd2c0d3670 0x7fdd2c0b25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60350/0 (socket says 172.21.15.32:60350) 2023-06-20T13:32:12.169 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.159+0000 7fdd3179c700 1 -- 172.21.15.32:0/2379348069 learned_addr learned my addr 172.21.15.32:0/2379348069 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:12.169 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.159+0000 7fdd3179c700 1 -- 172.21.15.32:0/2379348069 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd2c0d3200 msgr2=0x7fdd2c159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:12.169 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.159+0000 7fdd3179c700 1 --2- 172.21.15.32:0/2379348069 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd2c0d3200 0x7fdd2c159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:12.169 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.159+0000 7fdd3179c700 1 -- 172.21.15.32:0/2379348069 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd2c0d0980 msgr2=0x7fdd2c156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:12.169 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.159+0000 7fdd3179c700 1 --2- 172.21.15.32:0/2379348069 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd2c0d0980 0x7fdd2c156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:12.169 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.159+0000 7fdd3179c700 1 -- 172.21.15.32:0/2379348069 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd24009a70 con 0x7fdd2c0d3670 2023-06-20T13:32:12.169 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.159+0000 7fdd3179c700 1 --2- 172.21.15.32:0/2379348069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd2c0d3670 0x7fdd2c0b25a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c06c040 tx=0x7fdd24004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:12.170 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.160+0000 7fdd297fa700 1 -- 172.21.15.32:0/2379348069 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd24004720 con 0x7fdd2c0d3670 2023-06-20T13:32:12.170 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.160+0000 7fdd297fa700 1 -- 172.21.15.32:0/2379348069 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd240048c0 con 0x7fdd2c0d3670 2023-06-20T13:32:12.170 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.160+0000 7fdd331ff700 1 -- 172.21.15.32:0/2379348069 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd2c1589c0 con 0x7fdd2c0d3670 2023-06-20T13:32:12.170 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.160+0000 7fdd297fa700 1 -- 172.21.15.32:0/2379348069 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd24012670 con 0x7fdd2c0d3670 2023-06-20T13:32:12.170 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.160+0000 7fdd331ff700 1 -- 172.21.15.32:0/2379348069 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd2c158f80 con 0x7fdd2c0d3670 2023-06-20T13:32:12.170 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.161+0000 7fdd331ff700 1 -- 172.21.15.32:0/2379348069 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd2c073970 con 0x7fdd2c0d3670 2023-06-20T13:32:12.170 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.162+0000 7fdd297fa700 1 -- 172.21.15.32:0/2379348069 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdd240127d0 con 0x7fdd2c0d3670 2023-06-20T13:32:12.171 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.164+0000 7fdd297fa700 1 --2- 172.21.15.32:0/2379348069 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdd1006ad10 0x7fdd1006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:12.171 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.164+0000 7fdd297fa700 1 -- 172.21.15.32:0/2379348069 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdd2408b1d0 con 0x7fdd2c0d3670 2023-06-20T13:32:12.172 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.164+0000 7fdd30f9b700 1 --2- 172.21.15.32:0/2379348069 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdd1006ad10 0x7fdd1006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:12.172 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.165+0000 7fdd30f9b700 1 --2- 172.21.15.32:0/2379348069 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdd1006ad10 0x7fdd1006d1c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdd20007fd0 tx=0x7fdd20007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:12.172 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.169+0000 7fdd297fa700 1 -- 172.21.15.32:0/2379348069 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdd2405a1b0 con 0x7fdd2c0d3670 2023-06-20T13:32:12.379 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.377+0000 7fdd331ff700 1 -- 172.21.15.32:0/2379348069 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd2c0ced50 con 0x7fdd2c0d3670 2023-06-20T13:32:12.379 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.377+0000 7fdd297fa700 1 -- 172.21.15.32:0/2379348069 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12826 (secure 0 0 0) 0x7fdd24059d40 con 0x7fdd2c0d3670 2023-06-20T13:32:12.380 INFO:teuthology.misc.health.smithi032.stdout: 2023-06-20T13:32:12.380 INFO:teuthology.misc.health.smithi032.stdout:{"epoch":16,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:32:07.531246+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:32:12.382 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.380+0000 7fdd331ff700 1 -- 172.21.15.32:0/2379348069 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdd1006ad10 msgr2=0x7fdd1006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:12.382 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.380+0000 7fdd331ff700 1 --2- 172.21.15.32:0/2379348069 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdd1006ad10 0x7fdd1006d1c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdd20007fd0 tx=0x7fdd20007980 comp rx=0 tx=0).stop 2023-06-20T13:32:12.383 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.380+0000 7fdd331ff700 1 -- 172.21.15.32:0/2379348069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd2c0d3670 msgr2=0x7fdd2c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:12.383 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.380+0000 7fdd331ff700 1 --2- 172.21.15.32:0/2379348069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd2c0d3670 0x7fdd2c0b25a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c06c040 tx=0x7fdd24004ad0 comp rx=0 tx=0).stop 2023-06-20T13:32:12.383 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.380+0000 7fdd331ff700 1 -- 172.21.15.32:0/2379348069 shutdown_connections 2023-06-20T13:32:12.383 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.380+0000 7fdd331ff700 1 --2- 172.21.15.32:0/2379348069 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdd1006ad10 0x7fdd1006d1c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:12.383 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.380+0000 7fdd331ff700 1 --2- 172.21.15.32:0/2379348069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd2c0d3670 0x7fdd2c0b25a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:12.383 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.380+0000 7fdd331ff700 1 --2- 172.21.15.32:0/2379348069 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd2c0d0980 0x7fdd2c156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:12.383 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.380+0000 7fdd331ff700 1 --2- 172.21.15.32:0/2379348069 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd2c0d3200 0x7fdd2c159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:12.384 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.380+0000 7fdd331ff700 1 -- 172.21.15.32:0/2379348069 >> 172.21.15.32:0/2379348069 conn(0x7fdd2c06b3f0 msgr2=0x7fdd2c0b3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:12.384 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.380+0000 7fdd331ff700 1 -- 172.21.15.32:0/2379348069 shutdown_connections 2023-06-20T13:32:12.384 INFO:teuthology.misc.health.smithi032.stderr:2023-06-20T13:32:12.380+0000 7fdd331ff700 1 -- 172.21.15.32:0/2379348069 wait complete. 2023-06-20T13:32:12.398 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-06-20T13:32:12.399 INFO:tasks.ceph:Creating RBD pool 2023-06-20T13:32:12.399 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph osd pool create rbd 8 2023-06-20T13:32:12.594 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.592+0000 7f3775fff700 1 Processor -- start 2023-06-20T13:32:12.594 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.592+0000 7f3775fff700 1 -- start start 2023-06-20T13:32:12.595 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.593+0000 7f3775fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f37700d3730 0x7f37700cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:12.595 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.593+0000 7f3775fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f37700cfa90 0x7f37700d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:12.595 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.593+0000 7f3775fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37700d0b20 con 0x7f37700b8430 2023-06-20T13:32:12.596 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.593+0000 7f3775fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37700cda30 con 0x7f37700cfa90 2023-06-20T13:32:12.596 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.593+0000 7f3775fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37700b8800 con 0x7f37700d3730 2023-06-20T13:32:12.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.593+0000 7f376ffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f37700cfa90 0x7f37700d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:12.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.593+0000 7f376effd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f37700d3730 0x7f37700cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:12.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.594+0000 7f376ffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f37700cfa90 0x7f37700d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:41462/0 (socket says 172.21.15.32:41462) 2023-06-20T13:32:12.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.594+0000 7f376ffff700 1 -- 172.21.15.32:0/595905617 learned_addr learned my addr 172.21.15.32:0/595905617 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:12.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.594+0000 7f376f7fe700 1 --1- 172.21.15.32:0/595905617 >> v1:172.21.15.115:6789/0 conn(0x7f37700b8430 0x7f37700cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.32:49822/0 (socket says 172.21.15.32:49822) 2023-06-20T13:32:12.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.594+0000 7f376ffff700 1 -- 172.21.15.32:0/595905617 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f37700d3730 msgr2=0x7f37700cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:12.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.594+0000 7f376ffff700 1 --2- 172.21.15.32:0/595905617 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f37700d3730 0x7f37700cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:12.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.594+0000 7f376ffff700 1 -- 172.21.15.32:0/595905617 >> v1:172.21.15.115:6789/0 conn(0x7f37700b8430 legacy=0x7f37700cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:12.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.594+0000 7f376ffff700 1 -- 172.21.15.32:0/595905617 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37700cfeb0 con 0x7f37700cfa90 2023-06-20T13:32:12.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.594+0000 7f376e7fc700 1 -- 172.21.15.32:0/595905617 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2635664309 0 0) 0x7f37700d0b20 con 0x7f37700b8430 2023-06-20T13:32:12.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.594+0000 7f376ffff700 1 --2- 172.21.15.32:0/595905617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37700cfa90 0x7f37700d0fb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3768009e50 tx=0x7f376800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b84775c755efec62 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:12.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.595+0000 7f376e7fc700 1 -- 172.21.15.32:0/595905617 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376800e070 con 0x7f37700cfa90 2023-06-20T13:32:12.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.595+0000 7f376e7fc700 1 -- 172.21.15.32:0/595905617 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376800b910 con 0x7f37700cfa90 2023-06-20T13:32:12.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.595+0000 7f376e7fc700 1 -- 172.21.15.32:0/595905617 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376800bcc0 con 0x7f37700cfa90 2023-06-20T13:32:12.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.595+0000 7f3775fff700 1 -- 172.21.15.32:0/595905617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37700cfa90 msgr2=0x7f37700d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:12.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.595+0000 7f3775fff700 1 --2- 172.21.15.32:0/595905617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37700cfa90 0x7f37700d0fb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3768009e50 tx=0x7f376800b330 comp rx=0 tx=0).stop 2023-06-20T13:32:12.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.595+0000 7f3775fff700 1 -- 172.21.15.32:0/595905617 shutdown_connections 2023-06-20T13:32:12.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.595+0000 7f3775fff700 1 --2- 172.21.15.32:0/595905617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37700cfa90 0x7f37700d0fb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:12.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.595+0000 7f3775fff700 1 --2- 172.21.15.32:0/595905617 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f37700d3730 0x7f37700cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:12.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.595+0000 7f3775fff700 1 -- 172.21.15.32:0/595905617 >> 172.21.15.32:0/595905617 conn(0x7f377006b3f0 msgr2=0x7f377006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:12.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.595+0000 7f3775fff700 1 -- 172.21.15.32:0/595905617 shutdown_connections 2023-06-20T13:32:12.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.595+0000 7f3775fff700 1 -- 172.21.15.32:0/595905617 wait complete. 2023-06-20T13:32:12.602 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.597+0000 7f3775fff700 1 Processor -- start 2023-06-20T13:32:12.602 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.597+0000 7f3775fff700 1 -- start start 2023-06-20T13:32:12.602 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.598+0000 7f3775fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37700b8430 0x7f37700c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:12.602 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.598+0000 7f3775fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37700cfa90 0x7f37700b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:12.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.598+0000 7f3775fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f37700d3730 0x7f37700b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:12.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.598+0000 7f3775fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377015e6c0 con 0x7f37700cfa90 2023-06-20T13:32:12.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.598+0000 7f3775fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37700c7ed0 con 0x7f37700b8430 2023-06-20T13:32:12.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.598+0000 7f3775fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37700c6430 con 0x7f37700d3730 2023-06-20T13:32:12.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.598+0000 7f376effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37700cfa90 0x7f37700b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:12.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.598+0000 7f376effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37700cfa90 0x7f37700b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60354/0 (socket says 172.21.15.32:60354) 2023-06-20T13:32:12.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.598+0000 7f376effd700 1 -- 172.21.15.32:0/4242374884 learned_addr learned my addr 172.21.15.32:0/4242374884 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:12.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.599+0000 7f376f7fe700 1 --2- 172.21.15.32:0/4242374884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37700b8430 0x7f37700c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:12.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.599+0000 7f376ffff700 1 --2- 172.21.15.32:0/4242374884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f37700d3730 0x7f37700b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:12.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.599+0000 7f376effd700 1 -- 172.21.15.32:0/4242374884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f37700d3730 msgr2=0x7f37700b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:12.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.599+0000 7f376effd700 1 --2- 172.21.15.32:0/4242374884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f37700d3730 0x7f37700b3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:12.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.599+0000 7f376effd700 1 -- 172.21.15.32:0/4242374884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37700b8430 msgr2=0x7f37700c5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:12.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.599+0000 7f376effd700 1 --2- 172.21.15.32:0/4242374884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37700b8430 0x7f37700c5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:12.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.599+0000 7f376effd700 1 -- 172.21.15.32:0/4242374884 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3768009b30 con 0x7f37700cfa90 2023-06-20T13:32:12.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.599+0000 7f376f7fe700 1 --2- 172.21.15.32:0/4242374884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37700b8430 0x7f37700c5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:32:12.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.599+0000 7f376effd700 1 --2- 172.21.15.32:0/4242374884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37700cfa90 0x7f37700b39e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f376400e870 tx=0x7f376400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:12.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.599+0000 7f3757fff700 1 -- 172.21.15.32:0/4242374884 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3764009590 con 0x7f37700cfa90 2023-06-20T13:32:12.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.599+0000 7f3757fff700 1 -- 172.21.15.32:0/4242374884 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3764013680 con 0x7f37700cfa90 2023-06-20T13:32:12.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.599+0000 7f3757fff700 1 -- 172.21.15.32:0/4242374884 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37640139f0 con 0x7f37700cfa90 2023-06-20T13:32:12.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.599+0000 7f3775fff700 1 -- 172.21.15.32:0/4242374884 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37700c72c0 con 0x7f37700cfa90 2023-06-20T13:32:12.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.600+0000 7f3775fff700 1 -- 172.21.15.32:0/4242374884 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37700c7880 con 0x7f37700cfa90 2023-06-20T13:32:12.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.601+0000 7f3775fff700 1 -- 172.21.15.32:0/4242374884 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37700c8080 con 0x7f37700cfa90 2023-06-20T13:32:12.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.602+0000 7f3757fff700 1 -- 172.21.15.32:0/4242374884 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3764013b50 con 0x7f37700cfa90 2023-06-20T13:32:12.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.602+0000 7f3757fff700 1 --2- 172.21.15.32:0/4242374884 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f375c06ace0 0x7f375c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:12.607 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.603+0000 7f3757fff700 1 -- 172.21.15.32:0/4242374884 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3764089390 con 0x7f37700cfa90 2023-06-20T13:32:12.607 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.603+0000 7f376f7fe700 1 --2- 172.21.15.32:0/4242374884 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f375c06ace0 0x7f375c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:12.607 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.603+0000 7f376f7fe700 1 --2- 172.21.15.32:0/4242374884 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f375c06ace0 0x7f375c06d190 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3760000f60 tx=0x7f3760007ca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:12.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.607+0000 7f3757fff700 1 -- 172.21.15.32:0/4242374884 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f37700c8080 con 0x7f37700cfa90 2023-06-20T13:32:12.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.816+0000 7f3775fff700 1 -- 172.21.15.32:0/4242374884 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f37700c8040 con 0x7f37700cfa90 2023-06-20T13:32:12.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.962+0000 7f3757fff700 1 -- 172.21.15.32:0/4242374884 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7f3764058250 con 0x7f37700cfa90 2023-06-20T13:32:12.967 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.965+0000 7f3775fff700 1 -- 172.21.15.32:0/4242374884 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f375c06ace0 msgr2=0x7f375c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:12.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.965+0000 7f3775fff700 1 --2- 172.21.15.32:0/4242374884 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f375c06ace0 0x7f375c06d190 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3760000f60 tx=0x7f3760007ca0 comp rx=0 tx=0).stop 2023-06-20T13:32:12.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.965+0000 7f3775fff700 1 -- 172.21.15.32:0/4242374884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37700cfa90 msgr2=0x7f37700b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:12.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.965+0000 7f3775fff700 1 --2- 172.21.15.32:0/4242374884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37700cfa90 0x7f37700b39e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f376400e870 tx=0x7f376400eb80 comp rx=0 tx=0).stop 2023-06-20T13:32:12.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.966+0000 7f3775fff700 1 -- 172.21.15.32:0/4242374884 shutdown_connections 2023-06-20T13:32:12.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.966+0000 7f3775fff700 1 --2- 172.21.15.32:0/4242374884 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f375c06ace0 0x7f375c06d190 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:12.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.966+0000 7f3775fff700 1 --2- 172.21.15.32:0/4242374884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f37700d3730 0x7f37700b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:12.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.966+0000 7f3775fff700 1 --2- 172.21.15.32:0/4242374884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f37700b8430 0x7f37700c5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:12.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.966+0000 7f3775fff700 1 --2- 172.21.15.32:0/4242374884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f37700cfa90 0x7f37700b39e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:12.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.966+0000 7f3775fff700 1 -- 172.21.15.32:0/4242374884 >> 172.21.15.32:0/4242374884 conn(0x7f377006b3f0 msgr2=0x7f377015bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:12.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.966+0000 7f3775fff700 1 -- 172.21.15.32:0/4242374884 shutdown_connections 2023-06-20T13:32:12.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:12.966+0000 7f3775fff700 1 -- 172.21.15.32:0/4242374884 wait complete. 2023-06-20T13:32:12.971 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'rbd' created 2023-06-20T13:32:12.987 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-06-20T13:32:13.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.184+0000 7f76d67ff700 1 Processor -- start 2023-06-20T13:32:13.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.184+0000 7f76d67ff700 1 -- start start 2023-06-20T13:32:13.190 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.185+0000 7f76d67ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76d00b82c0 0x7f76d0160870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:13.190 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.185+0000 7f76d67ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f76d00b1f00 0x7f76d00ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:13.190 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.186+0000 7f76d67ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f76d00cf4d0 0x7f76d00cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:13.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.186+0000 7f76d67ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d00b8690 con 0x7f76d00b1f00 2023-06-20T13:32:13.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.186+0000 7f76d67ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d0160db0 con 0x7f76d00cf4d0 2023-06-20T13:32:13.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.186+0000 7f76d67ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d00cfe90 con 0x7f76d00b82c0 2023-06-20T13:32:13.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.186+0000 7f76cf7fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f76d00b1f00 0x7f76d00ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:13.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.186+0000 7f76cf7fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f76d00b1f00 0x7f76d00ceca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60366/0 (socket says 172.21.15.32:60366) 2023-06-20T13:32:13.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.186+0000 7f76cf7fe700 1 -- 172.21.15.32:0/1078168687 learned_addr learned my addr 172.21.15.32:0/1078168687 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:13.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.186+0000 7f76d4d9c700 1 --2- 172.21.15.32:0/1078168687 >> v2:172.21.15.115:3300/0 conn(0x7f76d00cf4d0 0x7f76d00cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:13.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.186+0000 7f76cffff700 1 --2- 172.21.15.32:0/1078168687 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76d00b82c0 0x7f76d0160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:13.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.186+0000 7f76cf7fe700 1 -- 172.21.15.32:0/1078168687 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76d00b82c0 msgr2=0x7f76d0160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:13.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.186+0000 7f76cf7fe700 1 --2- 172.21.15.32:0/1078168687 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76d00b82c0 0x7f76d0160870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:13.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.186+0000 7f76cf7fe700 1 -- 172.21.15.32:0/1078168687 >> v2:172.21.15.115:3300/0 conn(0x7f76d00cf4d0 msgr2=0x7f76d00cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:13.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.186+0000 7f76cf7fe700 1 --2- 172.21.15.32:0/1078168687 >> v2:172.21.15.115:3300/0 conn(0x7f76d00cf4d0 0x7f76d00cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:13.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.186+0000 7f76cf7fe700 1 -- 172.21.15.32:0/1078168687 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d015fe20 con 0x7f76d00b1f00 2023-06-20T13:32:13.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.186+0000 7f76d4d9c700 1 --2- 172.21.15.32:0/1078168687 >> v2:172.21.15.115:3300/0 conn(0x7f76d00cf4d0 0x7f76d00cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:32:13.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.187+0000 7f76cf7fe700 1 --2- 172.21.15.32:0/1078168687 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76d00b1f00 0x7f76d00ceca0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f76d00b4740 tx=0x7f76c4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551d7d2ab1948d56 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:13.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.187+0000 7f76ceffd700 1 -- 172.21.15.32:0/1078168687 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c400b870 con 0x7f76d00b1f00 2023-06-20T13:32:13.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.187+0000 7f76ceffd700 1 -- 172.21.15.32:0/1078168687 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c400b9d0 con 0x7f76d00b1f00 2023-06-20T13:32:13.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.187+0000 7f76ceffd700 1 -- 172.21.15.32:0/1078168687 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c400bd60 con 0x7f76d00b1f00 2023-06-20T13:32:13.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.187+0000 7f76d67ff700 1 -- 172.21.15.32:0/1078168687 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76d00b1f00 msgr2=0x7f76d00ceca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:13.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.187+0000 7f76d67ff700 1 --2- 172.21.15.32:0/1078168687 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76d00b1f00 0x7f76d00ceca0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f76d00b4740 tx=0x7f76c4009bd0 comp rx=0 tx=0).stop 2023-06-20T13:32:13.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.187+0000 7f76d67ff700 1 -- 172.21.15.32:0/1078168687 shutdown_connections 2023-06-20T13:32:13.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.187+0000 7f76d67ff700 1 --2- 172.21.15.32:0/1078168687 >> v2:172.21.15.115:3300/0 conn(0x7f76d00cf4d0 0x7f76d00cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:13.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.187+0000 7f76d67ff700 1 --2- 172.21.15.32:0/1078168687 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76d00b82c0 0x7f76d0160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:13.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.187+0000 7f76d67ff700 1 --2- 172.21.15.32:0/1078168687 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76d00b1f00 0x7f76d00ceca0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:13.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.187+0000 7f76d67ff700 1 -- 172.21.15.32:0/1078168687 >> 172.21.15.32:0/1078168687 conn(0x7f76d0071660 msgr2=0x7f76d0071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:13.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.188+0000 7f76d67ff700 1 -- 172.21.15.32:0/1078168687 shutdown_connections 2023-06-20T13:32:13.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.188+0000 7f76d67ff700 1 -- 172.21.15.32:0/1078168687 wait complete. 2023-06-20T13:32:13.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.189+0000 7f76d67ff700 1 Processor -- start 2023-06-20T13:32:13.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.189+0000 7f76d67ff700 1 -- start start 2023-06-20T13:32:13.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.190+0000 7f76d67ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76d00b1f00 0x7f76d00cc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:13.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.190+0000 7f76d67ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76d00b82c0 0x7f76d01e5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:13.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.190+0000 7f76d67ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76d00cf4d0 0x7f76d015eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:13.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.190+0000 7f76d67ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d00cc750 con 0x7f76d00b82c0 2023-06-20T13:32:13.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.190+0000 7f76d67ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d0149820 con 0x7f76d00cf4d0 2023-06-20T13:32:13.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.190+0000 7f76d67ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d0149b00 con 0x7f76d00b1f00 2023-06-20T13:32:13.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.191+0000 7f76cf7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76d00b82c0 0x7f76d01e5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:13.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.191+0000 7f76cf7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76d00b82c0 0x7f76d01e5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60374/0 (socket says 172.21.15.32:60374) 2023-06-20T13:32:13.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.191+0000 7f76cf7fe700 1 -- 172.21.15.32:0/2836359967 learned_addr learned my addr 172.21.15.32:0/2836359967 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:13.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.191+0000 7f76d4d9c700 1 --2- 172.21.15.32:0/2836359967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76d00cf4d0 0x7f76d015eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:13.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.191+0000 7f76cffff700 1 --2- 172.21.15.32:0/2836359967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76d00b1f00 0x7f76d00cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:13.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.191+0000 7f76cf7fe700 1 -- 172.21.15.32:0/2836359967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76d00b1f00 msgr2=0x7f76d00cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:13.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.191+0000 7f76cf7fe700 1 --2- 172.21.15.32:0/2836359967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76d00b1f00 0x7f76d00cc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:13.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.191+0000 7f76cf7fe700 1 -- 172.21.15.32:0/2836359967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76d00cf4d0 msgr2=0x7f76d015eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:13.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.191+0000 7f76cf7fe700 1 --2- 172.21.15.32:0/2836359967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76d00cf4d0 0x7f76d015eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:13.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.191+0000 7f76cf7fe700 1 -- 172.21.15.32:0/2836359967 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c4009550 con 0x7f76d00b82c0 2023-06-20T13:32:13.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.191+0000 7f76cf7fe700 1 --2- 172.21.15.32:0/2836359967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76d00b82c0 0x7f76d01e5db0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f76c4000c00 tx=0x7f76c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:13.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.191+0000 7f76ccff9700 1 -- 172.21.15.32:0/2836359967 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c4004520 con 0x7f76d00b82c0 2023-06-20T13:32:13.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.192+0000 7f76ccff9700 1 -- 172.21.15.32:0/2836359967 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c401e070 con 0x7f76d00b82c0 2023-06-20T13:32:13.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.192+0000 7f76ccff9700 1 -- 172.21.15.32:0/2836359967 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c40038c0 con 0x7f76d00b82c0 2023-06-20T13:32:13.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.192+0000 7f76d67ff700 1 -- 172.21.15.32:0/2836359967 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d0149de0 con 0x7f76d00b82c0 2023-06-20T13:32:13.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.192+0000 7f76d67ff700 1 -- 172.21.15.32:0/2836359967 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d014a3a0 con 0x7f76d00b82c0 2023-06-20T13:32:13.204 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.193+0000 7f76b6ffd700 1 -- 172.21.15.32:0/2836359967 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d0074180 con 0x7f76d00b82c0 2023-06-20T13:32:13.204 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.194+0000 7f76ccff9700 1 -- 172.21.15.32:0/2836359967 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f76c4003a20 con 0x7f76d00b82c0 2023-06-20T13:32:13.204 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.195+0000 7f76ccff9700 1 --2- 172.21.15.32:0/2836359967 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f76bc06ace0 0x7f76bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:13.204 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.195+0000 7f76ccff9700 1 -- 172.21.15.32:0/2836359967 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f76c4020070 con 0x7f76d00b82c0 2023-06-20T13:32:13.204 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.195+0000 7f76cffff700 1 --2- 172.21.15.32:0/2836359967 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f76bc06ace0 0x7f76bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:13.204 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.195+0000 7f76cffff700 1 --2- 172.21.15.32:0/2836359967 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f76bc06ace0 0x7f76bc06d190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f76c000b9b0 tx=0x7f76c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:13.205 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.200+0000 7f76ccff9700 1 -- 172.21.15.32:0/2836359967 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f76c4055af0 con 0x7f76d00b82c0 2023-06-20T13:32:13.417 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.415+0000 7f76b6ffd700 1 -- 172.21.15.32:0/2836359967 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f76d00d16e0 con 0x7f76d00b82c0 2023-06-20T13:32:13.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.970+0000 7f76ccff9700 1 -- 172.21.15.32:0/2836359967 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7f76c4059110 con 0x7f76d00b82c0 2023-06-20T13:32:13.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.975+0000 7f76b6ffd700 1 -- 172.21.15.32:0/2836359967 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f76bc06ace0 msgr2=0x7f76bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:13.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.975+0000 7f76b6ffd700 1 --2- 172.21.15.32:0/2836359967 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f76bc06ace0 0x7f76bc06d190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f76c000b9b0 tx=0x7f76c0008040 comp rx=0 tx=0).stop 2023-06-20T13:32:13.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.975+0000 7f76b6ffd700 1 -- 172.21.15.32:0/2836359967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76d00b82c0 msgr2=0x7f76d01e5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:13.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.975+0000 7f76b6ffd700 1 --2- 172.21.15.32:0/2836359967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76d00b82c0 0x7f76d01e5db0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f76c4000c00 tx=0x7f76c4004750 comp rx=0 tx=0).stop 2023-06-20T13:32:13.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.975+0000 7f76b6ffd700 1 -- 172.21.15.32:0/2836359967 shutdown_connections 2023-06-20T13:32:13.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.975+0000 7f76b6ffd700 1 --2- 172.21.15.32:0/2836359967 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f76bc06ace0 0x7f76bc06d190 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:13.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.975+0000 7f76b6ffd700 1 --2- 172.21.15.32:0/2836359967 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f76d00cf4d0 0x7f76d015eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:13.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.975+0000 7f76b6ffd700 1 --2- 172.21.15.32:0/2836359967 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f76d00b1f00 0x7f76d00cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:13.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.975+0000 7f76b6ffd700 1 --2- 172.21.15.32:0/2836359967 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f76d00b82c0 0x7f76d01e5db0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:13.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.975+0000 7f76b6ffd700 1 -- 172.21.15.32:0/2836359967 >> 172.21.15.32:0/2836359967 conn(0x7f76d0071660 msgr2=0x7f76d00729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:13.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.976+0000 7f76b6ffd700 1 -- 172.21.15.32:0/2836359967 shutdown_connections 2023-06-20T13:32:13.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:13.976+0000 7f76b6ffd700 1 -- 172.21.15.32:0/2836359967 wait complete. 2023-06-20T13:32:13.982 INFO:teuthology.orchestra.run.smithi032.stderr:enabled application 'rbd' on pool 'rbd' 2023-06-20T13:32:13.999 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-06-20T13:32:14.000 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-20T13:32:14.000 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-20T13:32:14.005 INFO:tasks.ceph.mds.a:Started 2023-06-20T13:32:14.006 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-20T13:32:14.006 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-20T13:32:14.010 INFO:tasks.ceph.mds.c:Started 2023-06-20T13:32:14.010 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-20T13:32:14.011 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-20T13:32:14.015 INFO:tasks.ceph.mds.b:Started 2023-06-20T13:32:14.015 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-20T13:32:14.015 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-20T13:32:14.019 INFO:tasks.ceph.mds.d:Started 2023-06-20T13:32:14.020 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-06-20T13:32:14.020 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:32:14.161 INFO:tasks.ceph.mds.a.smithi032.stdout:starting mds.a at 2023-06-20T13:32:14.165 INFO:tasks.ceph.mds.c.smithi032.stdout:starting mds.c at 2023-06-20T13:32:14.168 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-06-20T13:32:14.169 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-06-20T13:32:14.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.242+0000 7f51a2dff700 1 Processor -- start 2023-06-20T13:32:14.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.242+0000 7f51a2dff700 1 -- start start 2023-06-20T13:32:14.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.243+0000 7f51a2dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f519c0cef10 0x7f519c069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:14.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.243+0000 7f51a2dff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f519c0cf360 0x7f519c06a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:14.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.243+0000 7f51a2dff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519c0cdad0 con 0x7f519c15c290 2023-06-20T13:32:14.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.243+0000 7f51a2dff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f519c0725c0 con 0x7f519c0cf360 2023-06-20T13:32:14.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.243+0000 7f51a2dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f519c0cd550 con 0x7f519c0cef10 2023-06-20T13:32:14.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.243+0000 7f51a0b9b700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f519c15c290 0x7f519c0ab8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47344/0 (socket says 172.21.15.32:47344) 2023-06-20T13:32:14.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.243+0000 7f51a0b9b700 1 -- 172.21.15.32:0/1689048873 learned_addr learned my addr 172.21.15.32:0/1689048873 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:14.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.243+0000 7f51a139c700 1 --2- 172.21.15.32:0/1689048873 >> v2:172.21.15.32:3300/0 conn(0x7f519c0cf360 0x7f519c06a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:14.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.244+0000 7f519bfff700 1 --2- 172.21.15.32:0/1689048873 >> v2:172.21.15.115:3300/0 conn(0x7f519c0cef10 0x7f519c069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:14.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.244+0000 7f519b7fe700 1 -- 172.21.15.32:0/1689048873 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1787108651 0 0) 0x7f519c0cdad0 con 0x7f519c15c290 2023-06-20T13:32:14.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.244+0000 7f519b7fe700 1 -- 172.21.15.32:0/1689048873 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f518c0035b0 con 0x7f519c15c290 2023-06-20T13:32:14.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.244+0000 7f51a139c700 1 -- 172.21.15.32:0/1689048873 >> v2:172.21.15.115:3300/0 conn(0x7f519c0cef10 msgr2=0x7f519c069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:14.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.244+0000 7f51a139c700 1 --2- 172.21.15.32:0/1689048873 >> v2:172.21.15.115:3300/0 conn(0x7f519c0cef10 0x7f519c069f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:14.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.244+0000 7f51a139c700 1 -- 172.21.15.32:0/1689048873 >> v1:172.21.15.32:6789/0 conn(0x7f519c15c290 legacy=0x7f519c0ab8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:14.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.244+0000 7f51a139c700 1 -- 172.21.15.32:0/1689048873 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519c0722e0 con 0x7f519c0cf360 2023-06-20T13:32:14.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.244+0000 7f519bfff700 1 --2- 172.21.15.32:0/1689048873 >> v2:172.21.15.115:3300/0 conn(0x7f519c0cef10 0x7f519c069f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:32:14.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.244+0000 7f51a139c700 1 --2- 172.21.15.32:0/1689048873 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f519c0cf360 0x7f519c06a470 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f519c0cd240 tx=0x7f519400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da0b0be1ae49857a server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:14.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.244+0000 7f519b7fe700 1 -- 172.21.15.32:0/1689048873 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519400e070 con 0x7f519c0cf360 2023-06-20T13:32:14.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.244+0000 7f519b7fe700 1 -- 172.21.15.32:0/1689048873 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519400bb20 con 0x7f519c0cf360 2023-06-20T13:32:14.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.244+0000 7f519b7fe700 1 -- 172.21.15.32:0/1689048873 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5194012430 con 0x7f519c0cf360 2023-06-20T13:32:14.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.245+0000 7f51a2dff700 1 -- 172.21.15.32:0/1689048873 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f519c0cf360 msgr2=0x7f519c06a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:14.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.245+0000 7f51a2dff700 1 --2- 172.21.15.32:0/1689048873 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f519c0cf360 0x7f519c06a470 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f519c0cd240 tx=0x7f519400b330 comp rx=0 tx=0).stop 2023-06-20T13:32:14.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.245+0000 7f51a2dff700 1 -- 172.21.15.32:0/1689048873 shutdown_connections 2023-06-20T13:32:14.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.245+0000 7f51a2dff700 1 --2- 172.21.15.32:0/1689048873 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f519c0cf360 0x7f519c06a470 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:14.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.245+0000 7f51a2dff700 1 --2- 172.21.15.32:0/1689048873 >> v2:172.21.15.115:3300/0 conn(0x7f519c0cef10 0x7f519c069f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:14.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.245+0000 7f51a2dff700 1 -- 172.21.15.32:0/1689048873 >> 172.21.15.32:0/1689048873 conn(0x7f519c06d450 msgr2=0x7f519c06d850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:14.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.245+0000 7f51a2dff700 1 -- 172.21.15.32:0/1689048873 shutdown_connections 2023-06-20T13:32:14.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.245+0000 7f51a2dff700 1 -- 172.21.15.32:0/1689048873 wait complete. 2023-06-20T13:32:14.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.247+0000 7f51a2dff700 1 Processor -- start 2023-06-20T13:32:14.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.247+0000 7f51a2dff700 1 -- start start 2023-06-20T13:32:14.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.248+0000 7f51a2dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f519c0cef10 0x7f519c1544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:14.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.248+0000 7f51a2dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f519c0cf360 0x7f519c0cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:14.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.248+0000 7f51a2dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f519c15c290 0x7f519c0b3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:14.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.248+0000 7f51a2dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519c0ccd00 con 0x7f519c0cf360 2023-06-20T13:32:14.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.248+0000 7f51a2dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519c0c4750 con 0x7f519c0cef10 2023-06-20T13:32:14.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.248+0000 7f51a2dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519c0cbce0 con 0x7f519c15c290 2023-06-20T13:32:14.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.248+0000 7f519bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f519c0cf360 0x7f519c0cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:14.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.248+0000 7f519bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f519c0cf360 0x7f519c0cc7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60438/0 (socket says 172.21.15.32:60438) 2023-06-20T13:32:14.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.248+0000 7f519bfff700 1 -- 172.21.15.32:0/2280430598 learned_addr learned my addr 172.21.15.32:0/2280430598 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:14.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.248+0000 7f51a0b9b700 1 --2- 172.21.15.32:0/2280430598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f519c0cef10 0x7f519c1544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:14.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.248+0000 7f51a139c700 1 --2- 172.21.15.32:0/2280430598 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f519c15c290 0x7f519c0b3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:14.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.248+0000 7f519bfff700 1 -- 172.21.15.32:0/2280430598 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f519c15c290 msgr2=0x7f519c0b3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:14.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.248+0000 7f519bfff700 1 --2- 172.21.15.32:0/2280430598 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f519c15c290 0x7f519c0b3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:14.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.248+0000 7f519bfff700 1 -- 172.21.15.32:0/2280430598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f519c0cef10 msgr2=0x7f519c1544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:14.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.248+0000 7f519bfff700 1 --2- 172.21.15.32:0/2280430598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f519c0cef10 0x7f519c1544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:14.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.248+0000 7f519bfff700 1 -- 172.21.15.32:0/2280430598 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5194009a70 con 0x7f519c0cf360 2023-06-20T13:32:14.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.248+0000 7f51a0b9b700 1 --2- 172.21.15.32:0/2280430598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f519c0cef10 0x7f519c1544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:32:14.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.249+0000 7f519bfff700 1 --2- 172.21.15.32:0/2280430598 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f519c0cf360 0x7f519c0cc7c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f518800e760 tx=0x7f518800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:14.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.249+0000 7f51997fa700 1 -- 172.21.15.32:0/2280430598 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5188013610 con 0x7f519c0cf360 2023-06-20T13:32:14.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.249+0000 7f51997fa700 1 -- 172.21.15.32:0/2280430598 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5188013770 con 0x7f519c0cf360 2023-06-20T13:32:14.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.249+0000 7f51997fa700 1 -- 172.21.15.32:0/2280430598 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5188013b20 con 0x7f519c0cf360 2023-06-20T13:32:14.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.249+0000 7f51a2dff700 1 -- 172.21.15.32:0/2280430598 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f519c0cbfc0 con 0x7f519c0cf360 2023-06-20T13:32:14.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.249+0000 7f51a2dff700 1 -- 172.21.15.32:0/2280430598 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f519c0c4a30 con 0x7f519c0cf360 2023-06-20T13:32:14.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.250+0000 7f51a2dff700 1 -- 172.21.15.32:0/2280430598 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f519c0cc610 con 0x7f519c0cf360 2023-06-20T13:32:14.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.251+0000 7f51997fa700 1 -- 172.21.15.32:0/2280430598 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5188013c80 con 0x7f519c0cf360 2023-06-20T13:32:14.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.252+0000 7f51997fa700 1 --2- 172.21.15.32:0/2280430598 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f518006ace0 0x7f518006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:14.257 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.252+0000 7f51997fa700 1 -- 172.21.15.32:0/2280430598 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5188088d90 con 0x7f519c0cf360 2023-06-20T13:32:14.257 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.253+0000 7f51a0b9b700 1 --2- 172.21.15.32:0/2280430598 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f518006ace0 0x7f518006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:14.257 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.253+0000 7f51a0b9b700 1 --2- 172.21.15.32:0/2280430598 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f518006ace0 0x7f518006d190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f51900011e0 tx=0x7f5190009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:14.258 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.257+0000 7f51997fa700 1 -- 172.21.15.32:0/2280430598 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5188054180 con 0x7f519c0cf360 2023-06-20T13:32:14.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.461+0000 7f51a2dff700 1 -- 172.21.15.32:0/2280430598 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f519c0ae560 con 0x7f519c0cf360 2023-06-20T13:32:14.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.462+0000 7f51997fa700 1 -- 172.21.15.32:0/2280430598 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+14625 (secure 0 0 0) 0x7f5188021090 con 0x7f519c0cf360 2023-06-20T13:32:14.465 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:32:14.465 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":18,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:32:13.962843+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:32:14.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.465+0000 7f51a2dff700 1 -- 172.21.15.32:0/2280430598 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f518006ace0 msgr2=0x7f518006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:14.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.465+0000 7f51a2dff700 1 --2- 172.21.15.32:0/2280430598 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f518006ace0 0x7f518006d190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f51900011e0 tx=0x7f5190009040 comp rx=0 tx=0).stop 2023-06-20T13:32:14.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.465+0000 7f51a2dff700 1 -- 172.21.15.32:0/2280430598 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f519c0cf360 msgr2=0x7f519c0cc7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:14.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.465+0000 7f51a2dff700 1 --2- 172.21.15.32:0/2280430598 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f519c0cf360 0x7f519c0cc7c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f518800e760 tx=0x7f518800eb20 comp rx=0 tx=0).stop 2023-06-20T13:32:14.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.465+0000 7f51a2dff700 1 -- 172.21.15.32:0/2280430598 shutdown_connections 2023-06-20T13:32:14.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.465+0000 7f51a2dff700 1 --2- 172.21.15.32:0/2280430598 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f518006ace0 0x7f518006d190 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:14.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.465+0000 7f51a2dff700 1 --2- 172.21.15.32:0/2280430598 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f519c15c290 0x7f519c0b3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:14.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.465+0000 7f51a2dff700 1 --2- 172.21.15.32:0/2280430598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f519c0cef10 0x7f519c1544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:14.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.465+0000 7f51a2dff700 1 --2- 172.21.15.32:0/2280430598 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f519c0cf360 0x7f519c0cc7c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:14.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.465+0000 7f51a2dff700 1 -- 172.21.15.32:0/2280430598 >> 172.21.15.32:0/2280430598 conn(0x7f519c06d450 msgr2=0x7f519c06f160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:14.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.465+0000 7f51a2dff700 1 -- 172.21.15.32:0/2280430598 shutdown_connections 2023-06-20T13:32:14.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.465+0000 7f51a2dff700 1 -- 172.21.15.32:0/2280430598 wait complete. 2023-06-20T13:32:14.485 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-20T13:32:05.308022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-20T13:32:12.857161+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-20T13:32:14.485 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-20T13:32:14.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.687+0000 7f80353ff700 1 Processor -- start 2023-06-20T13:32:14.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.687+0000 7f80353ff700 1 -- start start 2023-06-20T13:32:14.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.688+0000 7f80353ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80300b8430 0x7f80300cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:14.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.688+0000 7f80353ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f80300cfc60 0x7f80300d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:14.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.688+0000 7f80353ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80300d0b20 con 0x7f80300d3730 2023-06-20T13:32:14.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.688+0000 7f80353ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80300b8800 con 0x7f80300cfc60 2023-06-20T13:32:14.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.688+0000 7f80353ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80300b4ee0 con 0x7f80300b8430 2023-06-20T13:32:14.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.689+0000 7f802f7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f80300cfc60 0x7f80300d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:14.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.689+0000 7f802effd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80300b8430 0x7f80300cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:14.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.689+0000 7f802e7fc700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f80300d3730 0x7f80300cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.32:49838/0 (socket says 172.21.15.32:49838) 2023-06-20T13:32:14.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.689+0000 7f802e7fc700 1 -- 172.21.15.32:0/4059566364 learned_addr learned my addr 172.21.15.32:0/4059566364 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:14.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.689+0000 7f802f7fe700 1 -- 172.21.15.32:0/4059566364 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80300b8430 msgr2=0x7f80300cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:14.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.689+0000 7f802f7fe700 1 --2- 172.21.15.32:0/4059566364 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80300b8430 0x7f80300cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:14.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.689+0000 7f802f7fe700 1 -- 172.21.15.32:0/4059566364 >> v1:172.21.15.115:6789/0 conn(0x7f80300d3730 legacy=0x7f80300cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:14.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.689+0000 7f802f7fe700 1 -- 172.21.15.32:0/4059566364 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80300b51c0 con 0x7f80300cfc60 2023-06-20T13:32:14.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.689+0000 7f802dffb700 1 -- 172.21.15.32:0/4059566364 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4248943120 0 0) 0x7f80300d0b20 con 0x7f80300d3730 2023-06-20T13:32:14.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.689+0000 7f802f7fe700 1 --2- 172.21.15.32:0/4059566364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80300cfc60 0x7f80300d0fb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8028009d90 tx=0x7f802800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ed7c5cc549733e7 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:14.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.690+0000 7f802dffb700 1 -- 172.21.15.32:0/4059566364 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802800e070 con 0x7f80300cfc60 2023-06-20T13:32:14.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.690+0000 7f802dffb700 1 -- 172.21.15.32:0/4059566364 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802800bb20 con 0x7f80300cfc60 2023-06-20T13:32:14.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.690+0000 7f802dffb700 1 -- 172.21.15.32:0/4059566364 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8028012430 con 0x7f80300cfc60 2023-06-20T13:32:14.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.690+0000 7f80353ff700 1 -- 172.21.15.32:0/4059566364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80300cfc60 msgr2=0x7f80300d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:14.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.690+0000 7f80353ff700 1 --2- 172.21.15.32:0/4059566364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80300cfc60 0x7f80300d0fb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8028009d90 tx=0x7f802800b330 comp rx=0 tx=0).stop 2023-06-20T13:32:14.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.690+0000 7f80353ff700 1 -- 172.21.15.32:0/4059566364 shutdown_connections 2023-06-20T13:32:14.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.690+0000 7f80353ff700 1 --2- 172.21.15.32:0/4059566364 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80300b8430 0x7f80300cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:14.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.690+0000 7f80353ff700 1 --2- 172.21.15.32:0/4059566364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80300cfc60 0x7f80300d0fb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:14.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.690+0000 7f80353ff700 1 -- 172.21.15.32:0/4059566364 >> 172.21.15.32:0/4059566364 conn(0x7f803006b3f0 msgr2=0x7f803006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:14.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.690+0000 7f80353ff700 1 -- 172.21.15.32:0/4059566364 shutdown_connections 2023-06-20T13:32:14.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.690+0000 7f80353ff700 1 -- 172.21.15.32:0/4059566364 wait complete. 2023-06-20T13:32:14.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.692+0000 7f80353ff700 1 Processor -- start 2023-06-20T13:32:14.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.692+0000 7f80353ff700 1 -- start start 2023-06-20T13:32:14.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.693+0000 7f80353ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80300b8430 0x7f80301f4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:14.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.693+0000 7f80353ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80300cfc60 0x7f80301f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:14.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.693+0000 7f80353ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80300d3730 0x7f80300b3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:14.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.693+0000 7f80353ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80301f2830 con 0x7f80300d3730 2023-06-20T13:32:14.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.693+0000 7f80353ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80300c6830 con 0x7f80300b8430 2023-06-20T13:32:14.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.693+0000 7f80353ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80301f5d50 con 0x7f80300cfc60 2023-06-20T13:32:14.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.694+0000 7f802f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80300d3730 0x7f80300b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:14.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.694+0000 7f802f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80300d3730 0x7f80300b3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60448/0 (socket says 172.21.15.32:60448) 2023-06-20T13:32:14.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.694+0000 7f802f7fe700 1 -- 172.21.15.32:0/901767581 learned_addr learned my addr 172.21.15.32:0/901767581 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:14.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.694+0000 7f802e7fc700 1 --2- 172.21.15.32:0/901767581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80300cfc60 0x7f80301f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:14.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.694+0000 7f802effd700 1 --2- 172.21.15.32:0/901767581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80300b8430 0x7f80301f4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:14.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.694+0000 7f802f7fe700 1 -- 172.21.15.32:0/901767581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80300cfc60 msgr2=0x7f80301f22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:14.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.694+0000 7f802f7fe700 1 --2- 172.21.15.32:0/901767581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80300cfc60 0x7f80301f22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:14.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.694+0000 7f802f7fe700 1 -- 172.21.15.32:0/901767581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80300b8430 msgr2=0x7f80301f4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:14.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.694+0000 7f802f7fe700 1 --2- 172.21.15.32:0/901767581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80300b8430 0x7f80301f4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:14.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.694+0000 7f802f7fe700 1 -- 172.21.15.32:0/901767581 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8028009a70 con 0x7f80300d3730 2023-06-20T13:32:14.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.694+0000 7f802f7fe700 1 --2- 172.21.15.32:0/901767581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80300d3730 0x7f80300b3870 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f803006c780 tx=0x7f8028004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:14.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.695+0000 7f80177fe700 1 -- 172.21.15.32:0/901767581 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8028012430 con 0x7f80300d3730 2023-06-20T13:32:14.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.695+0000 7f80353ff700 1 -- 172.21.15.32:0/901767581 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80301f54b0 con 0x7f80300d3730 2023-06-20T13:32:14.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.695+0000 7f80353ff700 1 -- 172.21.15.32:0/901767581 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80301f5a70 con 0x7f80300d3730 2023-06-20T13:32:14.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.695+0000 7f80177fe700 1 -- 172.21.15.32:0/901767581 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8028020070 con 0x7f80300d3730 2023-06-20T13:32:14.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.695+0000 7f80177fe700 1 -- 172.21.15.32:0/901767581 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8028004240 con 0x7f80300d3730 2023-06-20T13:32:14.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.696+0000 7f80353ff700 1 -- 172.21.15.32:0/901767581 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f803004ea60 con 0x7f80300d3730 2023-06-20T13:32:14.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.697+0000 7f80177fe700 1 -- 172.21.15.32:0/901767581 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f80280043a0 con 0x7f80300d3730 2023-06-20T13:32:14.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.698+0000 7f80177fe700 1 --2- 172.21.15.32:0/901767581 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f801c06ace0 0x7f801c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:14.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.698+0000 7f80177fe700 1 -- 172.21.15.32:0/901767581 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8028022070 con 0x7f80300d3730 2023-06-20T13:32:14.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.698+0000 7f802effd700 1 --2- 172.21.15.32:0/901767581 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f801c06ace0 0x7f801c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:14.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.699+0000 7f802effd700 1 --2- 172.21.15.32:0/901767581 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f801c06ace0 0x7f801c06d190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8020009be0 tx=0x7f8020009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:14.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.702+0000 7f80177fe700 1 -- 172.21.15.32:0/901767581 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8028056950 con 0x7f80300d3730 2023-06-20T13:32:14.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.910+0000 7f80353ff700 1 -- 172.21.15.32:0/901767581 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f80300b7a50 con 0x7f80300d3730 2023-06-20T13:32:14.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.911+0000 7f80177fe700 1 -- 172.21.15.32:0/901767581 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8028059f70 con 0x7f80300d3730 2023-06-20T13:32:14.913 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-06-20T13:32:14.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.913+0000 7f80353ff700 1 -- 172.21.15.32:0/901767581 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f801c06ace0 msgr2=0x7f801c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:14.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.913+0000 7f80353ff700 1 --2- 172.21.15.32:0/901767581 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f801c06ace0 0x7f801c06d190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8020009be0 tx=0x7f8020009210 comp rx=0 tx=0).stop 2023-06-20T13:32:14.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.913+0000 7f80353ff700 1 -- 172.21.15.32:0/901767581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80300d3730 msgr2=0x7f80300b3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:14.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.913+0000 7f80353ff700 1 --2- 172.21.15.32:0/901767581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80300d3730 0x7f80300b3870 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f803006c780 tx=0x7f8028004ad0 comp rx=0 tx=0).stop 2023-06-20T13:32:14.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.913+0000 7f80353ff700 1 -- 172.21.15.32:0/901767581 shutdown_connections 2023-06-20T13:32:14.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.913+0000 7f80353ff700 1 --2- 172.21.15.32:0/901767581 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f801c06ace0 0x7f801c06d190 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:14.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.913+0000 7f80353ff700 1 --2- 172.21.15.32:0/901767581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f80300d3730 0x7f80300b3870 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:14.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.913+0000 7f80353ff700 1 --2- 172.21.15.32:0/901767581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f80300b8430 0x7f80301f4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:14.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.913+0000 7f80353ff700 1 --2- 172.21.15.32:0/901767581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f80300cfc60 0x7f80301f22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:14.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.913+0000 7f80353ff700 1 -- 172.21.15.32:0/901767581 >> 172.21.15.32:0/901767581 conn(0x7f803006b3f0 msgr2=0x7f80300cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:14.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.913+0000 7f80353ff700 1 -- 172.21.15.32:0/901767581 shutdown_connections 2023-06-20T13:32:14.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:14.913+0000 7f80353ff700 1 -- 172.21.15.32:0/901767581 wait complete. 2023-06-20T13:32:14.933 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-20T13:32:15.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.136+0000 7f6004fff700 1 Processor -- start 2023-06-20T13:32:15.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.136+0000 7f6004fff700 1 -- start start 2023-06-20T13:32:15.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.137+0000 7f6004fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f60000d3730 0x7f60000cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:15.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.137+0000 7f6004fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60000cfa90 0x7f60000d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:15.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.137+0000 7f6004fff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60000d0b20 con 0x7f60000b8430 2023-06-20T13:32:15.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.137+0000 7f6004fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60000cda30 con 0x7f60000d3730 2023-06-20T13:32:15.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.137+0000 7f6004fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60000b8800 con 0x7f60000cfa90 2023-06-20T13:32:15.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.138+0000 7f5ffe59c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f60000b8430 0x7f60000cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47350/0 (socket says 172.21.15.32:47350) 2023-06-20T13:32:15.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.138+0000 7f5ffe59c700 1 -- 172.21.15.32:0/3652762822 learned_addr learned my addr 172.21.15.32:0/3652762822 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:15.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.138+0000 7f5ff7fff700 1 --2- 172.21.15.32:0/3652762822 >> v2:172.21.15.115:3300/0 conn(0x7f60000d3730 0x7f60000cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:15.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.138+0000 7f5ffed9d700 1 --2- 172.21.15.32:0/3652762822 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60000cfa90 0x7f60000d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:15.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.138+0000 7f5ffdd9b700 1 -- 172.21.15.32:0/3652762822 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987806995 0 0) 0x7f60000d0b20 con 0x7f60000b8430 2023-06-20T13:32:15.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.138+0000 7f5ffdd9b700 1 -- 172.21.15.32:0/3652762822 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fec0035b0 con 0x7f60000b8430 2023-06-20T13:32:15.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.138+0000 7f5ffdd9b700 1 -- 172.21.15.32:0/3652762822 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2581543974 0 0) 0x7f5fec0035b0 con 0x7f60000b8430 2023-06-20T13:32:15.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.138+0000 7f5ffdd9b700 1 -- 172.21.15.32:0/3652762822 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60000cfa90 msgr2=0x7f60000d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:15.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.138+0000 7f5ffdd9b700 1 --2- 172.21.15.32:0/3652762822 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60000cfa90 0x7f60000d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:15.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.138+0000 7f5ffdd9b700 1 -- 172.21.15.32:0/3652762822 >> v2:172.21.15.115:3300/0 conn(0x7f60000d3730 msgr2=0x7f60000cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:15.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.138+0000 7f5ffdd9b700 1 --2- 172.21.15.32:0/3652762822 >> v2:172.21.15.115:3300/0 conn(0x7f60000d3730 0x7f60000cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:15.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.138+0000 7f5ffdd9b700 1 -- 172.21.15.32:0/3652762822 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60000cfeb0 con 0x7f60000b8430 2023-06-20T13:32:15.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.138+0000 7f5ffdd9b700 1 -- 172.21.15.32:0/3652762822 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3380058562 0 0) 0x7f5ff0001670 con 0x7f60000b8430 2023-06-20T13:32:15.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.139+0000 7f5ffdd9b700 1 -- 172.21.15.32:0/3652762822 >> v1:172.21.15.32:6789/0 conn(0x7f60000b8430 legacy=0x7f60000cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:15.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.139+0000 7f5ffdd9b700 1 --2- 172.21.15.32:0/3652762822 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60000cfa90 0x7f5fec003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:15.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.139+0000 7f5ffdd9b700 1 --2- 172.21.15.32:0/3652762822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5fec003f80 0x7f5fec004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:15.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.139+0000 7f5ffdd9b700 1 --2- 172.21.15.32:0/3652762822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fec004d90 0x7f5fec005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:15.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.139+0000 7f5ffdd9b700 1 -- 172.21.15.32:0/3652762822 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60000b8800 con 0x7f5fec003f80 2023-06-20T13:32:15.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.139+0000 7f5ffdd9b700 1 -- 172.21.15.32:0/3652762822 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec00ba10 con 0x7f5fec004d90 2023-06-20T13:32:15.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.139+0000 7f5ffdd9b700 1 -- 172.21.15.32:0/3652762822 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec00bb50 con 0x7f60000cfa90 2023-06-20T13:32:15.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.139+0000 7f5ff7fff700 1 --2- 172.21.15.32:0/3652762822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5fec003f80 0x7f5fec004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:15.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.139+0000 7f5ffe59c700 1 --2- 172.21.15.32:0/3652762822 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60000cfa90 0x7f5fec003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:15.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.139+0000 7f5ffed9d700 1 --2- 172.21.15.32:0/3652762822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fec004d90 0x7f5fec005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:15.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.139+0000 7f5ff7fff700 1 -- 172.21.15.32:0/3652762822 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60000cfa90 msgr2=0x7f5fec003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:15.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.139+0000 7f5ff7fff700 1 --2- 172.21.15.32:0/3652762822 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60000cfa90 0x7f5fec003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:15.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.139+0000 7f5ff7fff700 1 -- 172.21.15.32:0/3652762822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fec004d90 msgr2=0x7f5fec005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:15.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.139+0000 7f5ff7fff700 1 --2- 172.21.15.32:0/3652762822 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fec004d90 0x7f5fec005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:15.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.139+0000 7f5ff7fff700 1 -- 172.21.15.32:0/3652762822 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec0035b0 con 0x7f5fec003f80 2023-06-20T13:32:15.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.140+0000 7f5ff7fff700 1 --2- 172.21.15.32:0/3652762822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5fec003f80 0x7f5fec004850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8009b60 tx=0x7f5fec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945535fbfb43f28a server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:15.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.140+0000 7f5ffdd9b700 1 -- 172.21.15.32:0/3652762822 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe800e6c0 con 0x7f5fec003f80 2023-06-20T13:32:15.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.140+0000 7f5ffdd9b700 1 -- 172.21.15.32:0/3652762822 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe800e820 con 0x7f5fec003f80 2023-06-20T13:32:15.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.140+0000 7f5ffdd9b700 1 -- 172.21.15.32:0/3652762822 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe800eb90 con 0x7f5fec003f80 2023-06-20T13:32:15.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.140+0000 7f6004fff700 1 -- 172.21.15.32:0/3652762822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5fec003f80 msgr2=0x7f5fec004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:15.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.140+0000 7f6004fff700 1 --2- 172.21.15.32:0/3652762822 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5fec003f80 0x7f5fec004850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8009b60 tx=0x7f5fec005880 comp rx=0 tx=0).stop 2023-06-20T13:32:15.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.140+0000 7f5ffed9d700 1 -- 172.21.15.32:0/3652762822 reap_dead start 2023-06-20T13:32:15.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.140+0000 7f6004fff700 1 -- 172.21.15.32:0/3652762822 shutdown_connections 2023-06-20T13:32:15.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.140+0000 7f6004fff700 1 -- 172.21.15.32:0/3652762822 >> 172.21.15.32:0/3652762822 conn(0x7f600006b3f0 msgr2=0x7f600006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:15.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.140+0000 7f6004fff700 1 -- 172.21.15.32:0/3652762822 shutdown_connections 2023-06-20T13:32:15.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.140+0000 7f6004fff700 1 -- 172.21.15.32:0/3652762822 wait complete. 2023-06-20T13:32:15.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.142+0000 7f6004fff700 1 Processor -- start 2023-06-20T13:32:15.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.142+0000 7f6004fff700 1 -- start start 2023-06-20T13:32:15.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.143+0000 7f6004fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fec003f80 0x7f6000155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:15.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.143+0000 7f6004fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60000cc4c0 0x7f60001f29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:15.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.143+0000 7f6004fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60000c8790 0x7f60000c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:15.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.143+0000 7f6004fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60000c9170 con 0x7f60000cc4c0 2023-06-20T13:32:15.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.143+0000 7f6004fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60001f2ee0 con 0x7f5fec003f80 2023-06-20T13:32:15.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.143+0000 7f6004fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60000c6ca0 con 0x7f60000c8790 2023-06-20T13:32:15.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.144+0000 7f5ff7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60000cc4c0 0x7f60001f29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:15.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.144+0000 7f5ff7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60000cc4c0 0x7f60001f29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60472/0 (socket says 172.21.15.32:60472) 2023-06-20T13:32:15.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.144+0000 7f5ff7fff700 1 -- 172.21.15.32:0/4050025960 learned_addr learned my addr 172.21.15.32:0/4050025960 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:15.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.144+0000 7f5ff7fff700 1 -- 172.21.15.32:0/4050025960 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60000c8790 msgr2=0x7f60000c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:15.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.144+0000 7f5ff7fff700 1 --2- 172.21.15.32:0/4050025960 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60000c8790 0x7f60000c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:15.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.144+0000 7f5ff7fff700 1 -- 172.21.15.32:0/4050025960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fec003f80 msgr2=0x7f6000155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:15.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.144+0000 7f5ffe59c700 1 --2- 172.21.15.32:0/4050025960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fec003f80 0x7f6000155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:15.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.144+0000 7f5ff7fff700 1 --2- 172.21.15.32:0/4050025960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fec003f80 0x7f6000155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:15.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.144+0000 7f5ff7fff700 1 -- 172.21.15.32:0/4050025960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60000c6f80 con 0x7f60000cc4c0 2023-06-20T13:32:15.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.144+0000 7f5ffe59c700 1 --2- 172.21.15.32:0/4050025960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fec003f80 0x7f6000155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:32:15.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.144+0000 7f5ff7fff700 1 --2- 172.21.15.32:0/4050025960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60000cc4c0 0x7f60001f29a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80090b0 tx=0x7f5fe80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:15.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.144+0000 7f5ff6ffd700 1 -- 172.21.15.32:0/4050025960 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8021070 con 0x7f60000cc4c0 2023-06-20T13:32:15.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.144+0000 7f5ff6ffd700 1 -- 172.21.15.32:0/4050025960 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe8004510 con 0x7f60000cc4c0 2023-06-20T13:32:15.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.144+0000 7f5ff6ffd700 1 -- 172.21.15.32:0/4050025960 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe800e6c0 con 0x7f60000cc4c0 2023-06-20T13:32:15.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.144+0000 7f6004fff700 1 -- 172.21.15.32:0/4050025960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60000c7260 con 0x7f60000cc4c0 2023-06-20T13:32:15.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.145+0000 7f6004fff700 1 -- 172.21.15.32:0/4050025960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60000c7820 con 0x7f60000cc4c0 2023-06-20T13:32:15.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.146+0000 7f6004fff700 1 -- 172.21.15.32:0/4050025960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60000c79e0 con 0x7f60000cc4c0 2023-06-20T13:32:15.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.147+0000 7f5ff6ffd700 1 -- 172.21.15.32:0/4050025960 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5fe8025070 con 0x7f60000cc4c0 2023-06-20T13:32:15.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.148+0000 7f5ff6ffd700 1 --2- 172.21.15.32:0/4050025960 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5fe006ace0 0x7f5fe006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:15.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.148+0000 7f5ff6ffd700 1 -- 172.21.15.32:0/4050025960 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5fe808a470 con 0x7f60000cc4c0 2023-06-20T13:32:15.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.148+0000 7f5ffe59c700 1 --2- 172.21.15.32:0/4050025960 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5fe006ace0 0x7f5fe006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:15.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.148+0000 7f5ffe59c700 1 --2- 172.21.15.32:0/4050025960 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5fe006ace0 0x7f5fe006d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0000fb0 tx=0x7f5ff0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:15.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.152+0000 7f5ff6ffd700 1 -- 172.21.15.32:0/4050025960 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5fe8055a20 con 0x7f60000cc4c0 2023-06-20T13:32:15.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.359+0000 7f6004fff700 1 -- 172.21.15.32:0/4050025960 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f600004ea60 con 0x7f60000cc4c0 2023-06-20T13:32:15.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.360+0000 7f5ff6ffd700 1 -- 172.21.15.32:0/4050025960 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5fe8059040 con 0x7f60000cc4c0 2023-06-20T13:32:15.362 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 8 2023-06-20T13:32:15.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.362+0000 7f6004fff700 1 -- 172.21.15.32:0/4050025960 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5fe006ace0 msgr2=0x7f5fe006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:15.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.362+0000 7f6004fff700 1 --2- 172.21.15.32:0/4050025960 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5fe006ace0 0x7f5fe006d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0000fb0 tx=0x7f5ff0009040 comp rx=0 tx=0).stop 2023-06-20T13:32:15.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.362+0000 7f6004fff700 1 -- 172.21.15.32:0/4050025960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60000cc4c0 msgr2=0x7f60001f29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:15.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.362+0000 7f6004fff700 1 --2- 172.21.15.32:0/4050025960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60000cc4c0 0x7f60001f29a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80090b0 tx=0x7f5fe80047c0 comp rx=0 tx=0).stop 2023-06-20T13:32:15.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.362+0000 7f6004fff700 1 -- 172.21.15.32:0/4050025960 shutdown_connections 2023-06-20T13:32:15.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.362+0000 7f6004fff700 1 --2- 172.21.15.32:0/4050025960 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5fe006ace0 0x7f5fe006d190 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:15.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.362+0000 7f6004fff700 1 --2- 172.21.15.32:0/4050025960 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60000c8790 0x7f60000c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:15.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.362+0000 7f6004fff700 1 --2- 172.21.15.32:0/4050025960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fec003f80 0x7f6000155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:15.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.362+0000 7f6004fff700 1 --2- 172.21.15.32:0/4050025960 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60000cc4c0 0x7f60001f29a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:15.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.362+0000 7f6004fff700 1 -- 172.21.15.32:0/4050025960 >> 172.21.15.32:0/4050025960 conn(0x7f600006b3f0 msgr2=0x7f60000d2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:15.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.362+0000 7f6004fff700 1 -- 172.21.15.32:0/4050025960 shutdown_connections 2023-06-20T13:32:15.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.363+0000 7f6004fff700 1 -- 172.21.15.32:0/4050025960 wait complete. 2023-06-20T13:32:15.383 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-20T13:32:15.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.580+0000 7f77a7fff700 1 Processor -- start 2023-06-20T13:32:15.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.580+0000 7f77a7fff700 1 -- start start 2023-06-20T13:32:15.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.581+0000 7f77a7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f77a00d2640 0x7f77a00b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:15.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.581+0000 7f77a7fff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a00d1790 con 0x7f77a00cf8f0 2023-06-20T13:32:15.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.581+0000 7f77a7fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a00cd950 con 0x7f77a015c460 2023-06-20T13:32:15.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.581+0000 7f77a7fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a00cedd0 con 0x7f77a00d2640 2023-06-20T13:32:15.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.582+0000 7f77a659c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f77a00cf8f0 0x7f77a015fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47360/0 (socket says 172.21.15.32:47360) 2023-06-20T13:32:15.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.582+0000 7f77a659c700 1 -- 172.21.15.32:0/1928617162 learned_addr learned my addr 172.21.15.32:0/1928617162 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:15.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.582+0000 7f77a559a700 1 --2- 172.21.15.32:0/1928617162 >> v2:172.21.15.115:3300/0 conn(0x7f77a00d2640 0x7f77a00b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:15.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.582+0000 7f77a4d99700 1 -- 172.21.15.32:0/1928617162 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4138615888 0 0) 0x7f77a00d1790 con 0x7f77a00cf8f0 2023-06-20T13:32:15.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.582+0000 7f77a4d99700 1 -- 172.21.15.32:0/1928617162 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f778c0035b0 con 0x7f77a00cf8f0 2023-06-20T13:32:15.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.582+0000 7f77a559a700 1 -- 172.21.15.32:0/1928617162 >> v1:172.21.15.115:6789/0 conn(0x7f77a015c460 legacy=0x7f77a00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:15.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.582+0000 7f77a559a700 1 -- 172.21.15.32:0/1928617162 >> v1:172.21.15.32:6789/0 conn(0x7f77a00cf8f0 legacy=0x7f77a015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:15.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.582+0000 7f77a559a700 1 -- 172.21.15.32:0/1928617162 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a00d14b0 con 0x7f77a00d2640 2023-06-20T13:32:15.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.583+0000 7f77a559a700 1 --2- 172.21.15.32:0/1928617162 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77a00d2640 0x7f77a00b59d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7790009840 tx=0x7f7790009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b7c5eae36681ecb server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:15.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.583+0000 7f77a4d99700 1 -- 172.21.15.32:0/1928617162 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7790011830 con 0x7f77a00d2640 2023-06-20T13:32:15.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.583+0000 7f77a4d99700 1 -- 172.21.15.32:0/1928617162 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7790011990 con 0x7f77a00d2640 2023-06-20T13:32:15.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.583+0000 7f77a4d99700 1 -- 172.21.15.32:0/1928617162 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7790011d20 con 0x7f77a00d2640 2023-06-20T13:32:15.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.583+0000 7f77a7fff700 1 -- 172.21.15.32:0/1928617162 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77a00d2640 msgr2=0x7f77a00b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:15.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.583+0000 7f77a7fff700 1 --2- 172.21.15.32:0/1928617162 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77a00d2640 0x7f77a00b59d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7790009840 tx=0x7f7790009b50 comp rx=0 tx=0).stop 2023-06-20T13:32:15.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.584+0000 7f77a7fff700 1 -- 172.21.15.32:0/1928617162 shutdown_connections 2023-06-20T13:32:15.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.584+0000 7f77a7fff700 1 --2- 172.21.15.32:0/1928617162 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77a00d2640 0x7f77a00b59d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:15.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.584+0000 7f77a7fff700 1 -- 172.21.15.32:0/1928617162 >> 172.21.15.32:0/1928617162 conn(0x7f77a0071660 msgr2=0x7f77a0071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:15.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.584+0000 7f77a7fff700 1 -- 172.21.15.32:0/1928617162 shutdown_connections 2023-06-20T13:32:15.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.584+0000 7f77a7fff700 1 -- 172.21.15.32:0/1928617162 wait complete. 2023-06-20T13:32:15.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.585+0000 7f77a7fff700 1 Processor -- start 2023-06-20T13:32:15.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.586+0000 7f77a7fff700 1 -- start start 2023-06-20T13:32:15.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.586+0000 7f77a7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f77a00cf8f0 0x7f77a00c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:15.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.586+0000 7f77a7fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77a00d2640 0x7f77a015ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:15.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.586+0000 7f77a7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77a015c460 0x7f77a015ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:15.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.586+0000 7f77a7fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a00c9430 con 0x7f77a015c460 2023-06-20T13:32:15.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.586+0000 7f77a7fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a00c8580 con 0x7f77a00d2640 2023-06-20T13:32:15.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.586+0000 7f77a7fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a00c8820 con 0x7f77a00cf8f0 2023-06-20T13:32:15.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.587+0000 7f77a659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77a015c460 0x7f77a015ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:15.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.587+0000 7f77a659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77a015c460 0x7f77a015ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60474/0 (socket says 172.21.15.32:60474) 2023-06-20T13:32:15.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.587+0000 7f77a659c700 1 -- 172.21.15.32:0/3902116586 learned_addr learned my addr 172.21.15.32:0/3902116586 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:15.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.587+0000 7f77a559a700 1 --2- 172.21.15.32:0/3902116586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77a00d2640 0x7f77a015ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:15.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.587+0000 7f77a5d9b700 1 --2- 172.21.15.32:0/3902116586 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f77a00cf8f0 0x7f77a00c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:15.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.587+0000 7f77a659c700 1 -- 172.21.15.32:0/3902116586 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f77a00cf8f0 msgr2=0x7f77a00c69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:15.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.587+0000 7f77a659c700 1 --2- 172.21.15.32:0/3902116586 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f77a00cf8f0 0x7f77a00c69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:15.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.587+0000 7f77a659c700 1 -- 172.21.15.32:0/3902116586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77a00d2640 msgr2=0x7f77a015ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:15.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.587+0000 7f77a659c700 1 --2- 172.21.15.32:0/3902116586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77a00d2640 0x7f77a015ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:15.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.587+0000 7f77a659c700 1 -- 172.21.15.32:0/3902116586 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77900094a0 con 0x7f77a015c460 2023-06-20T13:32:15.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.587+0000 7f77a659c700 1 --2- 172.21.15.32:0/3902116586 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77a015c460 0x7f77a015ef40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f779800caa0 tx=0x7f779800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:15.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.588+0000 7f77967fc700 1 -- 172.21.15.32:0/3902116586 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779800a9e0 con 0x7f77a015c460 2023-06-20T13:32:15.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.588+0000 7f77967fc700 1 -- 172.21.15.32:0/3902116586 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779800ab40 con 0x7f77a015c460 2023-06-20T13:32:15.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.588+0000 7f77967fc700 1 -- 172.21.15.32:0/3902116586 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7798012400 con 0x7f77a015c460 2023-06-20T13:32:15.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.588+0000 7f77a7fff700 1 -- 172.21.15.32:0/3902116586 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a00c8b00 con 0x7f77a015c460 2023-06-20T13:32:15.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.588+0000 7f77a7fff700 1 -- 172.21.15.32:0/3902116586 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a00c90c0 con 0x7f77a015c460 2023-06-20T13:32:15.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.589+0000 7f77a7fff700 1 -- 172.21.15.32:0/3902116586 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a00c95a0 con 0x7f77a015c460 2023-06-20T13:32:15.594 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.590+0000 7f77967fc700 1 -- 172.21.15.32:0/3902116586 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f779801b3b0 con 0x7f77a015c460 2023-06-20T13:32:15.594 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.591+0000 7f77967fc700 1 --2- 172.21.15.32:0/3902116586 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f778406ace0 0x7f778406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:15.594 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.591+0000 7f77967fc700 1 -- 172.21.15.32:0/3902116586 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7798088fb0 con 0x7f77a015c460 2023-06-20T13:32:15.594 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.591+0000 7f77a5d9b700 1 --2- 172.21.15.32:0/3902116586 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f778406ace0 0x7f778406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:15.594 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.592+0000 7f77a5d9b700 1 --2- 172.21.15.32:0/3902116586 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f778406ace0 0x7f778406d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f779c000f60 tx=0x7f779c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:15.597 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.595+0000 7f77967fc700 1 -- 172.21.15.32:0/3902116586 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7798054310 con 0x7f77a015c460 2023-06-20T13:32:15.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.844+0000 7f77a7fff700 1 -- 172.21.15.32:0/3902116586 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77a004ea60 con 0x7f77a015c460 2023-06-20T13:32:15.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.845+0000 7f77967fc700 1 -- 172.21.15.32:0/3902116586 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7f7798017090 con 0x7f77a015c460 2023-06-20T13:32:15.847 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:32:15.847 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2171664589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2171664589},{"type":"v1","addr":"172.21.15.115:6834","nonce":2171664589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/959333888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":959333888},{"type":"v1","addr":"172.21.15.32:6837","nonce":959333888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3388117179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":3388117179},{"type":"v1","addr":"172.21.15.32:6835","nonce":3388117179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3566362693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3566362693},{"type":"v1","addr":"172.21.15.115:6835","nonce":3566362693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-06-20T13:32:15.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.847+0000 7f77a7fff700 1 -- 172.21.15.32:0/3902116586 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f778406ace0 msgr2=0x7f778406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:15.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.847+0000 7f77a7fff700 1 --2- 172.21.15.32:0/3902116586 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f778406ace0 0x7f778406d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f779c000f60 tx=0x7f779c009040 comp rx=0 tx=0).stop 2023-06-20T13:32:15.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.847+0000 7f77a7fff700 1 -- 172.21.15.32:0/3902116586 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77a015c460 msgr2=0x7f77a015ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:15.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.847+0000 7f77a7fff700 1 --2- 172.21.15.32:0/3902116586 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77a015c460 0x7f77a015ef40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f779800caa0 tx=0x7f779800cdb0 comp rx=0 tx=0).stop 2023-06-20T13:32:15.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.847+0000 7f77a7fff700 1 -- 172.21.15.32:0/3902116586 shutdown_connections 2023-06-20T13:32:15.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.847+0000 7f77a7fff700 1 --2- 172.21.15.32:0/3902116586 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f778406ace0 0x7f778406d190 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:15.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.847+0000 7f77a7fff700 1 --2- 172.21.15.32:0/3902116586 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77a015c460 0x7f77a015ef40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:15.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.847+0000 7f77a7fff700 1 --2- 172.21.15.32:0/3902116586 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f77a00cf8f0 0x7f77a00c69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:15.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.847+0000 7f77a7fff700 1 --2- 172.21.15.32:0/3902116586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77a00d2640 0x7f77a015ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:15.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.847+0000 7f77a7fff700 1 -- 172.21.15.32:0/3902116586 >> 172.21.15.32:0/3902116586 conn(0x7f77a0071660 msgr2=0x7f77a00b7980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:15.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.847+0000 7f77a7fff700 1 -- 172.21.15.32:0/3902116586 shutdown_connections 2023-06-20T13:32:15.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:15.847+0000 7f77a7fff700 1 -- 172.21.15.32:0/3902116586 wait complete. 2023-06-20T13:32:15.851 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 3 2023-06-20T13:32:15.867 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:32:16.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.065+0000 7f08e73ff700 1 Processor -- start 2023-06-20T13:32:16.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.065+0000 7f08e73ff700 1 -- start start 2023-06-20T13:32:16.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.067+0000 7f08e73ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f08e00b59d0 0x7f08e01671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:16.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.067+0000 7f08e73ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e00d1790 con 0x7f08e015c460 2023-06-20T13:32:16.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.067+0000 7f08e73ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e00cd950 con 0x7f08e00d2640 2023-06-20T13:32:16.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.067+0000 7f08e73ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e00b5e10 con 0x7f08e00b59d0 2023-06-20T13:32:16.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.067+0000 7f08e519b700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f08e015c460 0x7f08e00cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47376/0 (socket says 172.21.15.32:47376) 2023-06-20T13:32:16.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.067+0000 7f08e519b700 1 -- 172.21.15.32:0/2873563896 learned_addr learned my addr 172.21.15.32:0/2873563896 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:16.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.067+0000 7f08e599c700 1 --2- 172.21.15.32:0/2873563896 >> v2:172.21.15.115:3300/0 conn(0x7f08e00b59d0 0x7f08e01671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:16.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.067+0000 7f08d7fff700 1 -- 172.21.15.32:0/2873563896 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 823766173 0 0) 0x7f08e00d1790 con 0x7f08e015c460 2023-06-20T13:32:16.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.067+0000 7f08d7fff700 1 -- 172.21.15.32:0/2873563896 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08cc0035b0 con 0x7f08e015c460 2023-06-20T13:32:16.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.068+0000 7f08d7fff700 1 -- 172.21.15.32:0/2873563896 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3840398060 0 0) 0x7f08cc0035b0 con 0x7f08e015c460 2023-06-20T13:32:16.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.068+0000 7f08d7fff700 1 -- 172.21.15.32:0/2873563896 >> v2:172.21.15.115:3300/0 conn(0x7f08e00b59d0 msgr2=0x7f08e01671b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:16.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.068+0000 7f08d7fff700 1 --2- 172.21.15.32:0/2873563896 >> v2:172.21.15.115:3300/0 conn(0x7f08e00b59d0 0x7f08e01671b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:16.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.068+0000 7f08d7fff700 1 -- 172.21.15.32:0/2873563896 >> v1:172.21.15.115:6789/0 conn(0x7f08e00d2640 legacy=0x7f08e00cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:16.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.068+0000 7f08d7fff700 1 -- 172.21.15.32:0/2873563896 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e00d14b0 con 0x7f08e015c460 2023-06-20T13:32:16.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.068+0000 7f08d7fff700 1 -- 172.21.15.32:0/2873563896 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3380058562 0 0) 0x7f08dc001670 con 0x7f08e015c460 2023-06-20T13:32:16.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.068+0000 7f08d7fff700 1 -- 172.21.15.32:0/2873563896 >> v1:172.21.15.32:6789/0 conn(0x7f08e015c460 legacy=0x7f08e00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:16.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.068+0000 7f08d7fff700 1 --2- 172.21.15.32:0/2873563896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08cc003a00 0x7f08cc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:16.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.068+0000 7f08d7fff700 1 --2- 172.21.15.32:0/2873563896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08cc004850 0x7f08cc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:16.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.068+0000 7f08d7fff700 1 --2- 172.21.15.32:0/2873563896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08cc005320 0x7f08cc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:16.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.068+0000 7f08d7fff700 1 -- 172.21.15.32:0/2873563896 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e00b5e10 con 0x7f08cc005320 2023-06-20T13:32:16.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.068+0000 7f08d7fff700 1 -- 172.21.15.32:0/2873563896 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc00c250 con 0x7f08cc004850 2023-06-20T13:32:16.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.068+0000 7f08d7fff700 1 -- 172.21.15.32:0/2873563896 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc00c410 con 0x7f08cc003a00 2023-06-20T13:32:16.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.068+0000 7f08e599c700 1 --2- 172.21.15.32:0/2873563896 >> v2:172.21.15.115:3300/0 conn(0x7f08e00b59d0 0x7f08e01671b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:32:16.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.068+0000 7f08e519b700 1 --2- 172.21.15.32:0/2873563896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08cc003a00 0x7f08cc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:16.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.068+0000 7f08e499a700 1 --2- 172.21.15.32:0/2873563896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08cc004850 0x7f08cc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:16.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.068+0000 7f08e599c700 1 --2- 172.21.15.32:0/2873563896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08cc005320 0x7f08cc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:16.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.068+0000 7f08e519b700 1 -- 172.21.15.32:0/2873563896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08cc004850 msgr2=0x7f08cc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:16.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.068+0000 7f08e519b700 1 --2- 172.21.15.32:0/2873563896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08cc004850 0x7f08cc004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:16.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.068+0000 7f08e519b700 1 -- 172.21.15.32:0/2873563896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08cc005320 msgr2=0x7f08cc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:16.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.068+0000 7f08e519b700 1 --2- 172.21.15.32:0/2873563896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08cc005320 0x7f08cc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:16.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.068+0000 7f08e519b700 1 -- 172.21.15.32:0/2873563896 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08cc0035b0 con 0x7f08cc003a00 2023-06-20T13:32:16.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.069+0000 7f08e599c700 1 --2- 172.21.15.32:0/2873563896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08cc005320 0x7f08cc00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:32:16.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.069+0000 7f08e599c700 1 -- 172.21.15.32:0/2873563896 reap_dead start 2023-06-20T13:32:16.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.069+0000 7f08e519b700 1 --2- 172.21.15.32:0/2873563896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08cc003a00 0x7f08cc003e10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f08dc00c2a0 tx=0x7f08cc005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9030ce17a793f8bd server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:16.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.069+0000 7f08d7fff700 1 -- 172.21.15.32:0/2873563896 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc007c10 con 0x7f08cc003a00 2023-06-20T13:32:16.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.069+0000 7f08d7fff700 1 -- 172.21.15.32:0/2873563896 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08dc00cde0 con 0x7f08cc003a00 2023-06-20T13:32:16.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.069+0000 7f08d7fff700 1 -- 172.21.15.32:0/2873563896 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc005ba0 con 0x7f08cc003a00 2023-06-20T13:32:16.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.069+0000 7f08e73ff700 1 -- 172.21.15.32:0/2873563896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08cc003a00 msgr2=0x7f08cc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:16.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.069+0000 7f08e73ff700 1 --2- 172.21.15.32:0/2873563896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08cc003a00 0x7f08cc003e10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f08dc00c2a0 tx=0x7f08cc005880 comp rx=0 tx=0).stop 2023-06-20T13:32:16.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.070+0000 7f08e73ff700 1 -- 172.21.15.32:0/2873563896 shutdown_connections 2023-06-20T13:32:16.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.070+0000 7f08e73ff700 1 --2- 172.21.15.32:0/2873563896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08cc003a00 0x7f08cc003e10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:16.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.070+0000 7f08e73ff700 1 -- 172.21.15.32:0/2873563896 >> 172.21.15.32:0/2873563896 conn(0x7f08e0071660 msgr2=0x7f08e0071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:16.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.070+0000 7f08e73ff700 1 -- 172.21.15.32:0/2873563896 shutdown_connections 2023-06-20T13:32:16.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.070+0000 7f08e73ff700 1 -- 172.21.15.32:0/2873563896 wait complete. 2023-06-20T13:32:16.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.071+0000 7f08e73ff700 1 Processor -- start 2023-06-20T13:32:16.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.072+0000 7f08e73ff700 1 -- start start 2023-06-20T13:32:16.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.072+0000 7f08e73ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08cc003a00 0x7f08e014d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:16.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.072+0000 7f08e73ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e00ca410 0x7f08e00cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:16.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.072+0000 7f08e73ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08e015f140 0x7f08e00c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:16.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.072+0000 7f08e73ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e00ccea0 con 0x7f08cc003a00 2023-06-20T13:32:16.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.072+0000 7f08e73ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e015ecb0 con 0x7f08e00ca410 2023-06-20T13:32:16.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.072+0000 7f08e73ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e015e0a0 con 0x7f08e015f140 2023-06-20T13:32:16.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.073+0000 7f08e519b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08cc003a00 0x7f08e014d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:16.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.073+0000 7f08e519b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08cc003a00 0x7f08e014d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60496/0 (socket says 172.21.15.32:60496) 2023-06-20T13:32:16.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.073+0000 7f08e519b700 1 -- 172.21.15.32:0/372451855 learned_addr learned my addr 172.21.15.32:0/372451855 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:16.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.073+0000 7f08e599c700 1 --2- 172.21.15.32:0/372451855 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08e015f140 0x7f08e00c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:16.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.073+0000 7f08e499a700 1 --2- 172.21.15.32:0/372451855 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e00ca410 0x7f08e00cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:16.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.073+0000 7f08e519b700 1 -- 172.21.15.32:0/372451855 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08e015f140 msgr2=0x7f08e00c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:16.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.073+0000 7f08e519b700 1 --2- 172.21.15.32:0/372451855 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08e015f140 0x7f08e00c7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:16.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.073+0000 7f08e519b700 1 -- 172.21.15.32:0/372451855 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e00ca410 msgr2=0x7f08e00cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:16.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.073+0000 7f08e519b700 1 --2- 172.21.15.32:0/372451855 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e00ca410 0x7f08e00cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:16.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.073+0000 7f08e519b700 1 -- 172.21.15.32:0/372451855 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e015e380 con 0x7f08cc003a00 2023-06-20T13:32:16.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.073+0000 7f08e519b700 1 --2- 172.21.15.32:0/372451855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08cc003a00 0x7f08e014d630 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f08dc00c890 tx=0x7f08e00cd8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:16.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.074+0000 7f08d5ffb700 1 -- 172.21.15.32:0/372451855 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc001430 con 0x7f08cc003a00 2023-06-20T13:32:16.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.074+0000 7f08d5ffb700 1 -- 172.21.15.32:0/372451855 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08dc001590 con 0x7f08cc003a00 2023-06-20T13:32:16.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.074+0000 7f08e73ff700 1 -- 172.21.15.32:0/372451855 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e015e660 con 0x7f08cc003a00 2023-06-20T13:32:16.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.074+0000 7f08d5ffb700 1 -- 172.21.15.32:0/372451855 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc007310 con 0x7f08cc003a00 2023-06-20T13:32:16.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.074+0000 7f08e73ff700 1 -- 172.21.15.32:0/372451855 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e015dce0 con 0x7f08cc003a00 2023-06-20T13:32:16.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.075+0000 7f08e73ff700 1 -- 172.21.15.32:0/372451855 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e015ef90 con 0x7f08cc003a00 2023-06-20T13:32:16.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.076+0000 7f08d5ffb700 1 -- 172.21.15.32:0/372451855 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f08dc007470 con 0x7f08cc003a00 2023-06-20T13:32:16.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.077+0000 7f08d5ffb700 1 --2- 172.21.15.32:0/372451855 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f08c406ace0 0x7f08c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:16.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.077+0000 7f08d5ffb700 1 -- 172.21.15.32:0/372451855 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f08dc08a4f0 con 0x7f08cc003a00 2023-06-20T13:32:16.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.078+0000 7f08e499a700 1 --2- 172.21.15.32:0/372451855 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f08c406ace0 0x7f08c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:16.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.078+0000 7f08e499a700 1 --2- 172.21.15.32:0/372451855 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f08c406ace0 0x7f08c406d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f08e0151070 tx=0x7f08d0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:16.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.082+0000 7f08d5ffb700 1 -- 172.21.15.32:0/372451855 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f08dc055a40 con 0x7f08cc003a00 2023-06-20T13:32:16.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.289+0000 7f08e73ff700 1 -- 172.21.15.32:0/372451855 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08e004ea60 con 0x7f08cc003a00 2023-06-20T13:32:16.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.290+0000 7f08d5ffb700 1 -- 172.21.15.32:0/372451855 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14612 (secure 0 0 0) 0x7f08dc059060 con 0x7f08cc003a00 2023-06-20T13:32:16.292 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:32:16.292 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":19,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:32:14.968430+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:32:16.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.292+0000 7f08e73ff700 1 -- 172.21.15.32:0/372451855 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f08c406ace0 msgr2=0x7f08c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:16.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.292+0000 7f08e73ff700 1 --2- 172.21.15.32:0/372451855 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f08c406ace0 0x7f08c406d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f08e0151070 tx=0x7f08d0009040 comp rx=0 tx=0).stop 2023-06-20T13:32:16.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.292+0000 7f08e73ff700 1 -- 172.21.15.32:0/372451855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08cc003a00 msgr2=0x7f08e014d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:16.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.292+0000 7f08e73ff700 1 --2- 172.21.15.32:0/372451855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08cc003a00 0x7f08e014d630 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f08dc00c890 tx=0x7f08e00cd8c0 comp rx=0 tx=0).stop 2023-06-20T13:32:16.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.292+0000 7f08e73ff700 1 -- 172.21.15.32:0/372451855 shutdown_connections 2023-06-20T13:32:16.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.292+0000 7f08e73ff700 1 --2- 172.21.15.32:0/372451855 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f08c406ace0 0x7f08c406d190 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:16.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.292+0000 7f08e73ff700 1 --2- 172.21.15.32:0/372451855 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08e015f140 0x7f08e00c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:16.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.292+0000 7f08e73ff700 1 --2- 172.21.15.32:0/372451855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08cc003a00 0x7f08e014d630 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:16.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.292+0000 7f08e73ff700 1 --2- 172.21.15.32:0/372451855 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e00ca410 0x7f08e00cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:16.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.292+0000 7f08e73ff700 1 -- 172.21.15.32:0/372451855 >> 172.21.15.32:0/372451855 conn(0x7f08e0071660 msgr2=0x7f08e00d16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:16.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.292+0000 7f08e73ff700 1 -- 172.21.15.32:0/372451855 shutdown_connections 2023-06-20T13:32:16.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.292+0000 7f08e73ff700 1 -- 172.21.15.32:0/372451855 wait complete. 2023-06-20T13:32:16.312 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-20T13:32:05.308022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-20T13:32:12.857161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-20T13:32:16.313 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-20T13:32:16.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.515+0000 7ff346bff700 1 Processor -- start 2023-06-20T13:32:16.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.515+0000 7ff346bff700 1 -- start start 2023-06-20T13:32:16.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.516+0000 7ff346bff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff3400b8430 0x7ff3400cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:16.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.516+0000 7ff346bff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3400d3730 0x7ff3400cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:16.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.516+0000 7ff346bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3400d0b20 con 0x7ff3400cfa90 2023-06-20T13:32:16.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.516+0000 7ff346bff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3400b8800 con 0x7ff3400b8430 2023-06-20T13:32:16.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.516+0000 7ff346bff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3400cfeb0 con 0x7ff3400d3730 2023-06-20T13:32:16.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.516+0000 7ff34499b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff3400b8430 0x7ff3400cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:16.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.516+0000 7ff34499b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff3400b8430 0x7ff3400cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60506/0 (socket says 172.21.15.32:60506) 2023-06-20T13:32:16.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.516+0000 7ff34499b700 1 -- 172.21.15.32:0/3793941521 learned_addr learned my addr 172.21.15.32:0/3793941521 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:16.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.516+0000 7ff33ffff700 1 --2- 172.21.15.32:0/3793941521 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3400d3730 0x7ff3400cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:16.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.517+0000 7ff34499b700 1 -- 172.21.15.32:0/3793941521 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3400d3730 msgr2=0x7ff3400cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:16.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.517+0000 7ff34499b700 1 --2- 172.21.15.32:0/3793941521 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3400d3730 0x7ff3400cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:16.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.517+0000 7ff34499b700 1 -- 172.21.15.32:0/3793941521 >> v1:172.21.15.115:6789/0 conn(0x7ff3400cfa90 legacy=0x7ff34015feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:16.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.517+0000 7ff34499b700 1 -- 172.21.15.32:0/3793941521 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3400b4ee0 con 0x7ff3400b8430 2023-06-20T13:32:16.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.517+0000 7ff34499b700 1 --2- 172.21.15.32:0/3793941521 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3400b8430 0x7ff3400cd320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff3340098f0 tx=0x7ff334009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a0f73a4b0a59b8d server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:16.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.517+0000 7ff33f7fe700 1 -- 172.21.15.32:0/3793941521 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff334011830 con 0x7ff3400b8430 2023-06-20T13:32:16.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.517+0000 7ff33f7fe700 1 -- 172.21.15.32:0/3793941521 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff334011990 con 0x7ff3400b8430 2023-06-20T13:32:16.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.517+0000 7ff33f7fe700 1 -- 172.21.15.32:0/3793941521 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff334011d20 con 0x7ff3400b8430 2023-06-20T13:32:16.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.518+0000 7ff346bff700 1 -- 172.21.15.32:0/3793941521 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3400b8430 msgr2=0x7ff3400cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:16.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.518+0000 7ff346bff700 1 --2- 172.21.15.32:0/3793941521 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3400b8430 0x7ff3400cd320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff3340098f0 tx=0x7ff334009c00 comp rx=0 tx=0).stop 2023-06-20T13:32:16.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.518+0000 7ff346bff700 1 -- 172.21.15.32:0/3793941521 shutdown_connections 2023-06-20T13:32:16.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.518+0000 7ff346bff700 1 --2- 172.21.15.32:0/3793941521 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3400b8430 0x7ff3400cd320 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:16.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.518+0000 7ff346bff700 1 --2- 172.21.15.32:0/3793941521 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3400d3730 0x7ff3400cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:16.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.518+0000 7ff346bff700 1 -- 172.21.15.32:0/3793941521 >> 172.21.15.32:0/3793941521 conn(0x7ff34006b3f0 msgr2=0x7ff34006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:16.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.518+0000 7ff346bff700 1 -- 172.21.15.32:0/3793941521 shutdown_connections 2023-06-20T13:32:16.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.518+0000 7ff346bff700 1 -- 172.21.15.32:0/3793941521 wait complete. 2023-06-20T13:32:16.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.520+0000 7ff346bff700 1 Processor -- start 2023-06-20T13:32:16.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.520+0000 7ff346bff700 1 -- start start 2023-06-20T13:32:16.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.521+0000 7ff346bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3400b8430 0x7ff3401f1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:16.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.521+0000 7ff346bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3400cfa90 0x7ff3400b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:16.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.521+0000 7ff346bff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3400d3730 0x7ff3400c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:16.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.521+0000 7ff346bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3400b49c0 con 0x7ff3400cfa90 2023-06-20T13:32:16.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.521+0000 7ff346bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3400cabe0 con 0x7ff3400b8430 2023-06-20T13:32:16.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.521+0000 7ff346bff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3400c9fd0 con 0x7ff3400d3730 2023-06-20T13:32:16.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.521+0000 7ff33ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3400cfa90 0x7ff3400b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:16.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.521+0000 7ff33ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3400cfa90 0x7ff3400b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60508/0 (socket says 172.21.15.32:60508) 2023-06-20T13:32:16.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.521+0000 7ff33ffff700 1 -- 172.21.15.32:0/2356870723 learned_addr learned my addr 172.21.15.32:0/2356870723 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:16.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.521+0000 7ff33ffff700 1 -- 172.21.15.32:0/2356870723 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3400d3730 msgr2=0x7ff3400c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:16.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.521+0000 7ff33ffff700 1 --2- 172.21.15.32:0/2356870723 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3400d3730 0x7ff3400c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:16.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.521+0000 7ff33ffff700 1 -- 172.21.15.32:0/2356870723 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3400b8430 msgr2=0x7ff3401f1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:16.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.521+0000 7ff33ffff700 1 --2- 172.21.15.32:0/2356870723 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3400b8430 0x7ff3401f1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:16.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.521+0000 7ff33ffff700 1 -- 172.21.15.32:0/2356870723 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff334009550 con 0x7ff3400cfa90 2023-06-20T13:32:16.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.522+0000 7ff33ffff700 1 --2- 172.21.15.32:0/2356870723 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3400cfa90 0x7ff3400b4480 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00e9e0 tx=0x7ff32c00eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:16.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.522+0000 7ff33d7fa700 1 -- 172.21.15.32:0/2356870723 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c009710 con 0x7ff3400cfa90 2023-06-20T13:32:16.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.522+0000 7ff33d7fa700 1 -- 172.21.15.32:0/2356870723 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32c00c850 con 0x7ff3400cfa90 2023-06-20T13:32:16.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.522+0000 7ff346bff700 1 -- 172.21.15.32:0/2356870723 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3400ca2b0 con 0x7ff3400cfa90 2023-06-20T13:32:16.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.522+0000 7ff33d7fa700 1 -- 172.21.15.32:0/2356870723 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c00cbc0 con 0x7ff3400cfa90 2023-06-20T13:32:16.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.522+0000 7ff346bff700 1 -- 172.21.15.32:0/2356870723 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3400ca870 con 0x7ff3400cfa90 2023-06-20T13:32:16.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.523+0000 7ff346bff700 1 -- 172.21.15.32:0/2356870723 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff34004ea60 con 0x7ff3400cfa90 2023-06-20T13:32:16.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.524+0000 7ff33d7fa700 1 -- 172.21.15.32:0/2356870723 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff32c00cd20 con 0x7ff3400cfa90 2023-06-20T13:32:16.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.525+0000 7ff33d7fa700 1 --2- 172.21.15.32:0/2356870723 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff32406ace0 0x7ff32406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:16.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.525+0000 7ff33d7fa700 1 -- 172.21.15.32:0/2356870723 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff32c089310 con 0x7ff3400cfa90 2023-06-20T13:32:16.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.525+0000 7ff34499b700 1 --2- 172.21.15.32:0/2356870723 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff32406ace0 0x7ff32406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:16.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.526+0000 7ff34499b700 1 --2- 172.21.15.32:0/2356870723 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff32406ace0 0x7ff32406d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff334014040 tx=0x7ff334010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:16.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.529+0000 7ff33d7fa700 1 -- 172.21.15.32:0/2356870723 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff32c058100 con 0x7ff3400cfa90 2023-06-20T13:32:16.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.735+0000 7ff346bff700 1 -- 172.21.15.32:0/2356870723 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff34015b250 con 0x7ff3400cfa90 2023-06-20T13:32:16.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.736+0000 7ff33d7fa700 1 -- 172.21.15.32:0/2356870723 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff32c057c90 con 0x7ff3400cfa90 2023-06-20T13:32:16.739 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-06-20T13:32:16.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.738+0000 7ff346bff700 1 -- 172.21.15.32:0/2356870723 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff32406ace0 msgr2=0x7ff32406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:16.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.738+0000 7ff346bff700 1 --2- 172.21.15.32:0/2356870723 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff32406ace0 0x7ff32406d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff334014040 tx=0x7ff334010000 comp rx=0 tx=0).stop 2023-06-20T13:32:16.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.738+0000 7ff346bff700 1 -- 172.21.15.32:0/2356870723 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3400cfa90 msgr2=0x7ff3400b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:16.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.738+0000 7ff346bff700 1 --2- 172.21.15.32:0/2356870723 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3400cfa90 0x7ff3400b4480 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00e9e0 tx=0x7ff32c00eda0 comp rx=0 tx=0).stop 2023-06-20T13:32:16.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.738+0000 7ff346bff700 1 -- 172.21.15.32:0/2356870723 shutdown_connections 2023-06-20T13:32:16.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.738+0000 7ff346bff700 1 --2- 172.21.15.32:0/2356870723 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff32406ace0 0x7ff32406d190 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:16.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.738+0000 7ff346bff700 1 --2- 172.21.15.32:0/2356870723 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3400d3730 0x7ff3400c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:16.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.738+0000 7ff346bff700 1 --2- 172.21.15.32:0/2356870723 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3400b8430 0x7ff3401f1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:16.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.738+0000 7ff346bff700 1 --2- 172.21.15.32:0/2356870723 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3400cfa90 0x7ff3400b4480 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:16.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.738+0000 7ff346bff700 1 -- 172.21.15.32:0/2356870723 >> 172.21.15.32:0/2356870723 conn(0x7ff34006b3f0 msgr2=0x7ff3400b61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:16.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.739+0000 7ff346bff700 1 -- 172.21.15.32:0/2356870723 shutdown_connections 2023-06-20T13:32:16.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.739+0000 7ff346bff700 1 -- 172.21.15.32:0/2356870723 wait complete. 2023-06-20T13:32:16.759 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-20T13:32:16.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.960+0000 7f6f447ff700 1 Processor -- start 2023-06-20T13:32:16.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.960+0000 7f6f447ff700 1 -- start start 2023-06-20T13:32:16.964 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.961+0000 7f6f447ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6f3c0b8430 0x7f6f3c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:16.964 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.961+0000 7f6f447ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6f3c0d3730 0x7f6f3c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:16.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.962+0000 7f6f447ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f3c0cfa90 0x7f6f3c15feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:16.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.962+0000 7f6f447ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f3c0b8800 con 0x7f6f3c0b8430 2023-06-20T13:32:16.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.962+0000 7f6f447ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f3c0d0b20 con 0x7f6f3c0d3730 2023-06-20T13:32:16.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.962+0000 7f6f447ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c0cfeb0 con 0x7f6f3c0cfa90 2023-06-20T13:32:16.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.962+0000 7f6f4259b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6f3c0b8430 0x7f6f3c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:16.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.962+0000 7f6f4259b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6f3c0b8430 0x7f6f3c0cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60524/0 (socket says 172.21.15.32:60524) 2023-06-20T13:32:16.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.962+0000 7f6f4259b700 1 -- 172.21.15.32:0/497934678 learned_addr learned my addr 172.21.15.32:0/497934678 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:16.966 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.962+0000 7f6f42d9c700 1 --2- 172.21.15.32:0/497934678 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f3c0cfa90 0x7f6f3c15feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:16.966 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.962+0000 7f6f41d9a700 1 --2- 172.21.15.32:0/497934678 >> v2:172.21.15.115:3300/0 conn(0x7f6f3c0d3730 0x7f6f3c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:16.966 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.962+0000 7f6f4259b700 1 -- 172.21.15.32:0/497934678 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f3c0cfa90 msgr2=0x7f6f3c15feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:16.966 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.962+0000 7f6f4259b700 1 --2- 172.21.15.32:0/497934678 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f3c0cfa90 0x7f6f3c15feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:16.966 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.962+0000 7f6f4259b700 1 -- 172.21.15.32:0/497934678 >> v2:172.21.15.115:3300/0 conn(0x7f6f3c0d3730 msgr2=0x7f6f3c0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:16.966 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.962+0000 7f6f4259b700 1 --2- 172.21.15.32:0/497934678 >> v2:172.21.15.115:3300/0 conn(0x7f6f3c0d3730 0x7f6f3c0cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:16.966 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.962+0000 7f6f4259b700 1 -- 172.21.15.32:0/497934678 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3c0b4ee0 con 0x7f6f3c0b8430 2023-06-20T13:32:16.966 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.962+0000 7f6f4259b700 1 --2- 172.21.15.32:0/497934678 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f3c0b8430 0x7f6f3c0cd320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c160f50 tx=0x7f6f38009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f90bbe14ffc6e5e server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:16.967 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.963+0000 7f6f41599700 1 -- 172.21.15.32:0/497934678 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3800b870 con 0x7f6f3c0b8430 2023-06-20T13:32:16.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.963+0000 7f6f41599700 1 -- 172.21.15.32:0/497934678 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3800b9d0 con 0x7f6f3c0b8430 2023-06-20T13:32:16.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.963+0000 7f6f41599700 1 -- 172.21.15.32:0/497934678 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3800bd60 con 0x7f6f3c0b8430 2023-06-20T13:32:16.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.963+0000 7f6f447ff700 1 -- 172.21.15.32:0/497934678 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f3c0b8430 msgr2=0x7f6f3c0cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:16.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.963+0000 7f6f447ff700 1 --2- 172.21.15.32:0/497934678 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f3c0b8430 0x7f6f3c0cd320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c160f50 tx=0x7f6f38009bd0 comp rx=0 tx=0).stop 2023-06-20T13:32:16.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.963+0000 7f6f447ff700 1 -- 172.21.15.32:0/497934678 shutdown_connections 2023-06-20T13:32:16.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.963+0000 7f6f447ff700 1 --2- 172.21.15.32:0/497934678 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f3c0cfa90 0x7f6f3c15feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:16.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.963+0000 7f6f447ff700 1 --2- 172.21.15.32:0/497934678 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f3c0b8430 0x7f6f3c0cd320 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:16.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.963+0000 7f6f447ff700 1 --2- 172.21.15.32:0/497934678 >> v2:172.21.15.115:3300/0 conn(0x7f6f3c0d3730 0x7f6f3c0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:16.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.963+0000 7f6f447ff700 1 -- 172.21.15.32:0/497934678 >> 172.21.15.32:0/497934678 conn(0x7f6f3c06b3f0 msgr2=0x7f6f3c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:16.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.964+0000 7f6f447ff700 1 -- 172.21.15.32:0/497934678 shutdown_connections 2023-06-20T13:32:16.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.964+0000 7f6f447ff700 1 -- 172.21.15.32:0/497934678 wait complete. 2023-06-20T13:32:16.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.965+0000 7f6f447ff700 1 Processor -- start 2023-06-20T13:32:16.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.965+0000 7f6f447ff700 1 -- start start 2023-06-20T13:32:16.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.966+0000 7f6f447ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f3c0b8430 0x7f6f3c15d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:16.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.966+0000 7f6f447ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f3c0cfa90 0x7f6f3c1f2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:16.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.966+0000 7f6f447ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f3c0d3730 0x7f6f3c0c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:16.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.966+0000 7f6f447ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c15dc30 con 0x7f6f3c0d3730 2023-06-20T13:32:16.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.966+0000 7f6f447ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c1f2650 con 0x7f6f3c0cfa90 2023-06-20T13:32:16.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.966+0000 7f6f447ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c0c95a0 con 0x7f6f3c0b8430 2023-06-20T13:32:16.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.967+0000 7f6f42d9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f3c0d3730 0x7f6f3c0c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:16.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.967+0000 7f6f42d9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f3c0d3730 0x7f6f3c0c9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60526/0 (socket says 172.21.15.32:60526) 2023-06-20T13:32:16.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.967+0000 7f6f42d9c700 1 -- 172.21.15.32:0/1053580349 learned_addr learned my addr 172.21.15.32:0/1053580349 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:16.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.967+0000 7f6f41d9a700 1 --2- 172.21.15.32:0/1053580349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f3c0cfa90 0x7f6f3c1f2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:16.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.967+0000 7f6f4259b700 1 --2- 172.21.15.32:0/1053580349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f3c0b8430 0x7f6f3c15d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:16.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.967+0000 7f6f42d9c700 1 -- 172.21.15.32:0/1053580349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f3c0b8430 msgr2=0x7f6f3c15d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:16.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.967+0000 7f6f42d9c700 1 --2- 172.21.15.32:0/1053580349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f3c0b8430 0x7f6f3c15d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:16.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.967+0000 7f6f42d9c700 1 -- 172.21.15.32:0/1053580349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f3c0cfa90 msgr2=0x7f6f3c1f2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:16.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.967+0000 7f6f42d9c700 1 --2- 172.21.15.32:0/1053580349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f3c0cfa90 0x7f6f3c1f2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:16.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.967+0000 7f6f42d9c700 1 -- 172.21.15.32:0/1053580349 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f38009550 con 0x7f6f3c0d3730 2023-06-20T13:32:16.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.967+0000 7f6f41d9a700 1 --2- 172.21.15.32:0/1053580349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f3c0cfa90 0x7f6f3c1f2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:32:16.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.967+0000 7f6f4259b700 1 --2- 172.21.15.32:0/1053580349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f3c0b8430 0x7f6f3c15d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:32:16.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.967+0000 7f6f42d9c700 1 --2- 172.21.15.32:0/1053580349 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f3c0d3730 0x7f6f3c0c9060 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6f34007e60 tx=0x7f6f3400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:16.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.968+0000 7f6f32ffd700 1 -- 172.21.15.32:0/1053580349 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3400ede0 con 0x7f6f3c0d3730 2023-06-20T13:32:16.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.968+0000 7f6f32ffd700 1 -- 172.21.15.32:0/1053580349 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f34014420 con 0x7f6f3c0d3730 2023-06-20T13:32:16.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.968+0000 7f6f447ff700 1 -- 172.21.15.32:0/1053580349 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f3c1f2850 con 0x7f6f3c0d3730 2023-06-20T13:32:16.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.968+0000 7f6f32ffd700 1 -- 172.21.15.32:0/1053580349 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f340147d0 con 0x7f6f3c0d3730 2023-06-20T13:32:16.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.968+0000 7f6f447ff700 1 -- 172.21.15.32:0/1053580349 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3c15cc10 con 0x7f6f3c0d3730 2023-06-20T13:32:16.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.969+0000 7f6f447ff700 1 -- 172.21.15.32:0/1053580349 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f3c04ea60 con 0x7f6f3c0d3730 2023-06-20T13:32:16.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.970+0000 7f6f32ffd700 1 -- 172.21.15.32:0/1053580349 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6f34014930 con 0x7f6f3c0d3730 2023-06-20T13:32:16.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.971+0000 7f6f32ffd700 1 --2- 172.21.15.32:0/1053580349 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6f2006ad10 0x7f6f2006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:16.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.971+0000 7f6f32ffd700 1 -- 172.21.15.32:0/1053580349 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6f34089850 con 0x7f6f3c0d3730 2023-06-20T13:32:16.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.971+0000 7f6f4259b700 1 --2- 172.21.15.32:0/1053580349 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6f2006ad10 0x7f6f2006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:16.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.971+0000 7f6f4259b700 1 --2- 172.21.15.32:0/1053580349 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6f2006ad10 0x7f6f2006d1c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009130 tx=0x7f6f38008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:16.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:16.975+0000 7f6f32ffd700 1 -- 172.21.15.32:0/1053580349 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6f34054c40 con 0x7f6f3c0d3730 2023-06-20T13:32:17.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.182+0000 7f6f447ff700 1 -- 172.21.15.32:0/1053580349 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6f3c15fbf0 con 0x7f6f3c0d3730 2023-06-20T13:32:17.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.183+0000 7f6f32ffd700 1 -- 172.21.15.32:0/1053580349 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6f34058260 con 0x7f6f3c0d3730 2023-06-20T13:32:17.185 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 8 2023-06-20T13:32:17.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.185+0000 7f6f447ff700 1 -- 172.21.15.32:0/1053580349 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6f2006ad10 msgr2=0x7f6f2006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:17.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.185+0000 7f6f447ff700 1 --2- 172.21.15.32:0/1053580349 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6f2006ad10 0x7f6f2006d1c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009130 tx=0x7f6f38008030 comp rx=0 tx=0).stop 2023-06-20T13:32:17.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.185+0000 7f6f447ff700 1 -- 172.21.15.32:0/1053580349 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f3c0d3730 msgr2=0x7f6f3c0c9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:17.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.185+0000 7f6f447ff700 1 --2- 172.21.15.32:0/1053580349 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f3c0d3730 0x7f6f3c0c9060 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6f34007e60 tx=0x7f6f3400e3c0 comp rx=0 tx=0).stop 2023-06-20T13:32:17.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.185+0000 7f6f447ff700 1 -- 172.21.15.32:0/1053580349 shutdown_connections 2023-06-20T13:32:17.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.185+0000 7f6f447ff700 1 --2- 172.21.15.32:0/1053580349 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6f2006ad10 0x7f6f2006d1c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:17.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.185+0000 7f6f447ff700 1 --2- 172.21.15.32:0/1053580349 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f3c0d3730 0x7f6f3c0c9060 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:17.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.185+0000 7f6f447ff700 1 --2- 172.21.15.32:0/1053580349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f3c0b8430 0x7f6f3c15d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:17.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.185+0000 7f6f447ff700 1 --2- 172.21.15.32:0/1053580349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f3c0cfa90 0x7f6f3c1f2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:17.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.185+0000 7f6f447ff700 1 -- 172.21.15.32:0/1053580349 >> 172.21.15.32:0/1053580349 conn(0x7f6f3c06b3f0 msgr2=0x7f6f3c0b6250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:17.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.185+0000 7f6f447ff700 1 -- 172.21.15.32:0/1053580349 shutdown_connections 2023-06-20T13:32:17.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.185+0000 7f6f447ff700 1 -- 172.21.15.32:0/1053580349 wait complete. 2023-06-20T13:32:17.205 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-20T13:32:17.406 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.403+0000 7fd13c9ff700 1 Processor -- start 2023-06-20T13:32:17.406 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.404+0000 7fd13c9ff700 1 -- start start 2023-06-20T13:32:17.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.405+0000 7fd13c9ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd13815c460 0x7fd1380b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:17.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.405+0000 7fd13c9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd1380d2640 0x7fd1380cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:17.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.405+0000 7fd13c9ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1380d1790 con 0x7fd1380cf720 2023-06-20T13:32:17.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.405+0000 7fd13c9ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1380cedd0 con 0x7fd13815c460 2023-06-20T13:32:17.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.405+0000 7fd13c9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1380cd950 con 0x7fd1380d2640 2023-06-20T13:32:17.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.405+0000 7fd13659c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd13815c460 0x7fd1380b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:17.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.405+0000 7fd136d9d700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd1380cf720 0x7fd1380d2b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:47388/0 (socket says 172.21.15.32:47388) 2023-06-20T13:32:17.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.405+0000 7fd136d9d700 1 -- 172.21.15.32:0/1576709243 learned_addr learned my addr 172.21.15.32:0/1576709243 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:17.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.405+0000 7fd12ffff700 1 --2- 172.21.15.32:0/1576709243 >> v2:172.21.15.115:3300/0 conn(0x7fd1380d2640 0x7fd1380cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:17.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.406+0000 7fd13659c700 1 -- 172.21.15.32:0/1576709243 >> v2:172.21.15.115:3300/0 conn(0x7fd1380d2640 msgr2=0x7fd1380cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:17.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.406+0000 7fd13659c700 1 --2- 172.21.15.32:0/1576709243 >> v2:172.21.15.115:3300/0 conn(0x7fd1380d2640 0x7fd1380cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:17.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.406+0000 7fd13659c700 1 -- 172.21.15.32:0/1576709243 >> v1:172.21.15.32:6789/0 conn(0x7fd1380cf720 legacy=0x7fd1380d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:17.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.406+0000 7fd13659c700 1 -- 172.21.15.32:0/1576709243 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1380d14b0 con 0x7fd13815c460 2023-06-20T13:32:17.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.406+0000 7fd135d9b700 1 -- 172.21.15.32:0/1576709243 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2969056802 0 0) 0x7fd1380d1790 con 0x7fd1380cf720 2023-06-20T13:32:17.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.406+0000 7fd13659c700 1 --2- 172.21.15.32:0/1576709243 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd13815c460 0x7fd1380b59d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd13815fd80 tx=0x7fd128009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b536deb775d70e9d server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:17.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.406+0000 7fd135d9b700 1 -- 172.21.15.32:0/1576709243 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd128011830 con 0x7fd13815c460 2023-06-20T13:32:17.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.406+0000 7fd135d9b700 1 -- 172.21.15.32:0/1576709243 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd128011990 con 0x7fd13815c460 2023-06-20T13:32:17.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.406+0000 7fd135d9b700 1 -- 172.21.15.32:0/1576709243 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd128011d20 con 0x7fd13815c460 2023-06-20T13:32:17.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.407+0000 7fd13c9ff700 1 -- 172.21.15.32:0/1576709243 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd13815c460 msgr2=0x7fd1380b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:17.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.407+0000 7fd13c9ff700 1 --2- 172.21.15.32:0/1576709243 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd13815c460 0x7fd1380b59d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd13815fd80 tx=0x7fd128009b20 comp rx=0 tx=0).stop 2023-06-20T13:32:17.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.407+0000 7fd13c9ff700 1 -- 172.21.15.32:0/1576709243 shutdown_connections 2023-06-20T13:32:17.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.407+0000 7fd13c9ff700 1 --2- 172.21.15.32:0/1576709243 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd13815c460 0x7fd1380b59d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:17.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.407+0000 7fd13c9ff700 1 --2- 172.21.15.32:0/1576709243 >> v2:172.21.15.115:3300/0 conn(0x7fd1380d2640 0x7fd1380cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:17.412 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.407+0000 7fd13c9ff700 1 -- 172.21.15.32:0/1576709243 >> 172.21.15.32:0/1576709243 conn(0x7fd138071660 msgr2=0x7fd138071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:17.412 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.407+0000 7fd13c9ff700 1 -- 172.21.15.32:0/1576709243 shutdown_connections 2023-06-20T13:32:17.412 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.407+0000 7fd13c9ff700 1 -- 172.21.15.32:0/1576709243 wait complete. 2023-06-20T13:32:17.413 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.409+0000 7fd13c9ff700 1 Processor -- start 2023-06-20T13:32:17.413 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.409+0000 7fd13c9ff700 1 -- start start 2023-06-20T13:32:17.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.410+0000 7fd13c9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1380cf720 0x7fd1381f18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:17.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.410+0000 7fd13c9ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1380d2640 0x7fd138142c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:17.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.410+0000 7fd13c9ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd13815c460 0x7fd138143150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:17.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.410+0000 7fd13c9ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1381f1de0 con 0x7fd1380d2640 2023-06-20T13:32:17.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.410+0000 7fd13c9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd138156560 con 0x7fd1380cf720 2023-06-20T13:32:17.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.410+0000 7fd13c9ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1380cb210 con 0x7fd13815c460 2023-06-20T13:32:17.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.410+0000 7fd12ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1380d2640 0x7fd138142c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:17.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.410+0000 7fd12ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1380d2640 0x7fd138142c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60544/0 (socket says 172.21.15.32:60544) 2023-06-20T13:32:17.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.410+0000 7fd12ffff700 1 -- 172.21.15.32:0/4147878471 learned_addr learned my addr 172.21.15.32:0/4147878471 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:17.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.410+0000 7fd136d9d700 1 --2- 172.21.15.32:0/4147878471 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd13815c460 0x7fd138143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:17.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.410+0000 7fd13659c700 1 --2- 172.21.15.32:0/4147878471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1380cf720 0x7fd1381f18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:17.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.410+0000 7fd12ffff700 1 -- 172.21.15.32:0/4147878471 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd13815c460 msgr2=0x7fd138143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:17.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.410+0000 7fd12ffff700 1 --2- 172.21.15.32:0/4147878471 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd13815c460 0x7fd138143150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:17.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.410+0000 7fd12ffff700 1 -- 172.21.15.32:0/4147878471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1380cf720 msgr2=0x7fd1381f18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:17.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.410+0000 7fd12ffff700 1 --2- 172.21.15.32:0/4147878471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1380cf720 0x7fd1381f18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:17.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.410+0000 7fd12ffff700 1 -- 172.21.15.32:0/4147878471 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1280094a0 con 0x7fd1380d2640 2023-06-20T13:32:17.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.411+0000 7fd12ffff700 1 --2- 172.21.15.32:0/4147878471 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1380d2640 0x7fd138142c10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd12000e870 tx=0x7fd12000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:17.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.411+0000 7fd12effd700 1 -- 172.21.15.32:0/4147878471 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd120009590 con 0x7fd1380d2640 2023-06-20T13:32:17.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.411+0000 7fd12effd700 1 -- 172.21.15.32:0/4147878471 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12000ee70 con 0x7fd1380d2640 2023-06-20T13:32:17.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.411+0000 7fd12effd700 1 -- 172.21.15.32:0/4147878471 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12000ca50 con 0x7fd1380d2640 2023-06-20T13:32:17.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.411+0000 7fd13c9ff700 1 -- 172.21.15.32:0/4147878471 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1380cb4f0 con 0x7fd1380d2640 2023-06-20T13:32:17.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.411+0000 7fd13c9ff700 1 -- 172.21.15.32:0/4147878471 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1380cbab0 con 0x7fd1380d2640 2023-06-20T13:32:17.417 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.412+0000 7fd13c9ff700 1 -- 172.21.15.32:0/4147878471 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1380d1140 con 0x7fd1380d2640 2023-06-20T13:32:17.417 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.413+0000 7fd12effd700 1 -- 172.21.15.32:0/4147878471 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd12000cbb0 con 0x7fd1380d2640 2023-06-20T13:32:17.417 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.414+0000 7fd12effd700 1 --2- 172.21.15.32:0/4147878471 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd11806ace0 0x7fd11806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:17.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.414+0000 7fd12effd700 1 -- 172.21.15.32:0/4147878471 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd120089110 con 0x7fd1380d2640 2023-06-20T13:32:17.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.414+0000 7fd13659c700 1 --2- 172.21.15.32:0/4147878471 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd11806ace0 0x7fd11806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:17.418 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.415+0000 7fd13659c700 1 --2- 172.21.15.32:0/4147878471 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd11806ace0 0x7fd11806d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd1280090b0 tx=0x7fd128008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:17.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.418+0000 7fd12effd700 1 -- 172.21.15.32:0/4147878471 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd1380d1140 con 0x7fd1380d2640 2023-06-20T13:32:17.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.625+0000 7fd13c9ff700 1 -- 172.21.15.32:0/4147878471 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd1380d1140 con 0x7fd1380d2640 2023-06-20T13:32:17.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.625+0000 7fd12effd700 1 -- 172.21.15.32:0/4147878471 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7fd120021090 con 0x7fd1380d2640 2023-06-20T13:32:17.628 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:32:17.628 INFO:teuthology.orchestra.run.smithi032.stdout:[ 2023-06-20T13:32:17.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-06-20T13:32:17.628 INFO:teuthology.orchestra.run.smithi032.stdout: "poolnum": 1, 2023-06-20T13:32:17.628 INFO:teuthology.orchestra.run.smithi032.stdout: "poolname": ".mgr" 2023-06-20T13:32:17.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:32:17.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-06-20T13:32:17.629 INFO:teuthology.orchestra.run.smithi032.stdout: "poolnum": 2, 2023-06-20T13:32:17.629 INFO:teuthology.orchestra.run.smithi032.stdout: "poolname": "rbd" 2023-06-20T13:32:17.629 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-06-20T13:32:17.629 INFO:teuthology.orchestra.run.smithi032.stdout:] 2023-06-20T13:32:17.630 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.628+0000 7fd13c9ff700 1 -- 172.21.15.32:0/4147878471 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd11806ace0 msgr2=0x7fd11806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:17.630 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.628+0000 7fd13c9ff700 1 --2- 172.21.15.32:0/4147878471 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd11806ace0 0x7fd11806d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd1280090b0 tx=0x7fd128008030 comp rx=0 tx=0).stop 2023-06-20T13:32:17.630 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.628+0000 7fd13c9ff700 1 -- 172.21.15.32:0/4147878471 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1380d2640 msgr2=0x7fd138142c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:17.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.628+0000 7fd13c9ff700 1 --2- 172.21.15.32:0/4147878471 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1380d2640 0x7fd138142c10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd12000e870 tx=0x7fd12000ec30 comp rx=0 tx=0).stop 2023-06-20T13:32:17.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.628+0000 7fd13c9ff700 1 -- 172.21.15.32:0/4147878471 shutdown_connections 2023-06-20T13:32:17.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.628+0000 7fd13c9ff700 1 --2- 172.21.15.32:0/4147878471 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd11806ace0 0x7fd11806d190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:17.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.628+0000 7fd13c9ff700 1 --2- 172.21.15.32:0/4147878471 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd13815c460 0x7fd138143150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:17.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.628+0000 7fd13c9ff700 1 --2- 172.21.15.32:0/4147878471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1380cf720 0x7fd1381f18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:17.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.628+0000 7fd13c9ff700 1 --2- 172.21.15.32:0/4147878471 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd1380d2640 0x7fd138142c10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:17.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.628+0000 7fd13c9ff700 1 -- 172.21.15.32:0/4147878471 >> 172.21.15.32:0/4147878471 conn(0x7fd138071660 msgr2=0x7fd1380b74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:17.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.628+0000 7fd13c9ff700 1 -- 172.21.15.32:0/4147878471 shutdown_connections 2023-06-20T13:32:17.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.628+0000 7fd13c9ff700 1 -- 172.21.15.32:0/4147878471 wait complete. 2023-06-20T13:32:17.647 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-20T13:32:17.648 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-20T13:32:17.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.851+0000 7fc7d59ff700 1 Processor -- start 2023-06-20T13:32:17.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.851+0000 7fc7d59ff700 1 -- start start 2023-06-20T13:32:17.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.852+0000 7fc7d59ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc7d00b1f00 0x7fc7d0160870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:17.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.852+0000 7fc7d59ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7d00cf4d0 0x7fc7d00cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:17.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.852+0000 7fc7d59ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7d0160db0 con 0x7fc7d00b82c0 2023-06-20T13:32:17.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.852+0000 7fc7d59ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7d00b8690 con 0x7fc7d00b1f00 2023-06-20T13:32:17.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.852+0000 7fc7d59ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d00cfe90 con 0x7fc7d00cf4d0 2023-06-20T13:32:17.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.852+0000 7fc7cf7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7d00cf4d0 0x7fc7d00cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:17.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.852+0000 7fc7ce7fc700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc7d00b1f00 0x7fc7d0160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:17.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.853+0000 7fc7cf7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7d00cf4d0 0x7fc7d00cf950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.32:59620/0 (socket says 172.21.15.32:59620) 2023-06-20T13:32:17.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.853+0000 7fc7cf7fe700 1 -- 172.21.15.32:0/3598795987 learned_addr learned my addr 172.21.15.32:0/3598795987 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:17.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.853+0000 7fc7ceffd700 1 --1- 172.21.15.32:0/3598795987 >> v1:172.21.15.115:6789/0 conn(0x7fc7d00b82c0 0x7fc7d00ceca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.32:49874/0 (socket says 172.21.15.32:49874) 2023-06-20T13:32:17.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.853+0000 7fc7cdffb700 1 -- 172.21.15.32:0/3598795987 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2559750761 0 0) 0x7fc7c0001110 con 0x7fc7d00b82c0 2023-06-20T13:32:17.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.853+0000 7fc7cdffb700 1 -- 172.21.15.32:0/3598795987 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7b80035b0 con 0x7fc7d00b82c0 2023-06-20T13:32:17.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.853+0000 7fc7cf7fe700 1 -- 172.21.15.32:0/3598795987 >> v2:172.21.15.115:3300/0 conn(0x7fc7d00b1f00 msgr2=0x7fc7d0160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:17.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.853+0000 7fc7cf7fe700 1 --2- 172.21.15.32:0/3598795987 >> v2:172.21.15.115:3300/0 conn(0x7fc7d00b1f00 0x7fc7d0160870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:17.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.853+0000 7fc7cf7fe700 1 -- 172.21.15.32:0/3598795987 >> v1:172.21.15.115:6789/0 conn(0x7fc7d00b82c0 legacy=0x7fc7d00ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:17.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.853+0000 7fc7cf7fe700 1 -- 172.21.15.32:0/3598795987 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d015fe20 con 0x7fc7d00cf4d0 2023-06-20T13:32:17.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.853+0000 7fc7ce7fc700 1 --2- 172.21.15.32:0/3598795987 >> v2:172.21.15.115:3300/0 conn(0x7fc7d00b1f00 0x7fc7d0160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:32:17.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.853+0000 7fc7cf7fe700 1 --2- 172.21.15.32:0/3598795987 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7d00cf4d0 0x7fc7d00cf950 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8009e50 tx=0x7fc7c800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adc5c6cdefe9a0fc server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:17.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.854+0000 7fc7cdffb700 1 -- 172.21.15.32:0/3598795987 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c800e070 con 0x7fc7d00cf4d0 2023-06-20T13:32:17.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.854+0000 7fc7cdffb700 1 -- 172.21.15.32:0/3598795987 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c800b910 con 0x7fc7d00cf4d0 2023-06-20T13:32:17.859 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.854+0000 7fc7cdffb700 1 -- 172.21.15.32:0/3598795987 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c800bcc0 con 0x7fc7d00cf4d0 2023-06-20T13:32:17.859 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.854+0000 7fc7d59ff700 1 -- 172.21.15.32:0/3598795987 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7d00cf4d0 msgr2=0x7fc7d00cf950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:17.859 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.854+0000 7fc7d59ff700 1 --2- 172.21.15.32:0/3598795987 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7d00cf4d0 0x7fc7d00cf950 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8009e50 tx=0x7fc7c800b330 comp rx=0 tx=0).stop 2023-06-20T13:32:17.859 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.854+0000 7fc7d59ff700 1 -- 172.21.15.32:0/3598795987 shutdown_connections 2023-06-20T13:32:17.859 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.854+0000 7fc7d59ff700 1 --2- 172.21.15.32:0/3598795987 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7d00cf4d0 0x7fc7d00cf950 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:17.859 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.854+0000 7fc7d59ff700 1 --2- 172.21.15.32:0/3598795987 >> v2:172.21.15.115:3300/0 conn(0x7fc7d00b1f00 0x7fc7d0160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:17.859 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.854+0000 7fc7d59ff700 1 -- 172.21.15.32:0/3598795987 >> 172.21.15.32:0/3598795987 conn(0x7fc7d0071660 msgr2=0x7fc7d0071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:17.860 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.854+0000 7fc7d59ff700 1 -- 172.21.15.32:0/3598795987 shutdown_connections 2023-06-20T13:32:17.860 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.854+0000 7fc7d59ff700 1 -- 172.21.15.32:0/3598795987 wait complete. 2023-06-20T13:32:17.861 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.856+0000 7fc7d59ff700 1 Processor -- start 2023-06-20T13:32:17.861 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.856+0000 7fc7d59ff700 1 -- start start 2023-06-20T13:32:17.861 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.857+0000 7fc7d59ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7d00b1f00 0x7fc7d01574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:17.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.857+0000 7fc7d59ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7d00b82c0 0x7fc7d00d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:17.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.857+0000 7fc7d59ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7d00cf4d0 0x7fc7d00d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:17.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.857+0000 7fc7d59ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d01579f0 con 0x7fc7d00b82c0 2023-06-20T13:32:17.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.857+0000 7fc7d59ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d015e620 con 0x7fc7d00cf4d0 2023-06-20T13:32:17.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.857+0000 7fc7d59ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d015da10 con 0x7fc7d00b1f00 2023-06-20T13:32:17.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.857+0000 7fc7ce7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7d00b82c0 0x7fc7d00d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:17.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.857+0000 7fc7cf7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7d00cf4d0 0x7fc7d00d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:17.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.857+0000 7fc7ce7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7d00b82c0 0x7fc7d00d06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60556/0 (socket says 172.21.15.32:60556) 2023-06-20T13:32:17.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.857+0000 7fc7ceffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7d00b1f00 0x7fc7d01574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:17.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.857+0000 7fc7ce7fc700 1 -- 172.21.15.32:0/4160207928 learned_addr learned my addr 172.21.15.32:0/4160207928 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:17.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.858+0000 7fc7cf7fe700 1 -- 172.21.15.32:0/4160207928 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7d00b1f00 msgr2=0x7fc7d01574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:17.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.858+0000 7fc7cf7fe700 1 --2- 172.21.15.32:0/4160207928 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7d00b1f00 0x7fc7d01574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:17.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.858+0000 7fc7cf7fe700 1 -- 172.21.15.32:0/4160207928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7d00b82c0 msgr2=0x7fc7d00d06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:17.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.858+0000 7fc7cf7fe700 1 --2- 172.21.15.32:0/4160207928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7d00b82c0 0x7fc7d00d06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:17.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.858+0000 7fc7cf7fe700 1 -- 172.21.15.32:0/4160207928 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c40094a0 con 0x7fc7d00cf4d0 2023-06-20T13:32:17.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.858+0000 7fc7ce7fc700 1 --2- 172.21.15.32:0/4160207928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7d00b82c0 0x7fc7d00d06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:32:17.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.858+0000 7fc7cf7fe700 1 --2- 172.21.15.32:0/4160207928 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7d00cf4d0 0x7fc7d00d0be0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8015000 tx=0x7fc7c8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:17.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.858+0000 7fc7b7fff700 1 -- 172.21.15.32:0/4160207928 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8004800 con 0x7fc7d00cf4d0 2023-06-20T13:32:17.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.858+0000 7fc7b7fff700 1 -- 172.21.15.32:0/4160207928 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c8004960 con 0x7fc7d00cf4d0 2023-06-20T13:32:17.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.858+0000 7fc7d59ff700 1 -- 172.21.15.32:0/4160207928 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c8009b30 con 0x7fc7d00cf4d0 2023-06-20T13:32:17.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.858+0000 7fc7b7fff700 1 -- 172.21.15.32:0/4160207928 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c801b670 con 0x7fc7d00cf4d0 2023-06-20T13:32:17.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.859+0000 7fc7d59ff700 1 -- 172.21.15.32:0/4160207928 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d015dfd0 con 0x7fc7d00cf4d0 2023-06-20T13:32:17.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.859+0000 7fc7d59ff700 1 -- 172.21.15.32:0/4160207928 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7d015e790 con 0x7fc7d00cf4d0 2023-06-20T13:32:17.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.861+0000 7fc7b7fff700 1 -- 172.21.15.32:0/4160207928 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc7c801b7d0 con 0x7fc7d00cf4d0 2023-06-20T13:32:17.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.861+0000 7fc7b7fff700 1 --2- 172.21.15.32:0/4160207928 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fc7bc06ace0 0x7fc7bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:17.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.861+0000 7fc7b7fff700 1 -- 172.21.15.32:0/4160207928 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc7c808a550 con 0x7fc7d00cf4d0 2023-06-20T13:32:17.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.862+0000 7fc7ceffd700 1 --2- 172.21.15.32:0/4160207928 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fc7bc06ace0 0x7fc7bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:17.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.862+0000 7fc7ceffd700 1 --2- 172.21.15.32:0/4160207928 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fc7bc06ace0 0x7fc7bc06d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0001370 tx=0x7fc7c0007c40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:17.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:17.867+0000 7fc7b7fff700 1 -- 172.21.15.32:0/4160207928 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc7c8055940 con 0x7fc7d00cf4d0 2023-06-20T13:32:18.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:18.078+0000 7fc7d59ff700 1 -- 172.21.15.32:0/4160207928 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc7d0074180 con 0x7fc7d00cf4d0 2023-06-20T13:32:19.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:18.999+0000 7fc7b7fff700 1 -- 172.21.15.32:0/4160207928 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc7c8058f60 con 0x7fc7d00cf4d0 2023-06-20T13:32:19.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.004+0000 7fc7d59ff700 1 -- 172.21.15.32:0/4160207928 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fc7bc06ace0 msgr2=0x7fc7bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:19.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.004+0000 7fc7d59ff700 1 --2- 172.21.15.32:0/4160207928 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fc7bc06ace0 0x7fc7bc06d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0001370 tx=0x7fc7c0007c40 comp rx=0 tx=0).stop 2023-06-20T13:32:19.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.004+0000 7fc7d59ff700 1 -- 172.21.15.32:0/4160207928 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7d00cf4d0 msgr2=0x7fc7d00d0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:19.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.004+0000 7fc7d59ff700 1 --2- 172.21.15.32:0/4160207928 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7d00cf4d0 0x7fc7d00d0be0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8015000 tx=0x7fc7c8004ad0 comp rx=0 tx=0).stop 2023-06-20T13:32:19.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.005+0000 7fc7d59ff700 1 -- 172.21.15.32:0/4160207928 shutdown_connections 2023-06-20T13:32:19.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.005+0000 7fc7d59ff700 1 --2- 172.21.15.32:0/4160207928 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fc7bc06ace0 0x7fc7bc06d190 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0001370 tx=0x7fc7c0007c40 comp rx=0 tx=0).stop 2023-06-20T13:32:19.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.005+0000 7fc7d59ff700 1 --2- 172.21.15.32:0/4160207928 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc7d00cf4d0 0x7fc7d00d0be0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:19.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.005+0000 7fc7d59ff700 1 --2- 172.21.15.32:0/4160207928 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc7d00b1f00 0x7fc7d01574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:19.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.005+0000 7fc7d59ff700 1 --2- 172.21.15.32:0/4160207928 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc7d00b82c0 0x7fc7d00d06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:19.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.005+0000 7fc7d59ff700 1 -- 172.21.15.32:0/4160207928 >> 172.21.15.32:0/4160207928 conn(0x7fc7d0071660 msgr2=0x7fc7d00729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:19.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.006+0000 7fc7d59ff700 1 -- 172.21.15.32:0/4160207928 shutdown_connections 2023-06-20T13:32:19.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.006+0000 7fc7d59ff700 1 -- 172.21.15.32:0/4160207928 wait complete. 2023-06-20T13:32:19.009 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_metadata' created 2023-06-20T13:32:19.029 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-06-20T13:32:19.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.239+0000 7f10aafff700 1 Processor -- start 2023-06-20T13:32:19.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.239+0000 7f10aafff700 1 -- start start 2023-06-20T13:32:19.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.240+0000 7f10aafff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f10a40b8430 0x7f10a40cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:19.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.240+0000 7f10aafff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10a40d3730 0x7f10a40cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:19.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.240+0000 7f10aafff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f10a40cfa90 0x7f10a415feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:19.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.241+0000 7f10aafff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a40b8800 con 0x7f10a40cfa90 2023-06-20T13:32:19.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.241+0000 7f10aafff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a40d0b20 con 0x7f10a40b8430 2023-06-20T13:32:19.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.241+0000 7f10aafff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a40cfeb0 con 0x7f10a40d3730 2023-06-20T13:32:19.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.241+0000 7f10a959c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f10a40cfa90 0x7f10a415feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:19.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.241+0000 7f10a959c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f10a40cfa90 0x7f10a415feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60564/0 (socket says 172.21.15.32:60564) 2023-06-20T13:32:19.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.241+0000 7f10a959c700 1 -- 172.21.15.32:0/47943313 learned_addr learned my addr 172.21.15.32:0/47943313 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:19.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.241+0000 7f10a8d9b700 1 --2- 172.21.15.32:0/47943313 >> v2:172.21.15.115:3300/0 conn(0x7f10a40b8430 0x7f10a40cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:19.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.241+0000 7f10a3fff700 1 --2- 172.21.15.32:0/47943313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10a40d3730 0x7f10a40cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:19.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.241+0000 7f10a959c700 1 -- 172.21.15.32:0/47943313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10a40d3730 msgr2=0x7f10a40cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:19.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.241+0000 7f10a959c700 1 --2- 172.21.15.32:0/47943313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10a40d3730 0x7f10a40cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:19.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.241+0000 7f10a959c700 1 -- 172.21.15.32:0/47943313 >> v2:172.21.15.115:3300/0 conn(0x7f10a40b8430 msgr2=0x7f10a40cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:19.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.241+0000 7f10a959c700 1 --2- 172.21.15.32:0/47943313 >> v2:172.21.15.115:3300/0 conn(0x7f10a40b8430 0x7f10a40cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:19.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.241+0000 7f10a959c700 1 -- 172.21.15.32:0/47943313 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a40b4ee0 con 0x7f10a40cfa90 2023-06-20T13:32:19.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.241+0000 7f10a959c700 1 --2- 172.21.15.32:0/47943313 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10a40cfa90 0x7f10a415feb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f10a40cf520 tx=0x7f109c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb51978d662aa27 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:19.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.242+0000 7f10a37fe700 1 -- 172.21.15.32:0/47943313 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c00e070 con 0x7f10a40cfa90 2023-06-20T13:32:19.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.242+0000 7f10a37fe700 1 -- 172.21.15.32:0/47943313 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109c00b910 con 0x7f10a40cfa90 2023-06-20T13:32:19.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.242+0000 7f10a37fe700 1 -- 172.21.15.32:0/47943313 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c00bcc0 con 0x7f10a40cfa90 2023-06-20T13:32:19.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.242+0000 7f10aafff700 1 -- 172.21.15.32:0/47943313 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10a40cfa90 msgr2=0x7f10a415feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:19.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.242+0000 7f10aafff700 1 --2- 172.21.15.32:0/47943313 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10a40cfa90 0x7f10a415feb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f10a40cf520 tx=0x7f109c00b330 comp rx=0 tx=0).stop 2023-06-20T13:32:19.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.242+0000 7f10aafff700 1 -- 172.21.15.32:0/47943313 shutdown_connections 2023-06-20T13:32:19.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.242+0000 7f10aafff700 1 --2- 172.21.15.32:0/47943313 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10a40cfa90 0x7f10a415feb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:19.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.242+0000 7f10aafff700 1 --2- 172.21.15.32:0/47943313 >> v2:172.21.15.115:3300/0 conn(0x7f10a40b8430 0x7f10a40cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:19.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.242+0000 7f10aafff700 1 --2- 172.21.15.32:0/47943313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10a40d3730 0x7f10a40cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:19.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.242+0000 7f10aafff700 1 -- 172.21.15.32:0/47943313 >> 172.21.15.32:0/47943313 conn(0x7f10a406b3f0 msgr2=0x7f10a406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:19.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.242+0000 7f10aafff700 1 -- 172.21.15.32:0/47943313 shutdown_connections 2023-06-20T13:32:19.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.243+0000 7f10aafff700 1 -- 172.21.15.32:0/47943313 wait complete. 2023-06-20T13:32:19.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.244+0000 7f10aafff700 1 Processor -- start 2023-06-20T13:32:19.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.245+0000 7f10aafff700 1 -- start start 2023-06-20T13:32:19.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.245+0000 7f10aafff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10a40b8430 0x7f10a415cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:19.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.245+0000 7f10aafff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10a40cfa90 0x7f10a40c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:19.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.246+0000 7f10aafff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10a40d3730 0x7f10a40c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:19.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.246+0000 7f10aafff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a415d010 con 0x7f10a40d3730 2023-06-20T13:32:19.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.246+0000 7f10aafff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a40c7320 con 0x7f10a40cfa90 2023-06-20T13:32:19.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.246+0000 7f10aafff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a40c6710 con 0x7f10a40b8430 2023-06-20T13:32:19.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.246+0000 7f10a959c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10a40d3730 0x7f10a40c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:19.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.246+0000 7f10a959c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10a40d3730 0x7f10a40c9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:60580/0 (socket says 172.21.15.32:60580) 2023-06-20T13:32:19.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.246+0000 7f10a959c700 1 -- 172.21.15.32:0/4102572311 learned_addr learned my addr 172.21.15.32:0/4102572311 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:19.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.246+0000 7f10a8d9b700 1 --2- 172.21.15.32:0/4102572311 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10a40b8430 0x7f10a415cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:19.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.246+0000 7f10a3fff700 1 --2- 172.21.15.32:0/4102572311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10a40cfa90 0x7f10a40c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:19.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.246+0000 7f10a959c700 1 -- 172.21.15.32:0/4102572311 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10a40b8430 msgr2=0x7f10a415cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:19.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.246+0000 7f10a959c700 1 --2- 172.21.15.32:0/4102572311 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10a40b8430 0x7f10a415cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:19.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.246+0000 7f10a959c700 1 -- 172.21.15.32:0/4102572311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10a40cfa90 msgr2=0x7f10a40c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:19.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.246+0000 7f10a959c700 1 --2- 172.21.15.32:0/4102572311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10a40cfa90 0x7f10a40c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:19.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.246+0000 7f10a959c700 1 -- 172.21.15.32:0/4102572311 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109c009b30 con 0x7f10a40d3730 2023-06-20T13:32:19.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.246+0000 7f10a8d9b700 1 --2- 172.21.15.32:0/4102572311 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10a40b8430 0x7f10a415cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:32:19.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.246+0000 7f10a3fff700 1 --2- 172.21.15.32:0/4102572311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10a40cfa90 0x7f10a40c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:32:19.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.247+0000 7f10a959c700 1 --2- 172.21.15.32:0/4102572311 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10a40d3730 0x7f10a40c9080 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f10a406c780 tx=0x7f109c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:19.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.247+0000 7f10a17fa700 1 -- 172.21.15.32:0/4102572311 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c00ce80 con 0x7f10a40d3730 2023-06-20T13:32:19.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.247+0000 7f10a17fa700 1 -- 172.21.15.32:0/4102572311 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109c004250 con 0x7f10a40d3730 2023-06-20T13:32:19.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.247+0000 7f10a17fa700 1 -- 172.21.15.32:0/4102572311 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c004600 con 0x7f10a40d3730 2023-06-20T13:32:19.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.247+0000 7f10aafff700 1 -- 172.21.15.32:0/4102572311 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a40c69f0 con 0x7f10a40d3730 2023-06-20T13:32:19.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.247+0000 7f10aafff700 1 -- 172.21.15.32:0/4102572311 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a40c6fb0 con 0x7f10a40d3730 2023-06-20T13:32:19.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.248+0000 7f10aafff700 1 -- 172.21.15.32:0/4102572311 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a40c7170 con 0x7f10a40d3730 2023-06-20T13:32:19.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.249+0000 7f10a17fa700 1 -- 172.21.15.32:0/4102572311 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f109c004760 con 0x7f10a40d3730 2023-06-20T13:32:19.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.250+0000 7f10a17fa700 1 --2- 172.21.15.32:0/4102572311 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f108806ace0 0x7f108806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:19.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.250+0000 7f10a17fa700 1 -- 172.21.15.32:0/4102572311 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f109c08a390 con 0x7f10a40d3730 2023-06-20T13:32:19.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.250+0000 7f10a8d9b700 1 --2- 172.21.15.32:0/4102572311 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f108806ace0 0x7f108806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:19.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.251+0000 7f10a8d9b700 1 --2- 172.21.15.32:0/4102572311 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f108806ace0 0x7f108806d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1098009b90 tx=0x7f1098008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:19.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.255+0000 7f10a17fa700 1 -- 172.21.15.32:0/4102572311 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f109c055610 con 0x7f10a40d3730 2023-06-20T13:32:19.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:19.462+0000 7f10aafff700 1 -- 172.21.15.32:0/4102572311 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f10a40c7490 con 0x7f10a40d3730 2023-06-20T13:32:20.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.002+0000 7f10a17fa700 1 -- 172.21.15.32:0/4102572311 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) v1 ==== 171+0+0 (secure 0 0 0) 0x7f109c058c30 con 0x7f10a40d3730 2023-06-20T13:32:20.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.011+0000 7f10aafff700 1 -- 172.21.15.32:0/4102572311 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f108806ace0 msgr2=0x7f108806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:20.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.011+0000 7f10aafff700 1 --2- 172.21.15.32:0/4102572311 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f108806ace0 0x7f108806d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1098009b90 tx=0x7f1098008040 comp rx=0 tx=0).stop 2023-06-20T13:32:20.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.011+0000 7f10aafff700 1 -- 172.21.15.32:0/4102572311 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10a40d3730 msgr2=0x7f10a40c9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:20.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.011+0000 7f10aafff700 1 --2- 172.21.15.32:0/4102572311 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10a40d3730 0x7f10a40c9080 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f10a406c780 tx=0x7f109c004ad0 comp rx=0 tx=0).stop 2023-06-20T13:32:20.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.016+0000 7f10aafff700 1 -- 172.21.15.32:0/4102572311 shutdown_connections 2023-06-20T13:32:20.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.016+0000 7f10aafff700 1 --2- 172.21.15.32:0/4102572311 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f108806ace0 0x7f108806d190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:20.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.016+0000 7f10aafff700 1 --2- 172.21.15.32:0/4102572311 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10a40d3730 0x7f10a40c9080 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:20.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.016+0000 7f10aafff700 1 --2- 172.21.15.32:0/4102572311 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10a40b8430 0x7f10a415cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:20.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.016+0000 7f10aafff700 1 --2- 172.21.15.32:0/4102572311 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10a40cfa90 0x7f10a40c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:20.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.016+0000 7f10aafff700 1 -- 172.21.15.32:0/4102572311 >> 172.21.15.32:0/4102572311 conn(0x7f10a406b3f0 msgr2=0x7f10a40b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:20.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.023+0000 7f10aafff700 1 -- 172.21.15.32:0/4102572311 shutdown_connections 2023-06-20T13:32:20.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.024+0000 7f10aafff700 1 -- 172.21.15.32:0/4102572311 wait complete. 2023-06-20T13:32:20.033 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data' created 2023-06-20T13:32:20.052 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-20T13:32:20.258 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.256+0000 7fe8c19ff700 1 Processor -- start 2023-06-20T13:32:20.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.257+0000 7fe8c19ff700 1 -- start start 2023-06-20T13:32:20.260 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.258+0000 7fe8c19ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe8bc0b8430 0x7fe8bc0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:20.260 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.258+0000 7fe8c19ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8bc0d0b20 con 0x7fe8bc0cfc60 2023-06-20T13:32:20.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.258+0000 7fe8c19ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8bc0b4ee0 con 0x7fe8bc0d3730 2023-06-20T13:32:20.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.258+0000 7fe8c19ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8bc0b8800 con 0x7fe8bc0b8430 2023-06-20T13:32:20.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.258+0000 7fe8bb7fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe8bc0cfc60 0x7fe8bc0d0fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:37582/0 (socket says 172.21.15.32:37582) 2023-06-20T13:32:20.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.258+0000 7fe8bb7fe700 1 -- 172.21.15.32:0/400705736 learned_addr learned my addr 172.21.15.32:0/400705736 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:20.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.258+0000 7fe8baffd700 1 --2- 172.21.15.32:0/400705736 >> v2:172.21.15.115:3300/0 conn(0x7fe8bc0b8430 0x7fe8bc0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:20.262 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.259+0000 7fe8ba7fc700 1 -- 172.21.15.32:0/400705736 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 601308631 0 0) 0x7fe8bc0d0b20 con 0x7fe8bc0cfc60 2023-06-20T13:32:20.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.259+0000 7fe8ba7fc700 1 -- 172.21.15.32:0/400705736 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8a80035b0 con 0x7fe8bc0cfc60 2023-06-20T13:32:20.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.259+0000 7fe8ba7fc700 1 -- 172.21.15.32:0/400705736 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3927452709 0 0) 0x7fe8a80035b0 con 0x7fe8bc0cfc60 2023-06-20T13:32:20.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.259+0000 7fe8baffd700 1 -- 172.21.15.32:0/400705736 >> v1:172.21.15.115:6789/0 conn(0x7fe8bc0d3730 legacy=0x7fe8bc0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:20.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.259+0000 7fe8baffd700 1 -- 172.21.15.32:0/400705736 >> v1:172.21.15.32:6789/0 conn(0x7fe8bc0cfc60 legacy=0x7fe8bc0d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:20.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.259+0000 7fe8baffd700 1 -- 172.21.15.32:0/400705736 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc0b51c0 con 0x7fe8bc0b8430 2023-06-20T13:32:20.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.259+0000 7fe8baffd700 1 --2- 172.21.15.32:0/400705736 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8bc0b8430 0x7fe8bc0cd320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac009840 tx=0x7fe8ac009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c09a2f6f92db1ac8 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:20.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.259+0000 7fe8ba7fc700 1 -- 172.21.15.32:0/400705736 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b40019f0 con 0x7fe8bc0b8430 2023-06-20T13:32:20.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.260+0000 7fe8ba7fc700 1 -- 172.21.15.32:0/400705736 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ac004030 con 0x7fe8bc0b8430 2023-06-20T13:32:20.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.260+0000 7fe8ba7fc700 1 -- 172.21.15.32:0/400705736 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac0043c0 con 0x7fe8bc0b8430 2023-06-20T13:32:20.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.260+0000 7fe8c19ff700 1 -- 172.21.15.32:0/400705736 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8bc0b8430 msgr2=0x7fe8bc0cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:20.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.260+0000 7fe8c19ff700 1 --2- 172.21.15.32:0/400705736 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8bc0b8430 0x7fe8bc0cd320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac009840 tx=0x7fe8ac009b50 comp rx=0 tx=0).stop 2023-06-20T13:32:20.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.260+0000 7fe8c19ff700 1 -- 172.21.15.32:0/400705736 shutdown_connections 2023-06-20T13:32:20.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.260+0000 7fe8c19ff700 1 --2- 172.21.15.32:0/400705736 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8bc0b8430 0x7fe8bc0cd320 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:20.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.260+0000 7fe8c19ff700 1 -- 172.21.15.32:0/400705736 >> 172.21.15.32:0/400705736 conn(0x7fe8bc06b3f0 msgr2=0x7fe8bc06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:20.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.260+0000 7fe8c19ff700 1 -- 172.21.15.32:0/400705736 shutdown_connections 2023-06-20T13:32:20.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.260+0000 7fe8c19ff700 1 -- 172.21.15.32:0/400705736 wait complete. 2023-06-20T13:32:20.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.262+0000 7fe8c19ff700 1 Processor -- start 2023-06-20T13:32:20.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.262+0000 7fe8c19ff700 1 -- start start 2023-06-20T13:32:20.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.263+0000 7fe8c19ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8bc0b8430 0x7fe8bc0c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:20.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.263+0000 7fe8c19ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8bc0cfc60 0x7fe8bc15f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:20.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.263+0000 7fe8c19ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8bc0d3730 0x7fe8bc1603e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:20.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.263+0000 7fe8c19ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc0b1000 con 0x7fe8bc0cfc60 2023-06-20T13:32:20.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.263+0000 7fe8c19ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc15f790 con 0x7fe8bc0b8430 2023-06-20T13:32:20.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.263+0000 7fe8c19ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc1f58e0 con 0x7fe8bc0d3730 2023-06-20T13:32:20.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.263+0000 7fe8b3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8bc0cfc60 0x7fe8bc15f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:20.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.263+0000 7fe8b3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8bc0cfc60 0x7fe8bc15f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46966/0 (socket says 172.21.15.32:46966) 2023-06-20T13:32:20.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.263+0000 7fe8b3fff700 1 -- 172.21.15.32:0/524989490 learned_addr learned my addr 172.21.15.32:0/524989490 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:20.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.263+0000 7fe8bb7fe700 1 --2- 172.21.15.32:0/524989490 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8bc0d3730 0x7fe8bc1603e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:20.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.264+0000 7fe8baffd700 1 --2- 172.21.15.32:0/524989490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8bc0b8430 0x7fe8bc0c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:20.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.264+0000 7fe8b3fff700 1 -- 172.21.15.32:0/524989490 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8bc0d3730 msgr2=0x7fe8bc1603e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:20.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.264+0000 7fe8b3fff700 1 --2- 172.21.15.32:0/524989490 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8bc0d3730 0x7fe8bc1603e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:20.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.264+0000 7fe8b3fff700 1 -- 172.21.15.32:0/524989490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8bc0b8430 msgr2=0x7fe8bc0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:20.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.264+0000 7fe8b3fff700 1 --2- 172.21.15.32:0/524989490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8bc0b8430 0x7fe8bc0c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:20.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.264+0000 7fe8b3fff700 1 -- 172.21.15.32:0/524989490 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ac0094a0 con 0x7fe8bc0cfc60 2023-06-20T13:32:20.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.264+0000 7fe8b3fff700 1 --2- 172.21.15.32:0/524989490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8bc0cfc60 0x7fe8bc15f250 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe8a400c700 tx=0x7fe8a400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:20.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.264+0000 7fe8b8ff9700 1 -- 172.21.15.32:0/524989490 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a40054e0 con 0x7fe8bc0cfc60 2023-06-20T13:32:20.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.264+0000 7fe8b8ff9700 1 -- 172.21.15.32:0/524989490 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a4003680 con 0x7fe8bc0cfc60 2023-06-20T13:32:20.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.264+0000 7fe8b8ff9700 1 -- 172.21.15.32:0/524989490 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a4003a30 con 0x7fe8bc0cfc60 2023-06-20T13:32:20.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.264+0000 7fe8c19ff700 1 -- 172.21.15.32:0/524989490 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8bc0b0aa0 con 0x7fe8bc0cfc60 2023-06-20T13:32:20.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.265+0000 7fe8c19ff700 1 -- 172.21.15.32:0/524989490 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8bc1f5290 con 0x7fe8bc0cfc60 2023-06-20T13:32:20.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.266+0000 7fe8c19ff700 1 -- 172.21.15.32:0/524989490 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8bc1f5a70 con 0x7fe8bc0cfc60 2023-06-20T13:32:20.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.267+0000 7fe8b8ff9700 1 -- 172.21.15.32:0/524989490 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe8a4003b90 con 0x7fe8bc0cfc60 2023-06-20T13:32:20.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.268+0000 7fe8b8ff9700 1 --2- 172.21.15.32:0/524989490 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe89c06ace0 0x7fe89c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:20.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.268+0000 7fe8b8ff9700 1 -- 172.21.15.32:0/524989490 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fe8a40883c0 con 0x7fe8bc0cfc60 2023-06-20T13:32:20.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.268+0000 7fe8baffd700 1 --2- 172.21.15.32:0/524989490 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe89c06ace0 0x7fe89c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:20.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.269+0000 7fe8baffd700 1 --2- 172.21.15.32:0/524989490 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe89c06ace0 0x7fe89c06d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac009b90 tx=0x7fe8ac008000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:20.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.273+0000 7fe8b8ff9700 1 -- 172.21.15.32:0/524989490 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe8a40534c0 con 0x7fe8bc0cfc60 2023-06-20T13:32:20.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:20.525+0000 7fe8c19ff700 1 -- 172.21.15.32:0/524989490 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe8bc04ea60 con 0x7fe8bc0cfc60 2023-06-20T13:32:21.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.005+0000 7fe8b8ff9700 1 -- 172.21.15.32:0/524989490 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe8a4056ae0 con 0x7fe8bc0cfc60 2023-06-20T13:32:21.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.017+0000 7fe8c19ff700 1 -- 172.21.15.32:0/524989490 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe89c06ace0 msgr2=0x7fe89c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:21.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.017+0000 7fe8c19ff700 1 --2- 172.21.15.32:0/524989490 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe89c06ace0 0x7fe89c06d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac009b90 tx=0x7fe8ac008000 comp rx=0 tx=0).stop 2023-06-20T13:32:21.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.017+0000 7fe8c19ff700 1 -- 172.21.15.32:0/524989490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8bc0cfc60 msgr2=0x7fe8bc15f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:21.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.018+0000 7fe8c19ff700 1 --2- 172.21.15.32:0/524989490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8bc0cfc60 0x7fe8bc15f250 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe8a400c700 tx=0x7fe8a400ca10 comp rx=0 tx=0).stop 2023-06-20T13:32:21.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.023+0000 7fe8c19ff700 1 -- 172.21.15.32:0/524989490 shutdown_connections 2023-06-20T13:32:21.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.023+0000 7fe8c19ff700 1 --2- 172.21.15.32:0/524989490 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe89c06ace0 0x7fe89c06d190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:21.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.023+0000 7fe8c19ff700 1 --2- 172.21.15.32:0/524989490 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8bc0d3730 0x7fe8bc1603e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:21.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.023+0000 7fe8c19ff700 1 --2- 172.21.15.32:0/524989490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8bc0b8430 0x7fe8bc0c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:21.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.023+0000 7fe8c19ff700 1 --2- 172.21.15.32:0/524989490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8bc0cfc60 0x7fe8bc15f250 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:21.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.023+0000 7fe8c19ff700 1 -- 172.21.15.32:0/524989490 >> 172.21.15.32:0/524989490 conn(0x7fe8bc06b3f0 msgr2=0x7fe8bc0cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:21.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.037+0000 7fe8c19ff700 1 -- 172.21.15.32:0/524989490 shutdown_connections 2023-06-20T13:32:21.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.037+0000 7fe8c19ff700 1 -- 172.21.15.32:0/524989490 wait complete. 2023-06-20T13:32:21.043 INFO:teuthology.orchestra.run.smithi032.stderr:new fs with metadata pool 3 and data pool 4 2023-06-20T13:32:21.062 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-06-20T13:32:21.062 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-06-20T13:32:21.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.268+0000 7f84c07ff700 1 Processor -- start 2023-06-20T13:32:21.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.268+0000 7f84c07ff700 1 -- start start 2023-06-20T13:32:21.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.269+0000 7f84c07ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84b80cfbe0 0x7f84b8160870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:21.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.269+0000 7f84c07ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b8160db0 con 0x7f84b80b1f00 2023-06-20T13:32:21.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.269+0000 7f84c07ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b815fe20 con 0x7f84b80b82c0 2023-06-20T13:32:21.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.269+0000 7f84c07ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b80b8690 con 0x7f84b80cfbe0 2023-06-20T13:32:21.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.270+0000 7f84bdd9a700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f84b80b1f00 0x7f84b80cf4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:37584/0 (socket says 172.21.15.32:37584) 2023-06-20T13:32:21.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.270+0000 7f84bdd9a700 1 -- 172.21.15.32:0/3599400071 learned_addr learned my addr 172.21.15.32:0/3599400071 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:21.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.270+0000 7f84bed9c700 1 --2- 172.21.15.32:0/3599400071 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84b80cfbe0 0x7f84b8160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:21.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.270+0000 7f84bd599700 1 -- 172.21.15.32:0/3599400071 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 606922037 0 0) 0x7f84a8001110 con 0x7f84b80b1f00 2023-06-20T13:32:21.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.270+0000 7f84bd599700 1 -- 172.21.15.32:0/3599400071 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84a40035b0 con 0x7f84b80b1f00 2023-06-20T13:32:21.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.270+0000 7f84bd599700 1 -- 172.21.15.32:0/3599400071 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 268110730 0 0) 0x7f84b815fe20 con 0x7f84b80b82c0 2023-06-20T13:32:21.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.270+0000 7f84bd599700 1 -- 172.21.15.32:0/3599400071 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84a8001110 con 0x7f84b80b82c0 2023-06-20T13:32:21.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.270+0000 7f84bd599700 1 -- 172.21.15.32:0/3599400071 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4281447394 0 0) 0x7f84a40035b0 con 0x7f84b80b1f00 2023-06-20T13:32:21.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.270+0000 7f84bd599700 1 -- 172.21.15.32:0/3599400071 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84b80cfbe0 msgr2=0x7f84b8160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:21.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.270+0000 7f84bd599700 1 --2- 172.21.15.32:0/3599400071 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84b80cfbe0 0x7f84b8160870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:21.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.270+0000 7f84bd599700 1 -- 172.21.15.32:0/3599400071 >> v1:172.21.15.115:6789/0 conn(0x7f84b80b82c0 legacy=0x7f84b80ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:21.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.270+0000 7f84bd599700 1 -- 172.21.15.32:0/3599400071 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b81603e0 con 0x7f84b80b1f00 2023-06-20T13:32:21.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.270+0000 7f84bd599700 1 -- 172.21.15.32:0/3599400071 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3380058562 0 0) 0x7f84a8001800 con 0x7f84b80b1f00 2023-06-20T13:32:21.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.270+0000 7f84bd599700 1 -- 172.21.15.32:0/3599400071 >> v1:172.21.15.32:6789/0 conn(0x7f84b80b1f00 legacy=0x7f84b80cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:21.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.271+0000 7f84bd599700 1 --2- 172.21.15.32:0/3599400071 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84a4003bc0 0x7f84a4003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:21.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.271+0000 7f84bd599700 1 --2- 172.21.15.32:0/3599400071 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84b80cfbe0 0x7f84a4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:21.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.271+0000 7f84bd599700 1 --2- 172.21.15.32:0/3599400071 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84a4004d90 0x7f84a4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:21.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.271+0000 7f84bd599700 1 -- 172.21.15.32:0/3599400071 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b80b8690 con 0x7f84a4003bc0 2023-06-20T13:32:21.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.271+0000 7f84bd599700 1 -- 172.21.15.32:0/3599400071 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a400bba0 con 0x7f84a4004d90 2023-06-20T13:32:21.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.271+0000 7f84bd599700 1 -- 172.21.15.32:0/3599400071 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a400bd10 con 0x7f84b80cfbe0 2023-06-20T13:32:21.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.271+0000 7f84be59b700 1 --2- 172.21.15.32:0/3599400071 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84a4003bc0 0x7f84a4003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:21.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.271+0000 7f84bed9c700 1 --2- 172.21.15.32:0/3599400071 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84a4004d90 0x7f84a4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:21.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.271+0000 7f84bdd9a700 1 --2- 172.21.15.32:0/3599400071 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84b80cfbe0 0x7f84a4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:21.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.271+0000 7f84be59b700 1 -- 172.21.15.32:0/3599400071 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84b80cfbe0 msgr2=0x7f84a4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:21.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.271+0000 7f84be59b700 1 --2- 172.21.15.32:0/3599400071 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84b80cfbe0 0x7f84a4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:21.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.271+0000 7f84be59b700 1 -- 172.21.15.32:0/3599400071 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84a4004d90 msgr2=0x7f84a4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:21.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.271+0000 7f84be59b700 1 --2- 172.21.15.32:0/3599400071 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84a4004d90 0x7f84a4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:21.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.271+0000 7f84be59b700 1 -- 172.21.15.32:0/3599400071 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a40035b0 con 0x7f84a4003bc0 2023-06-20T13:32:21.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.272+0000 7f84be59b700 1 --2- 172.21.15.32:0/3599400071 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84a4003bc0 0x7f84a4003fb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f84b4007fd0 tx=0x7f84a4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1773fed722f04a81 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:21.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.272+0000 7f84bd599700 1 -- 172.21.15.32:0/3599400071 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b4001d80 con 0x7f84a4003bc0 2023-06-20T13:32:21.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.272+0000 7f84bd599700 1 -- 172.21.15.32:0/3599400071 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b40052d0 con 0x7f84a4003bc0 2023-06-20T13:32:21.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.272+0000 7f84bd599700 1 -- 172.21.15.32:0/3599400071 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b4001470 con 0x7f84a4003bc0 2023-06-20T13:32:21.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.272+0000 7f84c07ff700 1 -- 172.21.15.32:0/3599400071 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84a4003bc0 msgr2=0x7f84a4003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:21.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.272+0000 7f84c07ff700 1 --2- 172.21.15.32:0/3599400071 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84a4003bc0 0x7f84a4003fb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f84b4007fd0 tx=0x7f84a4005880 comp rx=0 tx=0).stop 2023-06-20T13:32:21.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.272+0000 7f84bed9c700 1 -- 172.21.15.32:0/3599400071 reap_dead start 2023-06-20T13:32:21.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.272+0000 7f84c07ff700 1 -- 172.21.15.32:0/3599400071 shutdown_connections 2023-06-20T13:32:21.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.272+0000 7f84c07ff700 1 -- 172.21.15.32:0/3599400071 >> 172.21.15.32:0/3599400071 conn(0x7f84b8071660 msgr2=0x7f84b8071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:21.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.272+0000 7f84c07ff700 1 -- 172.21.15.32:0/3599400071 shutdown_connections 2023-06-20T13:32:21.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.272+0000 7f84c07ff700 1 -- 172.21.15.32:0/3599400071 wait complete. 2023-06-20T13:32:21.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.274+0000 7f84c07ff700 1 Processor -- start 2023-06-20T13:32:21.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.274+0000 7f84c07ff700 1 -- start start 2023-06-20T13:32:21.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.275+0000 7f84c07ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84a4003bc0 0x7f84b8159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:21.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.275+0000 7f84c07ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84b815a110 0x7f84b8159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:21.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.275+0000 7f84c07ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84b815be30 0x7f84b815c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:21.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.275+0000 7f84c07ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b815c610 con 0x7f84b815a110 2023-06-20T13:32:21.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.275+0000 7f84c07ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b81f20d0 con 0x7f84b815be30 2023-06-20T13:32:21.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.275+0000 7f84c07ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b81f2970 con 0x7f84a4003bc0 2023-06-20T13:32:21.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.275+0000 7f84bdd9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84b815a110 0x7f84b8159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:21.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.276+0000 7f84bdd9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84b815a110 0x7f84b8159260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46976/0 (socket says 172.21.15.32:46976) 2023-06-20T13:32:21.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.276+0000 7f84bdd9a700 1 -- 172.21.15.32:0/145047968 learned_addr learned my addr 172.21.15.32:0/145047968 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:21.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.276+0000 7f84be59b700 1 --2- 172.21.15.32:0/145047968 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84a4003bc0 0x7f84b8159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:21.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.276+0000 7f84bed9c700 1 --2- 172.21.15.32:0/145047968 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84b815be30 0x7f84b815c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:21.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.276+0000 7f84bdd9a700 1 -- 172.21.15.32:0/145047968 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84a4003bc0 msgr2=0x7f84b8159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:21.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.276+0000 7f84bdd9a700 1 --2- 172.21.15.32:0/145047968 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84a4003bc0 0x7f84b8159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:21.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.276+0000 7f84bdd9a700 1 -- 172.21.15.32:0/145047968 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84b815be30 msgr2=0x7f84b815c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:21.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.276+0000 7f84bdd9a700 1 --2- 172.21.15.32:0/145047968 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84b815be30 0x7f84b815c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:21.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.276+0000 7f84bdd9a700 1 -- 172.21.15.32:0/145047968 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b815c330 con 0x7f84b815a110 2023-06-20T13:32:21.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.276+0000 7f84bdd9a700 1 --2- 172.21.15.32:0/145047968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84b815a110 0x7f84b8159260 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f84a8007320 tx=0x7f84a8007630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:21.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.276+0000 7f84aeffd700 1 -- 172.21.15.32:0/145047968 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a8011640 con 0x7f84b815a110 2023-06-20T13:32:21.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.276+0000 7f84aeffd700 1 -- 172.21.15.32:0/145047968 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a8011800 con 0x7f84b815a110 2023-06-20T13:32:21.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.276+0000 7f84aeffd700 1 -- 172.21.15.32:0/145047968 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a8011bb0 con 0x7f84b815a110 2023-06-20T13:32:21.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.276+0000 7f84c07ff700 1 -- 172.21.15.32:0/145047968 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b81f2320 con 0x7f84b815a110 2023-06-20T13:32:21.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.277+0000 7f84c07ff700 1 -- 172.21.15.32:0/145047968 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b81597a0 con 0x7f84b815a110 2023-06-20T13:32:21.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.278+0000 7f84c07ff700 1 -- 172.21.15.32:0/145047968 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b8074180 con 0x7f84b815a110 2023-06-20T13:32:21.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.279+0000 7f84aeffd700 1 -- 172.21.15.32:0/145047968 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f84a8011d10 con 0x7f84b815a110 2023-06-20T13:32:21.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.280+0000 7f84aeffd700 1 --2- 172.21.15.32:0/145047968 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f849c06ace0 0x7f849c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:21.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.280+0000 7f84aeffd700 1 -- 172.21.15.32:0/145047968 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f84a80892a0 con 0x7f84b815a110 2023-06-20T13:32:21.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.280+0000 7f84be59b700 1 --2- 172.21.15.32:0/145047968 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f849c06ace0 0x7f849c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:21.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.281+0000 7f84be59b700 1 --2- 172.21.15.32:0/145047968 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f849c06ace0 0x7f849c06d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f84b815a6d0 tx=0x7f84b400a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:21.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.285+0000 7f84aeffd700 1 -- 172.21.15.32:0/145047968 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f84a80542b0 con 0x7f84b815a110 2023-06-20T13:32:21.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:21.505+0000 7f84c07ff700 1 -- 172.21.15.32:0/145047968 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f84b8160db0 con 0x7f84b815a110 2023-06-20T13:32:22.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.006+0000 7f84aeffd700 1 -- 172.21.15.32:0/145047968 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) v1 ==== 157+0+0 (secure 0 0 0) 0x7f84b8160db0 con 0x7f84b815a110 2023-06-20T13:32:22.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.009+0000 7f84c07ff700 1 -- 172.21.15.32:0/145047968 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f849c06ace0 msgr2=0x7f849c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:22.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.009+0000 7f84c07ff700 1 --2- 172.21.15.32:0/145047968 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f849c06ace0 0x7f849c06d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f84b815a6d0 tx=0x7f84b400a000 comp rx=0 tx=0).stop 2023-06-20T13:32:22.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.009+0000 7f84c07ff700 1 -- 172.21.15.32:0/145047968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84b815a110 msgr2=0x7f84b8159260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:22.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.009+0000 7f84c07ff700 1 --2- 172.21.15.32:0/145047968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84b815a110 0x7f84b8159260 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f84a8007320 tx=0x7f84a8007630 comp rx=0 tx=0).stop 2023-06-20T13:32:22.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.009+0000 7f84c07ff700 1 -- 172.21.15.32:0/145047968 shutdown_connections 2023-06-20T13:32:22.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.009+0000 7f84c07ff700 1 --2- 172.21.15.32:0/145047968 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f849c06ace0 0x7f849c06d190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:22.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.009+0000 7f84c07ff700 1 --2- 172.21.15.32:0/145047968 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84b815be30 0x7f84b815c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:22.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.009+0000 7f84c07ff700 1 --2- 172.21.15.32:0/145047968 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f84a4003bc0 0x7f84b8159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:22.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.009+0000 7f84c07ff700 1 --2- 172.21.15.32:0/145047968 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f84b815a110 0x7f84b8159260 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:22.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.009+0000 7f84c07ff700 1 -- 172.21.15.32:0/145047968 >> 172.21.15.32:0/145047968 conn(0x7f84b8071660 msgr2=0x7f84b80d1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:22.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.009+0000 7f84c07ff700 1 -- 172.21.15.32:0/145047968 shutdown_connections 2023-06-20T13:32:22.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.009+0000 7f84c07ff700 1 -- 172.21.15.32:0/145047968 wait complete. 2023-06-20T13:32:22.033 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-06-20T13:32:22.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.247+0000 7f8cbedff700 1 Processor -- start 2023-06-20T13:32:22.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.247+0000 7f8cbedff700 1 -- start start 2023-06-20T13:32:22.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.249+0000 7f8cbedff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8cb815c350 0x7f8cb815d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:22.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.249+0000 7f8cbedff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8cb80cef30 0x7f8cb80d07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:22.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.249+0000 7f8cbedff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb80cdad0 con 0x7f8cb80d0d10 2023-06-20T13:32:22.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.249+0000 7f8cbedff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb80b55b0 con 0x7f8cb80cef30 2023-06-20T13:32:22.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.249+0000 7f8cbedff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb80cd250 con 0x7f8cb815c350 2023-06-20T13:32:22.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.249+0000 7f8cb7fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8cb80cef30 0x7f8cb80d07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:22.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.249+0000 7f8cbd39c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f8cb80d0d10 0x7f8cb80d3150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:37600/0 (socket says 172.21.15.32:37600) 2023-06-20T13:32:22.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.249+0000 7f8cbd39c700 1 -- 172.21.15.32:0/50966266 learned_addr learned my addr 172.21.15.32:0/50966266 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:22.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.249+0000 7f8cbcb9b700 1 --2- 172.21.15.32:0/50966266 >> v2:172.21.15.115:3300/0 conn(0x7f8cb815c350 0x7f8cb815d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:22.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.249+0000 7f8cb77fe700 1 -- 172.21.15.32:0/50966266 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326683700 0 0) 0x7f8cb80cdad0 con 0x7f8cb80d0d10 2023-06-20T13:32:22.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.249+0000 7f8cb7fff700 1 -- 172.21.15.32:0/50966266 >> v2:172.21.15.115:3300/0 conn(0x7f8cb815c350 msgr2=0x7f8cb815d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:22.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.249+0000 7f8cb7fff700 1 --2- 172.21.15.32:0/50966266 >> v2:172.21.15.115:3300/0 conn(0x7f8cb815c350 0x7f8cb815d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:22.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.249+0000 7f8cb7fff700 1 -- 172.21.15.32:0/50966266 >> v1:172.21.15.32:6789/0 conn(0x7f8cb80d0d10 legacy=0x7f8cb80d3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:22.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.249+0000 7f8cb7fff700 1 -- 172.21.15.32:0/50966266 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb80cd510 con 0x7f8cb80cef30 2023-06-20T13:32:22.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.250+0000 7f8cb7fff700 1 --2- 172.21.15.32:0/50966266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8cb80cef30 0x7f8cb80d07d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80cf5e0 tx=0x7f8ca4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a698de8ae213eb9c server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:22.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.250+0000 7f8cb77fe700 1 -- 172.21.15.32:0/50966266 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4011830 con 0x7f8cb80cef30 2023-06-20T13:32:22.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.250+0000 7f8cb77fe700 1 -- 172.21.15.32:0/50966266 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca4011990 con 0x7f8cb80cef30 2023-06-20T13:32:22.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.250+0000 7f8cb77fe700 1 -- 172.21.15.32:0/50966266 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4011d20 con 0x7f8cb80cef30 2023-06-20T13:32:22.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.250+0000 7f8cbedff700 1 -- 172.21.15.32:0/50966266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8cb80cef30 msgr2=0x7f8cb80d07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:22.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.250+0000 7f8cbedff700 1 --2- 172.21.15.32:0/50966266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8cb80cef30 0x7f8cb80d07d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80cf5e0 tx=0x7f8ca4009b20 comp rx=0 tx=0).stop 2023-06-20T13:32:22.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.251+0000 7f8cbedff700 1 -- 172.21.15.32:0/50966266 shutdown_connections 2023-06-20T13:32:22.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.251+0000 7f8cbedff700 1 --2- 172.21.15.32:0/50966266 >> v2:172.21.15.115:3300/0 conn(0x7f8cb815c350 0x7f8cb815d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:22.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.251+0000 7f8cbedff700 1 --2- 172.21.15.32:0/50966266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8cb80cef30 0x7f8cb80d07d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:22.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.251+0000 7f8cbedff700 1 -- 172.21.15.32:0/50966266 >> 172.21.15.32:0/50966266 conn(0x7f8cb806b460 msgr2=0x7f8cb806b860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:22.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.251+0000 7f8cbedff700 1 -- 172.21.15.32:0/50966266 shutdown_connections 2023-06-20T13:32:22.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.251+0000 7f8cbedff700 1 -- 172.21.15.32:0/50966266 wait complete. 2023-06-20T13:32:22.258 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.252+0000 7f8cbedff700 1 Processor -- start 2023-06-20T13:32:22.258 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.253+0000 7f8cbedff700 1 -- start start 2023-06-20T13:32:22.258 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.253+0000 7f8cbedff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cb80cef30 0x7f8cb8157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:22.258 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.253+0000 7f8cbedff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8cb80d0d10 0x7f8cb81f29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:22.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.254+0000 7f8cbedff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cb815c350 0x7f8cb80b6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:22.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.254+0000 7f8cbedff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb81f2590 con 0x7f8cb80d0d10 2023-06-20T13:32:22.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.254+0000 7f8cbedff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb80b79c0 con 0x7f8cb815c350 2023-06-20T13:32:22.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.254+0000 7f8cbedff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb80b5a30 con 0x7f8cb80cef30 2023-06-20T13:32:22.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.254+0000 7f8cb7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8cb80d0d10 0x7f8cb81f29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:22.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.254+0000 7f8cb7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8cb80d0d10 0x7f8cb81f29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46996/0 (socket says 172.21.15.32:46996) 2023-06-20T13:32:22.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.254+0000 7f8cb7fff700 1 -- 172.21.15.32:0/2713417008 learned_addr learned my addr 172.21.15.32:0/2713417008 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:22.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.254+0000 7f8cbcb9b700 1 --2- 172.21.15.32:0/2713417008 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cb80cef30 0x7f8cb8157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:22.260 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.254+0000 7f8cbd39c700 1 --2- 172.21.15.32:0/2713417008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cb815c350 0x7f8cb80b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:22.260 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.254+0000 7f8cb7fff700 1 -- 172.21.15.32:0/2713417008 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cb80cef30 msgr2=0x7f8cb8157300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:22.260 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.254+0000 7f8cb7fff700 1 --2- 172.21.15.32:0/2713417008 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cb80cef30 0x7f8cb8157300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:22.260 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.254+0000 7f8cb7fff700 1 -- 172.21.15.32:0/2713417008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cb815c350 msgr2=0x7f8cb80b6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:22.260 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.254+0000 7f8cb7fff700 1 --2- 172.21.15.32:0/2713417008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cb815c350 0x7f8cb80b6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:22.260 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.254+0000 7f8cb7fff700 1 -- 172.21.15.32:0/2713417008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca40094a0 con 0x7f8cb80d0d10 2023-06-20T13:32:22.260 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.254+0000 7f8cbcb9b700 1 --2- 172.21.15.32:0/2713417008 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cb80cef30 0x7f8cb8157300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:32:22.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.254+0000 7f8cbd39c700 1 --2- 172.21.15.32:0/2713417008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cb815c350 0x7f8cb80b6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:32:22.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.255+0000 7f8cb7fff700 1 --2- 172.21.15.32:0/2713417008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8cb80d0d10 0x7f8cb81f29b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4000c00 tx=0x7f8ca4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:22.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.255+0000 7f8cb57fa700 1 -- 172.21.15.32:0/2713417008 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca40036a0 con 0x7f8cb80d0d10 2023-06-20T13:32:22.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.255+0000 7f8cb57fa700 1 -- 172.21.15.32:0/2713417008 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca401e070 con 0x7f8cb80d0d10 2023-06-20T13:32:22.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.255+0000 7f8cb57fa700 1 -- 172.21.15.32:0/2713417008 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4003a60 con 0x7f8cb80d0d10 2023-06-20T13:32:22.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.255+0000 7f8cbedff700 1 -- 172.21.15.32:0/2713417008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb80b5d10 con 0x7f8cb80d0d10 2023-06-20T13:32:22.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.255+0000 7f8cbedff700 1 -- 172.21.15.32:0/2713417008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb81f1ed0 con 0x7f8cb80d0d10 2023-06-20T13:32:22.262 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.256+0000 7f8cbedff700 1 -- 172.21.15.32:0/2713417008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb804ea60 con 0x7f8cb80d0d10 2023-06-20T13:32:22.262 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.257+0000 7f8cb57fa700 1 -- 172.21.15.32:0/2713417008 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8ca4003bc0 con 0x7f8cb80d0d10 2023-06-20T13:32:22.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.258+0000 7f8cb57fa700 1 --2- 172.21.15.32:0/2713417008 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8c9c06ace0 0x7f8c9c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:22.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.258+0000 7f8cb57fa700 1 -- 172.21.15.32:0/2713417008 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f8ca408a550 con 0x7f8cb80d0d10 2023-06-20T13:32:22.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.258+0000 7f8cbcb9b700 1 --2- 172.21.15.32:0/2713417008 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8c9c06ace0 0x7f8c9c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:22.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.259+0000 7f8cbcb9b700 1 --2- 172.21.15.32:0/2713417008 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8c9c06ace0 0x7f8c9c06d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80ca310 tx=0x7f8cac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:22.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.263+0000 7f8cb57fa700 1 -- 172.21.15.32:0/2713417008 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8ca4055530 con 0x7f8cb80d0d10 2023-06-20T13:32:22.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:22.473+0000 7f8cbedff700 1 -- 172.21.15.32:0/2713417008 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8cb80b5060 con 0x7f8cb80d0d10 2023-06-20T13:32:24.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.039+0000 7f8cb57fa700 1 -- 172.21.15.32:0/2713417008 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) v1 ==== 228+0+0 (secure 0 0 0) 0x7f8ca4058b50 con 0x7f8cb80d0d10 2023-06-20T13:32:24.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.046+0000 7f8cbedff700 1 -- 172.21.15.32:0/2713417008 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8c9c06ace0 msgr2=0x7f8c9c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:24.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.046+0000 7f8cbedff700 1 --2- 172.21.15.32:0/2713417008 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8c9c06ace0 0x7f8c9c06d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80ca310 tx=0x7f8cac008040 comp rx=0 tx=0).stop 2023-06-20T13:32:24.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.046+0000 7f8cbedff700 1 -- 172.21.15.32:0/2713417008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8cb80d0d10 msgr2=0x7f8cb81f29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:24.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.046+0000 7f8cbedff700 1 --2- 172.21.15.32:0/2713417008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8cb80d0d10 0x7f8cb81f29b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4000c00 tx=0x7f8ca4004750 comp rx=0 tx=0).stop 2023-06-20T13:32:24.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.050+0000 7f8cbedff700 1 -- 172.21.15.32:0/2713417008 shutdown_connections 2023-06-20T13:32:24.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.050+0000 7f8cbedff700 1 --2- 172.21.15.32:0/2713417008 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8c9c06ace0 0x7f8c9c06d190 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:24.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.050+0000 7f8cbedff700 1 --2- 172.21.15.32:0/2713417008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cb815c350 0x7f8cb80b6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:24.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.050+0000 7f8cbedff700 1 --2- 172.21.15.32:0/2713417008 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8cb80cef30 0x7f8cb8157300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:24.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.050+0000 7f8cbedff700 1 --2- 172.21.15.32:0/2713417008 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8cb80d0d10 0x7f8cb81f29b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:24.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.050+0000 7f8cbedff700 1 -- 172.21.15.32:0/2713417008 >> 172.21.15.32:0/2713417008 conn(0x7f8cb806b460 msgr2=0x7f8cb815c720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:24.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.051+0000 7f8cbedff700 1 -- 172.21.15.32:0/2713417008 shutdown_connections 2023-06-20T13:32:24.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.052+0000 7f8cbedff700 1 -- 172.21.15.32:0/2713417008 wait complete. 2023-06-20T13:32:24.057 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data_ec' created 2023-06-20T13:32:24.077 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-06-20T13:32:24.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.282+0000 7fdd891ff700 1 Processor -- start 2023-06-20T13:32:24.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.283+0000 7fdd891ff700 1 -- start start 2023-06-20T13:32:24.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.284+0000 7fdd891ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdd840b82c0 0x7fdd84160870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:24.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.284+0000 7fdd891ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdd840cf4d0 0x7fdd840cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:24.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.284+0000 7fdd891ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd84160db0 con 0x7fdd840b1f00 2023-06-20T13:32:24.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.284+0000 7fdd891ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd840b8690 con 0x7fdd840b82c0 2023-06-20T13:32:24.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.284+0000 7fdd891ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd8415fe20 con 0x7fdd840cf4d0 2023-06-20T13:32:24.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.284+0000 7fdd82d9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdd840b82c0 0x7fdd84160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:24.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.284+0000 7fdd8259c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fdd840b1f00 0x7fdd840ceca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:37602/0 (socket says 172.21.15.32:37602) 2023-06-20T13:32:24.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.284+0000 7fdd8259c700 1 -- 172.21.15.32:0/1289611368 learned_addr learned my addr 172.21.15.32:0/1289611368 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:24.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.284+0000 7fdd8359e700 1 --2- 172.21.15.32:0/1289611368 >> v2:172.21.15.115:3300/0 conn(0x7fdd840cf4d0 0x7fdd840cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:24.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.284+0000 7fdd82d9d700 1 -- 172.21.15.32:0/1289611368 >> v2:172.21.15.115:3300/0 conn(0x7fdd840cf4d0 msgr2=0x7fdd840cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:24.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.284+0000 7fdd82d9d700 1 --2- 172.21.15.32:0/1289611368 >> v2:172.21.15.115:3300/0 conn(0x7fdd840cf4d0 0x7fdd840cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:24.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.284+0000 7fdd82d9d700 1 -- 172.21.15.32:0/1289611368 >> v1:172.21.15.32:6789/0 conn(0x7fdd840b1f00 legacy=0x7fdd840ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:24.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.285+0000 7fdd82d9d700 1 -- 172.21.15.32:0/1289611368 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd841603e0 con 0x7fdd840b82c0 2023-06-20T13:32:24.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.285+0000 7fdd81d9b700 1 -- 172.21.15.32:0/1289611368 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2689563835 0 0) 0x7fdd78001110 con 0x7fdd840b1f00 2023-06-20T13:32:24.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.285+0000 7fdd82d9d700 1 --2- 172.21.15.32:0/1289611368 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd840b82c0 0x7fdd84160870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdd840b2500 tx=0x7fdd74009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576ae392f75b61c2 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:24.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.285+0000 7fdd81d9b700 1 -- 172.21.15.32:0/1289611368 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd74011830 con 0x7fdd840b82c0 2023-06-20T13:32:24.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.285+0000 7fdd81d9b700 1 -- 172.21.15.32:0/1289611368 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd74011990 con 0x7fdd840b82c0 2023-06-20T13:32:24.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.285+0000 7fdd81d9b700 1 -- 172.21.15.32:0/1289611368 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd74011d20 con 0x7fdd840b82c0 2023-06-20T13:32:24.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.285+0000 7fdd891ff700 1 -- 172.21.15.32:0/1289611368 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd840b82c0 msgr2=0x7fdd84160870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:24.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.285+0000 7fdd891ff700 1 --2- 172.21.15.32:0/1289611368 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd840b82c0 0x7fdd84160870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdd840b2500 tx=0x7fdd74009b20 comp rx=0 tx=0).stop 2023-06-20T13:32:24.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.286+0000 7fdd891ff700 1 -- 172.21.15.32:0/1289611368 shutdown_connections 2023-06-20T13:32:24.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.286+0000 7fdd891ff700 1 --2- 172.21.15.32:0/1289611368 >> v2:172.21.15.115:3300/0 conn(0x7fdd840cf4d0 0x7fdd840cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:24.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.286+0000 7fdd891ff700 1 --2- 172.21.15.32:0/1289611368 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd840b82c0 0x7fdd84160870 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:24.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.286+0000 7fdd891ff700 1 -- 172.21.15.32:0/1289611368 >> 172.21.15.32:0/1289611368 conn(0x7fdd84071660 msgr2=0x7fdd84071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:24.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.286+0000 7fdd891ff700 1 -- 172.21.15.32:0/1289611368 shutdown_connections 2023-06-20T13:32:24.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.286+0000 7fdd891ff700 1 -- 172.21.15.32:0/1289611368 wait complete. 2023-06-20T13:32:24.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.287+0000 7fdd891ff700 1 Processor -- start 2023-06-20T13:32:24.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.288+0000 7fdd891ff700 1 -- start start 2023-06-20T13:32:24.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.289+0000 7fdd891ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd840b1f00 0x7fdd8415bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:24.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.289+0000 7fdd891ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd840b82c0 0x7fdd841f5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:24.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.289+0000 7fdd891ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd840cf4d0 0x7fdd840b3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:24.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.289+0000 7fdd891ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8415c5a0 con 0x7fdd840cf4d0 2023-06-20T13:32:24.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.289+0000 7fdd891ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd841f1c50 con 0x7fdd840b82c0 2023-06-20T13:32:24.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.289+0000 7fdd891ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd841f6200 con 0x7fdd840b1f00 2023-06-20T13:32:24.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.289+0000 7fdd8359e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd840cf4d0 0x7fdd840b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:24.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.289+0000 7fdd8359e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd840cf4d0 0x7fdd840b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47012/0 (socket says 172.21.15.32:47012) 2023-06-20T13:32:24.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.289+0000 7fdd8359e700 1 -- 172.21.15.32:0/4154909074 learned_addr learned my addr 172.21.15.32:0/4154909074 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:24.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.289+0000 7fdd82d9d700 1 --2- 172.21.15.32:0/4154909074 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd840b1f00 0x7fdd8415bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:24.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.289+0000 7fdd8259c700 1 --2- 172.21.15.32:0/4154909074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd840b82c0 0x7fdd841f5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:24.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.289+0000 7fdd8359e700 1 -- 172.21.15.32:0/4154909074 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd840b1f00 msgr2=0x7fdd8415bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:24.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.289+0000 7fdd8359e700 1 --2- 172.21.15.32:0/4154909074 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd840b1f00 0x7fdd8415bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:24.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.289+0000 7fdd8359e700 1 -- 172.21.15.32:0/4154909074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd840b82c0 msgr2=0x7fdd841f5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:24.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.289+0000 7fdd8359e700 1 --2- 172.21.15.32:0/4154909074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd840b82c0 0x7fdd841f5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:24.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.289+0000 7fdd8359e700 1 -- 172.21.15.32:0/4154909074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd740094a0 con 0x7fdd840cf4d0 2023-06-20T13:32:24.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.290+0000 7fdd8359e700 1 --2- 172.21.15.32:0/4154909074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd840cf4d0 0x7fdd840b3790 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c007e40 tx=0x7fdd7c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:24.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.290+0000 7fdd6b7fe700 1 -- 172.21.15.32:0/4154909074 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c00ed30 con 0x7fdd840cf4d0 2023-06-20T13:32:24.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.290+0000 7fdd6b7fe700 1 -- 172.21.15.32:0/4154909074 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7c014420 con 0x7fdd840cf4d0 2023-06-20T13:32:24.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.290+0000 7fdd891ff700 1 -- 172.21.15.32:0/4154909074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd841f1e60 con 0x7fdd840cf4d0 2023-06-20T13:32:24.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.290+0000 7fdd6b7fe700 1 -- 172.21.15.32:0/4154909074 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c0147d0 con 0x7fdd840cf4d0 2023-06-20T13:32:24.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.290+0000 7fdd891ff700 1 -- 172.21.15.32:0/4154909074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd841f2420 con 0x7fdd840cf4d0 2023-06-20T13:32:24.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.291+0000 7fdd891ff700 1 -- 172.21.15.32:0/4154909074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd84074180 con 0x7fdd840cf4d0 2023-06-20T13:32:24.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.292+0000 7fdd6b7fe700 1 -- 172.21.15.32:0/4154909074 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdd7c014930 con 0x7fdd840cf4d0 2023-06-20T13:32:24.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.293+0000 7fdd6b7fe700 1 --2- 172.21.15.32:0/4154909074 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdd7006ace0 0x7fdd7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:24.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.293+0000 7fdd6b7fe700 1 -- 172.21.15.32:0/4154909074 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fdd7c089e00 con 0x7fdd840cf4d0 2023-06-20T13:32:24.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.293+0000 7fdd82d9d700 1 --2- 172.21.15.32:0/4154909074 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdd7006ace0 0x7fdd7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:24.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.294+0000 7fdd82d9d700 1 --2- 172.21.15.32:0/4154909074 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdd7006ace0 0x7fdd7006d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdd740090b0 tx=0x7fdd74008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:24.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.298+0000 7fdd6b7fe700 1 -- 172.21.15.32:0/4154909074 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdd7c054bd0 con 0x7fdd840cf4d0 2023-06-20T13:32:24.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:24.504+0000 7fdd891ff700 1 -- 172.21.15.32:0/4154909074 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fdd840d16e0 con 0x7fdd840cf4d0 2023-06-20T13:32:25.046 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.044+0000 7fdd6b7fe700 1 -- 172.21.15.32:0/4154909074 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdd7c0581f0 con 0x7fdd840cf4d0 2023-06-20T13:32:25.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.049+0000 7fdd891ff700 1 -- 172.21.15.32:0/4154909074 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdd7006ace0 msgr2=0x7fdd7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:25.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.049+0000 7fdd891ff700 1 --2- 172.21.15.32:0/4154909074 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdd7006ace0 0x7fdd7006d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdd740090b0 tx=0x7fdd74008030 comp rx=0 tx=0).stop 2023-06-20T13:32:25.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.049+0000 7fdd891ff700 1 -- 172.21.15.32:0/4154909074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd840cf4d0 msgr2=0x7fdd840b3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:25.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.049+0000 7fdd891ff700 1 --2- 172.21.15.32:0/4154909074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd840cf4d0 0x7fdd840b3790 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c007e40 tx=0x7fdd7c00e3c0 comp rx=0 tx=0).stop 2023-06-20T13:32:25.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.053+0000 7fdd891ff700 1 -- 172.21.15.32:0/4154909074 shutdown_connections 2023-06-20T13:32:25.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.053+0000 7fdd891ff700 1 --2- 172.21.15.32:0/4154909074 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdd7006ace0 0x7fdd7006d190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:25.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.053+0000 7fdd891ff700 1 --2- 172.21.15.32:0/4154909074 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd840cf4d0 0x7fdd840b3790 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:25.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.053+0000 7fdd891ff700 1 --2- 172.21.15.32:0/4154909074 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd840b1f00 0x7fdd8415bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:25.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.053+0000 7fdd891ff700 1 --2- 172.21.15.32:0/4154909074 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd840b82c0 0x7fdd841f5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:25.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.053+0000 7fdd891ff700 1 -- 172.21.15.32:0/4154909074 >> 172.21.15.32:0/4154909074 conn(0x7fdd84071660 msgr2=0x7fdd840b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:25.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.056+0000 7fdd891ff700 1 -- 172.21.15.32:0/4154909074 shutdown_connections 2023-06-20T13:32:25.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.057+0000 7fdd891ff700 1 -- 172.21.15.32:0/4154909074 wait complete. 2023-06-20T13:32:25.063 INFO:teuthology.orchestra.run.smithi032.stderr:set pool 5 allow_ec_overwrites to true 2023-06-20T13:32:25.099 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-06-20T13:32:25.183 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-06-20T13:32:25.180+0000 7f8258ff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-20T13:32:25.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.302+0000 7fbf271ff700 1 Processor -- start 2023-06-20T13:32:25.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.302+0000 7fbf271ff700 1 -- start start 2023-06-20T13:32:25.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.304+0000 7fbf271ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbf200b8260 0x7fbf200cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:25.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.304+0000 7fbf271ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf20160a00 con 0x7fbf200d25c0 2023-06-20T13:32:25.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.304+0000 7fbf271ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf20160ce0 con 0x7fbf200b4d20 2023-06-20T13:32:25.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.304+0000 7fbf271ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf200cd280 con 0x7fbf200b8260 2023-06-20T13:32:25.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.304+0000 7fbf1ffff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fbf200d25c0 0x7fbf200b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:37606/0 (socket says 172.21.15.32:37606) 2023-06-20T13:32:25.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.304+0000 7fbf24f9b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbf200b8260 0x7fbf200cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:25.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.304+0000 7fbf1ffff700 1 -- 172.21.15.32:0/2605747715 learned_addr learned my addr 172.21.15.32:0/2605747715 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:25.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.304+0000 7fbf24f9b700 1 -- 172.21.15.32:0/2605747715 >> v1:172.21.15.115:6789/0 conn(0x7fbf200b4d20 legacy=0x7fbf200d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:25.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.304+0000 7fbf24f9b700 1 -- 172.21.15.32:0/2605747715 >> v1:172.21.15.32:6789/0 conn(0x7fbf200d25c0 legacy=0x7fbf200b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:25.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.304+0000 7fbf24f9b700 1 -- 172.21.15.32:0/2605747715 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf200cd560 con 0x7fbf200b8260 2023-06-20T13:32:25.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.305+0000 7fbf24f9b700 1 --2- 172.21.15.32:0/2605747715 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbf200b8260 0x7fbf200cede0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbf14009840 tx=0x7fbf14009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec0c0d9666a6ff0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:25.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.305+0000 7fbf1f7fe700 1 -- 172.21.15.32:0/2605747715 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf14011830 con 0x7fbf200b8260 2023-06-20T13:32:25.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.305+0000 7fbf1f7fe700 1 -- 172.21.15.32:0/2605747715 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf14011990 con 0x7fbf200b8260 2023-06-20T13:32:25.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.305+0000 7fbf1f7fe700 1 -- 172.21.15.32:0/2605747715 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf14011d20 con 0x7fbf200b8260 2023-06-20T13:32:25.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.305+0000 7fbf271ff700 1 -- 172.21.15.32:0/2605747715 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbf200b8260 msgr2=0x7fbf200cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:25.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.305+0000 7fbf271ff700 1 --2- 172.21.15.32:0/2605747715 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbf200b8260 0x7fbf200cede0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbf14009840 tx=0x7fbf14009b50 comp rx=0 tx=0).stop 2023-06-20T13:32:25.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.306+0000 7fbf271ff700 1 -- 172.21.15.32:0/2605747715 shutdown_connections 2023-06-20T13:32:25.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.306+0000 7fbf271ff700 1 --2- 172.21.15.32:0/2605747715 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbf200b8260 0x7fbf200cede0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:25.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.306+0000 7fbf271ff700 1 -- 172.21.15.32:0/2605747715 >> 172.21.15.32:0/2605747715 conn(0x7fbf200722b0 msgr2=0x7fbf200cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:25.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.306+0000 7fbf271ff700 1 -- 172.21.15.32:0/2605747715 shutdown_connections 2023-06-20T13:32:25.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.306+0000 7fbf271ff700 1 -- 172.21.15.32:0/2605747715 wait complete. 2023-06-20T13:32:25.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.307+0000 7fbf271ff700 1 Processor -- start 2023-06-20T13:32:25.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.308+0000 7fbf271ff700 1 -- start start 2023-06-20T13:32:25.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.308+0000 7fbf271ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf200b8260 0x7fbf2015e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:25.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.308+0000 7fbf271ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf200d25c0 0x7fbf200cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:25.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.308+0000 7fbf271ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbf2015c070 0x7fbf200c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:25.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.308+0000 7fbf271ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf200c6840 con 0x7fbf2015c070 2023-06-20T13:32:25.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.308+0000 7fbf271ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf200c6b20 con 0x7fbf200d25c0 2023-06-20T13:32:25.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.308+0000 7fbf271ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf200c6e00 con 0x7fbf200b8260 2023-06-20T13:32:25.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.309+0000 7fbf2579c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbf2015c070 0x7fbf200c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:25.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.309+0000 7fbf2579c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbf2015c070 0x7fbf200c78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47022/0 (socket says 172.21.15.32:47022) 2023-06-20T13:32:25.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.309+0000 7fbf2579c700 1 -- 172.21.15.32:0/896503104 learned_addr learned my addr 172.21.15.32:0/896503104 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:25.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.309+0000 7fbf1ffff700 1 --2- 172.21.15.32:0/896503104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf200d25c0 0x7fbf200cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:25.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.309+0000 7fbf24f9b700 1 --2- 172.21.15.32:0/896503104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf200b8260 0x7fbf2015e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:25.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.309+0000 7fbf2579c700 1 -- 172.21.15.32:0/896503104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf200b8260 msgr2=0x7fbf2015e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:25.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.309+0000 7fbf2579c700 1 --2- 172.21.15.32:0/896503104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf200b8260 0x7fbf2015e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:25.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.309+0000 7fbf2579c700 1 -- 172.21.15.32:0/896503104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf200d25c0 msgr2=0x7fbf200cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:25.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.309+0000 7fbf2579c700 1 --2- 172.21.15.32:0/896503104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf200d25c0 0x7fbf200cbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:25.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.309+0000 7fbf2579c700 1 -- 172.21.15.32:0/896503104 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf140094a0 con 0x7fbf2015c070 2023-06-20T13:32:25.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.309+0000 7fbf24f9b700 1 --2- 172.21.15.32:0/896503104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf200b8260 0x7fbf2015e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:32:25.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.309+0000 7fbf2579c700 1 --2- 172.21.15.32:0/896503104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbf2015c070 0x7fbf200c78e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbf1800cc50 tx=0x7fbf1800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:25.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.309+0000 7fbf1d7fa700 1 -- 172.21.15.32:0/896503104 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf18003c00 con 0x7fbf2015c070 2023-06-20T13:32:25.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.310+0000 7fbf1d7fa700 1 -- 172.21.15.32:0/896503104 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf18003d60 con 0x7fbf2015c070 2023-06-20T13:32:25.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.310+0000 7fbf271ff700 1 -- 172.21.15.32:0/896503104 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf200c70e0 con 0x7fbf2015c070 2023-06-20T13:32:25.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.310+0000 7fbf1d7fa700 1 -- 172.21.15.32:0/896503104 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1800ab60 con 0x7fbf2015c070 2023-06-20T13:32:25.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.310+0000 7fbf271ff700 1 -- 172.21.15.32:0/896503104 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf2015e940 con 0x7fbf2015c070 2023-06-20T13:32:25.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.311+0000 7fbf271ff700 1 -- 172.21.15.32:0/896503104 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf2004ea60 con 0x7fbf2015c070 2023-06-20T13:32:25.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.312+0000 7fbf1d7fa700 1 -- 172.21.15.32:0/896503104 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbf1800acc0 con 0x7fbf2015c070 2023-06-20T13:32:25.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.313+0000 7fbf1d7fa700 1 --2- 172.21.15.32:0/896503104 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fbf0406ace0 0x7fbf0406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:25.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.313+0000 7fbf1d7fa700 1 -- 172.21.15.32:0/896503104 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fbf18089830 con 0x7fbf2015c070 2023-06-20T13:32:25.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.313+0000 7fbf24f9b700 1 --2- 172.21.15.32:0/896503104 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fbf0406ace0 0x7fbf0406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:25.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.314+0000 7fbf24f9b700 1 --2- 172.21.15.32:0/896503104 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fbf0406ace0 0x7fbf0406d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbf140090b0 tx=0x7fbf14008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:25.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.317+0000 7fbf1d7fa700 1 -- 172.21.15.32:0/896503104 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbf18054570 con 0x7fbf2015c070 2023-06-20T13:32:25.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:25.569+0000 7fbf271ff700 1 -- 172.21.15.32:0/896503104 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fbf200cfed0 con 0x7fbf2015c070 2023-06-20T13:32:26.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.046+0000 7fbf1d7fa700 1 -- 172.21.15.32:0/896503104 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v6) v1 ==== 137+0+0 (secure 0 0 0) 0x7fbf18057b90 con 0x7fbf2015c070 2023-06-20T13:32:26.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.050+0000 7fbf271ff700 1 -- 172.21.15.32:0/896503104 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fbf0406ace0 msgr2=0x7fbf0406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:26.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.050+0000 7fbf271ff700 1 --2- 172.21.15.32:0/896503104 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fbf0406ace0 0x7fbf0406d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbf140090b0 tx=0x7fbf14008030 comp rx=0 tx=0).stop 2023-06-20T13:32:26.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.050+0000 7fbf271ff700 1 -- 172.21.15.32:0/896503104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbf2015c070 msgr2=0x7fbf200c78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:26.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.050+0000 7fbf271ff700 1 --2- 172.21.15.32:0/896503104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbf2015c070 0x7fbf200c78e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbf1800cc50 tx=0x7fbf1800cf60 comp rx=0 tx=0).stop 2023-06-20T13:32:26.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.050+0000 7fbf271ff700 1 -- 172.21.15.32:0/896503104 shutdown_connections 2023-06-20T13:32:26.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.050+0000 7fbf271ff700 1 --2- 172.21.15.32:0/896503104 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fbf0406ace0 0x7fbf0406d190 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:26.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.050+0000 7fbf271ff700 1 --2- 172.21.15.32:0/896503104 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbf2015c070 0x7fbf200c78e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:26.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.050+0000 7fbf271ff700 1 --2- 172.21.15.32:0/896503104 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf200b8260 0x7fbf2015e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:26.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.050+0000 7fbf271ff700 1 --2- 172.21.15.32:0/896503104 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf200d25c0 0x7fbf200cbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:26.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.050+0000 7fbf271ff700 1 -- 172.21.15.32:0/896503104 >> 172.21.15.32:0/896503104 conn(0x7fbf200b4d20 msgr2=0x7fbf200b6230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:26.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.050+0000 7fbf271ff700 1 -- 172.21.15.32:0/896503104 shutdown_connections 2023-06-20T13:32:26.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.050+0000 7fbf271ff700 1 -- 172.21.15.32:0/896503104 wait complete. 2023-06-20T13:32:26.054 INFO:teuthology.orchestra.run.smithi032.stderr:added data pool 5 to fsmap 2023-06-20T13:32:26.072 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-20T13:32:26.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.271+0000 7ffa829ff700 1 Processor -- start 2023-06-20T13:32:26.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.272+0000 7ffa829ff700 1 -- start start 2023-06-20T13:32:26.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.273+0000 7ffa829ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ffa7c0d2640 0x7ffa7c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:26.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.273+0000 7ffa829ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa7c0cf8f0 0x7ffa7c15fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:26.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.273+0000 7ffa829ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa7c0d1790 con 0x7ffa7c15c460 2023-06-20T13:32:26.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.273+0000 7ffa829ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa7c0cedd0 con 0x7ffa7c0d2640 2023-06-20T13:32:26.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.273+0000 7ffa829ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c0cd950 con 0x7ffa7c0cf8f0 2023-06-20T13:32:26.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.273+0000 7ffa7b7fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ffa7c0d2640 0x7ffa7c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:26.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.273+0000 7ffa7b7fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ffa7c0d2640 0x7ffa7c0b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47034/0 (socket says 172.21.15.32:47034) 2023-06-20T13:32:26.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.273+0000 7ffa7b7fe700 1 -- 172.21.15.32:0/2655020524 learned_addr learned my addr 172.21.15.32:0/2655020524 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:26.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.273+0000 7ffa80f9c700 1 --2- 172.21.15.32:0/2655020524 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa7c0cf8f0 0x7ffa7c15fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:26.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.273+0000 7ffa7b7fe700 1 -- 172.21.15.32:0/2655020524 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa7c0cf8f0 msgr2=0x7ffa7c15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:26.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.273+0000 7ffa7b7fe700 1 --2- 172.21.15.32:0/2655020524 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa7c0cf8f0 0x7ffa7c15fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:26.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.273+0000 7ffa7b7fe700 1 -- 172.21.15.32:0/2655020524 >> v1:172.21.15.115:6789/0 conn(0x7ffa7c15c460 legacy=0x7ffa7c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:26.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.274+0000 7ffa7b7fe700 1 -- 172.21.15.32:0/2655020524 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c0d14b0 con 0x7ffa7c0d2640 2023-06-20T13:32:26.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.274+0000 7ffa7b7fe700 1 --2- 172.21.15.32:0/2655020524 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa7c0d2640 0x7ffa7c0b59d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffa700098f0 tx=0x7ffa70009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e746d9f21c111f8 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:26.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.274+0000 7ffa7affd700 1 -- 172.21.15.32:0/2655020524 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa70011830 con 0x7ffa7c0d2640 2023-06-20T13:32:26.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.274+0000 7ffa7affd700 1 -- 172.21.15.32:0/2655020524 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa70011990 con 0x7ffa7c0d2640 2023-06-20T13:32:26.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.274+0000 7ffa7affd700 1 -- 172.21.15.32:0/2655020524 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa70011d20 con 0x7ffa7c0d2640 2023-06-20T13:32:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.275+0000 7ffa829ff700 1 -- 172.21.15.32:0/2655020524 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa7c0d2640 msgr2=0x7ffa7c0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.275+0000 7ffa829ff700 1 --2- 172.21.15.32:0/2655020524 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa7c0d2640 0x7ffa7c0b59d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffa700098f0 tx=0x7ffa70009c00 comp rx=0 tx=0).stop 2023-06-20T13:32:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.275+0000 7ffa829ff700 1 -- 172.21.15.32:0/2655020524 shutdown_connections 2023-06-20T13:32:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.275+0000 7ffa829ff700 1 --2- 172.21.15.32:0/2655020524 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa7c0cf8f0 0x7ffa7c15fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.275+0000 7ffa829ff700 1 --2- 172.21.15.32:0/2655020524 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa7c0d2640 0x7ffa7c0b59d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.275+0000 7ffa829ff700 1 -- 172.21.15.32:0/2655020524 >> 172.21.15.32:0/2655020524 conn(0x7ffa7c071660 msgr2=0x7ffa7c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.275+0000 7ffa829ff700 1 -- 172.21.15.32:0/2655020524 shutdown_connections 2023-06-20T13:32:26.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.275+0000 7ffa829ff700 1 -- 172.21.15.32:0/2655020524 wait complete. 2023-06-20T13:32:26.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.277+0000 7ffa829ff700 1 Processor -- start 2023-06-20T13:32:26.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.277+0000 7ffa829ff700 1 -- start start 2023-06-20T13:32:26.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.279+0000 7ffa829ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa7c0cf8f0 0x7ffa7c0cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:26.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.279+0000 7ffa829ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa7c0d2640 0x7ffa7c15e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:26.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.279+0000 7ffa829ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa7c15c460 0x7ffa7c15e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:26.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.279+0000 7ffa829ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c0ccce0 con 0x7ffa7c15c460 2023-06-20T13:32:26.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.279+0000 7ffa829ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c159a60 con 0x7ffa7c0cf8f0 2023-06-20T13:32:26.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.279+0000 7ffa829ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c159d40 con 0x7ffa7c0d2640 2023-06-20T13:32:26.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.279+0000 7ffa80f9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa7c15c460 0x7ffa7c15e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:26.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.279+0000 7ffa80f9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa7c15c460 0x7ffa7c15e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47038/0 (socket says 172.21.15.32:47038) 2023-06-20T13:32:26.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.279+0000 7ffa80f9c700 1 -- 172.21.15.32:0/294991494 learned_addr learned my addr 172.21.15.32:0/294991494 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:26.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.279+0000 7ffa7b7fe700 1 --2- 172.21.15.32:0/294991494 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa7c0d2640 0x7ffa7c15e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:26.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.279+0000 7ffa7bfff700 1 --2- 172.21.15.32:0/294991494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa7c0cf8f0 0x7ffa7c0cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:26.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.279+0000 7ffa80f9c700 1 -- 172.21.15.32:0/294991494 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa7c0d2640 msgr2=0x7ffa7c15e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:26.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.279+0000 7ffa80f9c700 1 --2- 172.21.15.32:0/294991494 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa7c0d2640 0x7ffa7c15e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:26.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.279+0000 7ffa80f9c700 1 -- 172.21.15.32:0/294991494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa7c0cf8f0 msgr2=0x7ffa7c0cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:26.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.279+0000 7ffa80f9c700 1 --2- 172.21.15.32:0/294991494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa7c0cf8f0 0x7ffa7c0cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:26.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.279+0000 7ffa80f9c700 1 -- 172.21.15.32:0/294991494 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa70009550 con 0x7ffa7c15c460 2023-06-20T13:32:26.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.279+0000 7ffa7bfff700 1 --2- 172.21.15.32:0/294991494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa7c0cf8f0 0x7ffa7c0cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:32:26.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.280+0000 7ffa80f9c700 1 --2- 172.21.15.32:0/294991494 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa7c15c460 0x7ffa7c15e850 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400efc0 tx=0x7ffa7400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:26.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.280+0000 7ffa78ff9700 1 -- 172.21.15.32:0/294991494 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7400cb80 con 0x7ffa7c15c460 2023-06-20T13:32:26.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.280+0000 7ffa78ff9700 1 -- 172.21.15.32:0/294991494 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7400f040 con 0x7ffa7c15c460 2023-06-20T13:32:26.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.280+0000 7ffa829ff700 1 -- 172.21.15.32:0/294991494 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa7c15a020 con 0x7ffa7c15c460 2023-06-20T13:32:26.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.280+0000 7ffa78ff9700 1 -- 172.21.15.32:0/294991494 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa74014480 con 0x7ffa7c15c460 2023-06-20T13:32:26.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.280+0000 7ffa829ff700 1 -- 172.21.15.32:0/294991494 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa7c15a5e0 con 0x7ffa7c15c460 2023-06-20T13:32:26.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.281+0000 7ffa829ff700 1 -- 172.21.15.32:0/294991494 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa7c15a7d0 con 0x7ffa7c15c460 2023-06-20T13:32:26.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.282+0000 7ffa78ff9700 1 -- 172.21.15.32:0/294991494 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffa740145e0 con 0x7ffa7c15c460 2023-06-20T13:32:26.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.283+0000 7ffa78ff9700 1 --2- 172.21.15.32:0/294991494 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ffa6806ace0 0x7ffa6806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:26.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.283+0000 7ffa78ff9700 1 -- 172.21.15.32:0/294991494 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffa7408a0a0 con 0x7ffa7c15c460 2023-06-20T13:32:26.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.283+0000 7ffa7bfff700 1 --2- 172.21.15.32:0/294991494 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ffa6806ace0 0x7ffa6806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:26.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.284+0000 7ffa7bfff700 1 --2- 172.21.15.32:0/294991494 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ffa6806ace0 0x7ffa6806d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c000f60 tx=0x7ffa6c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:26.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.287+0000 7ffa78ff9700 1 -- 172.21.15.32:0/294991494 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ffa74054dc0 con 0x7ffa7c15c460 2023-06-20T13:32:26.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.539+0000 7ffa829ff700 1 -- 172.21.15.32:0/294991494 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa7c04ea60 con 0x7ffa7c15c460 2023-06-20T13:32:26.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.540+0000 7ffa78ff9700 1 -- 172.21.15.32:0/294991494 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4670 (secure 0 0 0) 0x7ffa740583e0 con 0x7ffa7c15c460 2023-06-20T13:32:26.542 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:32:26.543 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2171664589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2171664589},{"type":"v1","addr":"172.21.15.115:6834","nonce":2171664589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/959333888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":959333888},{"type":"v1","addr":"172.21.15.32:6837","nonce":959333888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3388117179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":3388117179},{"type":"v1","addr":"172.21.15.32:6835","nonce":3388117179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-20T13:32:20.527725+0000","modified":"2023-06-20T13:32:26.043158+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3566362693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3566362693},{"type":"v1","addr":"172.21.15.115:6835","nonce":3566362693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-06-20T13:32:26.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.542+0000 7ffa829ff700 1 -- 172.21.15.32:0/294991494 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ffa6806ace0 msgr2=0x7ffa6806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:26.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.543+0000 7ffa829ff700 1 --2- 172.21.15.32:0/294991494 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ffa6806ace0 0x7ffa6806d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c000f60 tx=0x7ffa6c009040 comp rx=0 tx=0).stop 2023-06-20T13:32:26.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.543+0000 7ffa829ff700 1 -- 172.21.15.32:0/294991494 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa7c15c460 msgr2=0x7ffa7c15e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:26.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.543+0000 7ffa829ff700 1 --2- 172.21.15.32:0/294991494 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa7c15c460 0x7ffa7c15e850 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400efc0 tx=0x7ffa7400c0c0 comp rx=0 tx=0).stop 2023-06-20T13:32:26.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.543+0000 7ffa829ff700 1 -- 172.21.15.32:0/294991494 shutdown_connections 2023-06-20T13:32:26.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.543+0000 7ffa829ff700 1 --2- 172.21.15.32:0/294991494 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ffa6806ace0 0x7ffa6806d190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:26.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.543+0000 7ffa829ff700 1 --2- 172.21.15.32:0/294991494 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa7c15c460 0x7ffa7c15e850 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:26.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.543+0000 7ffa829ff700 1 --2- 172.21.15.32:0/294991494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa7c0cf8f0 0x7ffa7c0cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:26.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.543+0000 7ffa829ff700 1 --2- 172.21.15.32:0/294991494 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa7c0d2640 0x7ffa7c15e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:26.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.543+0000 7ffa829ff700 1 -- 172.21.15.32:0/294991494 >> 172.21.15.32:0/294991494 conn(0x7ffa7c071660 msgr2=0x7ffa7c15d970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:26.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.543+0000 7ffa829ff700 1 -- 172.21.15.32:0/294991494 shutdown_connections 2023-06-20T13:32:26.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.543+0000 7ffa829ff700 1 -- 172.21.15.32:0/294991494 wait complete. 2023-06-20T13:32:26.547 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 6 2023-06-20T13:32:26.563 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:32:26.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.759+0000 7fdc1edff700 1 Processor -- start 2023-06-20T13:32:26.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.760+0000 7fdc1edff700 1 -- start start 2023-06-20T13:32:26.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.761+0000 7fdc1edff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdc180d2640 0x7fdc180b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:26.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.761+0000 7fdc1edff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdc180cf8f0 0x7fdc1815fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:26.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.761+0000 7fdc1edff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc180d1790 con 0x7fdc1815c460 2023-06-20T13:32:26.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.761+0000 7fdc1edff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc180cedd0 con 0x7fdc180d2640 2023-06-20T13:32:26.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.761+0000 7fdc1edff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc180cd950 con 0x7fdc180cf8f0 2023-06-20T13:32:26.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.761+0000 7fdc17fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdc180d2640 0x7fdc180b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:26.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.761+0000 7fdc17fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdc180d2640 0x7fdc180b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47040/0 (socket says 172.21.15.32:47040) 2023-06-20T13:32:26.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.761+0000 7fdc17fff700 1 -- 172.21.15.32:0/3693482782 learned_addr learned my addr 172.21.15.32:0/3693482782 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:26.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.761+0000 7fdc1d39c700 1 --2- 172.21.15.32:0/3693482782 >> v2:172.21.15.115:3300/0 conn(0x7fdc180cf8f0 0x7fdc1815fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:26.766 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.761+0000 7fdc17fff700 1 -- 172.21.15.32:0/3693482782 >> v2:172.21.15.115:3300/0 conn(0x7fdc180cf8f0 msgr2=0x7fdc1815fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:26.766 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.762+0000 7fdc17fff700 1 --2- 172.21.15.32:0/3693482782 >> v2:172.21.15.115:3300/0 conn(0x7fdc180cf8f0 0x7fdc1815fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:26.766 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.762+0000 7fdc17fff700 1 -- 172.21.15.32:0/3693482782 >> v1:172.21.15.115:6789/0 conn(0x7fdc1815c460 legacy=0x7fdc180cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:26.766 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.762+0000 7fdc17fff700 1 -- 172.21.15.32:0/3693482782 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc180d14b0 con 0x7fdc180d2640 2023-06-20T13:32:26.766 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.762+0000 7fdc17fff700 1 --2- 172.21.15.32:0/3693482782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc180d2640 0x7fdc180b59d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdc18072140 tx=0x7fdc04009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91de6d7afc8c20c server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:26.766 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.762+0000 7fdc177fe700 1 -- 172.21.15.32:0/3693482782 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0400b870 con 0x7fdc180d2640 2023-06-20T13:32:26.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.762+0000 7fdc177fe700 1 -- 172.21.15.32:0/3693482782 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0400b9d0 con 0x7fdc180d2640 2023-06-20T13:32:26.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.762+0000 7fdc177fe700 1 -- 172.21.15.32:0/3693482782 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0400bd60 con 0x7fdc180d2640 2023-06-20T13:32:26.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.763+0000 7fdc1edff700 1 -- 172.21.15.32:0/3693482782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc180d2640 msgr2=0x7fdc180b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:26.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.763+0000 7fdc1edff700 1 --2- 172.21.15.32:0/3693482782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc180d2640 0x7fdc180b59d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdc18072140 tx=0x7fdc04009bd0 comp rx=0 tx=0).stop 2023-06-20T13:32:26.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.763+0000 7fdc1edff700 1 -- 172.21.15.32:0/3693482782 shutdown_connections 2023-06-20T13:32:26.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.763+0000 7fdc1edff700 1 --2- 172.21.15.32:0/3693482782 >> v2:172.21.15.115:3300/0 conn(0x7fdc180cf8f0 0x7fdc1815fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:26.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.763+0000 7fdc1edff700 1 --2- 172.21.15.32:0/3693482782 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc180d2640 0x7fdc180b59d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:26.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.763+0000 7fdc1edff700 1 -- 172.21.15.32:0/3693482782 >> 172.21.15.32:0/3693482782 conn(0x7fdc18071660 msgr2=0x7fdc18071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:26.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.763+0000 7fdc1edff700 1 -- 172.21.15.32:0/3693482782 shutdown_connections 2023-06-20T13:32:26.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.763+0000 7fdc1edff700 1 -- 172.21.15.32:0/3693482782 wait complete. 2023-06-20T13:32:26.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.765+0000 7fdc1edff700 1 Processor -- start 2023-06-20T13:32:26.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.765+0000 7fdc1edff700 1 -- start start 2023-06-20T13:32:26.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.767+0000 7fdc1edff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc180cf8f0 0x7fdc180c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:26.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.767+0000 7fdc1edff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc180d2640 0x7fdc181e7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:26.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.767+0000 7fdc1edff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc1815c460 0x7fdc180cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:26.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.767+0000 7fdc1edff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1815b950 con 0x7fdc1815c460 2023-06-20T13:32:26.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.767+0000 7fdc1edff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc181e6650 con 0x7fdc180cf8f0 2023-06-20T13:32:26.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.767+0000 7fdc1edff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc181e68a0 con 0x7fdc180d2640 2023-06-20T13:32:26.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.767+0000 7fdc1d39c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc1815c460 0x7fdc180cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:26.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.767+0000 7fdc17fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc180d2640 0x7fdc181e7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:26.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.767+0000 7fdc1cb9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc180cf8f0 0x7fdc180c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:26.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.767+0000 7fdc1d39c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc1815c460 0x7fdc180cbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47050/0 (socket says 172.21.15.32:47050) 2023-06-20T13:32:26.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.767+0000 7fdc1d39c700 1 -- 172.21.15.32:0/3430071580 learned_addr learned my addr 172.21.15.32:0/3430071580 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:26.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.767+0000 7fdc1d39c700 1 -- 172.21.15.32:0/3430071580 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc180d2640 msgr2=0x7fdc181e7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:26.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.767+0000 7fdc1d39c700 1 --2- 172.21.15.32:0/3430071580 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc180d2640 0x7fdc181e7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:26.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.767+0000 7fdc1d39c700 1 -- 172.21.15.32:0/3430071580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc180cf8f0 msgr2=0x7fdc180c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:26.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.767+0000 7fdc1d39c700 1 --2- 172.21.15.32:0/3430071580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc180cf8f0 0x7fdc180c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:26.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.767+0000 7fdc1d39c700 1 -- 172.21.15.32:0/3430071580 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc04009550 con 0x7fdc1815c460 2023-06-20T13:32:26.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.768+0000 7fdc1d39c700 1 --2- 172.21.15.32:0/3430071580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc1815c460 0x7fdc180cbe20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdc10007e60 tx=0x7fdc1000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:26.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.768+0000 7fdc157fa700 1 -- 172.21.15.32:0/3430071580 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1000ed30 con 0x7fdc1815c460 2023-06-20T13:32:26.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.768+0000 7fdc157fa700 1 -- 172.21.15.32:0/3430071580 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc10014420 con 0x7fdc1815c460 2023-06-20T13:32:26.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.768+0000 7fdc1edff700 1 -- 172.21.15.32:0/3430071580 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc181e6b80 con 0x7fdc1815c460 2023-06-20T13:32:26.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.768+0000 7fdc157fa700 1 -- 172.21.15.32:0/3430071580 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc100147d0 con 0x7fdc1815c460 2023-06-20T13:32:26.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.768+0000 7fdc1edff700 1 -- 172.21.15.32:0/3430071580 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc181e7140 con 0x7fdc1815c460 2023-06-20T13:32:26.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.769+0000 7fdc1edff700 1 -- 172.21.15.32:0/3430071580 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc181e7330 con 0x7fdc1815c460 2023-06-20T13:32:26.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.770+0000 7fdc157fa700 1 -- 172.21.15.32:0/3430071580 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdc10014930 con 0x7fdc1815c460 2023-06-20T13:32:26.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.772+0000 7fdc157fa700 1 --2- 172.21.15.32:0/3430071580 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdbfc06ace0 0x7fdbfc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:26.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.772+0000 7fdc157fa700 1 -- 172.21.15.32:0/3430071580 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdc10089e40 con 0x7fdc1815c460 2023-06-20T13:32:26.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.772+0000 7fdc1cb9b700 1 --2- 172.21.15.32:0/3430071580 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdbfc06ace0 0x7fdbfc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:26.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.773+0000 7fdc1cb9b700 1 --2- 172.21.15.32:0/3430071580 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdbfc06ace0 0x7fdbfc06d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c007fd0 tx=0x7fdc0c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:26.778 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.776+0000 7fdc157fa700 1 -- 172.21.15.32:0/3430071580 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdc10054c10 con 0x7fdc1815c460 2023-06-20T13:32:26.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.984+0000 7fdc1edff700 1 -- 172.21.15.32:0/3430071580 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc1804ea60 con 0x7fdc1815c460 2023-06-20T13:32:26.987 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.985+0000 7fdc157fa700 1 -- 172.21.15.32:0/3430071580 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20096 (secure 0 0 0) 0x7fdc10058230 con 0x7fdc1815c460 2023-06-20T13:32:26.988 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:32:26.988 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":27,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:32:25.570940+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-20T13:32:18.120021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-20T13:32:19.503624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-20T13:32:23.074912+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:32:26.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.988+0000 7fdc1edff700 1 -- 172.21.15.32:0/3430071580 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdbfc06ace0 msgr2=0x7fdbfc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:26.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.988+0000 7fdc1edff700 1 --2- 172.21.15.32:0/3430071580 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdbfc06ace0 0x7fdbfc06d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c007fd0 tx=0x7fdc0c009040 comp rx=0 tx=0).stop 2023-06-20T13:32:26.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.988+0000 7fdc1edff700 1 -- 172.21.15.32:0/3430071580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc1815c460 msgr2=0x7fdc180cbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:26.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.988+0000 7fdc1edff700 1 --2- 172.21.15.32:0/3430071580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc1815c460 0x7fdc180cbe20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdc10007e60 tx=0x7fdc1000e3c0 comp rx=0 tx=0).stop 2023-06-20T13:32:26.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.988+0000 7fdc1edff700 1 -- 172.21.15.32:0/3430071580 shutdown_connections 2023-06-20T13:32:26.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.988+0000 7fdc1edff700 1 --2- 172.21.15.32:0/3430071580 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdbfc06ace0 0x7fdbfc06d190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:26.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.988+0000 7fdc1edff700 1 --2- 172.21.15.32:0/3430071580 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc1815c460 0x7fdc180cbe20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:26.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.988+0000 7fdc1edff700 1 --2- 172.21.15.32:0/3430071580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc180cf8f0 0x7fdc180c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:26.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.988+0000 7fdc1edff700 1 --2- 172.21.15.32:0/3430071580 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc180d2640 0x7fdc181e7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:26.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.988+0000 7fdc1edff700 1 -- 172.21.15.32:0/3430071580 >> 172.21.15.32:0/3430071580 conn(0x7fdc18071660 msgr2=0x7fdc180cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:26.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.989+0000 7fdc1edff700 1 -- 172.21.15.32:0/3430071580 shutdown_connections 2023-06-20T13:32:26.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:26.989+0000 7fdc1edff700 1 -- 172.21.15.32:0/3430071580 wait complete. 2023-06-20T13:32:27.011 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:32:27.214 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.212+0000 7fee495ff700 1 Processor -- start 2023-06-20T13:32:27.214 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.212+0000 7fee495ff700 1 -- start start 2023-06-20T13:32:27.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.213+0000 7fee495ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fee4415c460 0x7fee440b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:27.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.213+0000 7fee495ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fee440d2640 0x7fee440cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:27.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.213+0000 7fee495ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee440cf720 0x7fee440cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:27.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.213+0000 7fee495ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee440cedd0 con 0x7fee4415c460 2023-06-20T13:32:27.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.213+0000 7fee495ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee440d1790 con 0x7fee440d2640 2023-06-20T13:32:27.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.213+0000 7fee495ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee440cd950 con 0x7fee440cf720 2023-06-20T13:32:27.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.213+0000 7fee42ffd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fee4415c460 0x7fee440b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:27.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.214+0000 7fee42ffd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fee4415c460 0x7fee440b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47058/0 (socket says 172.21.15.32:47058) 2023-06-20T13:32:27.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.214+0000 7fee42ffd700 1 -- 172.21.15.32:0/1493914358 learned_addr learned my addr 172.21.15.32:0/1493914358 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:27.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.214+0000 7fee427fc700 1 --2- 172.21.15.32:0/1493914358 >> v2:172.21.15.115:3300/0 conn(0x7fee440d2640 0x7fee440cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:27.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.214+0000 7fee437fe700 1 --2- 172.21.15.32:0/1493914358 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee440cf720 0x7fee440cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:27.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.214+0000 7fee42ffd700 1 -- 172.21.15.32:0/1493914358 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee440cf720 msgr2=0x7fee440cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:27.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.214+0000 7fee42ffd700 1 --2- 172.21.15.32:0/1493914358 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee440cf720 0x7fee440cfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:27.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.214+0000 7fee42ffd700 1 -- 172.21.15.32:0/1493914358 >> v2:172.21.15.115:3300/0 conn(0x7fee440d2640 msgr2=0x7fee440cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:27.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.214+0000 7fee42ffd700 1 --2- 172.21.15.32:0/1493914358 >> v2:172.21.15.115:3300/0 conn(0x7fee440d2640 0x7fee440cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:27.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.214+0000 7fee42ffd700 1 -- 172.21.15.32:0/1493914358 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee440d14b0 con 0x7fee4415c460 2023-06-20T13:32:27.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.214+0000 7fee437fe700 1 --2- 172.21.15.32:0/1493914358 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee440cf720 0x7fee440cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:32:27.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.214+0000 7fee42ffd700 1 --2- 172.21.15.32:0/1493914358 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee4415c460 0x7fee440b59d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fee4415fd80 tx=0x7fee34009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b42c9822e901a7 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:27.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.214+0000 7fee41ffb700 1 -- 172.21.15.32:0/1493914358 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee34011830 con 0x7fee4415c460 2023-06-20T13:32:27.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.215+0000 7fee41ffb700 1 -- 172.21.15.32:0/1493914358 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee34011990 con 0x7fee4415c460 2023-06-20T13:32:27.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.215+0000 7fee41ffb700 1 -- 172.21.15.32:0/1493914358 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee34011d20 con 0x7fee4415c460 2023-06-20T13:32:27.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.215+0000 7fee495ff700 1 -- 172.21.15.32:0/1493914358 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee4415c460 msgr2=0x7fee440b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:27.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.215+0000 7fee495ff700 1 --2- 172.21.15.32:0/1493914358 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee4415c460 0x7fee440b59d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fee4415fd80 tx=0x7fee34009bd0 comp rx=0 tx=0).stop 2023-06-20T13:32:27.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.215+0000 7fee495ff700 1 -- 172.21.15.32:0/1493914358 shutdown_connections 2023-06-20T13:32:27.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.215+0000 7fee495ff700 1 --2- 172.21.15.32:0/1493914358 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee440cf720 0x7fee440cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:27.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.215+0000 7fee495ff700 1 --2- 172.21.15.32:0/1493914358 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee4415c460 0x7fee440b59d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:27.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.215+0000 7fee495ff700 1 --2- 172.21.15.32:0/1493914358 >> v2:172.21.15.115:3300/0 conn(0x7fee440d2640 0x7fee440cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:27.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.215+0000 7fee495ff700 1 -- 172.21.15.32:0/1493914358 >> 172.21.15.32:0/1493914358 conn(0x7fee44071660 msgr2=0x7fee44071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:27.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.215+0000 7fee495ff700 1 -- 172.21.15.32:0/1493914358 shutdown_connections 2023-06-20T13:32:27.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.215+0000 7fee495ff700 1 -- 172.21.15.32:0/1493914358 wait complete. 2023-06-20T13:32:27.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.217+0000 7fee495ff700 1 Processor -- start 2023-06-20T13:32:27.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.217+0000 7fee495ff700 1 -- start start 2023-06-20T13:32:27.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.218+0000 7fee495ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee440cf720 0x7fee440b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:27.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.218+0000 7fee495ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee440d2640 0x7fee440cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:27.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.218+0000 7fee495ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee4415c460 0x7fee44148e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:27.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.218+0000 7fee495ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee440b3700 con 0x7fee440d2640 2023-06-20T13:32:27.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.218+0000 7fee495ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee440b3270 con 0x7fee440cf720 2023-06-20T13:32:27.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.218+0000 7fee495ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee440b2660 con 0x7fee4415c460 2023-06-20T13:32:27.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.218+0000 7fee427fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee440d2640 0x7fee440cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:27.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.218+0000 7fee427fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee440d2640 0x7fee440cc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47068/0 (socket says 172.21.15.32:47068) 2023-06-20T13:32:27.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.218+0000 7fee427fc700 1 -- 172.21.15.32:0/2164509588 learned_addr learned my addr 172.21.15.32:0/2164509588 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:27.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.218+0000 7fee42ffd700 1 --2- 172.21.15.32:0/2164509588 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee440cf720 0x7fee440b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:27.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.218+0000 7fee437fe700 1 --2- 172.21.15.32:0/2164509588 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee4415c460 0x7fee44148e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:27.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.219+0000 7fee427fc700 1 -- 172.21.15.32:0/2164509588 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee4415c460 msgr2=0x7fee44148e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:27.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.219+0000 7fee427fc700 1 --2- 172.21.15.32:0/2164509588 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee4415c460 0x7fee44148e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:27.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.219+0000 7fee427fc700 1 -- 172.21.15.32:0/2164509588 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee440cf720 msgr2=0x7fee440b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:27.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.219+0000 7fee427fc700 1 --2- 172.21.15.32:0/2164509588 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee440cf720 0x7fee440b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:27.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.219+0000 7fee427fc700 1 -- 172.21.15.32:0/2164509588 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee34009550 con 0x7fee440d2640 2023-06-20T13:32:27.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.219+0000 7fee427fc700 1 --2- 172.21.15.32:0/2164509588 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee440d2640 0x7fee440cc2b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fee3800e870 tx=0x7fee3800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:27.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.219+0000 7fee2b7fe700 1 -- 172.21.15.32:0/2164509588 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee38009590 con 0x7fee440d2640 2023-06-20T13:32:27.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.219+0000 7fee2b7fe700 1 -- 172.21.15.32:0/2164509588 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee38013680 con 0x7fee440d2640 2023-06-20T13:32:27.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.219+0000 7fee2b7fe700 1 -- 172.21.15.32:0/2164509588 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee380139f0 con 0x7fee440d2640 2023-06-20T13:32:27.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.219+0000 7fee495ff700 1 -- 172.21.15.32:0/2164509588 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee440b2940 con 0x7fee440d2640 2023-06-20T13:32:27.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.219+0000 7fee495ff700 1 -- 172.21.15.32:0/2164509588 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee440b2f00 con 0x7fee440d2640 2023-06-20T13:32:27.226 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.220+0000 7fee495ff700 1 -- 172.21.15.32:0/2164509588 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee4404ea60 con 0x7fee440d2640 2023-06-20T13:32:27.226 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.222+0000 7fee2b7fe700 1 -- 172.21.15.32:0/2164509588 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fee38013b50 con 0x7fee440d2640 2023-06-20T13:32:27.226 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.222+0000 7fee2b7fe700 1 --2- 172.21.15.32:0/2164509588 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fee3006ace0 0x7fee3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:27.226 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.223+0000 7fee2b7fe700 1 -- 172.21.15.32:0/2164509588 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fee38089610 con 0x7fee440d2640 2023-06-20T13:32:27.227 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.223+0000 7fee42ffd700 1 --2- 172.21.15.32:0/2164509588 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fee3006ace0 0x7fee3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:27.227 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.224+0000 7fee42ffd700 1 --2- 172.21.15.32:0/2164509588 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fee3006ace0 0x7fee3006d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fee34014040 tx=0x7fee34008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:27.231 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.229+0000 7fee2b7fe700 1 -- 172.21.15.32:0/2164509588 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fee38057dc0 con 0x7fee440d2640 2023-06-20T13:32:27.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.439+0000 7fee495ff700 1 -- 172.21.15.32:0/2164509588 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee44071440 con 0x7fee440d2640 2023-06-20T13:32:27.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.441+0000 7fee2b7fe700 1 -- 172.21.15.32:0/2164509588 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20096 (secure 0 0 0) 0x7fee38057950 con 0x7fee440d2640 2023-06-20T13:32:27.443 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:32:27.443 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":27,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:32:25.570940+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-20T13:32:18.120021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-20T13:32:19.503624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-20T13:32:23.074912+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:32:27.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.443+0000 7fee495ff700 1 -- 172.21.15.32:0/2164509588 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fee3006ace0 msgr2=0x7fee3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:27.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.443+0000 7fee495ff700 1 --2- 172.21.15.32:0/2164509588 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fee3006ace0 0x7fee3006d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fee34014040 tx=0x7fee34008030 comp rx=0 tx=0).stop 2023-06-20T13:32:27.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.443+0000 7fee495ff700 1 -- 172.21.15.32:0/2164509588 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee440d2640 msgr2=0x7fee440cc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:27.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.443+0000 7fee495ff700 1 --2- 172.21.15.32:0/2164509588 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee440d2640 0x7fee440cc2b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fee3800e870 tx=0x7fee3800eb80 comp rx=0 tx=0).stop 2023-06-20T13:32:27.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.443+0000 7fee495ff700 1 -- 172.21.15.32:0/2164509588 shutdown_connections 2023-06-20T13:32:27.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.443+0000 7fee495ff700 1 --2- 172.21.15.32:0/2164509588 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fee3006ace0 0x7fee3006d190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:27.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.443+0000 7fee495ff700 1 --2- 172.21.15.32:0/2164509588 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fee4415c460 0x7fee44148e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:27.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.443+0000 7fee495ff700 1 --2- 172.21.15.32:0/2164509588 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fee440cf720 0x7fee440b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:27.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.443+0000 7fee495ff700 1 --2- 172.21.15.32:0/2164509588 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fee440d2640 0x7fee440cc2b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:27.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.443+0000 7fee495ff700 1 -- 172.21.15.32:0/2164509588 >> 172.21.15.32:0/2164509588 conn(0x7fee44071660 msgr2=0x7fee4415fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:27.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.443+0000 7fee495ff700 1 -- 172.21.15.32:0/2164509588 shutdown_connections 2023-06-20T13:32:27.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.443+0000 7fee495ff700 1 -- 172.21.15.32:0/2164509588 wait complete. 2023-06-20T13:32:27.479 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-20T13:32:27.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.677+0000 7f29571ff700 1 Processor -- start 2023-06-20T13:32:27.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.677+0000 7f29571ff700 1 -- start start 2023-06-20T13:32:27.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.678+0000 7f29571ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f29500b59d0 0x7f29501671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:27.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.678+0000 7f29571ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29500d1790 con 0x7f295015c460 2023-06-20T13:32:27.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.678+0000 7f29571ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29500cd950 con 0x7f29500d2640 2023-06-20T13:32:27.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.678+0000 7f29571ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29500b5e10 con 0x7f29500b59d0 2023-06-20T13:32:27.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.679+0000 7f2954f9b700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f295015c460 0x7f29500cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:37614/0 (socket says 172.21.15.32:37614) 2023-06-20T13:32:27.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.679+0000 7f2954f9b700 1 -- 172.21.15.32:0/2750236662 learned_addr learned my addr 172.21.15.32:0/2750236662 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:27.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.679+0000 7f295579c700 1 --2- 172.21.15.32:0/2750236662 >> v2:172.21.15.115:3300/0 conn(0x7f29500b59d0 0x7f29501671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:27.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.679+0000 7f294f7fe700 1 -- 172.21.15.32:0/2750236662 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3006498887 0 0) 0x7f29500d1790 con 0x7f295015c460 2023-06-20T13:32:27.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.679+0000 7f294f7fe700 1 -- 172.21.15.32:0/2750236662 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29400035b0 con 0x7f295015c460 2023-06-20T13:32:27.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.679+0000 7f294f7fe700 1 -- 172.21.15.32:0/2750236662 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 488048092 0 0) 0x7f29400035b0 con 0x7f295015c460 2023-06-20T13:32:27.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.679+0000 7f294f7fe700 1 -- 172.21.15.32:0/2750236662 >> v2:172.21.15.115:3300/0 conn(0x7f29500b59d0 msgr2=0x7f29501671b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:27.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.679+0000 7f294f7fe700 1 --2- 172.21.15.32:0/2750236662 >> v2:172.21.15.115:3300/0 conn(0x7f29500b59d0 0x7f29501671b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:27.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.679+0000 7f294f7fe700 1 -- 172.21.15.32:0/2750236662 >> v1:172.21.15.115:6789/0 conn(0x7f29500d2640 legacy=0x7f29500cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:27.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.679+0000 7f294f7fe700 1 -- 172.21.15.32:0/2750236662 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29500d14b0 con 0x7f295015c460 2023-06-20T13:32:27.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.679+0000 7f294f7fe700 1 -- 172.21.15.32:0/2750236662 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3380058562 0 0) 0x7f2944001670 con 0x7f295015c460 2023-06-20T13:32:27.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.679+0000 7f294f7fe700 1 -- 172.21.15.32:0/2750236662 >> v1:172.21.15.32:6789/0 conn(0x7f295015c460 legacy=0x7f29500cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:27.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.679+0000 7f294f7fe700 1 --2- 172.21.15.32:0/2750236662 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2940003a00 0x7f2940003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:27.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.679+0000 7f294f7fe700 1 --2- 172.21.15.32:0/2750236662 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2940004850 0x7f2940004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:27.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.679+0000 7f294f7fe700 1 --2- 172.21.15.32:0/2750236662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2940005320 0x7f294000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:27.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.679+0000 7f294f7fe700 1 -- 172.21.15.32:0/2750236662 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29500b5e10 con 0x7f2940003a00 2023-06-20T13:32:27.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.679+0000 7f294f7fe700 1 -- 172.21.15.32:0/2750236662 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294000c250 con 0x7f2940005320 2023-06-20T13:32:27.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.679+0000 7f294f7fe700 1 -- 172.21.15.32:0/2750236662 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294000c410 con 0x7f2940004850 2023-06-20T13:32:27.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.680+0000 7f295579c700 1 --2- 172.21.15.32:0/2750236662 >> v2:172.21.15.115:3300/0 conn(0x7f29500b59d0 0x7f29501671b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:32:27.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.680+0000 7f2954f9b700 1 --2- 172.21.15.32:0/2750236662 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2940003a00 0x7f2940003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:27.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.680+0000 7f294ffff700 1 --2- 172.21.15.32:0/2750236662 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2940004850 0x7f2940004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:27.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.680+0000 7f295579c700 1 --2- 172.21.15.32:0/2750236662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2940005320 0x7f294000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:27.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.680+0000 7f2954f9b700 1 -- 172.21.15.32:0/2750236662 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2940004850 msgr2=0x7f2940004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:27.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.680+0000 7f2954f9b700 1 --2- 172.21.15.32:0/2750236662 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2940004850 0x7f2940004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:27.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.680+0000 7f2954f9b700 1 -- 172.21.15.32:0/2750236662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2940005320 msgr2=0x7f294000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:27.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.680+0000 7f2954f9b700 1 --2- 172.21.15.32:0/2750236662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2940005320 0x7f294000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:27.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.680+0000 7f2954f9b700 1 -- 172.21.15.32:0/2750236662 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29400035b0 con 0x7f2940003a00 2023-06-20T13:32:27.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.680+0000 7f295579c700 1 -- 172.21.15.32:0/2750236662 reap_dead start 2023-06-20T13:32:27.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.680+0000 7f2954f9b700 1 --2- 172.21.15.32:0/2750236662 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2940003a00 0x7f2940003e10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f294400c2a0 tx=0x7f2940005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e84452301d6341 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:27.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.680+0000 7f294f7fe700 1 -- 172.21.15.32:0/2750236662 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2944007c10 con 0x7f2940003a00 2023-06-20T13:32:27.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.681+0000 7f294f7fe700 1 -- 172.21.15.32:0/2750236662 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294400cde0 con 0x7f2940003a00 2023-06-20T13:32:27.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.681+0000 7f294f7fe700 1 -- 172.21.15.32:0/2750236662 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2944005ba0 con 0x7f2940003a00 2023-06-20T13:32:27.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.681+0000 7f29571ff700 1 -- 172.21.15.32:0/2750236662 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2940003a00 msgr2=0x7f2940003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:27.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.681+0000 7f29571ff700 1 --2- 172.21.15.32:0/2750236662 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2940003a00 0x7f2940003e10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f294400c2a0 tx=0x7f2940005880 comp rx=0 tx=0).stop 2023-06-20T13:32:27.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.681+0000 7f29571ff700 1 -- 172.21.15.32:0/2750236662 shutdown_connections 2023-06-20T13:32:27.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.681+0000 7f29571ff700 1 --2- 172.21.15.32:0/2750236662 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2940003a00 0x7f2940003e10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:27.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.681+0000 7f29571ff700 1 -- 172.21.15.32:0/2750236662 >> 172.21.15.32:0/2750236662 conn(0x7f2950071660 msgr2=0x7f2950071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:27.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.681+0000 7f29571ff700 1 -- 172.21.15.32:0/2750236662 shutdown_connections 2023-06-20T13:32:27.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.681+0000 7f29571ff700 1 -- 172.21.15.32:0/2750236662 wait complete. 2023-06-20T13:32:27.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.683+0000 7f29571ff700 1 Processor -- start 2023-06-20T13:32:27.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.683+0000 7f29571ff700 1 -- start start 2023-06-20T13:32:27.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.684+0000 7f29571ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2940003a00 0x7f295014cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:27.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.684+0000 7f29571ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29500cc5e0 0x7f29500ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:27.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.684+0000 7f29571ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29500caba0 0x7f29500c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:27.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.684+0000 7f29571ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29500cb010 con 0x7f29500caba0 2023-06-20T13:32:27.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.684+0000 7f29571ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29500c9c50 con 0x7f29500cc5e0 2023-06-20T13:32:27.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.684+0000 7f29571ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29500c9f30 con 0x7f2940003a00 2023-06-20T13:32:27.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.684+0000 7f2954f9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2940003a00 0x7f295014cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:27.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.684+0000 7f294ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29500cc5e0 0x7f29500ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:27.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.684+0000 7f2954f9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2940003a00 0x7f295014cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.32:34064/0 (socket says 172.21.15.32:34064) 2023-06-20T13:32:27.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.684+0000 7f295579c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29500caba0 0x7f29500c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:27.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.684+0000 7f2954f9b700 1 -- 172.21.15.32:0/3895246383 learned_addr learned my addr 172.21.15.32:0/3895246383 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:27.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.685+0000 7f2954f9b700 1 -- 172.21.15.32:0/3895246383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29500cc5e0 msgr2=0x7f29500ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:27.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.685+0000 7f2954f9b700 1 --2- 172.21.15.32:0/3895246383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29500cc5e0 0x7f29500ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:27.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.685+0000 7f2954f9b700 1 -- 172.21.15.32:0/3895246383 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29500caba0 msgr2=0x7f29500c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:27.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.685+0000 7f2954f9b700 1 --2- 172.21.15.32:0/3895246383 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29500caba0 0x7f29500c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:27.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.685+0000 7f2954f9b700 1 -- 172.21.15.32:0/3895246383 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29500ca210 con 0x7f2940003a00 2023-06-20T13:32:27.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.685+0000 7f2954f9b700 1 --2- 172.21.15.32:0/3895246383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2940003a00 0x7f295014cac0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f294400c890 tx=0x7f29500cd8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:27.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.685+0000 7f294d7fa700 1 -- 172.21.15.32:0/3895246383 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2944001630 con 0x7f2940003a00 2023-06-20T13:32:27.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.685+0000 7f294d7fa700 1 -- 172.21.15.32:0/3895246383 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2944000fe0 con 0x7f2940003a00 2023-06-20T13:32:27.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.685+0000 7f29571ff700 1 -- 172.21.15.32:0/3895246383 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f295015d930 con 0x7f2940003a00 2023-06-20T13:32:27.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.685+0000 7f294d7fa700 1 -- 172.21.15.32:0/3895246383 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2944007310 con 0x7f2940003a00 2023-06-20T13:32:27.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.686+0000 7f29571ff700 1 -- 172.21.15.32:0/3895246383 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295015def0 con 0x7f2940003a00 2023-06-20T13:32:27.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.687+0000 7f29571ff700 1 -- 172.21.15.32:0/3895246383 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f295015e0b0 con 0x7f2940003a00 2023-06-20T13:32:27.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.688+0000 7f294d7fa700 1 -- 172.21.15.32:0/3895246383 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2944007470 con 0x7f2940003a00 2023-06-20T13:32:27.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.689+0000 7f294d7fa700 1 --2- 172.21.15.32:0/3895246383 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f293406ace0 0x7f293406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:27.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.689+0000 7f294d7fa700 1 -- 172.21.15.32:0/3895246383 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f294408ac20 con 0x7f2940003a00 2023-06-20T13:32:27.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.689+0000 7f294ffff700 1 --2- 172.21.15.32:0/3895246383 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f293406ace0 0x7f293406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:27.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.690+0000 7f294ffff700 1 --2- 172.21.15.32:0/3895246383 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f293406ace0 0x7f293406d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f293c007fd0 tx=0x7f293c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:27.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.693+0000 7f294d7fa700 1 -- 172.21.15.32:0/3895246383 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f294408ae60 con 0x7f2940003a00 2023-06-20T13:32:27.944 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.941+0000 7f29571ff700 1 -- 172.21.15.32:0/3895246383 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f295004ea60 con 0x7f2940003a00 2023-06-20T13:32:27.945 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.942+0000 7f294d7fa700 1 -- 172.21.15.32:0/3895246383 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f2944055af0 con 0x7f2940003a00 2023-06-20T13:32:27.945 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:32:27.945 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2171664589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2171664589},{"type":"v1","addr":"172.21.15.115:6834","nonce":2171664589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/959333888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":959333888},{"type":"v1","addr":"172.21.15.32:6837","nonce":959333888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3388117179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":3388117179},{"type":"v1","addr":"172.21.15.32:6835","nonce":3388117179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-20T13:32:20.527725+0000","modified":"2023-06-20T13:32:26.043158+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3566362693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3566362693},{"type":"v1","addr":"172.21.15.115:6835","nonce":3566362693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-06-20T13:32:27.947 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.945+0000 7f29571ff700 1 -- 172.21.15.32:0/3895246383 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f293406ace0 msgr2=0x7f293406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:27.947 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.945+0000 7f29571ff700 1 --2- 172.21.15.32:0/3895246383 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f293406ace0 0x7f293406d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f293c007fd0 tx=0x7f293c009040 comp rx=0 tx=0).stop 2023-06-20T13:32:27.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.945+0000 7f29571ff700 1 -- 172.21.15.32:0/3895246383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2940003a00 msgr2=0x7f295014cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:27.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.945+0000 7f29571ff700 1 --2- 172.21.15.32:0/3895246383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2940003a00 0x7f295014cac0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f294400c890 tx=0x7f29500cd8c0 comp rx=0 tx=0).stop 2023-06-20T13:32:27.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.945+0000 7f29571ff700 1 -- 172.21.15.32:0/3895246383 shutdown_connections 2023-06-20T13:32:27.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.945+0000 7f29571ff700 1 --2- 172.21.15.32:0/3895246383 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f293406ace0 0x7f293406d190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:27.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.945+0000 7f29571ff700 1 --2- 172.21.15.32:0/3895246383 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29500caba0 0x7f29500c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:27.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.945+0000 7f29571ff700 1 --2- 172.21.15.32:0/3895246383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2940003a00 0x7f295014cac0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:27.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.945+0000 7f29571ff700 1 --2- 172.21.15.32:0/3895246383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29500cc5e0 0x7f29500ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:27.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.945+0000 7f29571ff700 1 -- 172.21.15.32:0/3895246383 >> 172.21.15.32:0/3895246383 conn(0x7f2950071660 msgr2=0x7f29500b7680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:27.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.945+0000 7f29571ff700 1 -- 172.21.15.32:0/3895246383 shutdown_connections 2023-06-20T13:32:27.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:27.945+0000 7f29571ff700 1 -- 172.21.15.32:0/3895246383 wait complete. 2023-06-20T13:32:27.949 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 6 2023-06-20T13:32:27.966 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:32:28.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.168+0000 7f1ad0fff700 1 Processor -- start 2023-06-20T13:32:28.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.168+0000 7f1ad0fff700 1 -- start start 2023-06-20T13:32:28.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.169+0000 7f1ad0fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1acc15c460 0x7f1acc0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:28.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.169+0000 7f1ad0fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1acc0d2640 0x7f1acc0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:28.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.169+0000 7f1ad0fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1acc0d1790 con 0x7f1acc0cf720 2023-06-20T13:32:28.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.169+0000 7f1ad0fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1acc0cedd0 con 0x7f1acc0d2640 2023-06-20T13:32:28.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.169+0000 7f1ad0fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc0cd950 con 0x7f1acc15c460 2023-06-20T13:32:28.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.170+0000 7f1aca59c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1acc15c460 0x7f1acc0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:28.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.170+0000 7f1acad9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f1acc0cf720 0x7f1acc0d2b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.32:39062/0 (socket says 172.21.15.32:39062) 2023-06-20T13:32:28.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.170+0000 7f1acad9d700 1 -- 172.21.15.32:0/2758150881 learned_addr learned my addr 172.21.15.32:0/2758150881 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:28.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.170+0000 7f1ac9d9b700 1 --2- 172.21.15.32:0/2758150881 >> v2:172.21.15.115:3300/0 conn(0x7f1acc0d2640 0x7f1acc0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:28.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.170+0000 7f1ac959a700 1 -- 172.21.15.32:0/2758150881 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322380540 0 0) 0x7f1acc0d1790 con 0x7f1acc0cf720 2023-06-20T13:32:28.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.170+0000 7f1ac959a700 1 -- 172.21.15.32:0/2758150881 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ab40035b0 con 0x7f1acc0cf720 2023-06-20T13:32:28.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.170+0000 7f1ac9d9b700 1 -- 172.21.15.32:0/2758150881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1acc15c460 msgr2=0x7f1acc0b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:28.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.170+0000 7f1ac9d9b700 1 --2- 172.21.15.32:0/2758150881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1acc15c460 0x7f1acc0b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:28.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.170+0000 7f1ac9d9b700 1 -- 172.21.15.32:0/2758150881 >> v1:172.21.15.115:6789/0 conn(0x7f1acc0cf720 legacy=0x7f1acc0d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:28.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.170+0000 7f1ac9d9b700 1 -- 172.21.15.32:0/2758150881 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1acc0d14b0 con 0x7f1acc0d2640 2023-06-20T13:32:28.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.170+0000 7f1aca59c700 1 --2- 172.21.15.32:0/2758150881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1acc15c460 0x7f1acc0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:32:28.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.171+0000 7f1ac9d9b700 1 --2- 172.21.15.32:0/2758150881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1acc0d2640 0x7f1acc0cf1e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0009840 tx=0x7f1ac0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97ef60236966df8 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:28.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.171+0000 7f1ac959a700 1 -- 172.21.15.32:0/2758150881 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0011830 con 0x7f1acc0d2640 2023-06-20T13:32:28.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.171+0000 7f1ac959a700 1 -- 172.21.15.32:0/2758150881 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac0011990 con 0x7f1acc0d2640 2023-06-20T13:32:28.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.171+0000 7f1ac959a700 1 -- 172.21.15.32:0/2758150881 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0011d00 con 0x7f1acc0d2640 2023-06-20T13:32:28.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.172+0000 7f1ad0fff700 1 -- 172.21.15.32:0/2758150881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1acc0d2640 msgr2=0x7f1acc0cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:28.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.172+0000 7f1ad0fff700 1 --2- 172.21.15.32:0/2758150881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1acc0d2640 0x7f1acc0cf1e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0009840 tx=0x7f1ac0009b50 comp rx=0 tx=0).stop 2023-06-20T13:32:28.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.172+0000 7f1ad0fff700 1 -- 172.21.15.32:0/2758150881 shutdown_connections 2023-06-20T13:32:28.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.172+0000 7f1ad0fff700 1 --2- 172.21.15.32:0/2758150881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1acc15c460 0x7f1acc0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:28.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.172+0000 7f1ad0fff700 1 --2- 172.21.15.32:0/2758150881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1acc0d2640 0x7f1acc0cf1e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:28.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.172+0000 7f1ad0fff700 1 -- 172.21.15.32:0/2758150881 >> 172.21.15.32:0/2758150881 conn(0x7f1acc071660 msgr2=0x7f1acc071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:28.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.172+0000 7f1ad0fff700 1 -- 172.21.15.32:0/2758150881 shutdown_connections 2023-06-20T13:32:28.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.172+0000 7f1ad0fff700 1 -- 172.21.15.32:0/2758150881 wait complete. 2023-06-20T13:32:28.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.174+0000 7f1ad0fff700 1 Processor -- start 2023-06-20T13:32:28.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.174+0000 7f1ad0fff700 1 -- start start 2023-06-20T13:32:28.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.175+0000 7f1ad0fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1acc0cf720 0x7f1acc14db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:28.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.175+0000 7f1ad0fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1acc0d2640 0x7f1acc0c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:28.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.175+0000 7f1ad0fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1acc15c460 0x7f1acc14ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:28.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.175+0000 7f1ad0fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc150cc0 con 0x7f1acc0cf720 2023-06-20T13:32:28.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.175+0000 7f1ad0fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc150fa0 con 0x7f1acc15c460 2023-06-20T13:32:28.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.175+0000 7f1ad0fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc151280 con 0x7f1acc0d2640 2023-06-20T13:32:28.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.175+0000 7f1aca59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1acc0cf720 0x7f1acc14db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:28.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.175+0000 7f1aca59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1acc0cf720 0x7f1acc14db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47094/0 (socket says 172.21.15.32:47094) 2023-06-20T13:32:28.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.175+0000 7f1aca59c700 1 -- 172.21.15.32:0/1742215896 learned_addr learned my addr 172.21.15.32:0/1742215896 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:28.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.175+0000 7f1ac9d9b700 1 --2- 172.21.15.32:0/1742215896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1acc0d2640 0x7f1acc0c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:28.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.175+0000 7f1aca59c700 1 -- 172.21.15.32:0/1742215896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1acc0d2640 msgr2=0x7f1acc0c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:28.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.175+0000 7f1acad9d700 1 --2- 172.21.15.32:0/1742215896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1acc15c460 0x7f1acc14ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:28.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.175+0000 7f1aca59c700 1 --2- 172.21.15.32:0/1742215896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1acc0d2640 0x7f1acc0c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:28.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.175+0000 7f1aca59c700 1 -- 172.21.15.32:0/1742215896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1acc15c460 msgr2=0x7f1acc14ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:28.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.175+0000 7f1aca59c700 1 --2- 172.21.15.32:0/1742215896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1acc15c460 0x7f1acc14ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:28.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.175+0000 7f1aca59c700 1 -- 172.21.15.32:0/1742215896 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1abc0094a0 con 0x7f1acc0cf720 2023-06-20T13:32:28.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.175+0000 7f1ac9d9b700 1 --2- 172.21.15.32:0/1742215896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1acc0d2640 0x7f1acc0c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:32:28.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.175+0000 7f1acad9d700 1 --2- 172.21.15.32:0/1742215896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1acc15c460 0x7f1acc14ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:32:28.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.176+0000 7f1aca59c700 1 --2- 172.21.15.32:0/1742215896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1acc0cf720 0x7f1acc14db80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1abc00ebe0 tx=0x7f1abc009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:28.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.176+0000 7f1abaffd700 1 -- 172.21.15.32:0/1742215896 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc00c910 con 0x7f1acc0cf720 2023-06-20T13:32:28.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.176+0000 7f1abaffd700 1 -- 172.21.15.32:0/1742215896 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1abc00ca70 con 0x7f1acc0cf720 2023-06-20T13:32:28.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.176+0000 7f1abaffd700 1 -- 172.21.15.32:0/1742215896 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc00cde0 con 0x7f1acc0cf720 2023-06-20T13:32:28.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.176+0000 7f1ad0fff700 1 -- 172.21.15.32:0/1742215896 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac00094a0 con 0x7f1acc0cf720 2023-06-20T13:32:28.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.176+0000 7f1ad0fff700 1 -- 172.21.15.32:0/1742215896 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1acc14e0c0 con 0x7f1acc0cf720 2023-06-20T13:32:28.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.177+0000 7f1ad0fff700 1 -- 172.21.15.32:0/1742215896 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1acc0c79f0 con 0x7f1acc0cf720 2023-06-20T13:32:28.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.178+0000 7f1abaffd700 1 -- 172.21.15.32:0/1742215896 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1abc013470 con 0x7f1acc0cf720 2023-06-20T13:32:28.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.179+0000 7f1abaffd700 1 --2- 172.21.15.32:0/1742215896 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1aac06ace0 0x7f1aac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:28.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.180+0000 7f1abaffd700 1 -- 172.21.15.32:0/1742215896 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1abc0899f0 con 0x7f1acc0cf720 2023-06-20T13:32:28.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.180+0000 7f1ac9d9b700 1 --2- 172.21.15.32:0/1742215896 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1aac06ace0 0x7f1aac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:28.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.180+0000 7f1ac9d9b700 1 --2- 172.21.15.32:0/1742215896 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1aac06ace0 0x7f1aac06d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0009fd0 tx=0x7f1ac0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:28.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.184+0000 7f1abaffd700 1 -- 172.21.15.32:0/1742215896 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1abc054710 con 0x7f1acc0cf720 2023-06-20T13:32:28.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.393+0000 7f1ad0fff700 1 -- 172.21.15.32:0/1742215896 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1acc04ea60 con 0x7f1acc0cf720 2023-06-20T13:32:28.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.395+0000 7f1abaffd700 1 -- 172.21.15.32:0/1742215896 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20096 (secure 0 0 0) 0x7f1abc057d30 con 0x7f1acc0cf720 2023-06-20T13:32:28.397 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:32:28.398 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":27,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:32:25.570940+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-20T13:32:18.120021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-20T13:32:19.503624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-20T13:32:23.074912+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:32:28.400 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.397+0000 7f1ad0fff700 1 -- 172.21.15.32:0/1742215896 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1aac06ace0 msgr2=0x7f1aac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:28.400 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.397+0000 7f1ad0fff700 1 --2- 172.21.15.32:0/1742215896 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1aac06ace0 0x7f1aac06d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0009fd0 tx=0x7f1ac0008030 comp rx=0 tx=0).stop 2023-06-20T13:32:28.400 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.397+0000 7f1ad0fff700 1 -- 172.21.15.32:0/1742215896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1acc0cf720 msgr2=0x7f1acc14db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:28.400 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.397+0000 7f1ad0fff700 1 --2- 172.21.15.32:0/1742215896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1acc0cf720 0x7f1acc14db80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1abc00ebe0 tx=0x7f1abc009ec0 comp rx=0 tx=0).stop 2023-06-20T13:32:28.400 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.397+0000 7f1ad0fff700 1 -- 172.21.15.32:0/1742215896 shutdown_connections 2023-06-20T13:32:28.400 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.397+0000 7f1ad0fff700 1 --2- 172.21.15.32:0/1742215896 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1aac06ace0 0x7f1aac06d190 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:28.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.397+0000 7f1ad0fff700 1 --2- 172.21.15.32:0/1742215896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1acc15c460 0x7f1acc14ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:28.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.397+0000 7f1ad0fff700 1 --2- 172.21.15.32:0/1742215896 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1acc0cf720 0x7f1acc14db80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:28.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.397+0000 7f1ad0fff700 1 --2- 172.21.15.32:0/1742215896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1acc0d2640 0x7f1acc0c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:28.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.397+0000 7f1ad0fff700 1 -- 172.21.15.32:0/1742215896 >> 172.21.15.32:0/1742215896 conn(0x7f1acc071660 msgr2=0x7f1acc0b5d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:28.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.398+0000 7f1ad0fff700 1 -- 172.21.15.32:0/1742215896 shutdown_connections 2023-06-20T13:32:28.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:28.398+0000 7f1ad0fff700 1 -- 172.21.15.32:0/1742215896 wait complete. 2023-06-20T13:32:28.822 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-20T13:32:20.527725+0000', 'modified': '2023-06-20T13:32:26.043158+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4300}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4300': {'gid': 4300, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.115:6835/3566362693', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6833', 'nonce': 3566362693}, {'type': 'v1', 'addr': '172.21.15.115:6835', 'nonce': 3566362693}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-06-20T13:32:28.823 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-20T13:32:28.823 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-06-20T13:32:29.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.026+0000 7f5e3bbff700 1 Processor -- start 2023-06-20T13:32:29.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.026+0000 7f5e3bbff700 1 -- start start 2023-06-20T13:32:29.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.028+0000 7f5e3bbff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e340b8320 0x7f5e340cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:29.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.028+0000 7f5e3bbff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5e340b4cc0 0x7f5e341608e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:29.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.028+0000 7f5e3bbff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e340cf3b0 con 0x7f5e340d1cd0 2023-06-20T13:32:29.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.028+0000 7f5e3bbff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e34160e20 con 0x7f5e340b4cc0 2023-06-20T13:32:29.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.028+0000 7f5e3bbff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e340b86f0 con 0x7f5e340b8320 2023-06-20T13:32:29.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.028+0000 7f5e3a19c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5e340b4cc0 0x7f5e341608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:29.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.028+0000 7f5e3999b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e340b8320 0x7f5e340cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:29.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.028+0000 7f5e3999b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e340b8320 0x7f5e340cd4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.32:34084/0 (socket says 172.21.15.32:34084) 2023-06-20T13:32:29.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.028+0000 7f5e3a19c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5e340b4cc0 0x7f5e341608e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:35864/0 (socket says 172.21.15.32:35864) 2023-06-20T13:32:29.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.028+0000 7f5e3999b700 1 -- 172.21.15.32:0/1266238892 learned_addr learned my addr 172.21.15.32:0/1266238892 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:29.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.028+0000 7f5e3919a700 1 --1- 172.21.15.32:0/1266238892 >> v1:172.21.15.115:6789/0 conn(0x7f5e340d1cd0 0x7f5e340b45b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.32:39076/0 (socket says 172.21.15.32:39076) 2023-06-20T13:32:29.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.029+0000 7f5e3999b700 1 -- 172.21.15.32:0/1266238892 >> v2:172.21.15.115:3300/0 conn(0x7f5e340b4cc0 msgr2=0x7f5e341608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:29.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.029+0000 7f5e3999b700 1 --2- 172.21.15.32:0/1266238892 >> v2:172.21.15.115:3300/0 conn(0x7f5e340b4cc0 0x7f5e341608e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.029+0000 7f5e38999700 1 -- 172.21.15.32:0/1266238892 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 994609238 0 0) 0x7f5e340cf3b0 con 0x7f5e340d1cd0 2023-06-20T13:32:29.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.029+0000 7f5e3999b700 1 -- 172.21.15.32:0/1266238892 >> v1:172.21.15.115:6789/0 conn(0x7f5e340d1cd0 legacy=0x7f5e340b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:29.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.029+0000 7f5e3999b700 1 -- 172.21.15.32:0/1266238892 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e340cf0d0 con 0x7f5e340b8320 2023-06-20T13:32:29.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.029+0000 7f5e3999b700 1 --2- 172.21.15.32:0/1266238892 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e340b8320 0x7f5e340cd4f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5e300098f0 tx=0x7f5e30009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c56f9cc12f9b2e server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:29.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.030+0000 7f5e38999700 1 -- 172.21.15.32:0/1266238892 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e30011830 con 0x7f5e340b8320 2023-06-20T13:32:29.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.030+0000 7f5e38999700 1 -- 172.21.15.32:0/1266238892 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e30011990 con 0x7f5e340b8320 2023-06-20T13:32:29.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.030+0000 7f5e38999700 1 -- 172.21.15.32:0/1266238892 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e30011d20 con 0x7f5e340b8320 2023-06-20T13:32:29.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.030+0000 7f5e3bbff700 1 -- 172.21.15.32:0/1266238892 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e340b8320 msgr2=0x7f5e340cd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:29.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.030+0000 7f5e3bbff700 1 --2- 172.21.15.32:0/1266238892 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e340b8320 0x7f5e340cd4f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5e300098f0 tx=0x7f5e30009c00 comp rx=0 tx=0).stop 2023-06-20T13:32:29.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.031+0000 7f5e3bbff700 1 -- 172.21.15.32:0/1266238892 shutdown_connections 2023-06-20T13:32:29.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.031+0000 7f5e3bbff700 1 --2- 172.21.15.32:0/1266238892 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e340b8320 0x7f5e340cd4f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.031+0000 7f5e3bbff700 1 --2- 172.21.15.32:0/1266238892 >> v2:172.21.15.115:3300/0 conn(0x7f5e340b4cc0 0x7f5e341608e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.031+0000 7f5e3bbff700 1 -- 172.21.15.32:0/1266238892 >> 172.21.15.32:0/1266238892 conn(0x7f5e340722b0 msgr2=0x7f5e340cf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:29.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.031+0000 7f5e3bbff700 1 -- 172.21.15.32:0/1266238892 shutdown_connections 2023-06-20T13:32:29.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.031+0000 7f5e3bbff700 1 -- 172.21.15.32:0/1266238892 wait complete. 2023-06-20T13:32:29.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.033+0000 7f5e3bbff700 1 Processor -- start 2023-06-20T13:32:29.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.033+0000 7f5e3bbff700 1 -- start start 2023-06-20T13:32:29.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.034+0000 7f5e3bbff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e340b8320 0x7f5e3415ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:29.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.034+0000 7f5e3bbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e340d1cd0 0x7f5e341f5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:29.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.034+0000 7f5e3bbff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e3415ef20 0x7f5e3415f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:29.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.034+0000 7f5e3bbff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3415f900 con 0x7f5e3415ef20 2023-06-20T13:32:29.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.034+0000 7f5e3bbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3415d920 con 0x7f5e340d1cd0 2023-06-20T13:32:29.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.034+0000 7f5e3bbff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3415cd10 con 0x7f5e340b8320 2023-06-20T13:32:29.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.034+0000 7f5e3999b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e340b8320 0x7f5e3415ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:29.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.034+0000 7f5e3999b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e340b8320 0x7f5e3415ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.32:34098/0 (socket says 172.21.15.32:34098) 2023-06-20T13:32:29.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.034+0000 7f5e3999b700 1 -- 172.21.15.32:0/2978704499 learned_addr learned my addr 172.21.15.32:0/2978704499 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:29.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.034+0000 7f5e3919a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e340d1cd0 0x7f5e341f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:29.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.035+0000 7f5e3a19c700 1 --2- 172.21.15.32:0/2978704499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e3415ef20 0x7f5e3415f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:29.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.035+0000 7f5e3999b700 1 -- 172.21.15.32:0/2978704499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e340d1cd0 msgr2=0x7f5e341f5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:29.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.035+0000 7f5e3999b700 1 --2- 172.21.15.32:0/2978704499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e340d1cd0 0x7f5e341f5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.035+0000 7f5e3999b700 1 -- 172.21.15.32:0/2978704499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e3415ef20 msgr2=0x7f5e3415f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:29.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.035+0000 7f5e3999b700 1 --2- 172.21.15.32:0/2978704499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e3415ef20 0x7f5e3415f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.035+0000 7f5e3999b700 1 -- 172.21.15.32:0/2978704499 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e30009550 con 0x7f5e340b8320 2023-06-20T13:32:29.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.035+0000 7f5e3a19c700 1 --2- 172.21.15.32:0/2978704499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e3415ef20 0x7f5e3415f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:32:29.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.035+0000 7f5e3999b700 1 --2- 172.21.15.32:0/2978704499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e340b8320 0x7f5e3415ddb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009f50 tx=0x7f5e30004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:29.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.036+0000 7f5e2a7fc700 1 -- 172.21.15.32:0/2978704499 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e30004300 con 0x7f5e340b8320 2023-06-20T13:32:29.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.036+0000 7f5e2a7fc700 1 -- 172.21.15.32:0/2978704499 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3001f070 con 0x7f5e340b8320 2023-06-20T13:32:29.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.036+0000 7f5e2a7fc700 1 -- 172.21.15.32:0/2978704499 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e300036a0 con 0x7f5e340b8320 2023-06-20T13:32:29.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.036+0000 7f5e3bbff700 1 -- 172.21.15.32:0/2978704499 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e3415cff0 con 0x7f5e340b8320 2023-06-20T13:32:29.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.036+0000 7f5e3bbff700 1 -- 172.21.15.32:0/2978704499 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e3415d5b0 con 0x7f5e340b8320 2023-06-20T13:32:29.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.038+0000 7f5e2a7fc700 1 -- 172.21.15.32:0/2978704499 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5e30021030 con 0x7f5e340b8320 2023-06-20T13:32:29.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.040+0000 7f5e2a7fc700 1 --2- 172.21.15.32:0/2978704499 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5e1806ace0 0x7f5e1806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:29.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.041+0000 7f5e2a7fc700 1 -- 172.21.15.32:0/2978704499 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5e3008aa50 con 0x7f5e340b8320 2023-06-20T13:32:29.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.041+0000 7f5e3919a700 1 --2- 172.21.15.32:0/2978704499 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5e1806ace0 0x7f5e1806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:29.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.041+0000 7f5e3919a700 1 --2- 172.21.15.32:0/2978704499 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5e1806ace0 0x7f5e1806d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5e340cb5d0 tx=0x7f5e24007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:29.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.042+0000 7f5e4f5f1b80 1 Processor -- start 2023-06-20T13:32:29.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.043+0000 7f5e4f5f1b80 1 -- start start 2023-06-20T13:32:29.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.043+0000 7f5e4f5f1b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x565037ed1320 0x565037ed16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:29.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.043+0000 7f5e4f5f1b80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x565037ea46d0 0x565037ea7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:29.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.043+0000 7f5e4f5f1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x565037ea25b0 0x565037ece510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:29.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.044+0000 7f5e4f5f1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x565037e1bea0 con 0x565037ea25b0 2023-06-20T13:32:29.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.044+0000 7f5e4f5f1b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x565037d8f600 con 0x565037ed1320 2023-06-20T13:32:29.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.044+0000 7f5e4f5f1b80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x565037dfe910 con 0x565037ea46d0 2023-06-20T13:32:29.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.044+0000 7f5e3a19c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x565037ea25b0 0x565037ece510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:29.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.044+0000 7f5e3a19c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x565037ea25b0 0x565037ece510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47114/0 (socket says 172.21.15.32:47114) 2023-06-20T13:32:29.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.044+0000 7f5e3a19c700 1 -- 172.21.15.32:0/2840733232 learned_addr learned my addr 172.21.15.32:0/2840733232 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:29.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.044+0000 7f5e3a19c700 1 -- 172.21.15.32:0/2840733232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x565037ea46d0 msgr2=0x565037ea7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:29.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.044+0000 7f5e3a19c700 1 --2- 172.21.15.32:0/2840733232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x565037ea46d0 0x565037ea7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.044+0000 7f5e3a19c700 1 -- 172.21.15.32:0/2840733232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x565037ed1320 msgr2=0x565037ed16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:29.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.044+0000 7f5e3999b700 1 --2- 172.21.15.32:0/2840733232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x565037ed1320 0x565037ed16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:29.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.044+0000 7f5e3a19c700 1 --2- 172.21.15.32:0/2840733232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x565037ed1320 0x565037ed16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.044+0000 7f5e3a19c700 1 -- 172.21.15.32:0/2840733232 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565037beb790 con 0x565037ea25b0 2023-06-20T13:32:29.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.044+0000 7f5e3999b700 1 --2- 172.21.15.32:0/2840733232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x565037ed1320 0x565037ed16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:32:29.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.044+0000 7f5e3a19c700 1 --2- 172.21.15.32:0/2840733232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x565037ea25b0 0x565037ece510 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00e700 tx=0x7f5e2c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c04e52f22b1925b3 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:29.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.045+0000 7f5e177fe700 1 -- 172.21.15.32:0/2840733232 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c00e040 con 0x565037ea25b0 2023-06-20T13:32:29.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.045+0000 7f5e177fe700 1 -- 172.21.15.32:0/2840733232 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2c00f040 con 0x565037ea25b0 2023-06-20T13:32:29.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.045+0000 7f5e177fe700 1 -- 172.21.15.32:0/2840733232 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c003e40 con 0x565037ea25b0 2023-06-20T13:32:29.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.045+0000 7f5e4f5f1b80 1 -- 172.21.15.32:0/2840733232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x565037ea25b0 msgr2=0x565037ece510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:29.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.045+0000 7f5e4f5f1b80 1 --2- 172.21.15.32:0/2840733232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x565037ea25b0 0x565037ece510 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00e700 tx=0x7f5e2c009750 comp rx=0 tx=0).stop 2023-06-20T13:32:29.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.045+0000 7f5e4f5f1b80 1 -- 172.21.15.32:0/2840733232 shutdown_connections 2023-06-20T13:32:29.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.045+0000 7f5e4f5f1b80 1 --2- 172.21.15.32:0/2840733232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x565037ea25b0 0x565037ece510 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.045+0000 7f5e4f5f1b80 1 --2- 172.21.15.32:0/2840733232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x565037ed1320 0x565037ed16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.045+0000 7f5e4f5f1b80 1 --2- 172.21.15.32:0/2840733232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x565037ea46d0 0x565037ea7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.045+0000 7f5e4f5f1b80 1 -- 172.21.15.32:0/2840733232 >> 172.21.15.32:0/2840733232 conn(0x565037e9bdd0 msgr2=0x565037eec130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:29.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.045+0000 7f5e4f5f1b80 1 -- 172.21.15.32:0/2840733232 shutdown_connections 2023-06-20T13:32:29.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.045+0000 7f5e4f5f1b80 1 -- 172.21.15.32:0/2840733232 wait complete. 2023-06-20T13:32:29.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.046+0000 7f5e4f5f1b80 1 -- start start 2023-06-20T13:32:29.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.047+0000 7f5e4f5f1b80 1 Processor -- start 2023-06-20T13:32:29.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.048+0000 7f5e4f5f1b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x565037ea25b0 0x565037ecb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:29.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.048+0000 7f5e4f5f1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x565037ea46d0 0x565037eefe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:29.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.048+0000 7f5e4f5f1b80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x565037ed1320 0x565037ed22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:29.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.048+0000 7f5e4f5f1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x565037df7be0 con 0x565037ea46d0 2023-06-20T13:32:29.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.048+0000 7f5e4f5f1b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x565037db55b0 con 0x565037ea25b0 2023-06-20T13:32:29.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.048+0000 7f5e4f5f1b80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x565037d9b910 con 0x565037ed1320 2023-06-20T13:32:29.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.049+0000 7f5e4f5f1b80 10 client.0 _ll_register_callbacks cb 0x565037db3b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-20T13:32:29.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.049+0000 7f5e3919a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x565037ea46d0 0x565037eefe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:29.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.049+0000 7f5e3999b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x565037ea25b0 0x565037ecb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:29.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.049+0000 7f5e3919a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x565037ea46d0 0x565037eefe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47124/0 (socket says 172.21.15.32:47124) 2023-06-20T13:32:29.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.049+0000 7f5e3919a700 1 -- 172.21.15.32:0/3798215906 learned_addr learned my addr 172.21.15.32:0/3798215906 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:29.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.049+0000 7f5e3a19c700 1 --2- 172.21.15.32:0/3798215906 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x565037ed1320 0x565037ed22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:29.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.049+0000 7f5e3919a700 1 -- 172.21.15.32:0/3798215906 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x565037ed1320 msgr2=0x565037ed22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:29.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.049+0000 7f5e3919a700 1 --2- 172.21.15.32:0/3798215906 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x565037ed1320 0x565037ed22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.049+0000 7f5e3919a700 1 -- 172.21.15.32:0/3798215906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x565037ea25b0 msgr2=0x565037ecb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:29.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.049+0000 7f5e3919a700 1 --2- 172.21.15.32:0/3798215906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x565037ea25b0 0x565037ecb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.049+0000 7f5e3919a700 1 -- 172.21.15.32:0/3798215906 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e2c00e3b0 con 0x565037ea46d0 2023-06-20T13:32:29.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.049+0000 7f5e3a19c700 1 --2- 172.21.15.32:0/3798215906 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x565037ed1320 0x565037ed22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:32:29.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.049+0000 7f5e3919a700 1 --2- 172.21.15.32:0/3798215906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x565037ea46d0 0x565037eefe00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5e240049c0 tx=0x7f5e24001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a9a6bbd15c62ec1 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:29.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.049+0000 7f5e14ff9700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-06-20T13:32:29.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.050+0000 7f5e14ff9700 1 -- 172.21.15.32:0/3798215906 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e240157f0 con 0x565037ea46d0 2023-06-20T13:32:29.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.050+0000 7f5e4f5f1b80 1 -- 172.21.15.32:0/3798215906 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565037e993e0 con 0x565037ea46d0 2023-06-20T13:32:29.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.050+0000 7f5e14ff9700 1 -- 172.21.15.32:0/3798215906 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5e24015950 con 0x565037ea46d0 2023-06-20T13:32:29.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.050+0000 7f5e14ff9700 1 -- 172.21.15.32:0/3798215906 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e24015b10 con 0x565037ea46d0 2023-06-20T13:32:29.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.050+0000 7f5e4f5f1b80 10 client.4428 fetch_fsmap learned FSMap version 6 2023-06-20T13:32:29.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.050+0000 7f5e4f5f1b80 1 -- 172.21.15.32:0/3798215906 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x565037cd80a0 con 0x565037ea46d0 2023-06-20T13:32:29.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.050+0000 7f5e14ff9700 1 -- 172.21.15.32:0/3798215906 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x565037e993e0 con 0x565037ea46d0 2023-06-20T13:32:29.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.050+0000 7f5e14ff9700 1 -- 172.21.15.32:0/3798215906 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 6) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f5e24015c70 con 0x565037ea46d0 2023-06-20T13:32:29.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.050+0000 7f5e4f5f1b80 10 client.4428 fetch_fsmap finished waiting for FSMap version 6 2023-06-20T13:32:29.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.050+0000 7f5e4f5f1b80 10 client.4428 resolve_mds: resolved name 'b' to daemon mds.b 2023-06-20T13:32:29.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.050+0000 7f5e4f5f1b80 20 client.4428 populate_metadata read hostname 'smithi032' 2023-06-20T13:32:29.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.050+0000 7f5e4f5f1b80 1 --2- 172.21.15.32:0/3798215906 >> [v2:172.21.15.115:6833/3566362693,v1:172.21.15.115:6835/3566362693] conn(0x565037ed4870 0x565037ed3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:29.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.050+0000 7f5e4f5f1b80 4 client.4428 mds_command: new command op to 4300 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-20T13:32:29.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.050+0000 7f5e4f5f1b80 1 -- 172.21.15.32:0/3798215906 --> [v2:172.21.15.115:6833/3566362693,v1:172.21.15.115:6835/3566362693] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565037e75a50 con 0x565037ed4870 2023-06-20T13:32:29.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.051+0000 7f5e3999b700 1 --2- 172.21.15.32:0/3798215906 >> [v2:172.21.15.115:6833/3566362693,v1:172.21.15.115:6835/3566362693] conn(0x565037ed4870 0x565037ed3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:29.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.051+0000 7f5e3999b700 1 --2- 172.21.15.32:0/3798215906 >> [v2:172.21.15.115:6833/3566362693,v1:172.21.15.115:6835/3566362693] conn(0x565037ed4870 0x565037ed3f90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23b7272e0bfe853b server_cookie=fa39b0805a029973 in_seq=0 out_seq=0 2023-06-20T13:32:29.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.051+0000 7f5e14ff9700 10 client.4428 ms_handle_connect on v2:172.21.15.115:6833/3566362693 2023-06-20T13:32:29.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.052+0000 7f5e14ff9700 1 -- 172.21.15.32:0/3798215906 <== mds.0 v2:172.21.15.115:6833/3566362693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x565037e75a50 con 0x565037ed4870 2023-06-20T13:32:29.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.052+0000 7f5e14ff9700 10 client.4428 handle_command_reply: tid=0 2023-06-20T13:32:29.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.052+0000 7f5e4f5f1b80 1 client.4428 shutdown 2023-06-20T13:32:29.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.052+0000 7f5e4f5f1b80 1 -- 172.21.15.32:0/3798215906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x565037ea46d0 msgr2=0x565037eefe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:29.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.052+0000 7f5e4f5f1b80 1 --2- 172.21.15.32:0/3798215906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x565037ea46d0 0x565037eefe00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5e240049c0 tx=0x7f5e24001080 comp rx=0 tx=0).stop 2023-06-20T13:32:29.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.052+0000 7f5e4f5f1b80 1 -- 172.21.15.32:0/3798215906 shutdown_connections 2023-06-20T13:32:29.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.052+0000 7f5e4f5f1b80 1 --2- 172.21.15.32:0/3798215906 >> [v2:172.21.15.115:6833/3566362693,v1:172.21.15.115:6835/3566362693] conn(0x565037ed4870 0x565037ed3f90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.052+0000 7f5e4f5f1b80 1 --2- 172.21.15.32:0/3798215906 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x565037ed1320 0x565037ed22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.052+0000 7f5e4f5f1b80 1 --2- 172.21.15.32:0/3798215906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x565037ea25b0 0x565037ecb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.052+0000 7f5e14ff9700 0 client.4428 ms_handle_reset on v2:172.21.15.115:6833/3566362693 2023-06-20T13:32:29.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.052+0000 7f5e4f5f1b80 1 --2- 172.21.15.32:0/3798215906 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x565037ea46d0 0x565037eefe00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.052+0000 7f5e4f5f1b80 1 -- 172.21.15.32:0/3798215906 >> 172.21.15.32:0/3798215906 conn(0x565037e9bdd0 msgr2=0x565037ea14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:29.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.052+0000 7f5e4f5f1b80 1 -- 172.21.15.32:0/3798215906 shutdown_connections 2023-06-20T13:32:29.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.052+0000 7f5e4f5f1b80 1 -- 172.21.15.32:0/3798215906 wait complete. 2023-06-20T13:32:29.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.053+0000 7f5e4f5f1b80 20 client.4428 trim_cache size 0 max 16384 2023-06-20T13:32:29.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.071+0000 7f5e4f5f1b80 1 Processor -- start 2023-06-20T13:32:29.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.071+0000 7f5e4f5f1b80 1 -- start start 2023-06-20T13:32:29.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.072+0000 7f5e4f5f1b80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x565037ea25b0 0x565037efade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:29.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.072+0000 7f5e4f5f1b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x565037ea46d0 0x565037ed04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:29.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.072+0000 7f5e4f5f1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x565037ed1320 0x565037ed0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:29.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.072+0000 7f5e4f5f1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x565037bec390 con 0x565037ed1320 2023-06-20T13:32:29.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.072+0000 7f5e4f5f1b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x565037ef0b50 con 0x565037ea46d0 2023-06-20T13:32:29.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.072+0000 7f5e4f5f1b80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x565037ef36e0 con 0x565037ea25b0 2023-06-20T13:32:29.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.073+0000 7f5e3a19c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x565037ed1320 0x565037ed0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:29.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.073+0000 7f5e3a19c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x565037ed1320 0x565037ed0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47128/0 (socket says 172.21.15.32:47128) 2023-06-20T13:32:29.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.073+0000 7f5e3a19c700 1 -- 172.21.15.32:0/3000053457 learned_addr learned my addr 172.21.15.32:0/3000053457 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:29.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.073+0000 7f5e3919a700 1 --2- 172.21.15.32:0/3000053457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x565037ea46d0 0x565037ed04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:29.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.073+0000 7f5e3999b700 1 --2- 172.21.15.32:0/3000053457 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x565037ea25b0 0x565037efade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:29.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.073+0000 7f5e3a19c700 1 -- 172.21.15.32:0/3000053457 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x565037ea25b0 msgr2=0x565037efade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:29.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.073+0000 7f5e3a19c700 1 --2- 172.21.15.32:0/3000053457 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x565037ea25b0 0x565037efade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.073+0000 7f5e3a19c700 1 -- 172.21.15.32:0/3000053457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x565037ea46d0 msgr2=0x565037ed04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:29.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.073+0000 7f5e3a19c700 1 --2- 172.21.15.32:0/3000053457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x565037ea46d0 0x565037ed04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.073+0000 7f5e3a19c700 1 -- 172.21.15.32:0/3000053457 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565037dbdb10 con 0x565037ed1320 2023-06-20T13:32:29.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.073+0000 7f5e3a19c700 1 --2- 172.21.15.32:0/3000053457 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x565037ed1320 0x565037ed0a30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00b010 tx=0x7f5e2c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc957b8d01b9fe server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:29.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.073+0000 7f5e17fff700 1 -- 172.21.15.32:0/3000053457 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c023040 con 0x565037ed1320 2023-06-20T13:32:29.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.074+0000 7f5e17fff700 1 -- 172.21.15.32:0/3000053457 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2c003d20 con 0x565037ed1320 2023-06-20T13:32:29.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.074+0000 7f5e17fff700 1 -- 172.21.15.32:0/3000053457 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c00e040 con 0x565037ed1320 2023-06-20T13:32:29.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.074+0000 7f5e4f5f1b80 1 -- 172.21.15.32:0/3000053457 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x565037ed1320 msgr2=0x565037ed0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:29.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.074+0000 7f5e4f5f1b80 1 --2- 172.21.15.32:0/3000053457 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x565037ed1320 0x565037ed0a30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00b010 tx=0x7f5e2c016000 comp rx=0 tx=0).stop 2023-06-20T13:32:29.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.074+0000 7f5e4f5f1b80 1 -- 172.21.15.32:0/3000053457 shutdown_connections 2023-06-20T13:32:29.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.074+0000 7f5e4f5f1b80 1 --2- 172.21.15.32:0/3000053457 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x565037ed1320 0x565037ed0a30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.074+0000 7f5e4f5f1b80 1 --2- 172.21.15.32:0/3000053457 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x565037ea25b0 0x565037efade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.074+0000 7f5e4f5f1b80 1 --2- 172.21.15.32:0/3000053457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x565037ea46d0 0x565037ed04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.074+0000 7f5e4f5f1b80 1 -- 172.21.15.32:0/3000053457 >> 172.21.15.32:0/3000053457 conn(0x565037e9bdd0 msgr2=0x565037e9d340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:29.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.074+0000 7f5e4f5f1b80 1 -- 172.21.15.32:0/3000053457 shutdown_connections 2023-06-20T13:32:29.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.074+0000 7f5e4f5f1b80 1 -- 172.21.15.32:0/3000053457 wait complete. 2023-06-20T13:32:29.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.075+0000 7f5e4f5f1b80 1 -- start start 2023-06-20T13:32:29.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.075+0000 7f5e4f5f1b80 1 Processor -- start 2023-06-20T13:32:29.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.076+0000 7f5e4f5f1b80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x565037ea25b0 0x565037f56190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:29.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.076+0000 7f5e4f5f1b80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x565037ea46d0 0x565037ee5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:29.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.076+0000 7f5e4f5f1b80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x565037ed1320 0x565037ea0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:29.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.076+0000 7f5e4f5f1b80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x565037ee59a0 con 0x565037ea46d0 2023-06-20T13:32:29.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.076+0000 7f5e4f5f1b80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x565037ed0a90 con 0x565037ed1320 2023-06-20T13:32:29.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.076+0000 7f5e4f5f1b80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x565037efae80 con 0x565037ea25b0 2023-06-20T13:32:29.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.076+0000 7f5e4f5f1b80 10 client.0 _ll_register_callbacks cb 0x7f5e24001a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-20T13:32:29.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.076+0000 7f5e3919a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x565037ea46d0 0x565037ee5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:29.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.076+0000 7f5e3919a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x565037ea46d0 0x565037ee5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47140/0 (socket says 172.21.15.32:47140) 2023-06-20T13:32:29.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.076+0000 7f5e3919a700 1 -- 172.21.15.32:0/3007193840 learned_addr learned my addr 172.21.15.32:0/3007193840 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:29.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.077+0000 7f5e3a19c700 1 --2- 172.21.15.32:0/3007193840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x565037ed1320 0x565037ea0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:29.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.077+0000 7f5e3999b700 1 --2- 172.21.15.32:0/3007193840 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x565037ea25b0 0x565037f56190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:29.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.077+0000 7f5e3919a700 1 -- 172.21.15.32:0/3007193840 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x565037ea25b0 msgr2=0x565037f56190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:29.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.077+0000 7f5e3919a700 1 --2- 172.21.15.32:0/3007193840 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x565037ea25b0 0x565037f56190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.077+0000 7f5e3919a700 1 -- 172.21.15.32:0/3007193840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x565037ed1320 msgr2=0x565037ea0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:29.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.077+0000 7f5e3919a700 1 --2- 172.21.15.32:0/3007193840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x565037ed1320 0x565037ea0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.077+0000 7f5e3919a700 1 -- 172.21.15.32:0/3007193840 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565037beb790 con 0x565037ea46d0 2023-06-20T13:32:29.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.077+0000 7f5e3919a700 1 --2- 172.21.15.32:0/3007193840 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x565037ea46d0 0x565037ee5110 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5e24007fd0 tx=0x7f5e24009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c32cc10fd1be15ab server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:29.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.077+0000 7f5e14ff9700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-06-20T13:32:29.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.077+0000 7f5e14ff9700 1 -- 172.21.15.32:0/3007193840 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e240076d0 con 0x565037ea46d0 2023-06-20T13:32:29.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.077+0000 7f5e14ff9700 1 -- 172.21.15.32:0/3007193840 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5e24013600 con 0x565037ea46d0 2023-06-20T13:32:29.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.077+0000 7f5e4f5f1b80 1 -- 172.21.15.32:0/3007193840 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5e2c00f040 con 0x565037ea46d0 2023-06-20T13:32:29.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.078+0000 7f5e14ff9700 1 -- 172.21.15.32:0/3007193840 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e240137c0 con 0x565037ea46d0 2023-06-20T13:32:29.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.078+0000 7f5e4f5f1b80 10 client.4434 fetch_fsmap learned FSMap version 6 2023-06-20T13:32:29.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.078+0000 7f5e4f5f1b80 1 -- 172.21.15.32:0/3007193840 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x565037c4c1d0 con 0x565037ea46d0 2023-06-20T13:32:29.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.078+0000 7f5e14ff9700 1 -- 172.21.15.32:0/3007193840 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2c00f040 con 0x565037ea46d0 2023-06-20T13:32:29.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.078+0000 7f5e14ff9700 1 -- 172.21.15.32:0/3007193840 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 6) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f5e24013920 con 0x565037ea46d0 2023-06-20T13:32:29.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.078+0000 7f5e4f5f1b80 10 client.4434 fetch_fsmap finished waiting for FSMap version 6 2023-06-20T13:32:29.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.078+0000 7f5e4f5f1b80 10 client.4434 resolve_mds: resolved name 'b' to daemon mds.b 2023-06-20T13:32:29.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.078+0000 7f5e4f5f1b80 20 client.4434 populate_metadata read hostname 'smithi032' 2023-06-20T13:32:29.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.078+0000 7f5e4f5f1b80 1 --2- 172.21.15.32:0/3007193840 >> [v2:172.21.15.115:6833/3566362693,v1:172.21.15.115:6835/3566362693] conn(0x565037efd450 0x565037efd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:29.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.078+0000 7f5e4f5f1b80 4 client.4434 mds_command: new command op to 4300 tid=0[{"prefix": "status"}] 2023-06-20T13:32:29.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.078+0000 7f5e4f5f1b80 1 -- 172.21.15.32:0/3007193840 --> [v2:172.21.15.115:6833/3566362693,v1:172.21.15.115:6835/3566362693] -- command(tid 0: {"prefix": "status"}) v1 -- 0x565037df0d20 con 0x565037efd450 2023-06-20T13:32:29.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.078+0000 7f5e3999b700 1 --2- 172.21.15.32:0/3007193840 >> [v2:172.21.15.115:6833/3566362693,v1:172.21.15.115:6835/3566362693] conn(0x565037efd450 0x565037efd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:29.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.079+0000 7f5e3999b700 1 --2- 172.21.15.32:0/3007193840 >> [v2:172.21.15.115:6833/3566362693,v1:172.21.15.115:6835/3566362693] conn(0x565037efd450 0x565037efd820 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5609ce65e3a155e server_cookie=b57144a0e8df00d8 in_seq=0 out_seq=0 2023-06-20T13:32:29.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.079+0000 7f5e14ff9700 10 client.4434 ms_handle_connect on v2:172.21.15.115:6833/3566362693 2023-06-20T13:32:29.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.079+0000 7f5e14ff9700 1 -- 172.21.15.32:0/3007193840 <== mds.0 v2:172.21.15.115:6833/3566362693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x565037df0d20 con 0x565037efd450 2023-06-20T13:32:29.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.079+0000 7f5e14ff9700 10 client.4434 handle_command_reply: tid=0 2023-06-20T13:32:29.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.079+0000 7f5e4f5f1b80 1 client.4434 shutdown 2023-06-20T13:32:29.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.079+0000 7f5e4f5f1b80 1 -- 172.21.15.32:0/3007193840 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x565037ea46d0 msgr2=0x565037ee5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:29.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.079+0000 7f5e4f5f1b80 1 --2- 172.21.15.32:0/3007193840 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x565037ea46d0 0x565037ee5110 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5e24007fd0 tx=0x7f5e24009030 comp rx=0 tx=0).stop 2023-06-20T13:32:29.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.079+0000 7f5e4f5f1b80 1 -- 172.21.15.32:0/3007193840 shutdown_connections 2023-06-20T13:32:29.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.079+0000 7f5e4f5f1b80 1 --2- 172.21.15.32:0/3007193840 >> [v2:172.21.15.115:6833/3566362693,v1:172.21.15.115:6835/3566362693] conn(0x565037efd450 0x565037efd820 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.079+0000 7f5e4f5f1b80 1 --2- 172.21.15.32:0/3007193840 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x565037ed1320 0x565037ea0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.079+0000 7f5e4f5f1b80 1 --2- 172.21.15.32:0/3007193840 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x565037ea25b0 0x565037f56190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.079+0000 7f5e4f5f1b80 1 --2- 172.21.15.32:0/3007193840 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x565037ea46d0 0x565037ee5110 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.079+0000 7f5e14ff9700 0 client.4434 ms_handle_reset on v2:172.21.15.115:6833/3566362693 2023-06-20T13:32:29.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.080+0000 7f5e4f5f1b80 1 -- 172.21.15.32:0/3007193840 >> 172.21.15.32:0/3007193840 conn(0x565037e9bdd0 msgr2=0x565037ed2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:29.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.080+0000 7f5e4f5f1b80 1 -- 172.21.15.32:0/3007193840 shutdown_connections 2023-06-20T13:32:29.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.080+0000 7f5e4f5f1b80 1 -- 172.21.15.32:0/3007193840 wait complete. 2023-06-20T13:32:29.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.080+0000 7f5e4f5f1b80 20 client.4434 trim_cache size 0 max 16384 2023-06-20T13:32:29.092 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-06-20T13:32:29.093 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_fsid": "8ec09bdb-4968-488f-bf51-7b0f1e92355f", 2023-06-20T13:32:29.093 INFO:teuthology.orchestra.run.smithi032.stdout: "whoami": 0, 2023-06-20T13:32:29.093 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 4300, 2023-06-20T13:32:29.093 INFO:teuthology.orchestra.run.smithi032.stdout: "want_state": "up:active", 2023-06-20T13:32:29.093 INFO:teuthology.orchestra.run.smithi032.stdout: "state": "up:active", 2023-06-20T13:32:29.093 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs", 2023-06-20T13:32:29.093 INFO:teuthology.orchestra.run.smithi032.stdout: "rank_uptime": 8.0775682329999992, 2023-06-20T13:32:29.094 INFO:teuthology.orchestra.run.smithi032.stdout: "mdsmap_epoch": 6, 2023-06-20T13:32:29.094 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch": 27, 2023-06-20T13:32:29.094 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch_barrier": 26, 2023-06-20T13:32:29.094 INFO:teuthology.orchestra.run.smithi032.stdout: "uptime": 14.908417428 2023-06-20T13:32:29.094 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-06-20T13:32:29.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.080+0000 7f5e3bbff700 1 -- 172.21.15.32:0/2978704499 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5e1806ace0 msgr2=0x7f5e1806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:29.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.080+0000 7f5e3bbff700 1 --2- 172.21.15.32:0/2978704499 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5e1806ace0 0x7f5e1806d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5e340cb5d0 tx=0x7f5e24007de0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.080+0000 7f5e3bbff700 1 -- 172.21.15.32:0/2978704499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e340b8320 msgr2=0x7f5e3415ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:29.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.080+0000 7f5e3bbff700 1 --2- 172.21.15.32:0/2978704499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e340b8320 0x7f5e3415ddb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009f50 tx=0x7f5e30004750 comp rx=0 tx=0).stop 2023-06-20T13:32:29.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.080+0000 7f5e3bbff700 1 -- 172.21.15.32:0/2978704499 shutdown_connections 2023-06-20T13:32:29.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.080+0000 7f5e3bbff700 1 --2- 172.21.15.32:0/2978704499 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5e1806ace0 0x7f5e1806d190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.080+0000 7f5e3bbff700 1 --2- 172.21.15.32:0/2978704499 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5e3415ef20 0x7f5e3415f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.080+0000 7f5e3bbff700 1 --2- 172.21.15.32:0/2978704499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e340b8320 0x7f5e3415ddb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.080+0000 7f5e3bbff700 1 --2- 172.21.15.32:0/2978704499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e340d1cd0 0x7f5e341f5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.080+0000 7f5e3bbff700 1 -- 172.21.15.32:0/2978704499 >> 172.21.15.32:0/2978704499 conn(0x7f5e340b4cc0 msgr2=0x7f5e340b7760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:29.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.081+0000 7f5e3bbff700 1 -- 172.21.15.32:0/2978704499 shutdown_connections 2023-06-20T13:32:29.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.081+0000 7f5e3bbff700 1 -- 172.21.15.32:0/2978704499 wait complete. 2023-06-20T13:32:29.100 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-20T13:32:29.101 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-06-20T13:32:29.101 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-20T13:32:29.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.299+0000 7f8ff05ff700 1 Processor -- start 2023-06-20T13:32:29.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.299+0000 7f8ff05ff700 1 -- start start 2023-06-20T13:32:29.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.300+0000 7f8ff05ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8fe815c460 0x7f8fe80b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:29.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.300+0000 7f8ff05ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fe80cf8f0 0x7f8fe815fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:29.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.300+0000 7f8ff05ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe80d1790 con 0x7f8fe80d2640 2023-06-20T13:32:29.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.300+0000 7f8ff05ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe80cedd0 con 0x7f8fe815c460 2023-06-20T13:32:29.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.300+0000 7f8ff05ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe80cd950 con 0x7f8fe80cf8f0 2023-06-20T13:32:29.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.301+0000 7f8fee39b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8fe815c460 0x7f8fe80b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:29.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.301+0000 7f8feeb9c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fe80cf8f0 0x7f8fe815fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:29.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.301+0000 7f8fee39b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8fe815c460 0x7f8fe80b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:35904/0 (socket says 172.21.15.32:35904) 2023-06-20T13:32:29.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.301+0000 7f8fee39b700 1 -- 172.21.15.32:0/823092386 learned_addr learned my addr 172.21.15.32:0/823092386 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:29.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.301+0000 7f8fee39b700 1 -- 172.21.15.32:0/823092386 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fe80cf8f0 msgr2=0x7f8fe815fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:29.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.301+0000 7f8fee39b700 1 --2- 172.21.15.32:0/823092386 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fe80cf8f0 0x7f8fe815fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.301+0000 7f8fee39b700 1 -- 172.21.15.32:0/823092386 >> v1:172.21.15.115:6789/0 conn(0x7f8fe80d2640 legacy=0x7f8fe80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:29.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.301+0000 7f8fee39b700 1 -- 172.21.15.32:0/823092386 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe80d14b0 con 0x7f8fe815c460 2023-06-20T13:32:29.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.302+0000 7f8fee39b700 1 --2- 172.21.15.32:0/823092386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fe815c460 0x7f8fe80b59d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8fe40098f0 tx=0x7f8fe4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bd6f4c62b65888 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:29.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.302+0000 7f8fed399700 1 -- 172.21.15.32:0/823092386 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4011830 con 0x7f8fe815c460 2023-06-20T13:32:29.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.302+0000 7f8fed399700 1 -- 172.21.15.32:0/823092386 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe4011990 con 0x7f8fe815c460 2023-06-20T13:32:29.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.302+0000 7f8fed399700 1 -- 172.21.15.32:0/823092386 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4011d20 con 0x7f8fe815c460 2023-06-20T13:32:29.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.302+0000 7f8ff05ff700 1 -- 172.21.15.32:0/823092386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fe815c460 msgr2=0x7f8fe80b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:29.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.302+0000 7f8ff05ff700 1 --2- 172.21.15.32:0/823092386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fe815c460 0x7f8fe80b59d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8fe40098f0 tx=0x7f8fe4009c00 comp rx=0 tx=0).stop 2023-06-20T13:32:29.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.302+0000 7f8ff05ff700 1 -- 172.21.15.32:0/823092386 shutdown_connections 2023-06-20T13:32:29.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.302+0000 7f8ff05ff700 1 --2- 172.21.15.32:0/823092386 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fe80cf8f0 0x7f8fe815fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.302+0000 7f8ff05ff700 1 --2- 172.21.15.32:0/823092386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fe815c460 0x7f8fe80b59d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.302+0000 7f8ff05ff700 1 -- 172.21.15.32:0/823092386 >> 172.21.15.32:0/823092386 conn(0x7f8fe8071660 msgr2=0x7f8fe8071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:29.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.303+0000 7f8ff05ff700 1 -- 172.21.15.32:0/823092386 shutdown_connections 2023-06-20T13:32:29.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.303+0000 7f8ff05ff700 1 -- 172.21.15.32:0/823092386 wait complete. 2023-06-20T13:32:29.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.304+0000 7f8ff05ff700 1 Processor -- start 2023-06-20T13:32:29.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.304+0000 7f8ff05ff700 1 -- start start 2023-06-20T13:32:29.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.305+0000 7f8ff05ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fe80cf8f0 0x7f8fe8154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:29.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.305+0000 7f8ff05ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fe80d2640 0x7f8fe8145ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:29.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.305+0000 7f8ff05ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fe815c460 0x7f8fe8147f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:29.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.305+0000 7f8ff05ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe8155390 con 0x7f8fe80cf8f0 2023-06-20T13:32:29.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.305+0000 7f8ff05ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe80c78a0 con 0x7f8fe80d2640 2023-06-20T13:32:29.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.305+0000 7f8ff05ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe8146420 con 0x7f8fe815c460 2023-06-20T13:32:29.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.306+0000 7f8fee39b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fe80cf8f0 0x7f8fe8154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:29.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.306+0000 7f8fee39b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fe80cf8f0 0x7f8fe8154e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47142/0 (socket says 172.21.15.32:47142) 2023-06-20T13:32:29.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.306+0000 7f8fee39b700 1 -- 172.21.15.32:0/1358717789 learned_addr learned my addr 172.21.15.32:0/1358717789 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:29.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.306+0000 7f8fedb9a700 1 --2- 172.21.15.32:0/1358717789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fe80d2640 0x7f8fe8145ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:29.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.306+0000 7f8feeb9c700 1 --2- 172.21.15.32:0/1358717789 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fe815c460 0x7f8fe8147f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:29.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.306+0000 7f8fee39b700 1 -- 172.21.15.32:0/1358717789 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fe815c460 msgr2=0x7f8fe8147f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:29.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.306+0000 7f8fee39b700 1 --2- 172.21.15.32:0/1358717789 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fe815c460 0x7f8fe8147f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.306+0000 7f8fee39b700 1 -- 172.21.15.32:0/1358717789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fe80d2640 msgr2=0x7f8fe8145ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:29.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.306+0000 7f8fee39b700 1 --2- 172.21.15.32:0/1358717789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fe80d2640 0x7f8fe8145ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.306+0000 7f8fee39b700 1 -- 172.21.15.32:0/1358717789 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe4009550 con 0x7f8fe80cf8f0 2023-06-20T13:32:29.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.306+0000 7f8fee39b700 1 --2- 172.21.15.32:0/1358717789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fe80cf8f0 0x7f8fe8154e50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4009c40 tx=0x7f8fe4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:29.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.307+0000 7f8fdeffd700 1 -- 172.21.15.32:0/1358717789 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4004530 con 0x7f8fe80cf8f0 2023-06-20T13:32:29.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.307+0000 7f8ff05ff700 1 -- 172.21.15.32:0/1358717789 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe81f1fe0 con 0x7f8fe80cf8f0 2023-06-20T13:32:29.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.307+0000 7f8fdeffd700 1 -- 172.21.15.32:0/1358717789 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe401f070 con 0x7f8fe80cf8f0 2023-06-20T13:32:29.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.307+0000 7f8fdeffd700 1 -- 172.21.15.32:0/1358717789 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe40038c0 con 0x7f8fe80cf8f0 2023-06-20T13:32:29.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.307+0000 7f8ff05ff700 1 -- 172.21.15.32:0/1358717789 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe815bce0 con 0x7f8fe80cf8f0 2023-06-20T13:32:29.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.308+0000 7f8ff05ff700 1 -- 172.21.15.32:0/1358717789 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe804ea60 con 0x7f8fe80cf8f0 2023-06-20T13:32:29.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.309+0000 7f8fdeffd700 1 -- 172.21.15.32:0/1358717789 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8fe4021030 con 0x7f8fe80cf8f0 2023-06-20T13:32:29.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.310+0000 7f8fdeffd700 1 --2- 172.21.15.32:0/1358717789 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8fcc06ace0 0x7f8fcc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:29.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.310+0000 7f8fdeffd700 1 -- 172.21.15.32:0/1358717789 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8fe408ad10 con 0x7f8fe80cf8f0 2023-06-20T13:32:29.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.310+0000 7f8fedb9a700 1 --2- 172.21.15.32:0/1358717789 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8fcc06ace0 0x7f8fcc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:29.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.310+0000 7f8fedb9a700 1 --2- 172.21.15.32:0/1358717789 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8fcc06ace0 0x7f8fcc06d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8145db0 tx=0x7f8fd8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:29.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.314+0000 7f8fdeffd700 1 -- 172.21.15.32:0/1358717789 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8fe4090020 con 0x7f8fe80cf8f0 2023-06-20T13:32:29.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.570+0000 7f8ff05ff700 1 -- 172.21.15.32:0/1358717789 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8fe80b4fa0 con 0x7f8fe80cf8f0 2023-06-20T13:32:29.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.571+0000 7f8fdeffd700 1 -- 172.21.15.32:0/1358717789 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+88 (secure 0 0 0) 0x7f8fe4015070 con 0x7f8fe80cf8f0 2023-06-20T13:32:29.573 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-20T13:32:29.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.573+0000 7f8ff05ff700 1 -- 172.21.15.32:0/1358717789 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8fcc06ace0 msgr2=0x7f8fcc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:29.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.573+0000 7f8ff05ff700 1 --2- 172.21.15.32:0/1358717789 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8fcc06ace0 0x7f8fcc06d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8145db0 tx=0x7f8fd8009040 comp rx=0 tx=0).stop 2023-06-20T13:32:29.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.573+0000 7f8ff05ff700 1 -- 172.21.15.32:0/1358717789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fe80cf8f0 msgr2=0x7f8fe8154e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:29.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.573+0000 7f8ff05ff700 1 --2- 172.21.15.32:0/1358717789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fe80cf8f0 0x7f8fe8154e50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4009c40 tx=0x7f8fe4004750 comp rx=0 tx=0).stop 2023-06-20T13:32:29.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.573+0000 7f8ff05ff700 1 -- 172.21.15.32:0/1358717789 shutdown_connections 2023-06-20T13:32:29.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.573+0000 7f8ff05ff700 1 --2- 172.21.15.32:0/1358717789 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8fcc06ace0 0x7f8fcc06d190 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.573+0000 7f8ff05ff700 1 --2- 172.21.15.32:0/1358717789 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fe815c460 0x7f8fe8147f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.573+0000 7f8ff05ff700 1 --2- 172.21.15.32:0/1358717789 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fe80cf8f0 0x7f8fe8154e50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.573+0000 7f8ff05ff700 1 --2- 172.21.15.32:0/1358717789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fe80d2640 0x7f8fe8145ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:29.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.573+0000 7f8ff05ff700 1 -- 172.21.15.32:0/1358717789 >> 172.21.15.32:0/1358717789 conn(0x7f8fe8071660 msgr2=0x7f8fe815ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:29.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.574+0000 7f8ff05ff700 1 -- 172.21.15.32:0/1358717789 shutdown_connections 2023-06-20T13:32:29.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:29.574+0000 7f8ff05ff700 1 -- 172.21.15.32:0/1358717789 wait complete. 2023-06-20T13:32:29.593 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-06-20T13:32:29.594 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-20T13:32:29.594 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2023-06-20T13:32:29.594 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-06-20T13:32:29.594 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-06-20T13:32:29.595 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-06-20T13:32:29.595 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-20T13:32:29.595 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-20T13:32:29.595 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-06-20T13:32:29.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:32:29.596 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2023-06-20T13:32:29.642 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-20T13:32:29.642 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-20T13:32:29.642 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2023-06-20T13:32:29.643 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:32:29.643 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2023-06-20T13:32:29.643 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:32:29.643 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-20T13:32:29.643 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2023-06-20T13:32:29.643 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f0 2023-06-20T13:32:29.643 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-20T13:32:29.643 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2023-06-20T13:32:29.644 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f1 2023-06-20T13:32:29.644 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-20T13:32:29.644 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2023-06-20T13:32:29.644 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f0 2023-06-20T13:32:29.644 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-06-20T13:32:29.644 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42099sec preferred_lft 42099sec 2023-06-20T13:32:29.644 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link 2023-06-20T13:32:29.645 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:32:29.645 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-20T13:32:29.645 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2023-06-20T13:32:29.645 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f1 2023-06-20T13:32:29.647 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-20T13:32:29.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:32:29.647 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-06-20T13:32:29.649 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-06-20T13:32:29.649 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link add name ceph-brx type bridge 2023-06-20T13:32:29.649 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip addr flush dev ceph-brx 2023-06-20T13:32:29.650 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set ceph-brx up 2023-06-20T13:32:29.650 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-20T13:32:29.651 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-06-20T13:32:30.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:32:30.069 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-20T13:32:30.176 INFO:teuthology.orchestra.run.smithi032.stdout:1 2023-06-20T13:32:30.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:32:30.179 DEBUG:teuthology.orchestra.run.smithi032:> route 2023-06-20T13:32:30.251 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2023-06-20T13:32:30.252 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-20T13:32:30.252 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-06-20T13:32:30.252 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-06-20T13:32:30.252 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-20T13:32:30.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:32:30.253 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-06-20T13:32:30.253 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-06-20T13:32:30.254 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-20T13:32:30.254 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-20T13:32:30.254 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-20T13:32:30.255 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-06-20T13:32:30.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:32:30.946 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2023-06-20T13:32:30.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:32:30.994 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list-id 2023-06-20T13:32:31.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:32:31.041 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-06-20T13:32:31.041 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-06-20T13:32:31.041 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-06-20T13:32:31.042 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-06-20T13:32:31.042 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-06-20T13:32:31.225 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-06-20T13:32:31.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:32:31.225 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-06-20T13:32:31.226 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-06-20T13:32:31.226 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-06-20T13:32:31.226 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-20T13:32:31.227 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-06-20T13:32:31.227 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-06-20T13:32:31.227 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-06-20T13:32:31.227 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-06-20T13:32:31.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:32:31.512 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-06-20T13:32:31.512 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-06-20T13:32:31.512 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.0 up 2023-06-20T13:32:31.512 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set dev brx.0 master ceph-brx 2023-06-20T13:32:31.513 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-06-20T13:32:31.693 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-06-20T13:32:31.693 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-20T13:32:31.693 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-06-20T13:32:31.739 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-06-20T13:32:31.740 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-20T13:32:31.740 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-06-20T13:32:31.785 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2023-06-20T13:32:31.897 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-20T13:32:31.897 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-20T13:32:31.972 INFO:teuthology.orchestra.run.smithi032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-20T13:32:31.974 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-20T13:32:31.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:32:31.976 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2023-06-20T13:32:32.021 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-20T13:32:32.022 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-06-20T13:32:32.027 DEBUG:teuthology.orchestra.run.smithi032:> sudo modprobe fuse 2023-06-20T13:32:32.098 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-20T13:32:32.099 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-20T13:32:32.168 INFO:teuthology.orchestra.run.smithi032.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-20T13:32:32.171 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-20T13:32:32.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:32:32.172 DEBUG:teuthology.orchestra.run.smithi032:> ls /sys/fs/fuse/connections 2023-06-20T13:32:32.203 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi032.stderr:2023-06-20T13:32:32.201+0000 7f96650d15c0 -1 init, newargv = 0x55eda5a71940 newargc=15 2023-06-20T13:32:32.204 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi032.stderr:ceph-fuse[116992]: starting ceph client 2023-06-20T13:32:32.215 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi032.stderr:ceph-fuse[116992]: starting fuse 2023-06-20T13:32:32.225 INFO:teuthology.orchestra.run.smithi032.stdout:42 2023-06-20T13:32:32.226 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-06-20T13:32:32.226 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-20T13:32:32.226 DEBUG:teuthology.orchestra.run.smithi032:> import glob 2023-06-20T13:32:32.227 DEBUG:teuthology.orchestra.run.smithi032:> import re 2023-06-20T13:32:32.227 DEBUG:teuthology.orchestra.run.smithi032:> import os 2023-06-20T13:32:32.227 DEBUG:teuthology.orchestra.run.smithi032:> import subprocess 2023-06-20T13:32:32.228 DEBUG:teuthology.orchestra.run.smithi032:> 2023-06-20T13:32:32.228 DEBUG:teuthology.orchestra.run.smithi032:> def _find_admin_socket(client_name): 2023-06-20T13:32:32.228 DEBUG:teuthology.orchestra.run.smithi032:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-06-20T13:32:32.228 DEBUG:teuthology.orchestra.run.smithi032:> files = glob.glob(asok_path) 2023-06-20T13:32:32.229 DEBUG:teuthology.orchestra.run.smithi032:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-06-20T13:32:32.229 DEBUG:teuthology.orchestra.run.smithi032:> 2023-06-20T13:32:32.229 DEBUG:teuthology.orchestra.run.smithi032:> # Given a non-glob path, it better be there 2023-06-20T13:32:32.230 DEBUG:teuthology.orchestra.run.smithi032:> if "*" not in asok_path: 2023-06-20T13:32:32.230 DEBUG:teuthology.orchestra.run.smithi032:> assert(len(files) == 1) 2023-06-20T13:32:32.230 DEBUG:teuthology.orchestra.run.smithi032:> return files[0] 2023-06-20T13:32:32.231 DEBUG:teuthology.orchestra.run.smithi032:> 2023-06-20T13:32:32.231 DEBUG:teuthology.orchestra.run.smithi032:> for f in files: 2023-06-20T13:32:32.231 DEBUG:teuthology.orchestra.run.smithi032:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-20T13:32:32.231 DEBUG:teuthology.orchestra.run.smithi032:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-20T13:32:32.232 DEBUG:teuthology.orchestra.run.smithi032:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-20T13:32:32.232 DEBUG:teuthology.orchestra.run.smithi032:> contents = proc_f.read() 2023-06-20T13:32:32.232 DEBUG:teuthology.orchestra.run.smithi032:> if mountpoint in contents: 2023-06-20T13:32:32.232 DEBUG:teuthology.orchestra.run.smithi032:> return f 2023-06-20T13:32:32.233 DEBUG:teuthology.orchestra.run.smithi032:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-20T13:32:32.233 DEBUG:teuthology.orchestra.run.smithi032:> 2023-06-20T13:32:32.233 DEBUG:teuthology.orchestra.run.smithi032:> print(_find_admin_socket("client.admin")) 2023-06-20T13:32:32.234 DEBUG:teuthology.orchestra.run.smithi032:> ' 2023-06-20T13:32:32.410 INFO:teuthology.orchestra.run.smithi032.stdout:/var/run/ceph/ceph-client.admin.116992.asok 2023-06-20T13:32:32.587 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.116992.asok 2023-06-20T13:32:32.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:32:32.588 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.116992.asok status 2023-06-20T13:32:32.817 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-06-20T13:32:32.817 INFO:teuthology.orchestra.run.smithi032.stdout: "metadata": { 2023-06-20T13:32:32.817 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_sha1": "2016e3af238feea2bbee7eb0e99c925a041afbfb", 2023-06-20T13:32:32.817 INFO:teuthology.orchestra.run.smithi032.stdout: "ceph_version": "ceph version 18.0.0-4512-g2016e3af (2016e3af238feea2bbee7eb0e99c925a041afbfb) reef (dev)", 2023-06-20T13:32:32.817 INFO:teuthology.orchestra.run.smithi032.stdout: "entity_id": "admin", 2023-06-20T13:32:32.818 INFO:teuthology.orchestra.run.smithi032.stdout: "hostname": "smithi032", 2023-06-20T13:32:32.818 INFO:teuthology.orchestra.run.smithi032.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-06-20T13:32:32.818 INFO:teuthology.orchestra.run.smithi032.stdout: "pid": "116992", 2023-06-20T13:32:32.818 INFO:teuthology.orchestra.run.smithi032.stdout: "root": "/" 2023-06-20T13:32:32.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:32:32.818 INFO:teuthology.orchestra.run.smithi032.stdout: "dentry_count": 0, 2023-06-20T13:32:32.818 INFO:teuthology.orchestra.run.smithi032.stdout: "dentry_pinned_count": 0, 2023-06-20T13:32:32.818 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 4443, 2023-06-20T13:32:32.819 INFO:teuthology.orchestra.run.smithi032.stdout: "inst": { 2023-06-20T13:32:32.819 INFO:teuthology.orchestra.run.smithi032.stdout: "name": { 2023-06-20T13:32:32.819 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "client", 2023-06-20T13:32:32.819 INFO:teuthology.orchestra.run.smithi032.stdout: "num": 4443 2023-06-20T13:32:32.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:32:32.819 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": { 2023-06-20T13:32:32.819 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2023-06-20T13:32:32.819 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "192.168.0.1:0", 2023-06-20T13:32:32.820 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 4151687488 2023-06-20T13:32:32.820 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-06-20T13:32:32.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:32:32.820 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": { 2023-06-20T13:32:32.820 INFO:teuthology.orchestra.run.smithi032.stdout: "type": "v1", 2023-06-20T13:32:32.821 INFO:teuthology.orchestra.run.smithi032.stdout: "addr": "192.168.0.1:0", 2023-06-20T13:32:32.823 INFO:teuthology.orchestra.run.smithi032.stdout: "nonce": 4151687488 2023-06-20T13:32:32.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:32:32.824 INFO:teuthology.orchestra.run.smithi032.stdout: "inst_str": "client.4443 192.168.0.1:0/4151687488", 2023-06-20T13:32:32.824 INFO:teuthology.orchestra.run.smithi032.stdout: "addr_str": "192.168.0.1:0/4151687488", 2023-06-20T13:32:32.824 INFO:teuthology.orchestra.run.smithi032.stdout: "inode_count": 1, 2023-06-20T13:32:32.824 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_epoch": 6, 2023-06-20T13:32:32.824 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_epoch": 27, 2023-06-20T13:32:32.825 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_epoch_barrier": 0, 2023-06-20T13:32:32.825 INFO:teuthology.orchestra.run.smithi032.stdout: "blocklisted": false, 2023-06-20T13:32:32.825 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs" 2023-06-20T13:32:32.825 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-06-20T13:32:32.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:32:32.833 DEBUG:teuthology.orchestra.run.smithi032:> stat --file-system '--printf=%T 2023-06-20T13:32:32.833 DEBUG:teuthology.orchestra.run.smithi032:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-06-20T13:32:32.881 INFO:teuthology.orchestra.run.smithi032.stdout:fuseblk 2023-06-20T13:32:32.881 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-06-20T13:32:32.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:32:32.882 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-06-20T13:32:32.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:32:32.953 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-06-20T13:32:33.095 INFO:teuthology.orchestra.run.smithi032.stdout:# file: . 2023-06-20T13:32:33.096 INFO:teuthology.orchestra.run.smithi032.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-06-20T13:32:33.096 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:32:33.097 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:32:33.097 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-20T13:32:33.142 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:32:33.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.382+0000 7fbaf7dff700 1 Processor -- start 2023-06-20T13:32:33.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.383+0000 7fbaf7dff700 1 -- start start 2023-06-20T13:32:33.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.384+0000 7fbaf7dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaf00d2640 0x7fbaf00b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:33.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.384+0000 7fbaf7dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbaf00cf8f0 0x7fbaf015fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:33.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.384+0000 7fbaf7dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf00d1790 con 0x7fbaf015c460 2023-06-20T13:32:33.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.384+0000 7fbaf7dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf00cedd0 con 0x7fbaf00cf8f0 2023-06-20T13:32:33.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.384+0000 7fbaf7dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf00cd950 con 0x7fbaf00d2640 2023-06-20T13:32:33.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.385+0000 7fbaf539a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaf00d2640 0x7fbaf00b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:33.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.385+0000 7fbaf639c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fbaf00cf8f0 0x7fbaf015fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:33.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.385+0000 7fbaf539a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaf00d2640 0x7fbaf00b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.32:53440/0 (socket says 172.21.15.32:53440) 2023-06-20T13:32:33.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.385+0000 7fbaf539a700 1 -- 172.21.15.32:0/576742812 learned_addr learned my addr 172.21.15.32:0/576742812 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:33.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.386+0000 7fbaf539a700 1 -- 172.21.15.32:0/576742812 >> v2:172.21.15.115:3300/0 conn(0x7fbaf00cf8f0 msgr2=0x7fbaf015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:33.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.386+0000 7fbaf539a700 1 --2- 172.21.15.32:0/576742812 >> v2:172.21.15.115:3300/0 conn(0x7fbaf00cf8f0 0x7fbaf015fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:33.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.386+0000 7fbaf539a700 1 -- 172.21.15.32:0/576742812 >> v1:172.21.15.115:6789/0 conn(0x7fbaf015c460 legacy=0x7fbaf00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:33.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.386+0000 7fbaf539a700 1 -- 172.21.15.32:0/576742812 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf00d14b0 con 0x7fbaf00d2640 2023-06-20T13:32:33.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.386+0000 7fbaf639c700 1 --2- 172.21.15.32:0/576742812 >> v2:172.21.15.115:3300/0 conn(0x7fbaf00cf8f0 0x7fbaf015fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:32:33.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.386+0000 7fbaf4b99700 1 -- 172.21.15.32:0/576742812 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2881464604 0 0) 0x7fbaf00d1790 con 0x7fbaf015c460 2023-06-20T13:32:33.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.386+0000 7fbaf539a700 1 --2- 172.21.15.32:0/576742812 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaf00d2640 0x7fbaf00b59d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbae00098f0 tx=0x7fbae0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d90e64b91bd9114 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:33.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.386+0000 7fbaf4b99700 1 -- 172.21.15.32:0/576742812 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae0011830 con 0x7fbaf00d2640 2023-06-20T13:32:33.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.386+0000 7fbaf4b99700 1 -- 172.21.15.32:0/576742812 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae0011990 con 0x7fbaf00d2640 2023-06-20T13:32:33.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.386+0000 7fbaf4b99700 1 -- 172.21.15.32:0/576742812 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae0011d20 con 0x7fbaf00d2640 2023-06-20T13:32:33.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.387+0000 7fbaf7dff700 1 -- 172.21.15.32:0/576742812 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaf00d2640 msgr2=0x7fbaf00b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:33.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.387+0000 7fbaf7dff700 1 --2- 172.21.15.32:0/576742812 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaf00d2640 0x7fbaf00b59d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbae00098f0 tx=0x7fbae0009c00 comp rx=0 tx=0).stop 2023-06-20T13:32:33.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.387+0000 7fbaf7dff700 1 -- 172.21.15.32:0/576742812 shutdown_connections 2023-06-20T13:32:33.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.387+0000 7fbaf7dff700 1 --2- 172.21.15.32:0/576742812 >> v2:172.21.15.115:3300/0 conn(0x7fbaf00cf8f0 0x7fbaf015fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:33.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.387+0000 7fbaf7dff700 1 --2- 172.21.15.32:0/576742812 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaf00d2640 0x7fbaf00b59d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:33.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.387+0000 7fbaf7dff700 1 -- 172.21.15.32:0/576742812 >> 172.21.15.32:0/576742812 conn(0x7fbaf0071660 msgr2=0x7fbaf0071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:33.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.387+0000 7fbaf7dff700 1 -- 172.21.15.32:0/576742812 shutdown_connections 2023-06-20T13:32:33.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.387+0000 7fbaf7dff700 1 -- 172.21.15.32:0/576742812 wait complete. 2023-06-20T13:32:33.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.389+0000 7fbaf7dff700 1 Processor -- start 2023-06-20T13:32:33.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.389+0000 7fbaf7dff700 1 -- start start 2023-06-20T13:32:33.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.390+0000 7fbaf7dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaf00cf8f0 0x7fbaf015cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:33.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.390+0000 7fbaf7dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbaf00d2640 0x7fbaf00c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:33.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.390+0000 7fbaf7dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbaf015c460 0x7fbaf00c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:33.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.390+0000 7fbaf7dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf01f6070 con 0x7fbaf00d2640 2023-06-20T13:32:33.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.390+0000 7fbaf7dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf00cb070 con 0x7fbaf015c460 2023-06-20T13:32:33.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.390+0000 7fbaf7dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf00cb310 con 0x7fbaf00cf8f0 2023-06-20T13:32:33.396 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.390+0000 7fbaf539a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbaf00d2640 0x7fbaf00c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:33.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.390+0000 7fbaf539a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbaf00d2640 0x7fbaf00c86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57334/0 (socket says 172.21.15.32:57334) 2023-06-20T13:32:33.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.390+0000 7fbaf539a700 1 -- 172.21.15.32:0/3712733490 learned_addr learned my addr 172.21.15.32:0/3712733490 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:33.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.390+0000 7fbaf5b9b700 1 --2- 172.21.15.32:0/3712733490 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaf00cf8f0 0x7fbaf015cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:33.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.390+0000 7fbaf639c700 1 --2- 172.21.15.32:0/3712733490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbaf015c460 0x7fbaf00c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:33.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.390+0000 7fbaf539a700 1 -- 172.21.15.32:0/3712733490 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaf00cf8f0 msgr2=0x7fbaf015cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:33.397 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.390+0000 7fbaf539a700 1 --2- 172.21.15.32:0/3712733490 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaf00cf8f0 0x7fbaf015cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:33.398 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.390+0000 7fbaf539a700 1 -- 172.21.15.32:0/3712733490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbaf015c460 msgr2=0x7fbaf00c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:33.398 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.390+0000 7fbaf539a700 1 --2- 172.21.15.32:0/3712733490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbaf015c460 0x7fbaf00c8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:33.398 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.390+0000 7fbaf539a700 1 -- 172.21.15.32:0/3712733490 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae8009a70 con 0x7fbaf00d2640 2023-06-20T13:32:33.398 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.391+0000 7fbaf539a700 1 --2- 172.21.15.32:0/3712733490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbaf00d2640 0x7fbaf00c86c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbae0014040 tx=0x7fbae0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:33.398 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.391+0000 7fbae67fc700 1 -- 172.21.15.32:0/3712733490 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae00044d0 con 0x7fbaf00d2640 2023-06-20T13:32:33.398 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.391+0000 7fbae67fc700 1 -- 172.21.15.32:0/3712733490 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae001e070 con 0x7fbaf00d2640 2023-06-20T13:32:33.399 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.391+0000 7fbae67fc700 1 -- 172.21.15.32:0/3712733490 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae00038e0 con 0x7fbaf00d2640 2023-06-20T13:32:33.399 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.391+0000 7fbaf7dff700 1 -- 172.21.15.32:0/3712733490 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae0009550 con 0x7fbaf00d2640 2023-06-20T13:32:33.399 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.391+0000 7fbaf7dff700 1 -- 172.21.15.32:0/3712733490 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf00cb8d0 con 0x7fbaf00d2640 2023-06-20T13:32:33.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.392+0000 7fbaf7dff700 1 -- 172.21.15.32:0/3712733490 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaf004ea60 con 0x7fbaf00d2640 2023-06-20T13:32:33.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.393+0000 7fbae67fc700 1 -- 172.21.15.32:0/3712733490 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbae0003a40 con 0x7fbaf00d2640 2023-06-20T13:32:33.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.394+0000 7fbae67fc700 1 --2- 172.21.15.32:0/3712733490 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fbad406ace0 0x7fbad406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:33.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.394+0000 7fbae67fc700 1 -- 172.21.15.32:0/3712733490 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbae008a600 con 0x7fbaf00d2640 2023-06-20T13:32:33.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.394+0000 7fbaf5b9b700 1 --2- 172.21.15.32:0/3712733490 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fbad406ace0 0x7fbad406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:33.401 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.395+0000 7fbaf5b9b700 1 --2- 172.21.15.32:0/3712733490 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fbad406ace0 0x7fbad406d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbaec000f60 tx=0x7fbaec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:33.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.399+0000 7fbae67fc700 1 -- 172.21.15.32:0/3712733490 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbae00553b0 con 0x7fbaf00d2640 2023-06-20T13:32:33.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.607+0000 7fbaf7dff700 1 -- 172.21.15.32:0/3712733490 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbaf015cae0 con 0x7fbaf00d2640 2023-06-20T13:32:33.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.608+0000 7fbae67fc700 1 -- 172.21.15.32:0/3712733490 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20096 (secure 0 0 0) 0x7fbae002c3b0 con 0x7fbaf00d2640 2023-06-20T13:32:33.611 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:32:33.611 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":27,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:32:25.570940+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-20T13:32:18.120021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-20T13:32:19.503624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-20T13:32:23.074912+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:32:33.613 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.611+0000 7fbaf7dff700 1 -- 172.21.15.32:0/3712733490 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fbad406ace0 msgr2=0x7fbad406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:33.613 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.611+0000 7fbaf7dff700 1 --2- 172.21.15.32:0/3712733490 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fbad406ace0 0x7fbad406d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbaec000f60 tx=0x7fbaec009040 comp rx=0 tx=0).stop 2023-06-20T13:32:33.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.611+0000 7fbaf7dff700 1 -- 172.21.15.32:0/3712733490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbaf00d2640 msgr2=0x7fbaf00c86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:33.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.611+0000 7fbaf7dff700 1 --2- 172.21.15.32:0/3712733490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbaf00d2640 0x7fbaf00c86c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbae0014040 tx=0x7fbae0004750 comp rx=0 tx=0).stop 2023-06-20T13:32:33.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.611+0000 7fbaf7dff700 1 -- 172.21.15.32:0/3712733490 shutdown_connections 2023-06-20T13:32:33.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.611+0000 7fbaf7dff700 1 --2- 172.21.15.32:0/3712733490 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fbad406ace0 0x7fbad406d190 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:33.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.611+0000 7fbaf7dff700 1 --2- 172.21.15.32:0/3712733490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbaf015c460 0x7fbaf00c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:33.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.611+0000 7fbaf7dff700 1 --2- 172.21.15.32:0/3712733490 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbaf00cf8f0 0x7fbaf015cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:33.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.611+0000 7fbaf7dff700 1 --2- 172.21.15.32:0/3712733490 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbaf00d2640 0x7fbaf00c86c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:33.615 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.611+0000 7fbaf7dff700 1 -- 172.21.15.32:0/3712733490 >> 172.21.15.32:0/3712733490 conn(0x7fbaf0071660 msgr2=0x7fbaf015fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:33.615 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.611+0000 7fbaf7dff700 1 -- 172.21.15.32:0/3712733490 shutdown_connections 2023-06-20T13:32:33.615 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.611+0000 7fbaf7dff700 1 -- 172.21.15.32:0/3712733490 wait complete. 2023-06-20T13:32:33.632 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-20T13:32:05.308022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-20T13:32:12.857161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-20T13:32:18.120021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-20T13:32:19.503624+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-20T13:32:23.074912+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-20T13:32:33.632 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-20T13:32:33.836 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.833+0000 7f7f761ff700 1 Processor -- start 2023-06-20T13:32:33.836 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.834+0000 7f7f761ff700 1 -- start start 2023-06-20T13:32:33.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.835+0000 7f7f761ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7f700cfc60 0x7f7f70167010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:33.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.835+0000 7f7f761ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f700d0b20 con 0x7f7f700d3730 2023-06-20T13:32:33.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.836+0000 7f7f761ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f700b4ee0 con 0x7f7f700b8430 2023-06-20T13:32:33.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.836+0000 7f7f761ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f700cda30 con 0x7f7f700cfc60 2023-06-20T13:32:33.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.836+0000 7f7f6effd700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f7f700d3730 0x7f7f700cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48748/0 (socket says 172.21.15.32:48748) 2023-06-20T13:32:33.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.836+0000 7f7f6effd700 1 -- 172.21.15.32:0/3082090076 learned_addr learned my addr 172.21.15.32:0/3082090076 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:33.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.836+0000 7f7f6ffff700 1 --2- 172.21.15.32:0/3082090076 >> v2:172.21.15.32:3300/0 conn(0x7f7f700cfc60 0x7f7f70167010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:33.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.836+0000 7f7f6e7fc700 1 -- 172.21.15.32:0/3082090076 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2722638124 0 0) 0x7f7f700b4ee0 con 0x7f7f700b8430 2023-06-20T13:32:33.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.836+0000 7f7f6e7fc700 1 -- 172.21.15.32:0/3082090076 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f580035b0 con 0x7f7f700b8430 2023-06-20T13:32:33.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.836+0000 7f7f6e7fc700 1 -- 172.21.15.32:0/3082090076 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318614687 0 0) 0x7f7f700d0b20 con 0x7f7f700d3730 2023-06-20T13:32:33.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.836+0000 7f7f6e7fc700 1 -- 172.21.15.32:0/3082090076 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f700b4ee0 con 0x7f7f700d3730 2023-06-20T13:32:33.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.836+0000 7f7f6ffff700 1 -- 172.21.15.32:0/3082090076 >> v1:172.21.15.115:6789/0 conn(0x7f7f700b8430 legacy=0x7f7f700cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:33.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.836+0000 7f7f6ffff700 1 -- 172.21.15.32:0/3082090076 >> v1:172.21.15.32:6789/0 conn(0x7f7f700d3730 legacy=0x7f7f700cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:33.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.836+0000 7f7f6ffff700 1 -- 172.21.15.32:0/3082090076 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f700b51c0 con 0x7f7f700cfc60 2023-06-20T13:32:33.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.837+0000 7f7f6ffff700 1 --2- 172.21.15.32:0/3082090076 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f700cfc60 0x7f7f70167010 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7f68009d90 tx=0x7f7f6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a32efd18373e05c server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:33.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.837+0000 7f7f6e7fc700 1 -- 172.21.15.32:0/3082090076 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6800e070 con 0x7f7f700cfc60 2023-06-20T13:32:33.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.837+0000 7f7f6e7fc700 1 -- 172.21.15.32:0/3082090076 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6800bb20 con 0x7f7f700cfc60 2023-06-20T13:32:33.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.837+0000 7f7f6e7fc700 1 -- 172.21.15.32:0/3082090076 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f68012430 con 0x7f7f700cfc60 2023-06-20T13:32:33.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.837+0000 7f7f761ff700 1 -- 172.21.15.32:0/3082090076 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f700cfc60 msgr2=0x7f7f70167010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:33.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.837+0000 7f7f761ff700 1 --2- 172.21.15.32:0/3082090076 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f700cfc60 0x7f7f70167010 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7f68009d90 tx=0x7f7f6800b330 comp rx=0 tx=0).stop 2023-06-20T13:32:33.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.838+0000 7f7f761ff700 1 -- 172.21.15.32:0/3082090076 shutdown_connections 2023-06-20T13:32:33.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.838+0000 7f7f761ff700 1 --2- 172.21.15.32:0/3082090076 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f700cfc60 0x7f7f70167010 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:33.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.838+0000 7f7f761ff700 1 -- 172.21.15.32:0/3082090076 >> 172.21.15.32:0/3082090076 conn(0x7f7f7006b3f0 msgr2=0x7f7f7006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:33.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.838+0000 7f7f761ff700 1 -- 172.21.15.32:0/3082090076 shutdown_connections 2023-06-20T13:32:33.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.838+0000 7f7f761ff700 1 -- 172.21.15.32:0/3082090076 wait complete. 2023-06-20T13:32:33.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.839+0000 7f7f761ff700 1 Processor -- start 2023-06-20T13:32:33.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.839+0000 7f7f761ff700 1 -- start start 2023-06-20T13:32:33.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.840+0000 7f7f761ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f700b8430 0x7f7f701f5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:33.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.840+0000 7f7f761ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f700cfc60 0x7f7f700cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:33.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.840+0000 7f7f761ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f700d3730 0x7f7f700cb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:33.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.840+0000 7f7f761ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f701f6230 con 0x7f7f700cfc60 2023-06-20T13:32:33.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.840+0000 7f7f761ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f700c9fd0 con 0x7f7f700d3730 2023-06-20T13:32:33.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.840+0000 7f7f761ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f700ca2b0 con 0x7f7f700b8430 2023-06-20T13:32:33.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.841+0000 7f7f6effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f700cfc60 0x7f7f700cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:33.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.841+0000 7f7f6effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f700cfc60 0x7f7f700cb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57346/0 (socket says 172.21.15.32:57346) 2023-06-20T13:32:33.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.841+0000 7f7f6effd700 1 -- 172.21.15.32:0/3957448546 learned_addr learned my addr 172.21.15.32:0/3957448546 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:33.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.841+0000 7f7f6ffff700 1 --2- 172.21.15.32:0/3957448546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f700d3730 0x7f7f700cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:33.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.841+0000 7f7f6f7fe700 1 --2- 172.21.15.32:0/3957448546 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f700b8430 0x7f7f701f5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:33.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.841+0000 7f7f6effd700 1 -- 172.21.15.32:0/3957448546 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f700b8430 msgr2=0x7f7f701f5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:33.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.841+0000 7f7f6effd700 1 --2- 172.21.15.32:0/3957448546 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f700b8430 0x7f7f701f5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:33.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.841+0000 7f7f6effd700 1 -- 172.21.15.32:0/3957448546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f700d3730 msgr2=0x7f7f700cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:33.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.841+0000 7f7f6effd700 1 --2- 172.21.15.32:0/3957448546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f700d3730 0x7f7f700cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:33.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.841+0000 7f7f6effd700 1 -- 172.21.15.32:0/3957448546 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f68009a70 con 0x7f7f700cfc60 2023-06-20T13:32:33.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.841+0000 7f7f6effd700 1 --2- 172.21.15.32:0/3957448546 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f700cfc60 0x7f7f700cb300 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7f64001eb0 tx=0x7f7f6400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:33.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.842+0000 7f7f57fff700 1 -- 172.21.15.32:0/3957448546 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f64005d70 con 0x7f7f700cfc60 2023-06-20T13:32:33.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.842+0000 7f7f57fff700 1 -- 172.21.15.32:0/3957448546 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f640070d0 con 0x7f7f700cfc60 2023-06-20T13:32:33.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.842+0000 7f7f57fff700 1 -- 172.21.15.32:0/3957448546 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f64007460 con 0x7f7f700cfc60 2023-06-20T13:32:33.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.842+0000 7f7f761ff700 1 -- 172.21.15.32:0/3957448546 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f700ca590 con 0x7f7f700cfc60 2023-06-20T13:32:33.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.842+0000 7f7f761ff700 1 -- 172.21.15.32:0/3957448546 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f700cab50 con 0x7f7f700cfc60 2023-06-20T13:32:33.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.843+0000 7f7f761ff700 1 -- 172.21.15.32:0/3957448546 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f7004ea60 con 0x7f7f700cfc60 2023-06-20T13:32:33.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.844+0000 7f7f57fff700 1 -- 172.21.15.32:0/3957448546 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7f640075c0 con 0x7f7f700cfc60 2023-06-20T13:32:33.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.845+0000 7f7f57fff700 1 --2- 172.21.15.32:0/3957448546 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f7f5c06ace0 0x7f7f5c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:33.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.845+0000 7f7f57fff700 1 -- 172.21.15.32:0/3957448546 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7f64088c30 con 0x7f7f700cfc60 2023-06-20T13:32:33.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.845+0000 7f7f6f7fe700 1 --2- 172.21.15.32:0/3957448546 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f7f5c06ace0 0x7f7f5c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:33.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.846+0000 7f7f6f7fe700 1 --2- 172.21.15.32:0/3957448546 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f7f5c06ace0 0x7f7f5c06d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7f60001010 tx=0x7f7f60009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:33.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:33.850+0000 7f7f57fff700 1 -- 172.21.15.32:0/3957448546 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7f640539e0 con 0x7f7f700cfc60 2023-06-20T13:32:34.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.060+0000 7f7f761ff700 1 -- 172.21.15.32:0/3957448546 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7f70158960 con 0x7f7f700cfc60 2023-06-20T13:32:34.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.060+0000 7f7f57fff700 1 -- 172.21.15.32:0/3957448546 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7f64057000 con 0x7f7f700cfc60 2023-06-20T13:32:34.063 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-06-20T13:32:34.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.062+0000 7f7f761ff700 1 -- 172.21.15.32:0/3957448546 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f7f5c06ace0 msgr2=0x7f7f5c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:34.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.062+0000 7f7f761ff700 1 --2- 172.21.15.32:0/3957448546 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f7f5c06ace0 0x7f7f5c06d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7f60001010 tx=0x7f7f60009040 comp rx=0 tx=0).stop 2023-06-20T13:32:34.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.062+0000 7f7f761ff700 1 -- 172.21.15.32:0/3957448546 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f700cfc60 msgr2=0x7f7f700cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:34.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.062+0000 7f7f761ff700 1 --2- 172.21.15.32:0/3957448546 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f700cfc60 0x7f7f700cb300 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7f64001eb0 tx=0x7f7f6400c7b0 comp rx=0 tx=0).stop 2023-06-20T13:32:34.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.062+0000 7f7f761ff700 1 -- 172.21.15.32:0/3957448546 shutdown_connections 2023-06-20T13:32:34.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.062+0000 7f7f761ff700 1 --2- 172.21.15.32:0/3957448546 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f7f5c06ace0 0x7f7f5c06d190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:34.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.062+0000 7f7f761ff700 1 --2- 172.21.15.32:0/3957448546 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f700d3730 0x7f7f700cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:34.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.062+0000 7f7f761ff700 1 --2- 172.21.15.32:0/3957448546 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f700b8430 0x7f7f701f5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:34.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.062+0000 7f7f761ff700 1 --2- 172.21.15.32:0/3957448546 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f700cfc60 0x7f7f700cb300 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:34.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.062+0000 7f7f761ff700 1 -- 172.21.15.32:0/3957448546 >> 172.21.15.32:0/3957448546 conn(0x7f7f7006b3f0 msgr2=0x7f7f700d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:34.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.062+0000 7f7f761ff700 1 -- 172.21.15.32:0/3957448546 shutdown_connections 2023-06-20T13:32:34.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.062+0000 7f7f761ff700 1 -- 172.21.15.32:0/3957448546 wait complete. 2023-06-20T13:32:34.083 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-20T13:32:34.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.286+0000 7f770cbff700 1 Processor -- start 2023-06-20T13:32:34.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.286+0000 7f770cbff700 1 -- start start 2023-06-20T13:32:34.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.287+0000 7f770cbff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f77080b8430 0x7f77080cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:34.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.287+0000 7f770cbff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f77080cfc60 0x7f77080d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:34.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.287+0000 7f770cbff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77080d0b20 con 0x7f77080d3730 2023-06-20T13:32:34.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.287+0000 7f770cbff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77080b8800 con 0x7f77080cfc60 2023-06-20T13:32:34.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.287+0000 7f770cbff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77080b4ee0 con 0x7f77080b8430 2023-06-20T13:32:34.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.287+0000 7f7706d9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f77080cfc60 0x7f77080d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:34.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.287+0000 7f7706d9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f77080cfc60 0x7f77080d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57354/0 (socket says 172.21.15.32:57354) 2023-06-20T13:32:34.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.287+0000 7f7705d9b700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f77080d3730 0x7f77080cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48756/0 (socket says 172.21.15.32:48756) 2023-06-20T13:32:34.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.287+0000 7f7706d9d700 1 -- 172.21.15.32:0/2754393183 learned_addr learned my addr 172.21.15.32:0/2754393183 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:34.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.288+0000 7f770659c700 1 --2- 172.21.15.32:0/2754393183 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f77080b8430 0x7f77080cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:34.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.288+0000 7f7706d9d700 1 -- 172.21.15.32:0/2754393183 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f77080b8430 msgr2=0x7f77080cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:34.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.288+0000 7f7706d9d700 1 --2- 172.21.15.32:0/2754393183 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f77080b8430 0x7f77080cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:34.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.288+0000 7f7706d9d700 1 -- 172.21.15.32:0/2754393183 >> v1:172.21.15.32:6789/0 conn(0x7f77080d3730 legacy=0x7f77080cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:34.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.288+0000 7f7706d9d700 1 -- 172.21.15.32:0/2754393183 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77080b51c0 con 0x7f77080cfc60 2023-06-20T13:32:34.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.288+0000 7f770559a700 1 -- 172.21.15.32:0/2754393183 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192568275 0 0) 0x7f77080d0b20 con 0x7f77080d3730 2023-06-20T13:32:34.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.288+0000 7f770659c700 1 --2- 172.21.15.32:0/2754393183 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f77080b8430 0x7f77080cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:32:34.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.288+0000 7f7706d9d700 1 --2- 172.21.15.32:0/2754393183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77080cfc60 0x7f77080d0fb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7700009e50 tx=0x7f770000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22063eeb083460e server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:34.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.288+0000 7f770559a700 1 -- 172.21.15.32:0/2754393183 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770000e070 con 0x7f77080cfc60 2023-06-20T13:32:34.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.288+0000 7f770559a700 1 -- 172.21.15.32:0/2754393183 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770000b9c0 con 0x7f77080cfc60 2023-06-20T13:32:34.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.288+0000 7f770559a700 1 -- 172.21.15.32:0/2754393183 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770000bd70 con 0x7f77080cfc60 2023-06-20T13:32:34.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.289+0000 7f770cbff700 1 -- 172.21.15.32:0/2754393183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77080cfc60 msgr2=0x7f77080d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:34.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.289+0000 7f770cbff700 1 --2- 172.21.15.32:0/2754393183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77080cfc60 0x7f77080d0fb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7700009e50 tx=0x7f770000b330 comp rx=0 tx=0).stop 2023-06-20T13:32:34.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.289+0000 7f770cbff700 1 -- 172.21.15.32:0/2754393183 shutdown_connections 2023-06-20T13:32:34.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.289+0000 7f770cbff700 1 --2- 172.21.15.32:0/2754393183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77080cfc60 0x7f77080d0fb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:34.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.289+0000 7f770cbff700 1 --2- 172.21.15.32:0/2754393183 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f77080b8430 0x7f77080cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:34.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.289+0000 7f770cbff700 1 -- 172.21.15.32:0/2754393183 >> 172.21.15.32:0/2754393183 conn(0x7f770806b3f0 msgr2=0x7f770806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:34.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.289+0000 7f770cbff700 1 -- 172.21.15.32:0/2754393183 shutdown_connections 2023-06-20T13:32:34.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.289+0000 7f770cbff700 1 -- 172.21.15.32:0/2754393183 wait complete. 2023-06-20T13:32:34.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.291+0000 7f770cbff700 1 Processor -- start 2023-06-20T13:32:34.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.292+0000 7f770cbff700 1 -- start start 2023-06-20T13:32:34.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.293+0000 7f770cbff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f77080b8430 0x7f770815a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:34.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.293+0000 7f770cbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77080cfc60 0x7f77081605f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:34.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.293+0000 7f770cbff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77080d3730 0x7f77080cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:34.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.293+0000 7f770cbff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770815d7c0 con 0x7f77080d3730 2023-06-20T13:32:34.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.293+0000 7f770cbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770815c930 con 0x7f77080cfc60 2023-06-20T13:32:34.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.293+0000 7f770cbff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770815abf0 con 0x7f77080b8430 2023-06-20T13:32:34.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.293+0000 7f7706d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77080d3730 0x7f77080cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:34.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.293+0000 7f7706d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77080d3730 0x7f77080cbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57370/0 (socket says 172.21.15.32:57370) 2023-06-20T13:32:34.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.293+0000 7f770659c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f77080b8430 0x7f770815a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:34.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.293+0000 7f7706d9d700 1 -- 172.21.15.32:0/340243639 learned_addr learned my addr 172.21.15.32:0/340243639 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:34.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.293+0000 7f7705d9b700 1 --2- 172.21.15.32:0/340243639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77080cfc60 0x7f77081605f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:34.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.294+0000 7f7706d9d700 1 -- 172.21.15.32:0/340243639 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f77080b8430 msgr2=0x7f770815a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:34.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.294+0000 7f7706d9d700 1 --2- 172.21.15.32:0/340243639 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f77080b8430 0x7f770815a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:34.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.294+0000 7f7706d9d700 1 -- 172.21.15.32:0/340243639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77080cfc60 msgr2=0x7f77081605f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:34.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.294+0000 7f7706d9d700 1 --2- 172.21.15.32:0/340243639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77080cfc60 0x7f77081605f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:34.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.294+0000 7f7706d9d700 1 -- 172.21.15.32:0/340243639 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7700009b30 con 0x7f77080d3730 2023-06-20T13:32:34.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.294+0000 7f7706d9d700 1 --2- 172.21.15.32:0/340243639 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77080d3730 0x7f77080cbde0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f770806c780 tx=0x7f7700004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:34.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.294+0000 7f76f6ffd700 1 -- 172.21.15.32:0/340243639 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7700003ea0 con 0x7f77080d3730 2023-06-20T13:32:34.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.294+0000 7f76f6ffd700 1 -- 172.21.15.32:0/340243639 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77000048e0 con 0x7f77080d3730 2023-06-20T13:32:34.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.294+0000 7f76f6ffd700 1 -- 172.21.15.32:0/340243639 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770001c680 con 0x7f77080d3730 2023-06-20T13:32:34.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.294+0000 7f770cbff700 1 -- 172.21.15.32:0/340243639 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f770815cb40 con 0x7f77080d3730 2023-06-20T13:32:34.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.295+0000 7f770cbff700 1 -- 172.21.15.32:0/340243639 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f770815d100 con 0x7f77080d3730 2023-06-20T13:32:34.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.296+0000 7f770cbff700 1 -- 172.21.15.32:0/340243639 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f770815d900 con 0x7f77080d3730 2023-06-20T13:32:34.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.297+0000 7f76f6ffd700 1 -- 172.21.15.32:0/340243639 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f770001c7e0 con 0x7f77080d3730 2023-06-20T13:32:34.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.297+0000 7f76f6ffd700 1 --2- 172.21.15.32:0/340243639 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f76e806ace0 0x7f76e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:34.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.298+0000 7f76f6ffd700 1 -- 172.21.15.32:0/340243639 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f770008b2f0 con 0x7f77080d3730 2023-06-20T13:32:34.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.298+0000 7f770659c700 1 --2- 172.21.15.32:0/340243639 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f76e806ace0 0x7f76e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:34.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.298+0000 7f770659c700 1 --2- 172.21.15.32:0/340243639 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f76e806ace0 0x7f76e806d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f76f8006f10 tx=0x7f76f8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:34.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.302+0000 7f76f6ffd700 1 -- 172.21.15.32:0/340243639 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f770815d900 con 0x7f77080d3730 2023-06-20T13:32:34.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.504+0000 7f770cbff700 1 -- 172.21.15.32:0/340243639 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f770815d900 con 0x7f77080d3730 2023-06-20T13:32:34.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.504+0000 7f76f6ffd700 1 -- 172.21.15.32:0/340243639 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f770815d900 con 0x7f77080d3730 2023-06-20T13:32:34.507 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 8 2023-06-20T13:32:34.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.506+0000 7f770cbff700 1 -- 172.21.15.32:0/340243639 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f76e806ace0 msgr2=0x7f76e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:34.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.506+0000 7f770cbff700 1 --2- 172.21.15.32:0/340243639 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f76e806ace0 0x7f76e806d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f76f8006f10 tx=0x7f76f8008040 comp rx=0 tx=0).stop 2023-06-20T13:32:34.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.506+0000 7f770cbff700 1 -- 172.21.15.32:0/340243639 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77080d3730 msgr2=0x7f77080cbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:34.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.506+0000 7f770cbff700 1 --2- 172.21.15.32:0/340243639 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77080d3730 0x7f77080cbde0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f770806c780 tx=0x7f7700004ad0 comp rx=0 tx=0).stop 2023-06-20T13:32:34.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.506+0000 7f770cbff700 1 -- 172.21.15.32:0/340243639 shutdown_connections 2023-06-20T13:32:34.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.506+0000 7f770cbff700 1 --2- 172.21.15.32:0/340243639 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f76e806ace0 0x7f76e806d190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:34.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.506+0000 7f770cbff700 1 --2- 172.21.15.32:0/340243639 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77080d3730 0x7f77080cbde0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:34.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.506+0000 7f770cbff700 1 --2- 172.21.15.32:0/340243639 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f77080b8430 0x7f770815a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:34.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.506+0000 7f770cbff700 1 --2- 172.21.15.32:0/340243639 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77080cfc60 0x7f77081605f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:34.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.507+0000 7f770cbff700 1 -- 172.21.15.32:0/340243639 >> 172.21.15.32:0/340243639 conn(0x7f770806b3f0 msgr2=0x7f77080b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:34.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.507+0000 7f770cbff700 1 -- 172.21.15.32:0/340243639 shutdown_connections 2023-06-20T13:32:34.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.507+0000 7f770cbff700 1 -- 172.21.15.32:0/340243639 wait complete. 2023-06-20T13:32:34.527 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-20T13:32:34.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.729+0000 7f6e9f3ff700 1 Processor -- start 2023-06-20T13:32:34.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.729+0000 7f6e9f3ff700 1 -- start start 2023-06-20T13:32:34.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.730+0000 7f6e9f3ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6e980d3730 0x7f6e980cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:34.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.730+0000 7f6e9f3ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e980d0b20 con 0x7f6e980b8430 2023-06-20T13:32:34.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.730+0000 7f6e9f3ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e980cfe90 con 0x7f6e980cfa90 2023-06-20T13:32:34.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.730+0000 7f6e9f3ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e980cda30 con 0x7f6e980d3730 2023-06-20T13:32:34.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.730+0000 7f6e9c99a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6e980d3730 0x7f6e980cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:34.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.730+0000 7f6e9c99a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6e980d3730 0x7f6e980cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57378/0 (socket says 172.21.15.32:57378) 2023-06-20T13:32:34.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.730+0000 7f6e9d19b700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f6e980b8430 0x7f6e980cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48762/0 (socket says 172.21.15.32:48762) 2023-06-20T13:32:34.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.730+0000 7f6e9c99a700 1 -- 172.21.15.32:0/2551686523 learned_addr learned my addr 172.21.15.32:0/2551686523 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:34.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.731+0000 7f6e9c99a700 1 -- 172.21.15.32:0/2551686523 >> v1:172.21.15.115:6789/0 conn(0x7f6e980cfa90 legacy=0x7f6e980d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:34.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.731+0000 7f6e9c99a700 1 -- 172.21.15.32:0/2551686523 >> v1:172.21.15.32:6789/0 conn(0x7f6e980b8430 legacy=0x7f6e980cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:34.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.731+0000 7f6e9c99a700 1 -- 172.21.15.32:0/2551686523 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e980b4ee0 con 0x7f6e980d3730 2023-06-20T13:32:34.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.731+0000 7f6e8ffff700 1 -- 172.21.15.32:0/2551686523 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558143696 0 0) 0x7f6e980d0b20 con 0x7f6e980b8430 2023-06-20T13:32:34.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.731+0000 7f6e9c99a700 1 --2- 172.21.15.32:0/2551686523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e980d3730 0x7f6e980cf550 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6e880098f0 tx=0x7f6e88009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8376b1b23d3fc5d8 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:34.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.731+0000 7f6e8ffff700 1 -- 172.21.15.32:0/2551686523 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8800b8a0 con 0x7f6e980d3730 2023-06-20T13:32:34.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.731+0000 7f6e8ffff700 1 -- 172.21.15.32:0/2551686523 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8800ba00 con 0x7f6e980d3730 2023-06-20T13:32:34.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.731+0000 7f6e8ffff700 1 -- 172.21.15.32:0/2551686523 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8800bd90 con 0x7f6e980d3730 2023-06-20T13:32:34.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.732+0000 7f6e9f3ff700 1 -- 172.21.15.32:0/2551686523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e980d3730 msgr2=0x7f6e980cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:34.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.732+0000 7f6e9f3ff700 1 --2- 172.21.15.32:0/2551686523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e980d3730 0x7f6e980cf550 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6e880098f0 tx=0x7f6e88009c00 comp rx=0 tx=0).stop 2023-06-20T13:32:34.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.732+0000 7f6e9f3ff700 1 -- 172.21.15.32:0/2551686523 shutdown_connections 2023-06-20T13:32:34.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.732+0000 7f6e9f3ff700 1 --2- 172.21.15.32:0/2551686523 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e980d3730 0x7f6e980cf550 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:34.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.732+0000 7f6e9f3ff700 1 -- 172.21.15.32:0/2551686523 >> 172.21.15.32:0/2551686523 conn(0x7f6e9806b3f0 msgr2=0x7f6e9806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:34.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.732+0000 7f6e9f3ff700 1 -- 172.21.15.32:0/2551686523 shutdown_connections 2023-06-20T13:32:34.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.732+0000 7f6e9f3ff700 1 -- 172.21.15.32:0/2551686523 wait complete. 2023-06-20T13:32:34.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.734+0000 7f6e9f3ff700 1 Processor -- start 2023-06-20T13:32:34.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.734+0000 7f6e9f3ff700 1 -- start start 2023-06-20T13:32:34.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.735+0000 7f6e9f3ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e980b8430 0x7f6e980c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:34.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.735+0000 7f6e9f3ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e980cfa90 0x7f6e980cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:34.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.735+0000 7f6e9f3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e980d3730 0x7f6e980d29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:34.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.735+0000 7f6e9f3ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9815e2c0 con 0x7f6e980cfa90 2023-06-20T13:32:34.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.735+0000 7f6e9f3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e980cb250 con 0x7f6e980d3730 2023-06-20T13:32:34.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.735+0000 7f6e9f3ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e980ccf20 con 0x7f6e980b8430 2023-06-20T13:32:34.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.735+0000 7f6e9c99a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e980cfa90 0x7f6e980cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:34.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.736+0000 7f6e9c99a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e980cfa90 0x7f6e980cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57384/0 (socket says 172.21.15.32:57384) 2023-06-20T13:32:34.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.736+0000 7f6e9c99a700 1 -- 172.21.15.32:0/86931266 learned_addr learned my addr 172.21.15.32:0/86931266 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:34.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.736+0000 7f6e9d19b700 1 --2- 172.21.15.32:0/86931266 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e980b8430 0x7f6e980c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:34.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.736+0000 7f6e9d99c700 1 --2- 172.21.15.32:0/86931266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e980d3730 0x7f6e980d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:34.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.736+0000 7f6e9c99a700 1 -- 172.21.15.32:0/86931266 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e980b8430 msgr2=0x7f6e980c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:34.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.736+0000 7f6e9c99a700 1 --2- 172.21.15.32:0/86931266 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e980b8430 0x7f6e980c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:34.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.736+0000 7f6e9c99a700 1 -- 172.21.15.32:0/86931266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e980d3730 msgr2=0x7f6e980d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:34.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.736+0000 7f6e9c99a700 1 --2- 172.21.15.32:0/86931266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e980d3730 0x7f6e980d29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:34.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.736+0000 7f6e9c99a700 1 -- 172.21.15.32:0/86931266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e88009550 con 0x7f6e980cfa90 2023-06-20T13:32:34.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.736+0000 7f6e9c99a700 1 --2- 172.21.15.32:0/86931266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e980cfa90 0x7f6e980cc610 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6e9806c780 tx=0x7f6e88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:34.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.736+0000 7f6e8dffb700 1 -- 172.21.15.32:0/86931266 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e880044d0 con 0x7f6e980cfa90 2023-06-20T13:32:34.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.737+0000 7f6e8dffb700 1 -- 172.21.15.32:0/86931266 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8801e070 con 0x7f6e980cfa90 2023-06-20T13:32:34.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.737+0000 7f6e9f3ff700 1 -- 172.21.15.32:0/86931266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e980ccc40 con 0x7f6e980cfa90 2023-06-20T13:32:34.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.737+0000 7f6e8dffb700 1 -- 172.21.15.32:0/86931266 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e880038a0 con 0x7f6e980cfa90 2023-06-20T13:32:34.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.737+0000 7f6e9f3ff700 1 -- 172.21.15.32:0/86931266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e9815dee0 con 0x7f6e980cfa90 2023-06-20T13:32:34.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.738+0000 7f6e9f3ff700 1 -- 172.21.15.32:0/86931266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e9815e400 con 0x7f6e980cfa90 2023-06-20T13:32:34.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.739+0000 7f6e8dffb700 1 -- 172.21.15.32:0/86931266 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6e88003a00 con 0x7f6e980cfa90 2023-06-20T13:32:34.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.739+0000 7f6e8dffb700 1 --2- 172.21.15.32:0/86931266 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6e7c06ace0 0x7f6e7c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:34.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.740+0000 7f6e8dffb700 1 -- 172.21.15.32:0/86931266 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6e88020070 con 0x7f6e980cfa90 2023-06-20T13:32:34.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.740+0000 7f6e9d19b700 1 --2- 172.21.15.32:0/86931266 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6e7c06ace0 0x7f6e7c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:34.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.740+0000 7f6e9d19b700 1 --2- 172.21.15.32:0/86931266 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6e7c06ace0 0x7f6e7c06d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6e94007b10 tx=0x7f6e94007a60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:34.748 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.744+0000 7f6e8dffb700 1 -- 172.21.15.32:0/86931266 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6e9815e400 con 0x7f6e980cfa90 2023-06-20T13:32:34.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.948+0000 7f6e9f3ff700 1 -- 172.21.15.32:0/86931266 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6e9815e400 con 0x7f6e980cfa90 2023-06-20T13:32:34.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.949+0000 7f6e8dffb700 1 -- 172.21.15.32:0/86931266 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6e9815e400 con 0x7f6e980cfa90 2023-06-20T13:32:34.952 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-06-20T13:32:34.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.951+0000 7f6e9f3ff700 1 -- 172.21.15.32:0/86931266 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6e7c06ace0 msgr2=0x7f6e7c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:34.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.951+0000 7f6e9f3ff700 1 --2- 172.21.15.32:0/86931266 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6e7c06ace0 0x7f6e7c06d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6e94007b10 tx=0x7f6e94007a60 comp rx=0 tx=0).stop 2023-06-20T13:32:34.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.951+0000 7f6e9f3ff700 1 -- 172.21.15.32:0/86931266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e980cfa90 msgr2=0x7f6e980cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:34.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.951+0000 7f6e9f3ff700 1 --2- 172.21.15.32:0/86931266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e980cfa90 0x7f6e980cc610 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6e9806c780 tx=0x7f6e88004750 comp rx=0 tx=0).stop 2023-06-20T13:32:34.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.951+0000 7f6e9f3ff700 1 -- 172.21.15.32:0/86931266 shutdown_connections 2023-06-20T13:32:34.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.951+0000 7f6e9f3ff700 1 --2- 172.21.15.32:0/86931266 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6e7c06ace0 0x7f6e7c06d190 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:34.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.951+0000 7f6e9f3ff700 1 --2- 172.21.15.32:0/86931266 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e980d3730 0x7f6e980d29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:34.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.951+0000 7f6e9f3ff700 1 --2- 172.21.15.32:0/86931266 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e980b8430 0x7f6e980c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:34.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.951+0000 7f6e9f3ff700 1 --2- 172.21.15.32:0/86931266 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e980cfa90 0x7f6e980cc610 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:34.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.951+0000 7f6e9f3ff700 1 -- 172.21.15.32:0/86931266 >> 172.21.15.32:0/86931266 conn(0x7f6e9806b3f0 msgr2=0x7f6e980d1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:34.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.951+0000 7f6e9f3ff700 1 -- 172.21.15.32:0/86931266 shutdown_connections 2023-06-20T13:32:34.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:34.951+0000 7f6e9f3ff700 1 -- 172.21.15.32:0/86931266 wait complete. 2023-06-20T13:32:34.972 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-20T13:32:35.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.173+0000 7f5d1b5ff700 1 Processor -- start 2023-06-20T13:32:35.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.173+0000 7f5d1b5ff700 1 -- start start 2023-06-20T13:32:35.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.175+0000 7f5d1b5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5d140b8430 0x7f5d140cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:35.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.175+0000 7f5d1b5ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5d140d3730 0x7f5d140cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:35.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.175+0000 7f5d1b5ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d140cfa90 0x7f5d1415feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:35.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.175+0000 7f5d1b5ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d140b8800 con 0x7f5d140d3730 2023-06-20T13:32:35.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.175+0000 7f5d1b5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d140d0b20 con 0x7f5d140b8430 2023-06-20T13:32:35.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.175+0000 7f5d1b5ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d140cfeb0 con 0x7f5d140cfa90 2023-06-20T13:32:35.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.175+0000 7f5d18b9a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5d140d3730 0x7f5d140cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:35.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.175+0000 7f5d18b9a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5d140d3730 0x7f5d140cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57398/0 (socket says 172.21.15.32:57398) 2023-06-20T13:32:35.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.175+0000 7f5d18b9a700 1 -- 172.21.15.32:0/3970901969 learned_addr learned my addr 172.21.15.32:0/3970901969 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:35.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.175+0000 7f5d1939b700 1 --2- 172.21.15.32:0/3970901969 >> v2:172.21.15.115:3300/0 conn(0x7f5d140b8430 0x7f5d140cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:35.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.175+0000 7f5d19b9c700 1 --2- 172.21.15.32:0/3970901969 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d140cfa90 0x7f5d1415feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:35.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.175+0000 7f5d18b9a700 1 -- 172.21.15.32:0/3970901969 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d140cfa90 msgr2=0x7f5d1415feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:35.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.175+0000 7f5d18b9a700 1 --2- 172.21.15.32:0/3970901969 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d140cfa90 0x7f5d1415feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:35.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.175+0000 7f5d18b9a700 1 -- 172.21.15.32:0/3970901969 >> v2:172.21.15.115:3300/0 conn(0x7f5d140b8430 msgr2=0x7f5d140cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:35.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.175+0000 7f5d18b9a700 1 --2- 172.21.15.32:0/3970901969 >> v2:172.21.15.115:3300/0 conn(0x7f5d140b8430 0x7f5d140cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:35.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.175+0000 7f5d18b9a700 1 -- 172.21.15.32:0/3970901969 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d140b4ee0 con 0x7f5d140d3730 2023-06-20T13:32:35.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.175+0000 7f5d19b9c700 1 --2- 172.21.15.32:0/3970901969 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d140cfa90 0x7f5d1415feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:32:35.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.176+0000 7f5d18b9a700 1 --2- 172.21.15.32:0/3970901969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d140d3730 0x7f5d140cf550 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5d140cf520 tx=0x7f5d04009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b248ae22ba38179 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:35.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.176+0000 7f5d0bfff700 1 -- 172.21.15.32:0/3970901969 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0400b870 con 0x7f5d140d3730 2023-06-20T13:32:35.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.176+0000 7f5d0bfff700 1 -- 172.21.15.32:0/3970901969 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d0400b9d0 con 0x7f5d140d3730 2023-06-20T13:32:35.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.176+0000 7f5d0bfff700 1 -- 172.21.15.32:0/3970901969 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0400bd60 con 0x7f5d140d3730 2023-06-20T13:32:35.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.177+0000 7f5d1b5ff700 1 -- 172.21.15.32:0/3970901969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d140d3730 msgr2=0x7f5d140cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:35.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.177+0000 7f5d1b5ff700 1 --2- 172.21.15.32:0/3970901969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d140d3730 0x7f5d140cf550 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5d140cf520 tx=0x7f5d04009bd0 comp rx=0 tx=0).stop 2023-06-20T13:32:35.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.177+0000 7f5d1b5ff700 1 -- 172.21.15.32:0/3970901969 shutdown_connections 2023-06-20T13:32:35.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.177+0000 7f5d1b5ff700 1 --2- 172.21.15.32:0/3970901969 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d140cfa90 0x7f5d1415feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:35.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.177+0000 7f5d1b5ff700 1 --2- 172.21.15.32:0/3970901969 >> v2:172.21.15.115:3300/0 conn(0x7f5d140b8430 0x7f5d140cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:35.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.177+0000 7f5d1b5ff700 1 --2- 172.21.15.32:0/3970901969 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d140d3730 0x7f5d140cf550 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:35.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.177+0000 7f5d1b5ff700 1 -- 172.21.15.32:0/3970901969 >> 172.21.15.32:0/3970901969 conn(0x7f5d1406b3f0 msgr2=0x7f5d1406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:35.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.177+0000 7f5d1b5ff700 1 -- 172.21.15.32:0/3970901969 shutdown_connections 2023-06-20T13:32:35.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.177+0000 7f5d1b5ff700 1 -- 172.21.15.32:0/3970901969 wait complete. 2023-06-20T13:32:35.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.179+0000 7f5d1b5ff700 1 Processor -- start 2023-06-20T13:32:35.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.179+0000 7f5d1b5ff700 1 -- start start 2023-06-20T13:32:35.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.181+0000 7f5d1b5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d140b8430 0x7f5d1414db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:35.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.181+0000 7f5d1b5ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d140cfa90 0x7f5d140c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:35.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.181+0000 7f5d1b5ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d140d3730 0x7f5d140b6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:35.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.181+0000 7f5d1b5ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d141f31b0 con 0x7f5d140d3730 2023-06-20T13:32:35.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.181+0000 7f5d1b5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d140c7f10 con 0x7f5d140b8430 2023-06-20T13:32:35.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.181+0000 7f5d1b5ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d140c81f0 con 0x7f5d140cfa90 2023-06-20T13:32:35.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.181+0000 7f5d19b9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d140d3730 0x7f5d140b6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:35.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.181+0000 7f5d19b9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d140d3730 0x7f5d140b6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57404/0 (socket says 172.21.15.32:57404) 2023-06-20T13:32:35.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.181+0000 7f5d19b9c700 1 -- 172.21.15.32:0/3535390017 learned_addr learned my addr 172.21.15.32:0/3535390017 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:35.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.181+0000 7f5d18b9a700 1 --2- 172.21.15.32:0/3535390017 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d140cfa90 0x7f5d140c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:35.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.181+0000 7f5d1939b700 1 --2- 172.21.15.32:0/3535390017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d140b8430 0x7f5d1414db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:35.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.181+0000 7f5d19b9c700 1 -- 172.21.15.32:0/3535390017 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d140cfa90 msgr2=0x7f5d140c76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:35.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.181+0000 7f5d19b9c700 1 --2- 172.21.15.32:0/3535390017 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d140cfa90 0x7f5d140c76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:35.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.181+0000 7f5d19b9c700 1 -- 172.21.15.32:0/3535390017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d140b8430 msgr2=0x7f5d1414db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:35.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.181+0000 7f5d19b9c700 1 --2- 172.21.15.32:0/3535390017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d140b8430 0x7f5d1414db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:35.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.181+0000 7f5d19b9c700 1 -- 172.21.15.32:0/3535390017 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d04009550 con 0x7f5d140d3730 2023-06-20T13:32:35.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.181+0000 7f5d1939b700 1 --2- 172.21.15.32:0/3535390017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d140b8430 0x7f5d1414db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:32:35.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.182+0000 7f5d19b9c700 1 --2- 172.21.15.32:0/3535390017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d140d3730 0x7f5d140b6f00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c00cd50 tx=0x7f5d0c00a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:35.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.182+0000 7f5d09ffb700 1 -- 172.21.15.32:0/3535390017 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c00cea0 con 0x7f5d140d3730 2023-06-20T13:32:35.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.182+0000 7f5d09ffb700 1 -- 172.21.15.32:0/3535390017 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d0c00f480 con 0x7f5d140d3730 2023-06-20T13:32:35.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.182+0000 7f5d1b5ff700 1 -- 172.21.15.32:0/3535390017 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d140c84d0 con 0x7f5d140d3730 2023-06-20T13:32:35.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.182+0000 7f5d09ffb700 1 -- 172.21.15.32:0/3535390017 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c00f810 con 0x7f5d140d3730 2023-06-20T13:32:35.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.182+0000 7f5d1b5ff700 1 -- 172.21.15.32:0/3535390017 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d140c7c00 con 0x7f5d140d3730 2023-06-20T13:32:35.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.183+0000 7f5d1b5ff700 1 -- 172.21.15.32:0/3535390017 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d141f3320 con 0x7f5d140d3730 2023-06-20T13:32:35.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.184+0000 7f5d09ffb700 1 -- 172.21.15.32:0/3535390017 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5d0c00b040 con 0x7f5d140d3730 2023-06-20T13:32:35.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.185+0000 7f5d09ffb700 1 --2- 172.21.15.32:0/3535390017 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5cf806ace0 0x7f5cf806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:35.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.185+0000 7f5d09ffb700 1 -- 172.21.15.32:0/3535390017 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5d0c089e80 con 0x7f5d140d3730 2023-06-20T13:32:35.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.185+0000 7f5d1939b700 1 --2- 172.21.15.32:0/3535390017 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5cf806ace0 0x7f5cf806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:35.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.186+0000 7f5d1939b700 1 --2- 172.21.15.32:0/3535390017 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5cf806ace0 0x7f5cf806d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5d10007a50 tx=0x7f5d10008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:35.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.190+0000 7f5d09ffb700 1 -- 172.21.15.32:0/3535390017 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5d141f3320 con 0x7f5d140d3730 2023-06-20T13:32:35.399 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.397+0000 7f5d1b5ff700 1 -- 172.21.15.32:0/3535390017 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5d141f3320 con 0x7f5d140d3730 2023-06-20T13:32:35.400 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.397+0000 7f5d09ffb700 1 -- 172.21.15.32:0/3535390017 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5d141f3320 con 0x7f5d140d3730 2023-06-20T13:32:35.400 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-06-20T13:32:35.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.400+0000 7f5d1b5ff700 1 -- 172.21.15.32:0/3535390017 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5cf806ace0 msgr2=0x7f5cf806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:35.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.400+0000 7f5d1b5ff700 1 --2- 172.21.15.32:0/3535390017 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5cf806ace0 0x7f5cf806d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5d10007a50 tx=0x7f5d10008040 comp rx=0 tx=0).stop 2023-06-20T13:32:35.403 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.400+0000 7f5d1b5ff700 1 -- 172.21.15.32:0/3535390017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d140d3730 msgr2=0x7f5d140b6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:35.403 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.400+0000 7f5d1b5ff700 1 --2- 172.21.15.32:0/3535390017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d140d3730 0x7f5d140b6f00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c00cd50 tx=0x7f5d0c00a560 comp rx=0 tx=0).stop 2023-06-20T13:32:35.403 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.400+0000 7f5d1b5ff700 1 -- 172.21.15.32:0/3535390017 shutdown_connections 2023-06-20T13:32:35.403 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.400+0000 7f5d1b5ff700 1 --2- 172.21.15.32:0/3535390017 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5cf806ace0 0x7f5cf806d190 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:35.403 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.400+0000 7f5d1b5ff700 1 --2- 172.21.15.32:0/3535390017 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5d140d3730 0x7f5d140b6f00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:35.403 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.400+0000 7f5d1b5ff700 1 --2- 172.21.15.32:0/3535390017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d140b8430 0x7f5d1414db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:35.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.400+0000 7f5d1b5ff700 1 --2- 172.21.15.32:0/3535390017 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5d140cfa90 0x7f5d140c76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:35.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.400+0000 7f5d1b5ff700 1 -- 172.21.15.32:0/3535390017 >> 172.21.15.32:0/3535390017 conn(0x7f5d1406b3f0 msgr2=0x7f5d140d0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:35.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.400+0000 7f5d1b5ff700 1 -- 172.21.15.32:0/3535390017 shutdown_connections 2023-06-20T13:32:35.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.400+0000 7f5d1b5ff700 1 -- 172.21.15.32:0/3535390017 wait complete. 2023-06-20T13:32:35.420 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-20T13:32:35.623 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.621+0000 7f32b55ff700 1 Processor -- start 2023-06-20T13:32:35.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.621+0000 7f32b55ff700 1 -- start start 2023-06-20T13:32:35.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.622+0000 7f32b55ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f32b00d3730 0x7f32b00cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:35.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.623+0000 7f32b55ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32b00cfa90 0x7f32b00d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:35.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.623+0000 7f32b55ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b00d0b20 con 0x7f32b00b8430 2023-06-20T13:32:35.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.623+0000 7f32b55ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b00cda30 con 0x7f32b00d3730 2023-06-20T13:32:35.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.623+0000 7f32b55ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b00b8800 con 0x7f32b00cfa90 2023-06-20T13:32:35.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.623+0000 7f32a7fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f32b00d3730 0x7f32b00cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:35.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.623+0000 7f32a7fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f32b00d3730 0x7f32b00cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57412/0 (socket says 172.21.15.32:57412) 2023-06-20T13:32:35.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.623+0000 7f32a7fff700 1 -- 172.21.15.32:0/1854985432 learned_addr learned my addr 172.21.15.32:0/1854985432 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:35.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.623+0000 7f32af7fe700 1 --2- 172.21.15.32:0/1854985432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32b00cfa90 0x7f32b00d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:35.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.623+0000 7f32a7fff700 1 -- 172.21.15.32:0/1854985432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32b00cfa90 msgr2=0x7f32b00d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:35.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.623+0000 7f32a7fff700 1 --2- 172.21.15.32:0/1854985432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32b00cfa90 0x7f32b00d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:35.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.623+0000 7f32a7fff700 1 -- 172.21.15.32:0/1854985432 >> v1:172.21.15.115:6789/0 conn(0x7f32b00b8430 legacy=0x7f32b00cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:35.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.623+0000 7f32a7fff700 1 -- 172.21.15.32:0/1854985432 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b00cfeb0 con 0x7f32b00d3730 2023-06-20T13:32:35.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.624+0000 7f32a7fff700 1 --2- 172.21.15.32:0/1854985432 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32b00d3730 0x7f32b00cf550 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f32980098f0 tx=0x7f3298009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce03953b6269f982 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:35.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.624+0000 7f32ae7fc700 1 -- 172.21.15.32:0/1854985432 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329800b8a0 con 0x7f32b00d3730 2023-06-20T13:32:35.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.624+0000 7f32ae7fc700 1 -- 172.21.15.32:0/1854985432 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329800ba00 con 0x7f32b00d3730 2023-06-20T13:32:35.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.624+0000 7f32ae7fc700 1 -- 172.21.15.32:0/1854985432 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329800bd90 con 0x7f32b00d3730 2023-06-20T13:32:35.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.624+0000 7f32b55ff700 1 -- 172.21.15.32:0/1854985432 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32b00d3730 msgr2=0x7f32b00cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:35.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.624+0000 7f32b55ff700 1 --2- 172.21.15.32:0/1854985432 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32b00d3730 0x7f32b00cf550 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f32980098f0 tx=0x7f3298009c00 comp rx=0 tx=0).stop 2023-06-20T13:32:35.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.625+0000 7f32b55ff700 1 -- 172.21.15.32:0/1854985432 shutdown_connections 2023-06-20T13:32:35.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.625+0000 7f32b55ff700 1 --2- 172.21.15.32:0/1854985432 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32b00cfa90 0x7f32b00d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:35.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.625+0000 7f32b55ff700 1 --2- 172.21.15.32:0/1854985432 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32b00d3730 0x7f32b00cf550 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:35.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.625+0000 7f32b55ff700 1 -- 172.21.15.32:0/1854985432 >> 172.21.15.32:0/1854985432 conn(0x7f32b006b3f0 msgr2=0x7f32b006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:35.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.625+0000 7f32b55ff700 1 -- 172.21.15.32:0/1854985432 shutdown_connections 2023-06-20T13:32:35.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.625+0000 7f32b55ff700 1 -- 172.21.15.32:0/1854985432 wait complete. 2023-06-20T13:32:35.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.626+0000 7f32b55ff700 1 Processor -- start 2023-06-20T13:32:35.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.627+0000 7f32b55ff700 1 -- start start 2023-06-20T13:32:35.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.627+0000 7f32b55ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32b00b8430 0x7f32b01f2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:35.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.628+0000 7f32b55ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32b00cfa90 0x7f32b00b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:35.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.628+0000 7f32b55ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32b00d3730 0x7f32b00cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:35.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.628+0000 7f32b55ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b01f2c10 con 0x7f32b00cfa90 2023-06-20T13:32:35.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.628+0000 7f32b55ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b01f2090 con 0x7f32b00d3730 2023-06-20T13:32:35.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.628+0000 7f32b55ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b01f2370 con 0x7f32b00b8430 2023-06-20T13:32:35.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.628+0000 7f32a7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32b00cfa90 0x7f32b00b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:35.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.628+0000 7f32a7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32b00cfa90 0x7f32b00b0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57424/0 (socket says 172.21.15.32:57424) 2023-06-20T13:32:35.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.628+0000 7f32a7fff700 1 -- 172.21.15.32:0/1555241263 learned_addr learned my addr 172.21.15.32:0/1555241263 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:35.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.628+0000 7f32af7fe700 1 --2- 172.21.15.32:0/1555241263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32b00d3730 0x7f32b00cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:35.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.628+0000 7f32a7fff700 1 -- 172.21.15.32:0/1555241263 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32b00b8430 msgr2=0x7f32b01f2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:35.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.628+0000 7f32aeffd700 1 --2- 172.21.15.32:0/1555241263 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32b00b8430 0x7f32b01f2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:35.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.628+0000 7f32a7fff700 1 --2- 172.21.15.32:0/1555241263 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32b00b8430 0x7f32b01f2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:35.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.628+0000 7f32a7fff700 1 -- 172.21.15.32:0/1555241263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32b00d3730 msgr2=0x7f32b00cb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:35.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.628+0000 7f32a7fff700 1 --2- 172.21.15.32:0/1555241263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32b00d3730 0x7f32b00cb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:35.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.628+0000 7f32a7fff700 1 -- 172.21.15.32:0/1555241263 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3298009550 con 0x7f32b00cfa90 2023-06-20T13:32:35.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.628+0000 7f32aeffd700 1 --2- 172.21.15.32:0/1555241263 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32b00b8430 0x7f32b01f2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:32:35.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.628+0000 7f32af7fe700 1 --2- 172.21.15.32:0/1555241263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32b00d3730 0x7f32b00cb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:32:35.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.629+0000 7f32a7fff700 1 --2- 172.21.15.32:0/1555241263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32b00cfa90 0x7f32b00b0b40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3298009c40 tx=0x7f3298004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:35.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.629+0000 7f32a77fe700 1 -- 172.21.15.32:0/1555241263 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32980036a0 con 0x7f32b00cfa90 2023-06-20T13:32:35.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.629+0000 7f32a77fe700 1 -- 172.21.15.32:0/1555241263 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329801e070 con 0x7f32b00cfa90 2023-06-20T13:32:35.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.629+0000 7f32a77fe700 1 -- 172.21.15.32:0/1555241263 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3298003a60 con 0x7f32b00cfa90 2023-06-20T13:32:35.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.629+0000 7f32b55ff700 1 -- 172.21.15.32:0/1555241263 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b01f2650 con 0x7f32b00cfa90 2023-06-20T13:32:35.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.629+0000 7f32b55ff700 1 -- 172.21.15.32:0/1555241263 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b01f32b0 con 0x7f32b00cfa90 2023-06-20T13:32:35.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.630+0000 7f32b55ff700 1 -- 172.21.15.32:0/1555241263 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b004ea60 con 0x7f32b00cfa90 2023-06-20T13:32:35.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.631+0000 7f32a77fe700 1 -- 172.21.15.32:0/1555241263 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3298003bc0 con 0x7f32b00cfa90 2023-06-20T13:32:35.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.632+0000 7f32a77fe700 1 --2- 172.21.15.32:0/1555241263 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f329006ace0 0x7f329006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:35.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.632+0000 7f32a77fe700 1 -- 172.21.15.32:0/1555241263 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3298020070 con 0x7f32b00cfa90 2023-06-20T13:32:35.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.632+0000 7f32aeffd700 1 --2- 172.21.15.32:0/1555241263 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f329006ace0 0x7f329006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:35.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.633+0000 7f32aeffd700 1 --2- 172.21.15.32:0/1555241263 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f329006ace0 0x7f329006d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f32a0000f60 tx=0x7f32a0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:35.638 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.637+0000 7f32a77fe700 1 -- 172.21.15.32:0/1555241263 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3298055a50 con 0x7f32b00cfa90 2023-06-20T13:32:35.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.842+0000 7f32b55ff700 1 -- 172.21.15.32:0/1555241263 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f32b00d1530 con 0x7f32b00cfa90 2023-06-20T13:32:35.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.843+0000 7f32a77fe700 1 -- 172.21.15.32:0/1555241263 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3298015020 con 0x7f32b00cfa90 2023-06-20T13:32:35.845 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-06-20T13:32:35.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.845+0000 7f32b55ff700 1 -- 172.21.15.32:0/1555241263 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f329006ace0 msgr2=0x7f329006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:35.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.845+0000 7f32b55ff700 1 --2- 172.21.15.32:0/1555241263 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f329006ace0 0x7f329006d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f32a0000f60 tx=0x7f32a0009040 comp rx=0 tx=0).stop 2023-06-20T13:32:35.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.845+0000 7f32b55ff700 1 -- 172.21.15.32:0/1555241263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32b00cfa90 msgr2=0x7f32b00b0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:35.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.845+0000 7f32b55ff700 1 --2- 172.21.15.32:0/1555241263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32b00cfa90 0x7f32b00b0b40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3298009c40 tx=0x7f3298004750 comp rx=0 tx=0).stop 2023-06-20T13:32:35.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.845+0000 7f32b55ff700 1 -- 172.21.15.32:0/1555241263 shutdown_connections 2023-06-20T13:32:35.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.845+0000 7f32b55ff700 1 --2- 172.21.15.32:0/1555241263 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f329006ace0 0x7f329006d190 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:35.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.845+0000 7f32b55ff700 1 --2- 172.21.15.32:0/1555241263 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32b00d3730 0x7f32b00cb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:35.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.845+0000 7f32b55ff700 1 --2- 172.21.15.32:0/1555241263 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32b00b8430 0x7f32b01f2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:35.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.845+0000 7f32b55ff700 1 --2- 172.21.15.32:0/1555241263 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32b00cfa90 0x7f32b00b0b40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:35.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.845+0000 7f32b55ff700 1 -- 172.21.15.32:0/1555241263 >> 172.21.15.32:0/1555241263 conn(0x7f32b006b3f0 msgr2=0x7f32b00d1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:35.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.845+0000 7f32b55ff700 1 -- 172.21.15.32:0/1555241263 shutdown_connections 2023-06-20T13:32:35.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:35.845+0000 7f32b55ff700 1 -- 172.21.15.32:0/1555241263 wait complete. 2023-06-20T13:32:35.866 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-20T13:32:36.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.068+0000 7f03e0dff700 1 Processor -- start 2023-06-20T13:32:36.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.068+0000 7f03e0dff700 1 -- start start 2023-06-20T13:32:36.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.069+0000 7f03e0dff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f03dc0d2640 0x7f03dc0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:36.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.069+0000 7f03e0dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f03dc0cf8f0 0x7f03dc15fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:36.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.069+0000 7f03e0dff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03dc0d1790 con 0x7f03dc15c460 2023-06-20T13:32:36.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.069+0000 7f03e0dff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03dc0cedd0 con 0x7f03dc0d2640 2023-06-20T13:32:36.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.069+0000 7f03e0dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03dc0cd950 con 0x7f03dc0cf8f0 2023-06-20T13:32:36.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.070+0000 7f03d9d9b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f03dc0d2640 0x7f03dc0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:36.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.070+0000 7f03da59c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f03dc15c460 0x7f03dc0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48772/0 (socket says 172.21.15.32:48772) 2023-06-20T13:32:36.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.070+0000 7f03da59c700 1 -- 172.21.15.32:0/3771437600 learned_addr learned my addr 172.21.15.32:0/3771437600 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:36.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.070+0000 7f03dad9d700 1 --2- 172.21.15.32:0/3771437600 >> v2:172.21.15.115:3300/0 conn(0x7f03dc0cf8f0 0x7f03dc15fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:36.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.070+0000 7f03d9d9b700 1 -- 172.21.15.32:0/3771437600 >> v2:172.21.15.115:3300/0 conn(0x7f03dc0cf8f0 msgr2=0x7f03dc15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:36.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.070+0000 7f03d9d9b700 1 --2- 172.21.15.32:0/3771437600 >> v2:172.21.15.115:3300/0 conn(0x7f03dc0cf8f0 0x7f03dc15fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:36.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.070+0000 7f03d9d9b700 1 -- 172.21.15.32:0/3771437600 >> v1:172.21.15.32:6789/0 conn(0x7f03dc15c460 legacy=0x7f03dc0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:36.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.070+0000 7f03d9d9b700 1 -- 172.21.15.32:0/3771437600 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc0d14b0 con 0x7f03dc0d2640 2023-06-20T13:32:36.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.070+0000 7f03d959a700 1 -- 172.21.15.32:0/3771437600 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325965949 0 0) 0x7f03dc0d1790 con 0x7f03dc15c460 2023-06-20T13:32:36.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.070+0000 7f03dad9d700 1 --2- 172.21.15.32:0/3771437600 >> v2:172.21.15.115:3300/0 conn(0x7f03dc0cf8f0 0x7f03dc15fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:32:36.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.070+0000 7f03d9d9b700 1 --2- 172.21.15.32:0/3771437600 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03dc0d2640 0x7f03dc0b59d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f03dc072140 tx=0x7f03d0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45c5953c46b4903 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:36.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.071+0000 7f03d959a700 1 -- 172.21.15.32:0/3771437600 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d0011830 con 0x7f03dc0d2640 2023-06-20T13:32:36.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.071+0000 7f03d959a700 1 -- 172.21.15.32:0/3771437600 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d0011990 con 0x7f03dc0d2640 2023-06-20T13:32:36.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.071+0000 7f03d959a700 1 -- 172.21.15.32:0/3771437600 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d0011d20 con 0x7f03dc0d2640 2023-06-20T13:32:36.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.071+0000 7f03e0dff700 1 -- 172.21.15.32:0/3771437600 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03dc0d2640 msgr2=0x7f03dc0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:36.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.071+0000 7f03e0dff700 1 --2- 172.21.15.32:0/3771437600 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03dc0d2640 0x7f03dc0b59d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f03dc072140 tx=0x7f03d0009b20 comp rx=0 tx=0).stop 2023-06-20T13:32:36.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.071+0000 7f03e0dff700 1 -- 172.21.15.32:0/3771437600 shutdown_connections 2023-06-20T13:32:36.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.071+0000 7f03e0dff700 1 --2- 172.21.15.32:0/3771437600 >> v2:172.21.15.115:3300/0 conn(0x7f03dc0cf8f0 0x7f03dc15fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:36.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.071+0000 7f03e0dff700 1 --2- 172.21.15.32:0/3771437600 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03dc0d2640 0x7f03dc0b59d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:36.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.071+0000 7f03e0dff700 1 -- 172.21.15.32:0/3771437600 >> 172.21.15.32:0/3771437600 conn(0x7f03dc071660 msgr2=0x7f03dc071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:36.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.071+0000 7f03e0dff700 1 -- 172.21.15.32:0/3771437600 shutdown_connections 2023-06-20T13:32:36.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.071+0000 7f03e0dff700 1 -- 172.21.15.32:0/3771437600 wait complete. 2023-06-20T13:32:36.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.073+0000 7f03e0dff700 1 Processor -- start 2023-06-20T13:32:36.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.073+0000 7f03e0dff700 1 -- start start 2023-06-20T13:32:36.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.074+0000 7f03e0dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03dc0cf8f0 0x7f03dc0c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:36.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.074+0000 7f03e0dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03dc0d2640 0x7f03dc0c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:36.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.074+0000 7f03e0dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03dc15c460 0x7f03dc1f3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:36.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.074+0000 7f03e0dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc0b33a0 con 0x7f03dc0d2640 2023-06-20T13:32:36.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.074+0000 7f03e0dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc0c9540 con 0x7f03dc15c460 2023-06-20T13:32:36.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.074+0000 7f03e0dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc0b2a70 con 0x7f03dc0cf8f0 2023-06-20T13:32:36.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.074+0000 7f03d9d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03dc0d2640 0x7f03dc0c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:36.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.074+0000 7f03d9d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03dc0d2640 0x7f03dc0c9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57438/0 (socket says 172.21.15.32:57438) 2023-06-20T13:32:36.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.074+0000 7f03d9d9b700 1 -- 172.21.15.32:0/1063028111 learned_addr learned my addr 172.21.15.32:0/1063028111 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:36.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.075+0000 7f03dad9d700 1 --2- 172.21.15.32:0/1063028111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03dc15c460 0x7f03dc1f3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:36.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.075+0000 7f03da59c700 1 --2- 172.21.15.32:0/1063028111 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03dc0cf8f0 0x7f03dc0c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:36.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.075+0000 7f03d9d9b700 1 -- 172.21.15.32:0/1063028111 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03dc0cf8f0 msgr2=0x7f03dc0c7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:36.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.075+0000 7f03d9d9b700 1 --2- 172.21.15.32:0/1063028111 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03dc0cf8f0 0x7f03dc0c7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:36.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.075+0000 7f03d9d9b700 1 -- 172.21.15.32:0/1063028111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03dc15c460 msgr2=0x7f03dc1f3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:36.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.075+0000 7f03d9d9b700 1 --2- 172.21.15.32:0/1063028111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03dc15c460 0x7f03dc1f3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:36.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.075+0000 7f03d9d9b700 1 -- 172.21.15.32:0/1063028111 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d00094a0 con 0x7f03dc0d2640 2023-06-20T13:32:36.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.075+0000 7f03d9d9b700 1 --2- 172.21.15.32:0/1063028111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03dc0d2640 0x7f03dc0c9000 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f03d0014040 tx=0x7f03d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:36.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.075+0000 7f03caffd700 1 -- 172.21.15.32:0/1063028111 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d00038a0 con 0x7f03dc0d2640 2023-06-20T13:32:36.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.075+0000 7f03caffd700 1 -- 172.21.15.32:0/1063028111 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d001e070 con 0x7f03dc0d2640 2023-06-20T13:32:36.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.075+0000 7f03e0dff700 1 -- 172.21.15.32:0/1063028111 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03dc0b2d50 con 0x7f03dc0d2640 2023-06-20T13:32:36.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.075+0000 7f03caffd700 1 -- 172.21.15.32:0/1063028111 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d0003c40 con 0x7f03dc0d2640 2023-06-20T13:32:36.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.076+0000 7f03e0dff700 1 -- 172.21.15.32:0/1063028111 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03dc1f3880 con 0x7f03dc0d2640 2023-06-20T13:32:36.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.077+0000 7f03e0dff700 1 -- 172.21.15.32:0/1063028111 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03dc0b3510 con 0x7f03dc0d2640 2023-06-20T13:32:36.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.078+0000 7f03caffd700 1 -- 172.21.15.32:0/1063028111 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f03d002d450 con 0x7f03dc0d2640 2023-06-20T13:32:36.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.078+0000 7f03caffd700 1 --2- 172.21.15.32:0/1063028111 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f03bc06ace0 0x7f03bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:36.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.079+0000 7f03caffd700 1 -- 172.21.15.32:0/1063028111 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f03d008a880 con 0x7f03dc0d2640 2023-06-20T13:32:36.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.079+0000 7f03da59c700 1 --2- 172.21.15.32:0/1063028111 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f03bc06ace0 0x7f03bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:36.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.079+0000 7f03da59c700 1 --2- 172.21.15.32:0/1063028111 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f03bc06ace0 0x7f03bc06d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f03cc000f60 tx=0x7f03cc007be0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:36.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.083+0000 7f03caffd700 1 -- 172.21.15.32:0/1063028111 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f03d00556d0 con 0x7f03dc0d2640 2023-06-20T13:32:36.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.306+0000 7f03e0dff700 1 -- 172.21.15.32:0/1063028111 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f03dc04ea60 con 0x7f03dc0d2640 2023-06-20T13:32:36.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.307+0000 7f03caffd700 1 -- 172.21.15.32:0/1063028111 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f03d0020080 con 0x7f03dc0d2640 2023-06-20T13:32:36.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.309+0000 7f03e0dff700 1 -- 172.21.15.32:0/1063028111 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f03bc06ace0 msgr2=0x7f03bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:36.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.309+0000 7f03e0dff700 1 --2- 172.21.15.32:0/1063028111 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f03bc06ace0 0x7f03bc06d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f03cc000f60 tx=0x7f03cc007be0 comp rx=0 tx=0).stop 2023-06-20T13:32:36.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.309+0000 7f03e0dff700 1 -- 172.21.15.32:0/1063028111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03dc0d2640 msgr2=0x7f03dc0c9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:36.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.309+0000 7f03e0dff700 1 --2- 172.21.15.32:0/1063028111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03dc0d2640 0x7f03dc0c9000 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f03d0014040 tx=0x7f03d0004750 comp rx=0 tx=0).stop 2023-06-20T13:32:36.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.309+0000 7f03e0dff700 1 -- 172.21.15.32:0/1063028111 shutdown_connections 2023-06-20T13:32:36.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.309+0000 7f03e0dff700 1 --2- 172.21.15.32:0/1063028111 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f03bc06ace0 0x7f03bc06d190 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:36.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.309+0000 7f03e0dff700 1 --2- 172.21.15.32:0/1063028111 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03dc15c460 0x7f03dc1f3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:36.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.309+0000 7f03e0dff700 1 --2- 172.21.15.32:0/1063028111 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03dc0cf8f0 0x7f03dc0c7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:36.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.309+0000 7f03e0dff700 1 --2- 172.21.15.32:0/1063028111 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03dc0d2640 0x7f03dc0c9000 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:36.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.309+0000 7f03e0dff700 1 -- 172.21.15.32:0/1063028111 >> 172.21.15.32:0/1063028111 conn(0x7f03dc071660 msgr2=0x7f03dc0b59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:36.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.309+0000 7f03e0dff700 1 -- 172.21.15.32:0/1063028111 shutdown_connections 2023-06-20T13:32:36.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.309+0000 7f03e0dff700 1 -- 172.21.15.32:0/1063028111 wait complete. 2023-06-20T13:32:36.313 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2023-06-20T13:32:36.329 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:32:36.329 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-20T13:32:36.375 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:32:36.616 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.613+0000 7f16819ff700 1 Processor -- start 2023-06-20T13:32:36.616 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.614+0000 7f16819ff700 1 -- start start 2023-06-20T13:32:36.617 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.615+0000 7f16819ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f167c15c460 0x7f167c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:36.617 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.615+0000 7f16819ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f167c0d1790 con 0x7f167c0d2640 2023-06-20T13:32:36.617 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.615+0000 7f16819ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f167c0cd950 con 0x7f167c0cf8f0 2023-06-20T13:32:36.617 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.615+0000 7f16819ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167c0cedd0 con 0x7f167c15c460 2023-06-20T13:32:36.619 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.615+0000 7f1673fff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f167c0d2640 0x7f167c0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48774/0 (socket says 172.21.15.32:48774) 2023-06-20T13:32:36.619 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.615+0000 7f1673fff700 1 -- 172.21.15.32:0/3655047503 learned_addr learned my addr 172.21.15.32:0/3655047503 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:36.619 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.615+0000 7f167affd700 1 --2- 172.21.15.32:0/3655047503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f167c15c460 0x7f167c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:36.619 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.616+0000 7f167a7fc700 1 -- 172.21.15.32:0/3655047503 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2126348284 0 0) 0x7f167c0d1790 con 0x7f167c0d2640 2023-06-20T13:32:36.619 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.616+0000 7f167a7fc700 1 -- 172.21.15.32:0/3655047503 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16680035b0 con 0x7f167c0d2640 2023-06-20T13:32:36.619 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.616+0000 7f167a7fc700 1 -- 172.21.15.32:0/3655047503 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3171922025 0 0) 0x7f167c0cd950 con 0x7f167c0cf8f0 2023-06-20T13:32:36.619 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.616+0000 7f167a7fc700 1 -- 172.21.15.32:0/3655047503 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f167c0d1790 con 0x7f167c0cf8f0 2023-06-20T13:32:36.620 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.616+0000 7f167affd700 1 -- 172.21.15.32:0/3655047503 >> v1:172.21.15.115:6789/0 conn(0x7f167c0cf8f0 legacy=0x7f167c15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:36.620 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.616+0000 7f167affd700 1 -- 172.21.15.32:0/3655047503 >> v1:172.21.15.32:6789/0 conn(0x7f167c0d2640 legacy=0x7f167c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:36.620 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.616+0000 7f167affd700 1 -- 172.21.15.32:0/3655047503 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f167c0d14b0 con 0x7f167c15c460 2023-06-20T13:32:36.620 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.616+0000 7f167affd700 1 --2- 172.21.15.32:0/3655047503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f167c15c460 0x7f167c0b59d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f166c009870 tx=0x7f166c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61b5661491adabe5 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:36.620 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.617+0000 7f167a7fc700 1 -- 172.21.15.32:0/3655047503 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166c011830 con 0x7f167c15c460 2023-06-20T13:32:36.620 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.617+0000 7f167a7fc700 1 -- 172.21.15.32:0/3655047503 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166c011990 con 0x7f167c15c460 2023-06-20T13:32:36.620 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.617+0000 7f167a7fc700 1 -- 172.21.15.32:0/3655047503 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166c011d20 con 0x7f167c15c460 2023-06-20T13:32:36.621 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.617+0000 7f16819ff700 1 -- 172.21.15.32:0/3655047503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f167c15c460 msgr2=0x7f167c0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:36.621 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.617+0000 7f16819ff700 1 --2- 172.21.15.32:0/3655047503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f167c15c460 0x7f167c0b59d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f166c009870 tx=0x7f166c009b80 comp rx=0 tx=0).stop 2023-06-20T13:32:36.622 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.617+0000 7f16819ff700 1 -- 172.21.15.32:0/3655047503 shutdown_connections 2023-06-20T13:32:36.622 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.617+0000 7f16819ff700 1 --2- 172.21.15.32:0/3655047503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f167c15c460 0x7f167c0b59d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:36.622 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.617+0000 7f16819ff700 1 -- 172.21.15.32:0/3655047503 >> 172.21.15.32:0/3655047503 conn(0x7f167c071660 msgr2=0x7f167c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:36.622 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.617+0000 7f16819ff700 1 -- 172.21.15.32:0/3655047503 shutdown_connections 2023-06-20T13:32:36.622 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.617+0000 7f16819ff700 1 -- 172.21.15.32:0/3655047503 wait complete. 2023-06-20T13:32:36.622 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.619+0000 7f16819ff700 1 Processor -- start 2023-06-20T13:32:36.622 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.619+0000 7f16819ff700 1 -- start start 2023-06-20T13:32:36.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.620+0000 7f16819ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f167c0cf8f0 0x7f167c14d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:36.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.620+0000 7f16819ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f167c0d2640 0x7f167c14dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:36.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.620+0000 7f16819ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f167c15c460 0x7f167c14e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:36.624 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.620+0000 7f16819ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167c0c7c50 con 0x7f167c15c460 2023-06-20T13:32:36.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.620+0000 7f16819ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167c0c7f30 con 0x7f167c0cf8f0 2023-06-20T13:32:36.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.620+0000 7f16819ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167c0c8210 con 0x7f167c0d2640 2023-06-20T13:32:36.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.620+0000 7f167b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f167c15c460 0x7f167c14e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:36.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.620+0000 7f167b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f167c15c460 0x7f167c14e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57440/0 (socket says 172.21.15.32:57440) 2023-06-20T13:32:36.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.620+0000 7f167b7fe700 1 -- 172.21.15.32:0/1492583852 learned_addr learned my addr 172.21.15.32:0/1492583852 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:36.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.620+0000 7f167affd700 1 --2- 172.21.15.32:0/1492583852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f167c0cf8f0 0x7f167c14d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:36.625 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.621+0000 7f1673fff700 1 --2- 172.21.15.32:0/1492583852 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f167c0d2640 0x7f167c14dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:36.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.621+0000 7f167b7fe700 1 -- 172.21.15.32:0/1492583852 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f167c0d2640 msgr2=0x7f167c14dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:36.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.621+0000 7f167b7fe700 1 --2- 172.21.15.32:0/1492583852 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f167c0d2640 0x7f167c14dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:36.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.621+0000 7f167b7fe700 1 -- 172.21.15.32:0/1492583852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f167c0cf8f0 msgr2=0x7f167c14d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:36.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.621+0000 7f167b7fe700 1 --2- 172.21.15.32:0/1492583852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f167c0cf8f0 0x7f167c14d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:36.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.621+0000 7f167b7fe700 1 -- 172.21.15.32:0/1492583852 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f166c0094a0 con 0x7f167c15c460 2023-06-20T13:32:36.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.621+0000 7f167b7fe700 1 --2- 172.21.15.32:0/1492583852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f167c15c460 0x7f167c14e420 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f167400cbc0 tx=0x7f167400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:36.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.621+0000 7f1678ff9700 1 -- 172.21.15.32:0/1492583852 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1674003c00 con 0x7f167c15c460 2023-06-20T13:32:36.626 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.621+0000 7f1678ff9700 1 -- 172.21.15.32:0/1492583852 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1674003d60 con 0x7f167c15c460 2023-06-20T13:32:36.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.621+0000 7f1678ff9700 1 -- 172.21.15.32:0/1492583852 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167400aaa0 con 0x7f167c15c460 2023-06-20T13:32:36.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.621+0000 7f16819ff700 1 -- 172.21.15.32:0/1492583852 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f167c0c84f0 con 0x7f167c15c460 2023-06-20T13:32:36.627 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.622+0000 7f16819ff700 1 -- 172.21.15.32:0/1492583852 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f167c14d690 con 0x7f167c15c460 2023-06-20T13:32:36.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.623+0000 7f16819ff700 1 -- 172.21.15.32:0/1492583852 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f167c0c8a10 con 0x7f167c15c460 2023-06-20T13:32:36.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.624+0000 7f1678ff9700 1 -- 172.21.15.32:0/1492583852 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f167400ac00 con 0x7f167c15c460 2023-06-20T13:32:36.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.625+0000 7f1678ff9700 1 --2- 172.21.15.32:0/1492583852 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f165c06ace0 0x7f165c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:36.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.625+0000 7f1678ff9700 1 -- 172.21.15.32:0/1492583852 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1674089730 con 0x7f167c15c460 2023-06-20T13:32:36.628 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.625+0000 7f167affd700 1 --2- 172.21.15.32:0/1492583852 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f165c06ace0 0x7f165c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:36.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.626+0000 7f167affd700 1 --2- 172.21.15.32:0/1492583852 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f165c06ace0 0x7f165c06d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f166c0097c0 tx=0x7f166c01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:36.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.629+0000 7f1678ff9700 1 -- 172.21.15.32:0/1492583852 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f167c0c8a10 con 0x7f167c15c460 2023-06-20T13:32:36.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.837+0000 7f16819ff700 1 -- 172.21.15.32:0/1492583852 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f167c0c8a10 con 0x7f167c15c460 2023-06-20T13:32:36.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.838+0000 7f1678ff9700 1 -- 172.21.15.32:0/1492583852 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20096 (secure 0 0 0) 0x7f167c0c8a10 con 0x7f167c15c460 2023-06-20T13:32:36.841 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:32:36.841 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":27,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:32:25.570940+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-20T13:32:18.120021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-20T13:32:19.503624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-20T13:32:23.074912+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:32:36.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.841+0000 7f16819ff700 1 -- 172.21.15.32:0/1492583852 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f165c06ace0 msgr2=0x7f165c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:36.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.841+0000 7f16819ff700 1 --2- 172.21.15.32:0/1492583852 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f165c06ace0 0x7f165c06d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f166c0097c0 tx=0x7f166c01c040 comp rx=0 tx=0).stop 2023-06-20T13:32:36.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.841+0000 7f16819ff700 1 -- 172.21.15.32:0/1492583852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f167c15c460 msgr2=0x7f167c14e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:36.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.841+0000 7f16819ff700 1 --2- 172.21.15.32:0/1492583852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f167c15c460 0x7f167c14e420 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f167400cbc0 tx=0x7f167400ced0 comp rx=0 tx=0).stop 2023-06-20T13:32:36.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.841+0000 7f16819ff700 1 -- 172.21.15.32:0/1492583852 shutdown_connections 2023-06-20T13:32:36.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.841+0000 7f16819ff700 1 --2- 172.21.15.32:0/1492583852 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f165c06ace0 0x7f165c06d190 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:36.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.841+0000 7f16819ff700 1 --2- 172.21.15.32:0/1492583852 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f167c15c460 0x7f167c14e420 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:36.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.841+0000 7f16819ff700 1 --2- 172.21.15.32:0/1492583852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f167c0cf8f0 0x7f167c14d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:36.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.841+0000 7f16819ff700 1 --2- 172.21.15.32:0/1492583852 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f167c0d2640 0x7f167c14dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:36.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.841+0000 7f16819ff700 1 -- 172.21.15.32:0/1492583852 >> 172.21.15.32:0/1492583852 conn(0x7f167c071660 msgr2=0x7f167c156ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:36.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.841+0000 7f16819ff700 1 -- 172.21.15.32:0/1492583852 shutdown_connections 2023-06-20T13:32:36.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:36.841+0000 7f16819ff700 1 -- 172.21.15.32:0/1492583852 wait complete. 2023-06-20T13:32:36.861 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-20T13:32:05.308022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-20T13:32:12.857161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-20T13:32:18.120021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-20T13:32:19.503624+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-20T13:32:23.074912+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-20T13:32:36.862 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-20T13:32:37.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.068+0000 7fb05abff700 1 Processor -- start 2023-06-20T13:32:37.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.068+0000 7fb05abff700 1 -- start start 2023-06-20T13:32:37.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.069+0000 7fb05abff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb0540d3730 0x7fb0540cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:37.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.069+0000 7fb05abff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0540cfa90 0x7fb0540d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:37.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.069+0000 7fb05abff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0540d0b20 con 0x7fb0540b8430 2023-06-20T13:32:37.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.069+0000 7fb05abff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0540cda30 con 0x7fb0540d3730 2023-06-20T13:32:37.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.069+0000 7fb05abff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0540b8800 con 0x7fb0540cfa90 2023-06-20T13:32:37.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.069+0000 7fb053fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb0540d3730 0x7fb0540cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:37.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.069+0000 7fb053fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb0540d3730 0x7fb0540cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57442/0 (socket says 172.21.15.32:57442) 2023-06-20T13:32:37.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.069+0000 7fb053fff700 1 -- 172.21.15.32:0/665148581 learned_addr learned my addr 172.21.15.32:0/665148581 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:37.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.070+0000 7fb05919c700 1 --2- 172.21.15.32:0/665148581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0540cfa90 0x7fb0540d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:37.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.070+0000 7fb053fff700 1 -- 172.21.15.32:0/665148581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0540cfa90 msgr2=0x7fb0540d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:37.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.070+0000 7fb053fff700 1 --2- 172.21.15.32:0/665148581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0540cfa90 0x7fb0540d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:37.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.070+0000 7fb053fff700 1 -- 172.21.15.32:0/665148581 >> v1:172.21.15.115:6789/0 conn(0x7fb0540b8430 legacy=0x7fb0540cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:37.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.070+0000 7fb053fff700 1 -- 172.21.15.32:0/665148581 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0540cfeb0 con 0x7fb0540d3730 2023-06-20T13:32:37.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.070+0000 7fb0537fe700 1 -- 172.21.15.32:0/665148581 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842025670 0 0) 0x7fb0540d0b20 con 0x7fb0540b8430 2023-06-20T13:32:37.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.070+0000 7fb053fff700 1 --2- 172.21.15.32:0/665148581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0540d3730 0x7fb0540cf550 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb0400098f0 tx=0x7fb040009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0dcc043f634d034 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:37.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.070+0000 7fb0537fe700 1 -- 172.21.15.32:0/665148581 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb040011830 con 0x7fb0540d3730 2023-06-20T13:32:37.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.070+0000 7fb0537fe700 1 -- 172.21.15.32:0/665148581 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb040011990 con 0x7fb0540d3730 2023-06-20T13:32:37.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.071+0000 7fb0537fe700 1 -- 172.21.15.32:0/665148581 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb040011d20 con 0x7fb0540d3730 2023-06-20T13:32:37.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.071+0000 7fb05abff700 1 -- 172.21.15.32:0/665148581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0540d3730 msgr2=0x7fb0540cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:37.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.071+0000 7fb05abff700 1 --2- 172.21.15.32:0/665148581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0540d3730 0x7fb0540cf550 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb0400098f0 tx=0x7fb040009c00 comp rx=0 tx=0).stop 2023-06-20T13:32:37.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.071+0000 7fb05abff700 1 -- 172.21.15.32:0/665148581 shutdown_connections 2023-06-20T13:32:37.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.071+0000 7fb05abff700 1 --2- 172.21.15.32:0/665148581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0540cfa90 0x7fb0540d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:37.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.071+0000 7fb05abff700 1 --2- 172.21.15.32:0/665148581 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0540d3730 0x7fb0540cf550 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:37.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.071+0000 7fb05abff700 1 -- 172.21.15.32:0/665148581 >> 172.21.15.32:0/665148581 conn(0x7fb05406b3f0 msgr2=0x7fb05406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:37.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.071+0000 7fb05abff700 1 -- 172.21.15.32:0/665148581 shutdown_connections 2023-06-20T13:32:37.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.071+0000 7fb05abff700 1 -- 172.21.15.32:0/665148581 wait complete. 2023-06-20T13:32:37.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.073+0000 7fb05abff700 1 Processor -- start 2023-06-20T13:32:37.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.073+0000 7fb05abff700 1 -- start start 2023-06-20T13:32:37.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.074+0000 7fb05abff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0540b8430 0x7fb0540cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:37.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.074+0000 7fb05abff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0540cfa90 0x7fb0540c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:37.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.074+0000 7fb05abff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0540d3730 0x7fb054151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:37.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.074+0000 7fb05abff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0540cbfd0 con 0x7fb0540d3730 2023-06-20T13:32:37.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.074+0000 7fb05abff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0540c6810 con 0x7fb0540cfa90 2023-06-20T13:32:37.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.074+0000 7fb05abff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0540c6af0 con 0x7fb0540b8430 2023-06-20T13:32:37.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.074+0000 7fb05919c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0540d3730 0x7fb054151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:37.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.074+0000 7fb05919c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0540d3730 0x7fb054151760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57448/0 (socket says 172.21.15.32:57448) 2023-06-20T13:32:37.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.074+0000 7fb05919c700 1 -- 172.21.15.32:0/2835628084 learned_addr learned my addr 172.21.15.32:0/2835628084 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:37.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.074+0000 7fb053fff700 1 --2- 172.21.15.32:0/2835628084 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0540cfa90 0x7fb0540c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:37.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.074+0000 7fb05899b700 1 --2- 172.21.15.32:0/2835628084 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0540b8430 0x7fb0540cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:37.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.075+0000 7fb05919c700 1 -- 172.21.15.32:0/2835628084 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0540b8430 msgr2=0x7fb0540cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:37.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.075+0000 7fb05919c700 1 --2- 172.21.15.32:0/2835628084 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0540b8430 0x7fb0540cb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:37.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.075+0000 7fb05919c700 1 -- 172.21.15.32:0/2835628084 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0540cfa90 msgr2=0x7fb0540c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:37.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.075+0000 7fb05919c700 1 --2- 172.21.15.32:0/2835628084 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0540cfa90 0x7fb0540c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:37.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.075+0000 7fb05919c700 1 -- 172.21.15.32:0/2835628084 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb040009550 con 0x7fb0540d3730 2023-06-20T13:32:37.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.075+0000 7fb05919c700 1 --2- 172.21.15.32:0/2835628084 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0540d3730 0x7fb054151760 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00efc0 tx=0x7fb04c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:37.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.075+0000 7fb0517fa700 1 -- 172.21.15.32:0/2835628084 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c009ea0 con 0x7fb0540d3730 2023-06-20T13:32:37.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.075+0000 7fb0517fa700 1 -- 172.21.15.32:0/2835628084 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04c00f040 con 0x7fb0540d3730 2023-06-20T13:32:37.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.075+0000 7fb05abff700 1 -- 172.21.15.32:0/2835628084 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0540c6dd0 con 0x7fb0540d3730 2023-06-20T13:32:37.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.075+0000 7fb0517fa700 1 -- 172.21.15.32:0/2835628084 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c014480 con 0x7fb0540d3730 2023-06-20T13:32:37.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.075+0000 7fb05abff700 1 -- 172.21.15.32:0/2835628084 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0540c8fa0 con 0x7fb0540d3730 2023-06-20T13:32:37.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.077+0000 7fb05abff700 1 -- 172.21.15.32:0/2835628084 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0540d09f0 con 0x7fb0540d3730 2023-06-20T13:32:37.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.077+0000 7fb0517fa700 1 -- 172.21.15.32:0/2835628084 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb04c0145e0 con 0x7fb0540d3730 2023-06-20T13:32:37.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.079+0000 7fb0517fa700 1 --2- 172.21.15.32:0/2835628084 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fb03806ace0 0x7fb03806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:37.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.079+0000 7fb0517fa700 1 -- 172.21.15.32:0/2835628084 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb04c089f20 con 0x7fb0540d3730 2023-06-20T13:32:37.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.079+0000 7fb05899b700 1 --2- 172.21.15.32:0/2835628084 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fb03806ace0 0x7fb03806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:37.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.079+0000 7fb05899b700 1 --2- 172.21.15.32:0/2835628084 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fb03806ace0 0x7fb03806d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb048000f60 tx=0x7fb048009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:37.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.083+0000 7fb0517fa700 1 -- 172.21.15.32:0/2835628084 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb04c054d70 con 0x7fb0540d3730 2023-06-20T13:32:37.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.287+0000 7fb05abff700 1 -- 172.21.15.32:0/2835628084 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb05415c620 con 0x7fb0540d3730 2023-06-20T13:32:37.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.288+0000 7fb0517fa700 1 -- 172.21.15.32:0/2835628084 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb04c0180a0 con 0x7fb0540d3730 2023-06-20T13:32:37.290 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-06-20T13:32:37.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.290+0000 7fb05abff700 1 -- 172.21.15.32:0/2835628084 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fb03806ace0 msgr2=0x7fb03806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:37.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.290+0000 7fb05abff700 1 --2- 172.21.15.32:0/2835628084 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fb03806ace0 0x7fb03806d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb048000f60 tx=0x7fb048009040 comp rx=0 tx=0).stop 2023-06-20T13:32:37.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.290+0000 7fb05abff700 1 -- 172.21.15.32:0/2835628084 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0540d3730 msgr2=0x7fb054151760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:37.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.290+0000 7fb05abff700 1 --2- 172.21.15.32:0/2835628084 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0540d3730 0x7fb054151760 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00efc0 tx=0x7fb04c00c3a0 comp rx=0 tx=0).stop 2023-06-20T13:32:37.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.290+0000 7fb05abff700 1 -- 172.21.15.32:0/2835628084 shutdown_connections 2023-06-20T13:32:37.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.290+0000 7fb05abff700 1 --2- 172.21.15.32:0/2835628084 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fb03806ace0 0x7fb03806d190 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:37.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.290+0000 7fb05abff700 1 --2- 172.21.15.32:0/2835628084 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb0540d3730 0x7fb054151760 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:37.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.290+0000 7fb05abff700 1 --2- 172.21.15.32:0/2835628084 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0540b8430 0x7fb0540cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:37.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.290+0000 7fb05abff700 1 --2- 172.21.15.32:0/2835628084 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0540cfa90 0x7fb0540c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:37.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.290+0000 7fb05abff700 1 -- 172.21.15.32:0/2835628084 >> 172.21.15.32:0/2835628084 conn(0x7fb05406b3f0 msgr2=0x7fb0540b5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:37.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.290+0000 7fb05abff700 1 -- 172.21.15.32:0/2835628084 shutdown_connections 2023-06-20T13:32:37.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.290+0000 7fb05abff700 1 -- 172.21.15.32:0/2835628084 wait complete. 2023-06-20T13:32:37.310 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-20T13:32:37.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.510+0000 7f124f3ff700 1 Processor -- start 2023-06-20T13:32:37.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.511+0000 7f124f3ff700 1 -- start start 2023-06-20T13:32:37.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.512+0000 7f124f3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f12480d3730 0x7f12480cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:37.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.512+0000 7f124f3ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f12480cfa90 0x7f12480d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:37.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.512+0000 7f124f3ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12480d0b20 con 0x7f12480b8430 2023-06-20T13:32:37.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.512+0000 7f124f3ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12480cda30 con 0x7f12480cfa90 2023-06-20T13:32:37.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.512+0000 7f124f3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12480b8800 con 0x7f12480d3730 2023-06-20T13:32:37.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.512+0000 7f124d99c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f12480cfa90 0x7f12480d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:37.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.512+0000 7f124d99c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f12480cfa90 0x7f12480d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57458/0 (socket says 172.21.15.32:57458) 2023-06-20T13:32:37.515 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.512+0000 7f124d99c700 1 -- 172.21.15.32:0/1632064731 learned_addr learned my addr 172.21.15.32:0/1632064731 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:37.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.513+0000 7f124c99a700 1 --2- 172.21.15.32:0/1632064731 >> v2:172.21.15.115:3300/0 conn(0x7f12480d3730 0x7f12480cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:37.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.513+0000 7f124d99c700 1 -- 172.21.15.32:0/1632064731 >> v2:172.21.15.115:3300/0 conn(0x7f12480d3730 msgr2=0x7f12480cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:37.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.513+0000 7f124d99c700 1 --2- 172.21.15.32:0/1632064731 >> v2:172.21.15.115:3300/0 conn(0x7f12480d3730 0x7f12480cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:37.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.513+0000 7f124d99c700 1 -- 172.21.15.32:0/1632064731 >> v1:172.21.15.32:6789/0 conn(0x7f12480b8430 legacy=0x7f12480cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:37.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.513+0000 7f123ffff700 1 -- 172.21.15.32:0/1632064731 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843257275 0 0) 0x7f12480d0b20 con 0x7f12480b8430 2023-06-20T13:32:37.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.513+0000 7f124d99c700 1 -- 172.21.15.32:0/1632064731 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12480cfe90 con 0x7f12480cfa90 2023-06-20T13:32:37.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.513+0000 7f124c99a700 1 --2- 172.21.15.32:0/1632064731 >> v2:172.21.15.115:3300/0 conn(0x7f12480d3730 0x7f12480cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:32:37.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.513+0000 7f124d99c700 1 --2- 172.21.15.32:0/1632064731 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12480cfa90 0x7f12480d0fb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1248160f50 tx=0x7f124000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=688c1050e4d7dde6 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:37.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.513+0000 7f123ffff700 1 -- 172.21.15.32:0/1632064731 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124000e070 con 0x7f12480cfa90 2023-06-20T13:32:37.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.513+0000 7f123ffff700 1 -- 172.21.15.32:0/1632064731 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124000b9c0 con 0x7f12480cfa90 2023-06-20T13:32:37.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.513+0000 7f123ffff700 1 -- 172.21.15.32:0/1632064731 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124000bd70 con 0x7f12480cfa90 2023-06-20T13:32:37.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.514+0000 7f124f3ff700 1 -- 172.21.15.32:0/1632064731 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12480cfa90 msgr2=0x7f12480d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:37.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.514+0000 7f124f3ff700 1 --2- 172.21.15.32:0/1632064731 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12480cfa90 0x7f12480d0fb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1248160f50 tx=0x7f124000b330 comp rx=0 tx=0).stop 2023-06-20T13:32:37.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.514+0000 7f124f3ff700 1 -- 172.21.15.32:0/1632064731 shutdown_connections 2023-06-20T13:32:37.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.514+0000 7f124f3ff700 1 --2- 172.21.15.32:0/1632064731 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12480cfa90 0x7f12480d0fb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:37.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.514+0000 7f124f3ff700 1 --2- 172.21.15.32:0/1632064731 >> v2:172.21.15.115:3300/0 conn(0x7f12480d3730 0x7f12480cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:37.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.514+0000 7f124f3ff700 1 -- 172.21.15.32:0/1632064731 >> 172.21.15.32:0/1632064731 conn(0x7f124806b3f0 msgr2=0x7f124806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:37.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.514+0000 7f124f3ff700 1 -- 172.21.15.32:0/1632064731 shutdown_connections 2023-06-20T13:32:37.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.514+0000 7f124f3ff700 1 -- 172.21.15.32:0/1632064731 wait complete. 2023-06-20T13:32:37.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.516+0000 7f124f3ff700 1 Processor -- start 2023-06-20T13:32:37.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.516+0000 7f124f3ff700 1 -- start start 2023-06-20T13:32:37.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.517+0000 7f124f3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12480b8430 0x7f124815d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:37.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.517+0000 7f124f3ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12480cfa90 0x7f1248159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:37.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.517+0000 7f124f3ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12480d3730 0x7f12481f1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:37.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.517+0000 7f124f3ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1248154b60 con 0x7f12480cfa90 2023-06-20T13:32:37.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.517+0000 7f124f3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1248155400 con 0x7f12480b8430 2023-06-20T13:32:37.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.517+0000 7f124f3ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1248159bb0 con 0x7f12480d3730 2023-06-20T13:32:37.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.517+0000 7f124d99c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12480d3730 0x7f12481f1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:37.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.517+0000 7f124d19b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12480b8430 0x7f124815d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:37.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.517+0000 7f124c99a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12480cfa90 0x7f1248159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:37.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.517+0000 7f124d99c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12480d3730 0x7f12481f1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.32:53560/0 (socket says 172.21.15.32:53560) 2023-06-20T13:32:37.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.517+0000 7f124d99c700 1 -- 172.21.15.32:0/2908448808 learned_addr learned my addr 172.21.15.32:0/2908448808 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:37.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.517+0000 7f124d19b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12480b8430 0x7f124815d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:50540/0 (socket says 172.21.15.32:50540) 2023-06-20T13:32:37.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.518+0000 7f124c99a700 1 -- 172.21.15.32:0/2908448808 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12480d3730 msgr2=0x7f12481f1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:37.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.518+0000 7f124c99a700 1 --2- 172.21.15.32:0/2908448808 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12480d3730 0x7f12481f1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:37.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.518+0000 7f124c99a700 1 -- 172.21.15.32:0/2908448808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12480b8430 msgr2=0x7f124815d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:37.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.518+0000 7f124c99a700 1 --2- 172.21.15.32:0/2908448808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12480b8430 0x7f124815d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:37.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.518+0000 7f124c99a700 1 -- 172.21.15.32:0/2908448808 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1240009b30 con 0x7f12480cfa90 2023-06-20T13:32:37.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.518+0000 7f124c99a700 1 --2- 172.21.15.32:0/2908448808 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12480cfa90 0x7f1248159130 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f123800c7f0 tx=0x7f123800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:37.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.518+0000 7f123dffb700 1 -- 172.21.15.32:0/2908448808 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1238011800 con 0x7f12480cfa90 2023-06-20T13:32:37.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.518+0000 7f123dffb700 1 -- 172.21.15.32:0/2908448808 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1238011960 con 0x7f12480cfa90 2023-06-20T13:32:37.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.518+0000 7f124f3ff700 1 -- 172.21.15.32:0/2908448808 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1248154db0 con 0x7f12480cfa90 2023-06-20T13:32:37.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.518+0000 7f123dffb700 1 -- 172.21.15.32:0/2908448808 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1238011cf0 con 0x7f12480cfa90 2023-06-20T13:32:37.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.519+0000 7f124f3ff700 1 -- 172.21.15.32:0/2908448808 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1248157cf0 con 0x7f12480cfa90 2023-06-20T13:32:37.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.519+0000 7f124f3ff700 1 -- 172.21.15.32:0/2908448808 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f124804ea60 con 0x7f12480cfa90 2023-06-20T13:32:37.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.520+0000 7f123dffb700 1 -- 172.21.15.32:0/2908448808 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1238018360 con 0x7f12480cfa90 2023-06-20T13:32:37.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.522+0000 7f123dffb700 1 --2- 172.21.15.32:0/2908448808 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f122c06ace0 0x7f122c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:37.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.522+0000 7f123dffb700 1 -- 172.21.15.32:0/2908448808 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1238089590 con 0x7f12480cfa90 2023-06-20T13:32:37.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.522+0000 7f124d19b700 1 --2- 172.21.15.32:0/2908448808 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f122c06ace0 0x7f122c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:37.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.523+0000 7f124d19b700 1 --2- 172.21.15.32:0/2908448808 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f122c06ace0 0x7f122c06d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1244007fd0 tx=0x7f1244009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:37.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.527+0000 7f123dffb700 1 -- 172.21.15.32:0/2908448808 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f12380542c0 con 0x7f12480cfa90 2023-06-20T13:32:37.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.730+0000 7f124f3ff700 1 -- 172.21.15.32:0/2908448808 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1248155540 con 0x7f12480cfa90 2023-06-20T13:32:37.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.731+0000 7f123dffb700 1 -- 172.21.15.32:0/2908448808 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f12380578e0 con 0x7f12480cfa90 2023-06-20T13:32:37.733 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 8 2023-06-20T13:32:37.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.733+0000 7f124f3ff700 1 -- 172.21.15.32:0/2908448808 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f122c06ace0 msgr2=0x7f122c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:37.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.733+0000 7f124f3ff700 1 --2- 172.21.15.32:0/2908448808 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f122c06ace0 0x7f122c06d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1244007fd0 tx=0x7f1244009040 comp rx=0 tx=0).stop 2023-06-20T13:32:37.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.733+0000 7f124f3ff700 1 -- 172.21.15.32:0/2908448808 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12480cfa90 msgr2=0x7f1248159130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:37.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.733+0000 7f124f3ff700 1 --2- 172.21.15.32:0/2908448808 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12480cfa90 0x7f1248159130 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f123800c7f0 tx=0x7f123800cb00 comp rx=0 tx=0).stop 2023-06-20T13:32:37.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.733+0000 7f124f3ff700 1 -- 172.21.15.32:0/2908448808 shutdown_connections 2023-06-20T13:32:37.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.733+0000 7f124f3ff700 1 --2- 172.21.15.32:0/2908448808 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f122c06ace0 0x7f122c06d190 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:37.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.733+0000 7f124f3ff700 1 --2- 172.21.15.32:0/2908448808 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12480d3730 0x7f12481f1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:37.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.733+0000 7f124f3ff700 1 --2- 172.21.15.32:0/2908448808 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12480b8430 0x7f124815d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:37.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.733+0000 7f124f3ff700 1 --2- 172.21.15.32:0/2908448808 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12480cfa90 0x7f1248159130 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:37.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.733+0000 7f124f3ff700 1 -- 172.21.15.32:0/2908448808 >> 172.21.15.32:0/2908448808 conn(0x7f124806b3f0 msgr2=0x7f124815a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:37.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.733+0000 7f124f3ff700 1 -- 172.21.15.32:0/2908448808 shutdown_connections 2023-06-20T13:32:37.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.733+0000 7f124f3ff700 1 -- 172.21.15.32:0/2908448808 wait complete. 2023-06-20T13:32:37.753 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-20T13:32:37.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.954+0000 7f1c737ff700 1 Processor -- start 2023-06-20T13:32:37.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.954+0000 7f1c737ff700 1 -- start start 2023-06-20T13:32:37.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.955+0000 7f1c737ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1c6c0b8430 0x7f1c6c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:37.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.955+0000 7f1c737ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c6c0d3730 0x7f1c6c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:37.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.955+0000 7f1c737ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6c0d0b20 con 0x7f1c6c0cfa90 2023-06-20T13:32:37.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.955+0000 7f1c737ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6c0b8800 con 0x7f1c6c0b8430 2023-06-20T13:32:37.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.955+0000 7f1c737ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0cfeb0 con 0x7f1c6c0d3730 2023-06-20T13:32:37.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.955+0000 7f1c7159b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1c6c0b8430 0x7f1c6c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:37.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.955+0000 7f1c7159b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1c6c0b8430 0x7f1c6c0cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57482/0 (socket says 172.21.15.32:57482) 2023-06-20T13:32:37.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.956+0000 7f1c7159b700 1 -- 172.21.15.32:0/3989240034 learned_addr learned my addr 172.21.15.32:0/3989240034 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:37.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.956+0000 7f1c70d9a700 1 --2- 172.21.15.32:0/3989240034 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c6c0d3730 0x7f1c6c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:37.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.956+0000 7f1c7159b700 1 -- 172.21.15.32:0/3989240034 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c6c0d3730 msgr2=0x7f1c6c0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:37.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.956+0000 7f1c7159b700 1 --2- 172.21.15.32:0/3989240034 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c6c0d3730 0x7f1c6c0cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:37.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.956+0000 7f1c7159b700 1 -- 172.21.15.32:0/3989240034 >> v1:172.21.15.115:6789/0 conn(0x7f1c6c0cfa90 legacy=0x7f1c6c15feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:37.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.956+0000 7f1c7159b700 1 -- 172.21.15.32:0/3989240034 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6c0b4ee0 con 0x7f1c6c0b8430 2023-06-20T13:32:37.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.956+0000 7f1c7159b700 1 --2- 172.21.15.32:0/3989240034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c6c0b8430 0x7f1c6c0cd320 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1c680098f0 tx=0x7f1c68009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bdf1bb779aeb0d9 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:37.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.956+0000 7f1c63fff700 1 -- 172.21.15.32:0/3989240034 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6800b8a0 con 0x7f1c6c0b8430 2023-06-20T13:32:37.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.956+0000 7f1c63fff700 1 -- 172.21.15.32:0/3989240034 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6800ba00 con 0x7f1c6c0b8430 2023-06-20T13:32:37.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.956+0000 7f1c63fff700 1 -- 172.21.15.32:0/3989240034 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6800bd90 con 0x7f1c6c0b8430 2023-06-20T13:32:37.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.957+0000 7f1c737ff700 1 -- 172.21.15.32:0/3989240034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c6c0b8430 msgr2=0x7f1c6c0cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:37.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.957+0000 7f1c737ff700 1 --2- 172.21.15.32:0/3989240034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c6c0b8430 0x7f1c6c0cd320 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1c680098f0 tx=0x7f1c68009c00 comp rx=0 tx=0).stop 2023-06-20T13:32:37.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.957+0000 7f1c737ff700 1 -- 172.21.15.32:0/3989240034 shutdown_connections 2023-06-20T13:32:37.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.957+0000 7f1c737ff700 1 --2- 172.21.15.32:0/3989240034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c6c0b8430 0x7f1c6c0cd320 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:37.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.957+0000 7f1c737ff700 1 --2- 172.21.15.32:0/3989240034 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c6c0d3730 0x7f1c6c0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:37.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.957+0000 7f1c737ff700 1 -- 172.21.15.32:0/3989240034 >> 172.21.15.32:0/3989240034 conn(0x7f1c6c06b3f0 msgr2=0x7f1c6c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:37.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.957+0000 7f1c737ff700 1 -- 172.21.15.32:0/3989240034 shutdown_connections 2023-06-20T13:32:37.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.957+0000 7f1c737ff700 1 -- 172.21.15.32:0/3989240034 wait complete. 2023-06-20T13:32:37.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.959+0000 7f1c737ff700 1 Processor -- start 2023-06-20T13:32:37.964 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.959+0000 7f1c737ff700 1 -- start start 2023-06-20T13:32:37.964 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.960+0000 7f1c737ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c6c0b8430 0x7f1c6c1f1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:37.964 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.960+0000 7f1c737ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c6c0cfa90 0x7f1c6c0b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:37.964 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.960+0000 7f1c737ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c6c0d3730 0x7f1c6c0c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:37.964 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.960+0000 7f1c737ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0b49c0 con 0x7f1c6c0cfa90 2023-06-20T13:32:37.964 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.960+0000 7f1c737ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0cabe0 con 0x7f1c6c0b8430 2023-06-20T13:32:37.964 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.960+0000 7f1c737ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0c9fd0 con 0x7f1c6c0d3730 2023-06-20T13:32:37.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.960+0000 7f1c70d9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c6c0cfa90 0x7f1c6c0b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:37.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.960+0000 7f1c70d9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c6c0cfa90 0x7f1c6c0b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57484/0 (socket says 172.21.15.32:57484) 2023-06-20T13:32:37.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.960+0000 7f1c70d9a700 1 -- 172.21.15.32:0/1916063857 learned_addr learned my addr 172.21.15.32:0/1916063857 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:37.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.960+0000 7f1c71d9c700 1 --2- 172.21.15.32:0/1916063857 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c6c0d3730 0x7f1c6c0c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:37.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.960+0000 7f1c7159b700 1 --2- 172.21.15.32:0/1916063857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c6c0b8430 0x7f1c6c1f1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:37.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.961+0000 7f1c70d9a700 1 -- 172.21.15.32:0/1916063857 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c6c0d3730 msgr2=0x7f1c6c0c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:37.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.961+0000 7f1c70d9a700 1 --2- 172.21.15.32:0/1916063857 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c6c0d3730 0x7f1c6c0c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:37.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.961+0000 7f1c70d9a700 1 -- 172.21.15.32:0/1916063857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c6c0b8430 msgr2=0x7f1c6c1f1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:37.966 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.961+0000 7f1c70d9a700 1 --2- 172.21.15.32:0/1916063857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c6c0b8430 0x7f1c6c1f1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:37.966 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.961+0000 7f1c70d9a700 1 -- 172.21.15.32:0/1916063857 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c68009550 con 0x7f1c6c0cfa90 2023-06-20T13:32:37.966 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.961+0000 7f1c70d9a700 1 --2- 172.21.15.32:0/1916063857 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c6c0cfa90 0x7f1c6c0b4480 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00e840 tx=0x7f1c5c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:37.966 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.961+0000 7f1c61ffb700 1 -- 172.21.15.32:0/1916063857 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c013610 con 0x7f1c6c0cfa90 2023-06-20T13:32:37.966 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.961+0000 7f1c61ffb700 1 -- 172.21.15.32:0/1916063857 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5c013770 con 0x7f1c6c0cfa90 2023-06-20T13:32:37.966 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.961+0000 7f1c61ffb700 1 -- 172.21.15.32:0/1916063857 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c013b20 con 0x7f1c6c0cfa90 2023-06-20T13:32:37.966 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.961+0000 7f1c737ff700 1 -- 172.21.15.32:0/1916063857 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c6c0ca2b0 con 0x7f1c6c0cfa90 2023-06-20T13:32:37.967 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.961+0000 7f1c737ff700 1 -- 172.21.15.32:0/1916063857 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c6c0ca870 con 0x7f1c6c0cfa90 2023-06-20T13:32:37.967 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.962+0000 7f1c737ff700 1 -- 172.21.15.32:0/1916063857 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c6c04ea60 con 0x7f1c6c0cfa90 2023-06-20T13:32:37.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.963+0000 7f1c61ffb700 1 -- 172.21.15.32:0/1916063857 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1c5c013c80 con 0x7f1c6c0cfa90 2023-06-20T13:32:37.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.964+0000 7f1c61ffb700 1 --2- 172.21.15.32:0/1916063857 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1c5006ace0 0x7f1c5006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:37.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.964+0000 7f1c61ffb700 1 -- 172.21.15.32:0/1916063857 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1c5c089400 con 0x7f1c6c0cfa90 2023-06-20T13:32:37.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.964+0000 7f1c7159b700 1 --2- 172.21.15.32:0/1916063857 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1c5006ace0 0x7f1c5006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:37.968 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.965+0000 7f1c7159b700 1 --2- 172.21.15.32:0/1916063857 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1c5006ace0 0x7f1c5006d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1c68014040 tx=0x7f1c68008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:37.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:37.968+0000 7f1c61ffb700 1 -- 172.21.15.32:0/1916063857 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1c5c057bc0 con 0x7f1c6c0cfa90 2023-06-20T13:32:38.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.178+0000 7f1c737ff700 1 -- 172.21.15.32:0/1916063857 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1c6c15b250 con 0x7f1c6c0cfa90 2023-06-20T13:32:38.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.178+0000 7f1c61ffb700 1 -- 172.21.15.32:0/1916063857 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1c5c057750 con 0x7f1c6c0cfa90 2023-06-20T13:32:38.181 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-06-20T13:32:38.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.181+0000 7f1c737ff700 1 -- 172.21.15.32:0/1916063857 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1c5006ace0 msgr2=0x7f1c5006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:38.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.181+0000 7f1c737ff700 1 --2- 172.21.15.32:0/1916063857 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1c5006ace0 0x7f1c5006d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1c68014040 tx=0x7f1c68008030 comp rx=0 tx=0).stop 2023-06-20T13:32:38.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.181+0000 7f1c737ff700 1 -- 172.21.15.32:0/1916063857 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c6c0cfa90 msgr2=0x7f1c6c0b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:38.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.181+0000 7f1c737ff700 1 --2- 172.21.15.32:0/1916063857 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c6c0cfa90 0x7f1c6c0b4480 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00e840 tx=0x7f1c5c00eb50 comp rx=0 tx=0).stop 2023-06-20T13:32:38.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.181+0000 7f1c737ff700 1 -- 172.21.15.32:0/1916063857 shutdown_connections 2023-06-20T13:32:38.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.181+0000 7f1c737ff700 1 --2- 172.21.15.32:0/1916063857 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1c5006ace0 0x7f1c5006d190 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:38.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.181+0000 7f1c737ff700 1 --2- 172.21.15.32:0/1916063857 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1c6c0d3730 0x7f1c6c0c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:38.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.181+0000 7f1c737ff700 1 --2- 172.21.15.32:0/1916063857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1c6c0b8430 0x7f1c6c1f1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:38.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.181+0000 7f1c737ff700 1 --2- 172.21.15.32:0/1916063857 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1c6c0cfa90 0x7f1c6c0b4480 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:38.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.181+0000 7f1c737ff700 1 -- 172.21.15.32:0/1916063857 >> 172.21.15.32:0/1916063857 conn(0x7f1c6c06b3f0 msgr2=0x7f1c6c0b61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:38.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.181+0000 7f1c737ff700 1 -- 172.21.15.32:0/1916063857 shutdown_connections 2023-06-20T13:32:38.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.181+0000 7f1c737ff700 1 -- 172.21.15.32:0/1916063857 wait complete. 2023-06-20T13:32:38.185 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:32:38.189 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:32:38.203 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-20T13:32:38.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.444+0000 7fd9529ff700 1 Processor -- start 2023-06-20T13:32:38.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.444+0000 7fd9529ff700 1 -- start start 2023-06-20T13:32:38.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.446+0000 7fd9529ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd94c0d3730 0x7fd94c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:38.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.446+0000 7fd9529ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd94c0d0b20 con 0x7fd94c0b8430 2023-06-20T13:32:38.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.446+0000 7fd9529ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd94c0cfe90 con 0x7fd94c0cfa90 2023-06-20T13:32:38.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.446+0000 7fd9529ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd94c0cda30 con 0x7fd94c0d3730 2023-06-20T13:32:38.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.446+0000 7fd94bfff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd94c0b8430 0x7fd94c0cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:48790/0 (socket says 172.21.15.32:48790) 2023-06-20T13:32:38.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.446+0000 7fd94bfff700 1 -- 172.21.15.32:0/1058165150 learned_addr learned my addr 172.21.15.32:0/1058165150 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:38.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.447+0000 7fd94b7fe700 1 --2- 172.21.15.32:0/1058165150 >> v2:172.21.15.115:3300/0 conn(0x7fd94c0d3730 0x7fd94c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:38.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.447+0000 7fd94affd700 1 -- 172.21.15.32:0/1058165150 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810640224 0 0) 0x7fd94c0d0b20 con 0x7fd94c0b8430 2023-06-20T13:32:38.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.447+0000 7fd94affd700 1 -- 172.21.15.32:0/1058165150 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9340035b0 con 0x7fd94c0b8430 2023-06-20T13:32:38.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.447+0000 7fd94affd700 1 -- 172.21.15.32:0/1058165150 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2143035618 0 0) 0x7fd94c0cfe90 con 0x7fd94c0cfa90 2023-06-20T13:32:38.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.447+0000 7fd94affd700 1 -- 172.21.15.32:0/1058165150 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd94c0d0b20 con 0x7fd94c0cfa90 2023-06-20T13:32:38.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.447+0000 7fd94b7fe700 1 -- 172.21.15.32:0/1058165150 >> v1:172.21.15.115:6789/0 conn(0x7fd94c0cfa90 legacy=0x7fd94c0d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:38.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.447+0000 7fd94affd700 1 -- 172.21.15.32:0/1058165150 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2848025170 0 0) 0x7fd9340035b0 con 0x7fd94c0b8430 2023-06-20T13:32:38.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.447+0000 7fd94b7fe700 1 -- 172.21.15.32:0/1058165150 >> v1:172.21.15.32:6789/0 conn(0x7fd94c0b8430 legacy=0x7fd94c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:38.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.447+0000 7fd94b7fe700 1 -- 172.21.15.32:0/1058165150 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94c0b4ee0 con 0x7fd94c0d3730 2023-06-20T13:32:38.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.448+0000 7fd94b7fe700 1 --2- 172.21.15.32:0/1058165150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd94c0d3730 0x7fd94c0cf550 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd940009840 tx=0x7fd940009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a1069eb6ef48a26 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:38.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.448+0000 7fd94affd700 1 -- 172.21.15.32:0/1058165150 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c001670 con 0x7fd94c0d3730 2023-06-20T13:32:38.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.448+0000 7fd94affd700 1 -- 172.21.15.32:0/1058165150 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd940004030 con 0x7fd94c0d3730 2023-06-20T13:32:38.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.448+0000 7fd94affd700 1 -- 172.21.15.32:0/1058165150 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9400043c0 con 0x7fd94c0d3730 2023-06-20T13:32:38.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.448+0000 7fd9529ff700 1 -- 172.21.15.32:0/1058165150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd94c0d3730 msgr2=0x7fd94c0cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:38.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.448+0000 7fd9529ff700 1 --2- 172.21.15.32:0/1058165150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd94c0d3730 0x7fd94c0cf550 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd940009840 tx=0x7fd940009b50 comp rx=0 tx=0).stop 2023-06-20T13:32:38.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.448+0000 7fd9529ff700 1 -- 172.21.15.32:0/1058165150 shutdown_connections 2023-06-20T13:32:38.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.448+0000 7fd9529ff700 1 --2- 172.21.15.32:0/1058165150 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd94c0d3730 0x7fd94c0cf550 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:38.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.448+0000 7fd9529ff700 1 -- 172.21.15.32:0/1058165150 >> 172.21.15.32:0/1058165150 conn(0x7fd94c06b3f0 msgr2=0x7fd94c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:38.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.448+0000 7fd9529ff700 1 -- 172.21.15.32:0/1058165150 shutdown_connections 2023-06-20T13:32:38.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.448+0000 7fd9529ff700 1 -- 172.21.15.32:0/1058165150 wait complete. 2023-06-20T13:32:38.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.450+0000 7fd9529ff700 1 Processor -- start 2023-06-20T13:32:38.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.450+0000 7fd9529ff700 1 -- start start 2023-06-20T13:32:38.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.451+0000 7fd9529ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd94c0b8430 0x7fd94c14cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:38.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.451+0000 7fd9529ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd94c0cfa90 0x7fd94c15f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:38.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.451+0000 7fd9529ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd94c0d3730 0x7fd94c0c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:38.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.451+0000 7fd9529ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c14e6d0 con 0x7fd94c0b8430 2023-06-20T13:32:38.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.451+0000 7fd9529ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c14da50 con 0x7fd94c0d3730 2023-06-20T13:32:38.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.451+0000 7fd9529ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c14dd30 con 0x7fd94c0cfa90 2023-06-20T13:32:38.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.452+0000 7fd94bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd94c0b8430 0x7fd94c14cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:38.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.452+0000 7fd94bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd94c0b8430 0x7fd94c14cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57494/0 (socket says 172.21.15.32:57494) 2023-06-20T13:32:38.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.452+0000 7fd94bfff700 1 -- 172.21.15.32:0/3209908734 learned_addr learned my addr 172.21.15.32:0/3209908734 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:38.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.452+0000 7fd94b7fe700 1 --2- 172.21.15.32:0/3209908734 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd94c0cfa90 0x7fd94c15f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:38.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.452+0000 7fd950f9c700 1 --2- 172.21.15.32:0/3209908734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd94c0d3730 0x7fd94c0c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:38.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.452+0000 7fd94bfff700 1 -- 172.21.15.32:0/3209908734 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd94c0cfa90 msgr2=0x7fd94c15f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:38.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.452+0000 7fd94bfff700 1 --2- 172.21.15.32:0/3209908734 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd94c0cfa90 0x7fd94c15f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:38.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.452+0000 7fd94bfff700 1 -- 172.21.15.32:0/3209908734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd94c0d3730 msgr2=0x7fd94c0c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:38.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.452+0000 7fd94bfff700 1 --2- 172.21.15.32:0/3209908734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd94c0d3730 0x7fd94c0c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:38.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.452+0000 7fd94bfff700 1 -- 172.21.15.32:0/3209908734 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9400094a0 con 0x7fd94c0b8430 2023-06-20T13:32:38.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.452+0000 7fd950f9c700 1 --2- 172.21.15.32:0/3209908734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd94c0d3730 0x7fd94c0c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:32:38.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.452+0000 7fd94bfff700 1 --2- 172.21.15.32:0/3209908734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd94c0b8430 0x7fd94c14cef0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd93c00c750 tx=0x7fd93c00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:38.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.453+0000 7fd948ff9700 1 -- 172.21.15.32:0/3209908734 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c004c80 con 0x7fd94c0b8430 2023-06-20T13:32:38.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.453+0000 7fd948ff9700 1 -- 172.21.15.32:0/3209908734 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93c004de0 con 0x7fd94c0b8430 2023-06-20T13:32:38.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.453+0000 7fd948ff9700 1 -- 172.21.15.32:0/3209908734 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c0072d0 con 0x7fd94c0b8430 2023-06-20T13:32:38.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.453+0000 7fd9529ff700 1 -- 172.21.15.32:0/3209908734 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd94c14e010 con 0x7fd94c0b8430 2023-06-20T13:32:38.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.453+0000 7fd9529ff700 1 -- 172.21.15.32:0/3209908734 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd94c14d430 con 0x7fd94c0b8430 2023-06-20T13:32:38.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.454+0000 7fd9529ff700 1 -- 172.21.15.32:0/3209908734 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd94c04ea60 con 0x7fd94c0b8430 2023-06-20T13:32:38.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.455+0000 7fd948ff9700 1 -- 172.21.15.32:0/3209908734 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd93c007430 con 0x7fd94c0b8430 2023-06-20T13:32:38.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.456+0000 7fd948ff9700 1 --2- 172.21.15.32:0/3209908734 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd93806ace0 0x7fd93806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:38.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.456+0000 7fd948ff9700 1 -- 172.21.15.32:0/3209908734 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd93c089560 con 0x7fd94c0b8430 2023-06-20T13:32:38.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.456+0000 7fd94b7fe700 1 --2- 172.21.15.32:0/3209908734 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd93806ace0 0x7fd93806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:38.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.456+0000 7fd94b7fe700 1 --2- 172.21.15.32:0/3209908734 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd93806ace0 0x7fd93806d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd9400090b0 tx=0x7fd940008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:38.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.460+0000 7fd948ff9700 1 -- 172.21.15.32:0/3209908734 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd93c054310 con 0x7fd94c0b8430 2023-06-20T13:32:38.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.663+0000 7fd9529ff700 1 -- 172.21.15.32:0/3209908734 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd94c0d1ad0 con 0x7fd94c0b8430 2023-06-20T13:32:38.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.663+0000 7fd948ff9700 1 -- 172.21.15.32:0/3209908734 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd93c057930 con 0x7fd94c0b8430 2023-06-20T13:32:38.666 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-06-20T13:32:38.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.665+0000 7fd9529ff700 1 -- 172.21.15.32:0/3209908734 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd93806ace0 msgr2=0x7fd93806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:38.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.665+0000 7fd9529ff700 1 --2- 172.21.15.32:0/3209908734 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd93806ace0 0x7fd93806d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd9400090b0 tx=0x7fd940008030 comp rx=0 tx=0).stop 2023-06-20T13:32:38.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.665+0000 7fd9529ff700 1 -- 172.21.15.32:0/3209908734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd94c0b8430 msgr2=0x7fd94c14cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:38.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.665+0000 7fd9529ff700 1 --2- 172.21.15.32:0/3209908734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd94c0b8430 0x7fd94c14cef0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd93c00c750 tx=0x7fd93c00ca60 comp rx=0 tx=0).stop 2023-06-20T13:32:38.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.665+0000 7fd9529ff700 1 -- 172.21.15.32:0/3209908734 shutdown_connections 2023-06-20T13:32:38.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.665+0000 7fd9529ff700 1 --2- 172.21.15.32:0/3209908734 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd93806ace0 0x7fd93806d190 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:38.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.666+0000 7fd9529ff700 1 --2- 172.21.15.32:0/3209908734 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd94c0d3730 0x7fd94c0c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:38.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.666+0000 7fd9529ff700 1 --2- 172.21.15.32:0/3209908734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd94c0b8430 0x7fd94c14cef0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:38.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.666+0000 7fd9529ff700 1 --2- 172.21.15.32:0/3209908734 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd94c0cfa90 0x7fd94c15f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:38.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.666+0000 7fd9529ff700 1 -- 172.21.15.32:0/3209908734 >> 172.21.15.32:0/3209908734 conn(0x7fd94c06b3f0 msgr2=0x7fd94c06b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:38.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.666+0000 7fd9529ff700 1 -- 172.21.15.32:0/3209908734 shutdown_connections 2023-06-20T13:32:38.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.666+0000 7fd9529ff700 1 -- 172.21.15.32:0/3209908734 wait complete. 2023-06-20T13:32:38.685 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-20T13:32:38.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.888+0000 7f45fafff700 1 Processor -- start 2023-06-20T13:32:38.891 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.888+0000 7f45fafff700 1 -- start start 2023-06-20T13:32:38.892 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.889+0000 7f45fafff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45f40b8430 0x7f45f40cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:38.892 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.889+0000 7f45fafff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f45f40cfc60 0x7f45f40d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:38.892 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.889+0000 7f45fafff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f40d0b20 con 0x7f45f40d3730 2023-06-20T13:32:38.892 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.889+0000 7f45fafff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f40b8800 con 0x7f45f40cfc60 2023-06-20T13:32:38.892 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.889+0000 7f45fafff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f40b4ee0 con 0x7f45f40b8430 2023-06-20T13:32:38.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.890+0000 7f45f959c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f45f40cfc60 0x7f45f40d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:38.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.890+0000 7f45f959c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f45f40cfc60 0x7f45f40d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57508/0 (socket says 172.21.15.32:57508) 2023-06-20T13:32:38.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.890+0000 7f45f959c700 1 -- 172.21.15.32:0/733356727 learned_addr learned my addr 172.21.15.32:0/733356727 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:38.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.890+0000 7f45f8d9b700 1 --2- 172.21.15.32:0/733356727 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45f40b8430 0x7f45f40cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:38.894 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.890+0000 7f45f959c700 1 -- 172.21.15.32:0/733356727 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45f40b8430 msgr2=0x7f45f40cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:38.894 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.890+0000 7f45f959c700 1 --2- 172.21.15.32:0/733356727 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45f40b8430 0x7f45f40cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:38.894 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.890+0000 7f45f959c700 1 -- 172.21.15.32:0/733356727 >> v1:172.21.15.115:6789/0 conn(0x7f45f40d3730 legacy=0x7f45f40cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:38.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.890+0000 7f45f959c700 1 -- 172.21.15.32:0/733356727 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f40b51c0 con 0x7f45f40cfc60 2023-06-20T13:32:38.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.890+0000 7f45f959c700 1 --2- 172.21.15.32:0/733356727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45f40cfc60 0x7f45f40d0fb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009e50 tx=0x7f45ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7bb4df9354bee6 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:38.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.891+0000 7f45f37fe700 1 -- 172.21.15.32:0/733356727 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec00e070 con 0x7f45f40cfc60 2023-06-20T13:32:38.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.891+0000 7f45f37fe700 1 -- 172.21.15.32:0/733356727 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ec00b910 con 0x7f45f40cfc60 2023-06-20T13:32:38.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.891+0000 7f45f37fe700 1 -- 172.21.15.32:0/733356727 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec00bcc0 con 0x7f45f40cfc60 2023-06-20T13:32:38.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.891+0000 7f45fafff700 1 -- 172.21.15.32:0/733356727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45f40cfc60 msgr2=0x7f45f40d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:38.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.891+0000 7f45fafff700 1 --2- 172.21.15.32:0/733356727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45f40cfc60 0x7f45f40d0fb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f45ec009e50 tx=0x7f45ec00b330 comp rx=0 tx=0).stop 2023-06-20T13:32:38.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.891+0000 7f45fafff700 1 -- 172.21.15.32:0/733356727 shutdown_connections 2023-06-20T13:32:38.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.891+0000 7f45fafff700 1 --2- 172.21.15.32:0/733356727 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45f40cfc60 0x7f45f40d0fb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:38.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.891+0000 7f45fafff700 1 --2- 172.21.15.32:0/733356727 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45f40b8430 0x7f45f40cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:38.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.891+0000 7f45fafff700 1 -- 172.21.15.32:0/733356727 >> 172.21.15.32:0/733356727 conn(0x7f45f406b3f0 msgr2=0x7f45f406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:38.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.891+0000 7f45fafff700 1 -- 172.21.15.32:0/733356727 shutdown_connections 2023-06-20T13:32:38.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.891+0000 7f45fafff700 1 -- 172.21.15.32:0/733356727 wait complete. 2023-06-20T13:32:38.898 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.893+0000 7f45fafff700 1 Processor -- start 2023-06-20T13:32:38.898 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.893+0000 7f45fafff700 1 -- start start 2023-06-20T13:32:38.898 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.894+0000 7f45fafff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45f40b8430 0x7f45f41573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:38.898 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.894+0000 7f45fafff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45f40cfc60 0x7f45f415d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:38.898 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.894+0000 7f45fafff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45f40d3730 0x7f45f415f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:38.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.894+0000 7f45fafff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f415dc90 con 0x7f45f40d3730 2023-06-20T13:32:38.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.894+0000 7f45fafff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f40c7860 con 0x7f45f40b8430 2023-06-20T13:32:38.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.894+0000 7f45fafff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f40c7b40 con 0x7f45f40cfc60 2023-06-20T13:32:38.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.895+0000 7f45f959c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45f40d3730 0x7f45f415f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:38.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.895+0000 7f45f959c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45f40d3730 0x7f45f415f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57512/0 (socket says 172.21.15.32:57512) 2023-06-20T13:32:38.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.895+0000 7f45f959c700 1 -- 172.21.15.32:0/1453999931 learned_addr learned my addr 172.21.15.32:0/1453999931 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:38.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.895+0000 7f45f8d9b700 1 --2- 172.21.15.32:0/1453999931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45f40b8430 0x7f45f41573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:38.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.895+0000 7f45f3fff700 1 --2- 172.21.15.32:0/1453999931 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45f40cfc60 0x7f45f415d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:38.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.895+0000 7f45f959c700 1 -- 172.21.15.32:0/1453999931 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45f40cfc60 msgr2=0x7f45f415d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:38.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.895+0000 7f45f959c700 1 --2- 172.21.15.32:0/1453999931 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45f40cfc60 0x7f45f415d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:38.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.895+0000 7f45f959c700 1 -- 172.21.15.32:0/1453999931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45f40b8430 msgr2=0x7f45f41573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:38.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.895+0000 7f45f959c700 1 --2- 172.21.15.32:0/1453999931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45f40b8430 0x7f45f41573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:38.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.895+0000 7f45f959c700 1 -- 172.21.15.32:0/1453999931 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ec009b30 con 0x7f45f40d3730 2023-06-20T13:32:38.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.895+0000 7f45f8d9b700 1 --2- 172.21.15.32:0/1453999931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45f40b8430 0x7f45f41573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:32:38.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.895+0000 7f45f959c700 1 --2- 172.21.15.32:0/1453999931 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45f40d3730 0x7f45f415f190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f45f406c780 tx=0x7f45ec004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:38.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.896+0000 7f45f17fa700 1 -- 172.21.15.32:0/1453999931 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec003ea0 con 0x7f45f40d3730 2023-06-20T13:32:38.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.896+0000 7f45f17fa700 1 -- 172.21.15.32:0/1453999931 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ec0099b0 con 0x7f45f40d3730 2023-06-20T13:32:38.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.896+0000 7f45f17fa700 1 -- 172.21.15.32:0/1453999931 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec01c680 con 0x7f45f40d3730 2023-06-20T13:32:38.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.896+0000 7f45fafff700 1 -- 172.21.15.32:0/1453999931 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f40c7e20 con 0x7f45f40d3730 2023-06-20T13:32:38.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.896+0000 7f45fafff700 1 -- 172.21.15.32:0/1453999931 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f4157910 con 0x7f45f40d3730 2023-06-20T13:32:38.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.897+0000 7f45fafff700 1 -- 172.21.15.32:0/1453999931 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f404ea60 con 0x7f45f40d3730 2023-06-20T13:32:38.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.898+0000 7f45f17fa700 1 -- 172.21.15.32:0/1453999931 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f45ec01c7e0 con 0x7f45f40d3730 2023-06-20T13:32:38.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.900+0000 7f45f17fa700 1 --2- 172.21.15.32:0/1453999931 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f45d806ace0 0x7f45d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:38.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.900+0000 7f45f17fa700 1 -- 172.21.15.32:0/1453999931 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f45ec08b450 con 0x7f45f40d3730 2023-06-20T13:32:38.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.900+0000 7f45f8d9b700 1 --2- 172.21.15.32:0/1453999931 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f45d806ace0 0x7f45d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:38.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.901+0000 7f45f8d9b700 1 --2- 172.21.15.32:0/1453999931 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f45d806ace0 0x7f45d806d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f45e8009c30 tx=0x7f45e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:38.906 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:38.904+0000 7f45f17fa700 1 -- 172.21.15.32:0/1453999931 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f45ec056200 con 0x7f45f40d3730 2023-06-20T13:32:39.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.111+0000 7f45fafff700 1 -- 172.21.15.32:0/1453999931 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f45f40cf8a0 con 0x7f45f40d3730 2023-06-20T13:32:39.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.111+0000 7f45f17fa700 1 -- 172.21.15.32:0/1453999931 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f45ec059820 con 0x7f45f40d3730 2023-06-20T13:32:39.114 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-06-20T13:32:39.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.114+0000 7f45fafff700 1 -- 172.21.15.32:0/1453999931 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f45d806ace0 msgr2=0x7f45d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:39.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.114+0000 7f45fafff700 1 --2- 172.21.15.32:0/1453999931 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f45d806ace0 0x7f45d806d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f45e8009c30 tx=0x7f45e8008040 comp rx=0 tx=0).stop 2023-06-20T13:32:39.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.114+0000 7f45fafff700 1 -- 172.21.15.32:0/1453999931 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45f40d3730 msgr2=0x7f45f415f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:39.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.114+0000 7f45fafff700 1 --2- 172.21.15.32:0/1453999931 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45f40d3730 0x7f45f415f190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f45f406c780 tx=0x7f45ec004ad0 comp rx=0 tx=0).stop 2023-06-20T13:32:39.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.114+0000 7f45fafff700 1 -- 172.21.15.32:0/1453999931 shutdown_connections 2023-06-20T13:32:39.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.114+0000 7f45fafff700 1 --2- 172.21.15.32:0/1453999931 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f45d806ace0 0x7f45d806d190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:39.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.114+0000 7f45fafff700 1 --2- 172.21.15.32:0/1453999931 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f45f40d3730 0x7f45f415f190 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:39.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.114+0000 7f45fafff700 1 --2- 172.21.15.32:0/1453999931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45f40b8430 0x7f45f41573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:39.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.114+0000 7f45fafff700 1 --2- 172.21.15.32:0/1453999931 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45f40cfc60 0x7f45f415d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:39.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.114+0000 7f45fafff700 1 -- 172.21.15.32:0/1453999931 >> 172.21.15.32:0/1453999931 conn(0x7f45f406b3f0 msgr2=0x7f45f40cdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:39.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.114+0000 7f45fafff700 1 -- 172.21.15.32:0/1453999931 shutdown_connections 2023-06-20T13:32:39.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.114+0000 7f45fafff700 1 -- 172.21.15.32:0/1453999931 wait complete. 2023-06-20T13:32:39.134 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-20T13:32:39.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.334+0000 7f6f619ff700 1 Processor -- start 2023-06-20T13:32:39.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.334+0000 7f6f619ff700 1 -- start start 2023-06-20T13:32:39.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.336+0000 7f6f619ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6f5c0d2640 0x7f6f5c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:39.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.336+0000 7f6f619ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f5c0cf8f0 0x7f6f5c15fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:39.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.336+0000 7f6f619ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5c0d1790 con 0x7f6f5c15c460 2023-06-20T13:32:39.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.336+0000 7f6f619ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5c0cedd0 con 0x7f6f5c0d2640 2023-06-20T13:32:39.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.336+0000 7f6f619ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c0cd950 con 0x7f6f5c0cf8f0 2023-06-20T13:32:39.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.336+0000 7f6f53fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6f5c0d2640 0x7f6f5c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:39.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.336+0000 7f6f53fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f6f5c0d2640 0x7f6f5c0b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57520/0 (socket says 172.21.15.32:57520) 2023-06-20T13:32:39.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.336+0000 7f6f53fff700 1 -- 172.21.15.32:0/998932714 learned_addr learned my addr 172.21.15.32:0/998932714 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:39.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.336+0000 7f6f5b7fe700 1 --2- 172.21.15.32:0/998932714 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f5c0cf8f0 0x7f6f5c15fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:39.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.336+0000 7f6f53fff700 1 -- 172.21.15.32:0/998932714 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f5c0cf8f0 msgr2=0x7f6f5c15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:39.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.336+0000 7f6f53fff700 1 --2- 172.21.15.32:0/998932714 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f5c0cf8f0 0x7f6f5c15fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:39.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.336+0000 7f6f53fff700 1 -- 172.21.15.32:0/998932714 >> v1:172.21.15.115:6789/0 conn(0x7f6f5c15c460 legacy=0x7f6f5c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:39.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.336+0000 7f6f53fff700 1 -- 172.21.15.32:0/998932714 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c0d14b0 con 0x7f6f5c0d2640 2023-06-20T13:32:39.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.337+0000 7f6f53fff700 1 --2- 172.21.15.32:0/998932714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f5c0d2640 0x7f6f5c0b59d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6f440098f0 tx=0x7f6f44009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c4b2bb1a5192351 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:39.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.337+0000 7f6f5a7fc700 1 -- 172.21.15.32:0/998932714 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4400b8a0 con 0x7f6f5c0d2640 2023-06-20T13:32:39.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.337+0000 7f6f5a7fc700 1 -- 172.21.15.32:0/998932714 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4400ba00 con 0x7f6f5c0d2640 2023-06-20T13:32:39.342 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.337+0000 7f6f5a7fc700 1 -- 172.21.15.32:0/998932714 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4400bd90 con 0x7f6f5c0d2640 2023-06-20T13:32:39.342 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.337+0000 7f6f619ff700 1 -- 172.21.15.32:0/998932714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f5c0d2640 msgr2=0x7f6f5c0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:39.342 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.337+0000 7f6f619ff700 1 --2- 172.21.15.32:0/998932714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f5c0d2640 0x7f6f5c0b59d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6f440098f0 tx=0x7f6f44009c00 comp rx=0 tx=0).stop 2023-06-20T13:32:39.342 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.338+0000 7f6f619ff700 1 -- 172.21.15.32:0/998932714 shutdown_connections 2023-06-20T13:32:39.342 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.338+0000 7f6f619ff700 1 --2- 172.21.15.32:0/998932714 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f5c0cf8f0 0x7f6f5c15fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:39.342 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.338+0000 7f6f619ff700 1 --2- 172.21.15.32:0/998932714 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f5c0d2640 0x7f6f5c0b59d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:39.342 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.338+0000 7f6f619ff700 1 -- 172.21.15.32:0/998932714 >> 172.21.15.32:0/998932714 conn(0x7f6f5c071660 msgr2=0x7f6f5c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:39.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.338+0000 7f6f619ff700 1 -- 172.21.15.32:0/998932714 shutdown_connections 2023-06-20T13:32:39.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.338+0000 7f6f619ff700 1 -- 172.21.15.32:0/998932714 wait complete. 2023-06-20T13:32:39.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.339+0000 7f6f619ff700 1 Processor -- start 2023-06-20T13:32:39.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.339+0000 7f6f619ff700 1 -- start start 2023-06-20T13:32:39.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.340+0000 7f6f619ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f5c0cf8f0 0x7f6f5c0cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:39.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.340+0000 7f6f619ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f5c0d2640 0x7f6f5c15e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:39.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.340+0000 7f6f619ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f5c15c460 0x7f6f5c15e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:39.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.340+0000 7f6f619ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c0ccce0 con 0x7f6f5c0d2640 2023-06-20T13:32:39.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.341+0000 7f6f619ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c159a60 con 0x7f6f5c0cf8f0 2023-06-20T13:32:39.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.341+0000 7f6f619ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c159d40 con 0x7f6f5c15c460 2023-06-20T13:32:39.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.341+0000 7f6f53fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f5c0d2640 0x7f6f5c15e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:39.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.341+0000 7f6f53fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f5c0d2640 0x7f6f5c15e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:57532/0 (socket says 172.21.15.32:57532) 2023-06-20T13:32:39.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.341+0000 7f6f53fff700 1 -- 172.21.15.32:0/4006459954 learned_addr learned my addr 172.21.15.32:0/4006459954 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:39.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.341+0000 7f6f5b7fe700 1 --2- 172.21.15.32:0/4006459954 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f5c15c460 0x7f6f5c15e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:39.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.341+0000 7f6f5affd700 1 --2- 172.21.15.32:0/4006459954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f5c0cf8f0 0x7f6f5c0cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:39.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.341+0000 7f6f53fff700 1 -- 172.21.15.32:0/4006459954 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f5c15c460 msgr2=0x7f6f5c15e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:39.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.341+0000 7f6f53fff700 1 --2- 172.21.15.32:0/4006459954 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f5c15c460 0x7f6f5c15e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:39.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.341+0000 7f6f53fff700 1 -- 172.21.15.32:0/4006459954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f5c0cf8f0 msgr2=0x7f6f5c0cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:39.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.341+0000 7f6f53fff700 1 --2- 172.21.15.32:0/4006459954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f5c0cf8f0 0x7f6f5c0cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:39.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.341+0000 7f6f53fff700 1 -- 172.21.15.32:0/4006459954 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f44009550 con 0x7f6f5c0d2640 2023-06-20T13:32:39.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.341+0000 7f6f5affd700 1 --2- 172.21.15.32:0/4006459954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f5c0cf8f0 0x7f6f5c0cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:32:39.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.341+0000 7f6f53fff700 1 --2- 172.21.15.32:0/4006459954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f5c0d2640 0x7f6f5c15e310 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6f44009c40 tx=0x7f6f44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:39.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.342+0000 7f6f58ff9700 1 -- 172.21.15.32:0/4006459954 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f440036a0 con 0x7f6f5c0d2640 2023-06-20T13:32:39.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.342+0000 7f6f58ff9700 1 -- 172.21.15.32:0/4006459954 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4401e070 con 0x7f6f5c0d2640 2023-06-20T13:32:39.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.342+0000 7f6f58ff9700 1 -- 172.21.15.32:0/4006459954 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f44003a60 con 0x7f6f5c0d2640 2023-06-20T13:32:39.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.342+0000 7f6f619ff700 1 -- 172.21.15.32:0/4006459954 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5c15a020 con 0x7f6f5c0d2640 2023-06-20T13:32:39.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.342+0000 7f6f619ff700 1 -- 172.21.15.32:0/4006459954 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5c15a5e0 con 0x7f6f5c0d2640 2023-06-20T13:32:39.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.343+0000 7f6f619ff700 1 -- 172.21.15.32:0/4006459954 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5c04ea60 con 0x7f6f5c0d2640 2023-06-20T13:32:39.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.344+0000 7f6f58ff9700 1 -- 172.21.15.32:0/4006459954 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6f44003bc0 con 0x7f6f5c0d2640 2023-06-20T13:32:39.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.345+0000 7f6f58ff9700 1 --2- 172.21.15.32:0/4006459954 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6f3c06ace0 0x7f6f3c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:39.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.345+0000 7f6f58ff9700 1 -- 172.21.15.32:0/4006459954 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6f44020070 con 0x7f6f5c0d2640 2023-06-20T13:32:39.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.345+0000 7f6f5affd700 1 --2- 172.21.15.32:0/4006459954 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6f3c06ace0 0x7f6f3c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:39.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.346+0000 7f6f5affd700 1 --2- 172.21.15.32:0/4006459954 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6f3c06ace0 0x7f6f3c06d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c000f60 tx=0x7f6f4c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:39.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.350+0000 7f6f58ff9700 1 -- 172.21.15.32:0/4006459954 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6f440559e0 con 0x7f6f5c0d2640 2023-06-20T13:32:39.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.573+0000 7f6f619ff700 1 -- 172.21.15.32:0/4006459954 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6f5c0b4fa0 con 0x7f6f5c0d2640 2023-06-20T13:32:39.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.574+0000 7f6f58ff9700 1 -- 172.21.15.32:0/4006459954 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6f44059000 con 0x7f6f5c0d2640 2023-06-20T13:32:39.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.576+0000 7f6f619ff700 1 -- 172.21.15.32:0/4006459954 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6f3c06ace0 msgr2=0x7f6f3c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:39.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.576+0000 7f6f619ff700 1 --2- 172.21.15.32:0/4006459954 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6f3c06ace0 0x7f6f3c06d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c000f60 tx=0x7f6f4c009040 comp rx=0 tx=0).stop 2023-06-20T13:32:39.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.576+0000 7f6f619ff700 1 -- 172.21.15.32:0/4006459954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f5c0d2640 msgr2=0x7f6f5c15e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:39.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.576+0000 7f6f619ff700 1 --2- 172.21.15.32:0/4006459954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f5c0d2640 0x7f6f5c15e310 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6f44009c40 tx=0x7f6f44004750 comp rx=0 tx=0).stop 2023-06-20T13:32:39.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.576+0000 7f6f619ff700 1 -- 172.21.15.32:0/4006459954 shutdown_connections 2023-06-20T13:32:39.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.576+0000 7f6f619ff700 1 --2- 172.21.15.32:0/4006459954 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6f3c06ace0 0x7f6f3c06d190 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:39.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.576+0000 7f6f619ff700 1 --2- 172.21.15.32:0/4006459954 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6f5c15c460 0x7f6f5c15e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:39.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.576+0000 7f6f619ff700 1 --2- 172.21.15.32:0/4006459954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6f5c0cf8f0 0x7f6f5c0cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:39.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.576+0000 7f6f619ff700 1 --2- 172.21.15.32:0/4006459954 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6f5c0d2640 0x7f6f5c15e310 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:39.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.576+0000 7f6f619ff700 1 -- 172.21.15.32:0/4006459954 >> 172.21.15.32:0/4006459954 conn(0x7f6f5c071660 msgr2=0x7f6f5c15d970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:39.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.576+0000 7f6f619ff700 1 -- 172.21.15.32:0/4006459954 shutdown_connections 2023-06-20T13:32:39.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:39.576+0000 7f6f619ff700 1 -- 172.21.15.32:0/4006459954 wait complete. 2023-06-20T13:32:39.580 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2023-06-20T13:32:39.596 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi032.front.sepia.ceph.com... 2023-06-20T13:32:39.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:32:39.597 DEBUG:teuthology.orchestra.run.smithi032:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-06-20T13:32:39.665 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi032.stderr:ceph-fuse[116992]: fuse finished with error 0 and tester_r 0 2023-06-20T13:32:39.668 INFO:teuthology.orchestra.run:waiting for 300 2023-06-20T13:32:45.770 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2023-06-20T13:32:45.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:32:45.771 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-06-20T13:32:45.840 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:32:46.047 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.045+0000 7f292abff700 1 Processor -- start 2023-06-20T13:32:46.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.045+0000 7f292abff700 1 -- start start 2023-06-20T13:32:46.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.047+0000 7f292abff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29240cef10 0x7f2924069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:46.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.047+0000 7f292abff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f29240cf360 0x7f292406a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:46.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.047+0000 7f292abff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29240cdad0 con 0x7f292415c290 2023-06-20T13:32:46.049 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.047+0000 7f292abff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29240725c0 con 0x7f29240cf360 2023-06-20T13:32:46.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.047+0000 7f292abff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29240cd550 con 0x7f29240cef10 2023-06-20T13:32:46.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.047+0000 7f292919c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f29240cf360 0x7f292406a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:46.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.047+0000 7f292919c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f29240cf360 0x7f292406a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39326/0 (socket says 172.21.15.32:39326) 2023-06-20T13:32:46.050 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.047+0000 7f292919c700 1 -- 172.21.15.32:0/3838203998 learned_addr learned my addr 172.21.15.32:0/3838203998 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:46.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.047+0000 7f2923fff700 1 --2- 172.21.15.32:0/3838203998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29240cef10 0x7f2924069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:46.051 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.047+0000 7f292919c700 1 -- 172.21.15.32:0/3838203998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29240cef10 msgr2=0x7f2924069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:46.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.047+0000 7f292919c700 1 --2- 172.21.15.32:0/3838203998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29240cef10 0x7f2924069f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:46.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.047+0000 7f292919c700 1 -- 172.21.15.32:0/3838203998 >> v1:172.21.15.115:6789/0 conn(0x7f292415c290 legacy=0x7f29240ab8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:46.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.047+0000 7f292919c700 1 -- 172.21.15.32:0/3838203998 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29240722e0 con 0x7f29240cf360 2023-06-20T13:32:46.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.048+0000 7f292919c700 1 --2- 172.21.15.32:0/3838203998 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29240cf360 0x7f292406a470 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f291c009e50 tx=0x7f291c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d21b20c8a08135 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:46.052 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.048+0000 7f29237fe700 1 -- 172.21.15.32:0/3838203998 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c00e070 con 0x7f29240cf360 2023-06-20T13:32:46.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.048+0000 7f29237fe700 1 -- 172.21.15.32:0/3838203998 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291c00b9c0 con 0x7f29240cf360 2023-06-20T13:32:46.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.048+0000 7f29237fe700 1 -- 172.21.15.32:0/3838203998 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c00bd70 con 0x7f29240cf360 2023-06-20T13:32:46.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.049+0000 7f292abff700 1 -- 172.21.15.32:0/3838203998 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29240cf360 msgr2=0x7f292406a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:46.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.049+0000 7f292abff700 1 --2- 172.21.15.32:0/3838203998 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29240cf360 0x7f292406a470 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f291c009e50 tx=0x7f291c00b330 comp rx=0 tx=0).stop 2023-06-20T13:32:46.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.049+0000 7f292abff700 1 -- 172.21.15.32:0/3838203998 shutdown_connections 2023-06-20T13:32:46.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.049+0000 7f292abff700 1 --2- 172.21.15.32:0/3838203998 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29240cf360 0x7f292406a470 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:46.053 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.049+0000 7f292abff700 1 --2- 172.21.15.32:0/3838203998 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29240cef10 0x7f2924069f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:46.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.049+0000 7f292abff700 1 -- 172.21.15.32:0/3838203998 >> 172.21.15.32:0/3838203998 conn(0x7f292406d450 msgr2=0x7f292406d850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:46.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.049+0000 7f292abff700 1 -- 172.21.15.32:0/3838203998 shutdown_connections 2023-06-20T13:32:46.054 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.049+0000 7f292abff700 1 -- 172.21.15.32:0/3838203998 wait complete. 2023-06-20T13:32:46.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.051+0000 7f292abff700 1 Processor -- start 2023-06-20T13:32:46.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.051+0000 7f292abff700 1 -- start start 2023-06-20T13:32:46.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.053+0000 7f292abff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29240cef10 0x7f2924158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:46.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.053+0000 7f292abff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29240cf360 0x7f292415f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:46.055 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.053+0000 7f292abff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f292415c290 0x7f292415d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:46.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.053+0000 7f292abff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292415de90 con 0x7f29240cf360 2023-06-20T13:32:46.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.053+0000 7f292abff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29240b37b0 con 0x7f29240cef10 2023-06-20T13:32:46.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.053+0000 7f292abff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2924155080 con 0x7f292415c290 2023-06-20T13:32:46.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.053+0000 7f2923fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29240cf360 0x7f292415f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:46.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.053+0000 7f2923fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29240cf360 0x7f292415f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39330/0 (socket says 172.21.15.32:39330) 2023-06-20T13:32:46.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.053+0000 7f2923fff700 1 -- 172.21.15.32:0/4075241992 learned_addr learned my addr 172.21.15.32:0/4075241992 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:46.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.053+0000 7f292899b700 1 --2- 172.21.15.32:0/4075241992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29240cef10 0x7f2924158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:46.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.053+0000 7f292919c700 1 --2- 172.21.15.32:0/4075241992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f292415c290 0x7f292415d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:46.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.053+0000 7f2923fff700 1 -- 172.21.15.32:0/4075241992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f292415c290 msgr2=0x7f292415d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:46.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.053+0000 7f2923fff700 1 --2- 172.21.15.32:0/4075241992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f292415c290 0x7f292415d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:46.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.053+0000 7f2923fff700 1 -- 172.21.15.32:0/4075241992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29240cef10 msgr2=0x7f2924158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:46.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.053+0000 7f2923fff700 1 --2- 172.21.15.32:0/4075241992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29240cef10 0x7f2924158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:46.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.053+0000 7f2923fff700 1 -- 172.21.15.32:0/4075241992 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291c009b30 con 0x7f29240cf360 2023-06-20T13:32:46.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.054+0000 7f2923fff700 1 --2- 172.21.15.32:0/4075241992 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29240cf360 0x7f292415f250 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f291000e840 tx=0x7f291000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:46.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.054+0000 7f29217fa700 1 -- 172.21.15.32:0/4075241992 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2910013610 con 0x7f29240cf360 2023-06-20T13:32:46.058 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.054+0000 7f29217fa700 1 -- 172.21.15.32:0/4075241992 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2910013770 con 0x7f29240cf360 2023-06-20T13:32:46.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.054+0000 7f29217fa700 1 -- 172.21.15.32:0/4075241992 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2910013b20 con 0x7f29240cf360 2023-06-20T13:32:46.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.054+0000 7f292abff700 1 -- 172.21.15.32:0/4075241992 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29240b3a00 con 0x7f29240cf360 2023-06-20T13:32:46.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.054+0000 7f292abff700 1 -- 172.21.15.32:0/4075241992 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29240b3fc0 con 0x7f29240cf360 2023-06-20T13:32:46.059 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.055+0000 7f292abff700 1 -- 172.21.15.32:0/4075241992 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f292404ea60 con 0x7f29240cf360 2023-06-20T13:32:46.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.056+0000 7f29217fa700 1 -- 172.21.15.32:0/4075241992 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2910013c80 con 0x7f29240cf360 2023-06-20T13:32:46.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.057+0000 7f29217fa700 1 --2- 172.21.15.32:0/4075241992 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f290806ace0 0x7f290806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:46.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.057+0000 7f29217fa700 1 -- 172.21.15.32:0/4075241992 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2910089440 con 0x7f29240cf360 2023-06-20T13:32:46.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.058+0000 7f292899b700 1 --2- 172.21.15.32:0/4075241992 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f290806ace0 0x7f290806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:46.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.058+0000 7f292899b700 1 --2- 172.21.15.32:0/4075241992 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f290806ace0 0x7f290806d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f29241554c0 tx=0x7f2918009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:46.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.062+0000 7f29217fa700 1 -- 172.21.15.32:0/4075241992 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2910057c80 con 0x7f29240cf360 2023-06-20T13:32:46.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.269+0000 7f292abff700 1 -- 172.21.15.32:0/4075241992 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f292406a4d0 con 0x7f29240cf360 2023-06-20T13:32:46.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.270+0000 7f29217fa700 1 -- 172.21.15.32:0/4075241992 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20096 (secure 0 0 0) 0x7f2910057810 con 0x7f29240cf360 2023-06-20T13:32:46.272 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:32:46.273 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":27,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:32:25.570940+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-20T13:32:18.120021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-20T13:32:19.503624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-20T13:32:23.074912+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:32:46.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.272+0000 7f292abff700 1 -- 172.21.15.32:0/4075241992 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f290806ace0 msgr2=0x7f290806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:46.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.272+0000 7f292abff700 1 --2- 172.21.15.32:0/4075241992 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f290806ace0 0x7f290806d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f29241554c0 tx=0x7f2918009040 comp rx=0 tx=0).stop 2023-06-20T13:32:46.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.272+0000 7f292abff700 1 -- 172.21.15.32:0/4075241992 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29240cf360 msgr2=0x7f292415f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:46.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.272+0000 7f292abff700 1 --2- 172.21.15.32:0/4075241992 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29240cf360 0x7f292415f250 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f291000e840 tx=0x7f291000ec00 comp rx=0 tx=0).stop 2023-06-20T13:32:46.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.272+0000 7f292abff700 1 -- 172.21.15.32:0/4075241992 shutdown_connections 2023-06-20T13:32:46.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.272+0000 7f292abff700 1 --2- 172.21.15.32:0/4075241992 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f290806ace0 0x7f290806d190 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:46.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.272+0000 7f292abff700 1 --2- 172.21.15.32:0/4075241992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f292415c290 0x7f292415d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:46.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.272+0000 7f292abff700 1 --2- 172.21.15.32:0/4075241992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29240cef10 0x7f2924158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:46.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.272+0000 7f292abff700 1 --2- 172.21.15.32:0/4075241992 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29240cf360 0x7f292415f250 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:46.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.273+0000 7f292abff700 1 -- 172.21.15.32:0/4075241992 >> 172.21.15.32:0/4075241992 conn(0x7f292406d450 msgr2=0x7f29240ad120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:46.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.273+0000 7f292abff700 1 -- 172.21.15.32:0/4075241992 shutdown_connections 2023-06-20T13:32:46.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.273+0000 7f292abff700 1 -- 172.21.15.32:0/4075241992 wait complete. 2023-06-20T13:32:46.293 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:32:46.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.491+0000 7f063c5ff700 1 Processor -- start 2023-06-20T13:32:46.494 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.492+0000 7f063c5ff700 1 -- start start 2023-06-20T13:32:46.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.493+0000 7f063c5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f063415c460 0x7f06340b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:46.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.493+0000 7f063c5ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06340d1790 con 0x7f06340cf8f0 2023-06-20T13:32:46.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.493+0000 7f063c5ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06340cd950 con 0x7f06340d2640 2023-06-20T13:32:46.495 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.493+0000 7f063c5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06340cedd0 con 0x7f063415c460 2023-06-20T13:32:46.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.493+0000 7f063ab9c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f06340cf8f0 0x7f063415fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45110/0 (socket says 172.21.15.32:45110) 2023-06-20T13:32:46.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.493+0000 7f063ab9c700 1 -- 172.21.15.32:0/2772194571 learned_addr learned my addr 172.21.15.32:0/2772194571 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:46.496 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.493+0000 7f063a39b700 1 --2- 172.21.15.32:0/2772194571 >> v2:172.21.15.115:3300/0 conn(0x7f063415c460 0x7f06340b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:46.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.493+0000 7f0639399700 1 -- 172.21.15.32:0/2772194571 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1179157475 0 0) 0x7f06340d1790 con 0x7f06340cf8f0 2023-06-20T13:32:46.498 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.493+0000 7f0639399700 1 -- 172.21.15.32:0/2772194571 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06200035b0 con 0x7f06340cf8f0 2023-06-20T13:32:46.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.494+0000 7f0639399700 1 -- 172.21.15.32:0/2772194571 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2547719880 0 0) 0x7f06340cd950 con 0x7f06340d2640 2023-06-20T13:32:46.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.494+0000 7f0639399700 1 -- 172.21.15.32:0/2772194571 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06340d1790 con 0x7f06340d2640 2023-06-20T13:32:46.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.494+0000 7f0639399700 1 -- 172.21.15.32:0/2772194571 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3455079586 0 0) 0x7f06200035b0 con 0x7f06340cf8f0 2023-06-20T13:32:46.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.494+0000 7f0639399700 1 -- 172.21.15.32:0/2772194571 >> v2:172.21.15.115:3300/0 conn(0x7f063415c460 msgr2=0x7f06340b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:46.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.494+0000 7f0639399700 1 --2- 172.21.15.32:0/2772194571 >> v2:172.21.15.115:3300/0 conn(0x7f063415c460 0x7f06340b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:46.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.494+0000 7f0639399700 1 -- 172.21.15.32:0/2772194571 >> v1:172.21.15.115:6789/0 conn(0x7f06340d2640 legacy=0x7f06340cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:46.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.494+0000 7f0639399700 1 -- 172.21.15.32:0/2772194571 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06340d14b0 con 0x7f06340cf8f0 2023-06-20T13:32:46.499 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.494+0000 7f0639399700 1 -- 172.21.15.32:0/2772194571 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3380058562 0 0) 0x7f062c0019f0 con 0x7f06340cf8f0 2023-06-20T13:32:46.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.494+0000 7f0639399700 1 -- 172.21.15.32:0/2772194571 >> v1:172.21.15.32:6789/0 conn(0x7f06340cf8f0 legacy=0x7f063415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:46.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.494+0000 7f0639399700 1 --2- 172.21.15.32:0/2772194571 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0620003be0 0x7f0620003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:46.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.494+0000 7f0639399700 1 --2- 172.21.15.32:0/2772194571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0620004850 0x7f0620004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:46.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.494+0000 7f0639399700 1 --2- 172.21.15.32:0/2772194571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06200052c0 0x7f062000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:46.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.494+0000 7f0639399700 1 -- 172.21.15.32:0/2772194571 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06340cedd0 con 0x7f06200052c0 2023-06-20T13:32:46.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.494+0000 7f0639399700 1 -- 172.21.15.32:0/2772194571 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062000c200 con 0x7f0620004850 2023-06-20T13:32:46.500 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.494+0000 7f0639399700 1 -- 172.21.15.32:0/2772194571 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062000c3c0 con 0x7f0620003be0 2023-06-20T13:32:46.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.494+0000 7f063a39b700 1 --2- 172.21.15.32:0/2772194571 >> v2:172.21.15.115:3300/0 conn(0x7f063415c460 0x7f06340b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:32:46.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.494+0000 7f0639b9a700 1 --2- 172.21.15.32:0/2772194571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0620004850 0x7f0620004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:46.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.494+0000 7f063ab9c700 1 --2- 172.21.15.32:0/2772194571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06200052c0 0x7f062000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:46.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.494+0000 7f063a39b700 1 --2- 172.21.15.32:0/2772194571 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0620003be0 0x7f0620003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:46.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.495+0000 7f0639b9a700 1 -- 172.21.15.32:0/2772194571 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0620003be0 msgr2=0x7f0620003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:46.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.495+0000 7f0639b9a700 1 --2- 172.21.15.32:0/2772194571 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0620003be0 0x7f0620003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:46.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.495+0000 7f0639b9a700 1 -- 172.21.15.32:0/2772194571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06200052c0 msgr2=0x7f062000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:46.501 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.495+0000 7f0639b9a700 1 --2- 172.21.15.32:0/2772194571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06200052c0 0x7f062000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:46.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.495+0000 7f0639b9a700 1 -- 172.21.15.32:0/2772194571 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06200035b0 con 0x7f0620004850 2023-06-20T13:32:46.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.495+0000 7f063ab9c700 1 --2- 172.21.15.32:0/2772194571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06200052c0 0x7f062000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:32:46.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.495+0000 7f063ab9c700 1 -- 172.21.15.32:0/2772194571 reap_dead start 2023-06-20T13:32:46.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.495+0000 7f0639b9a700 1 --2- 172.21.15.32:0/2772194571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0620004850 0x7f0620004cc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0624001940 tx=0x7f0620005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c119871761852835 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:46.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.495+0000 7f0639399700 1 -- 172.21.15.32:0/2772194571 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624001430 con 0x7f0620004850 2023-06-20T13:32:46.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.495+0000 7f0639399700 1 -- 172.21.15.32:0/2772194571 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0624001d70 con 0x7f0620004850 2023-06-20T13:32:46.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.495+0000 7f0639399700 1 -- 172.21.15.32:0/2772194571 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624005530 con 0x7f0620004850 2023-06-20T13:32:46.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.496+0000 7f063c5ff700 1 -- 172.21.15.32:0/2772194571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0620004850 msgr2=0x7f0620004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:46.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.496+0000 7f063c5ff700 1 --2- 172.21.15.32:0/2772194571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0620004850 0x7f0620004cc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0624001940 tx=0x7f0620005880 comp rx=0 tx=0).stop 2023-06-20T13:32:46.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.496+0000 7f063c5ff700 1 -- 172.21.15.32:0/2772194571 shutdown_connections 2023-06-20T13:32:46.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.496+0000 7f063c5ff700 1 --2- 172.21.15.32:0/2772194571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0620004850 0x7f0620004cc0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:46.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.496+0000 7f063c5ff700 1 -- 172.21.15.32:0/2772194571 >> 172.21.15.32:0/2772194571 conn(0x7f0634071660 msgr2=0x7f0634071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:46.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.496+0000 7f063c5ff700 1 -- 172.21.15.32:0/2772194571 shutdown_connections 2023-06-20T13:32:46.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.496+0000 7f063c5ff700 1 -- 172.21.15.32:0/2772194571 wait complete. 2023-06-20T13:32:46.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.498+0000 7f063c5ff700 1 Processor -- start 2023-06-20T13:32:46.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.498+0000 7f063c5ff700 1 -- start start 2023-06-20T13:32:46.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.499+0000 7f063c5ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0620004850 0x7f06340c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:46.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.499+0000 7f063c5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06341e5c40 0x7f06341e60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:46.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.499+0000 7f063c5ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f063415c830 0x7f063415cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:46.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.499+0000 7f063c5ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06341e75b0 con 0x7f063415c830 2023-06-20T13:32:46.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.499+0000 7f063c5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06341e6930 con 0x7f06341e5c40 2023-06-20T13:32:46.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.499+0000 7f063c5ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06341e6c10 con 0x7f0620004850 2023-06-20T13:32:46.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.499+0000 7f063ab9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f063415c830 0x7f063415cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:46.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.499+0000 7f063ab9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f063415c830 0x7f063415cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39346/0 (socket says 172.21.15.32:39346) 2023-06-20T13:32:46.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.499+0000 7f063ab9c700 1 -- 172.21.15.32:0/3594237123 learned_addr learned my addr 172.21.15.32:0/3594237123 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:46.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.499+0000 7f0639b9a700 1 --2- 172.21.15.32:0/3594237123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06341e5c40 0x7f06341e60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:46.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.499+0000 7f063a39b700 1 --2- 172.21.15.32:0/3594237123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0620004850 0x7f06340c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:46.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.500+0000 7f063ab9c700 1 -- 172.21.15.32:0/3594237123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0620004850 msgr2=0x7f06340c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:46.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.500+0000 7f063ab9c700 1 --2- 172.21.15.32:0/3594237123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0620004850 0x7f06340c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:46.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.500+0000 7f063ab9c700 1 -- 172.21.15.32:0/3594237123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06341e5c40 msgr2=0x7f06341e60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:46.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.500+0000 7f063ab9c700 1 --2- 172.21.15.32:0/3594237123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06341e5c40 0x7f06341e60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:46.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.500+0000 7f063ab9c700 1 -- 172.21.15.32:0/3594237123 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06341e6ef0 con 0x7f063415c830 2023-06-20T13:32:46.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.500+0000 7f0639b9a700 1 --2- 172.21.15.32:0/3594237123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06341e5c40 0x7f06341e60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:32:46.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.500+0000 7f063a39b700 1 --2- 172.21.15.32:0/3594237123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0620004850 0x7f06340c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:32:46.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.500+0000 7f063ab9c700 1 --2- 172.21.15.32:0/3594237123 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f063415c830 0x7f063415cc80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f06340ce580 tx=0x7f062c001540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:46.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.500+0000 7f062affd700 1 -- 172.21.15.32:0/3594237123 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c007a80 con 0x7f063415c830 2023-06-20T13:32:46.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.500+0000 7f062affd700 1 -- 172.21.15.32:0/3594237123 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c0133f0 con 0x7f063415c830 2023-06-20T13:32:46.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.500+0000 7f062affd700 1 -- 172.21.15.32:0/3594237123 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c013780 con 0x7f063415c830 2023-06-20T13:32:46.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.500+0000 7f063c5ff700 1 -- 172.21.15.32:0/3594237123 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06341e71d0 con 0x7f063415c830 2023-06-20T13:32:46.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.500+0000 7f063c5ff700 1 -- 172.21.15.32:0/3594237123 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06340c88c0 con 0x7f063415c830 2023-06-20T13:32:46.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.501+0000 7f063c5ff700 1 -- 172.21.15.32:0/3594237123 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06341e76f0 con 0x7f063415c830 2023-06-20T13:32:46.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.502+0000 7f062affd700 1 -- 172.21.15.32:0/3594237123 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f062c0138e0 con 0x7f063415c830 2023-06-20T13:32:46.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.503+0000 7f062affd700 1 --2- 172.21.15.32:0/3594237123 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f061806ad10 0x7f061806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:46.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.503+0000 7f062affd700 1 -- 172.21.15.32:0/3594237123 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f062c089fd0 con 0x7f063415c830 2023-06-20T13:32:46.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.503+0000 7f063a39b700 1 --2- 172.21.15.32:0/3594237123 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f061806ad10 0x7f061806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:46.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.504+0000 7f063a39b700 1 --2- 172.21.15.32:0/3594237123 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f061806ad10 0x7f061806d1c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f063404f520 tx=0x7f0630008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:46.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.508+0000 7f062affd700 1 -- 172.21.15.32:0/3594237123 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f06341e76f0 con 0x7f063415c830 2023-06-20T13:32:46.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.717+0000 7f063c5ff700 1 -- 172.21.15.32:0/3594237123 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06341e76f0 con 0x7f063415c830 2023-06-20T13:32:46.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.718+0000 7f062affd700 1 -- 172.21.15.32:0/3594237123 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20096 (secure 0 0 0) 0x7f06341e76f0 con 0x7f063415c830 2023-06-20T13:32:46.721 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:32:46.721 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":27,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:32:25.570940+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-20T13:32:18.120021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-20T13:32:19.503624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-20T13:32:23.074912+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:32:46.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.720+0000 7f063c5ff700 1 -- 172.21.15.32:0/3594237123 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f061806ad10 msgr2=0x7f061806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:46.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.720+0000 7f063c5ff700 1 --2- 172.21.15.32:0/3594237123 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f061806ad10 0x7f061806d1c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f063404f520 tx=0x7f0630008040 comp rx=0 tx=0).stop 2023-06-20T13:32:46.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.720+0000 7f063c5ff700 1 -- 172.21.15.32:0/3594237123 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f063415c830 msgr2=0x7f063415cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:46.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.720+0000 7f063c5ff700 1 --2- 172.21.15.32:0/3594237123 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f063415c830 0x7f063415cc80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f06340ce580 tx=0x7f062c001540 comp rx=0 tx=0).stop 2023-06-20T13:32:46.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.720+0000 7f063c5ff700 1 -- 172.21.15.32:0/3594237123 shutdown_connections 2023-06-20T13:32:46.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.720+0000 7f063c5ff700 1 --2- 172.21.15.32:0/3594237123 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f061806ad10 0x7f061806d1c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:46.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.720+0000 7f063c5ff700 1 --2- 172.21.15.32:0/3594237123 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f063415c830 0x7f063415cc80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:46.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.720+0000 7f063c5ff700 1 --2- 172.21.15.32:0/3594237123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0620004850 0x7f06340c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:46.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.720+0000 7f063c5ff700 1 --2- 172.21.15.32:0/3594237123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06341e5c40 0x7f06341e60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:46.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.720+0000 7f063c5ff700 1 -- 172.21.15.32:0/3594237123 >> 172.21.15.32:0/3594237123 conn(0x7f0634071660 msgr2=0x7f06340b8040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:46.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.721+0000 7f063c5ff700 1 -- 172.21.15.32:0/3594237123 shutdown_connections 2023-06-20T13:32:46.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.721+0000 7f063c5ff700 1 -- 172.21.15.32:0/3594237123 wait complete. 2023-06-20T13:32:46.741 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-20T13:32:46.945 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.942+0000 7f4c51bff700 1 Processor -- start 2023-06-20T13:32:46.945 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.943+0000 7f4c51bff700 1 -- start start 2023-06-20T13:32:46.946 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.944+0000 7f4c51bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4c4c0d3730 0x7f4c4c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:46.946 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.944+0000 7f4c51bff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c4c0cfa90 0x7f4c4c0d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:46.946 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.944+0000 7f4c51bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c4c0d0b20 con 0x7f4c4c0b8430 2023-06-20T13:32:46.946 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.944+0000 7f4c51bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c4c0cda30 con 0x7f4c4c0d3730 2023-06-20T13:32:46.946 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.944+0000 7f4c51bff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c0b8800 con 0x7f4c4c0cfa90 2023-06-20T13:32:46.947 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.944+0000 7f4c43fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4c4c0d3730 0x7f4c4c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:46.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.944+0000 7f4c4bfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c4c0cfa90 0x7f4c4c0d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:46.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.944+0000 7f4c43fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4c4c0d3730 0x7f4c4c0cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:58684/0 (socket says 172.21.15.32:58684) 2023-06-20T13:32:46.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.944+0000 7f4c43fff700 1 -- 172.21.15.32:0/1130134100 learned_addr learned my addr 172.21.15.32:0/1130134100 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:46.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.945+0000 7f4c43fff700 1 -- 172.21.15.32:0/1130134100 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c4c0cfa90 msgr2=0x7f4c4c0d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:46.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.945+0000 7f4c43fff700 1 --2- 172.21.15.32:0/1130134100 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c4c0cfa90 0x7f4c4c0d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:46.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.945+0000 7f4c43fff700 1 -- 172.21.15.32:0/1130134100 >> v1:172.21.15.115:6789/0 conn(0x7f4c4c0b8430 legacy=0x7f4c4c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:46.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.945+0000 7f4c43fff700 1 -- 172.21.15.32:0/1130134100 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4c0cfeb0 con 0x7f4c4c0d3730 2023-06-20T13:32:46.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.945+0000 7f4c4bfff700 1 --2- 172.21.15.32:0/1130134100 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c4c0cfa90 0x7f4c4c0d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:32:46.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.945+0000 7f4c4affd700 1 -- 172.21.15.32:0/1130134100 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3601127212 0 0) 0x7f4c4c0d0b20 con 0x7f4c4c0b8430 2023-06-20T13:32:46.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.945+0000 7f4c43fff700 1 --2- 172.21.15.32:0/1130134100 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c4c0d3730 0x7f4c4c0cf550 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4c340098f0 tx=0x7f4c34009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=446fc7d17b9143db server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:46.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.946+0000 7f4c4affd700 1 -- 172.21.15.32:0/1130134100 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c34011830 con 0x7f4c4c0d3730 2023-06-20T13:32:46.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.946+0000 7f4c4affd700 1 -- 172.21.15.32:0/1130134100 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c34011990 con 0x7f4c4c0d3730 2023-06-20T13:32:46.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.946+0000 7f4c4affd700 1 -- 172.21.15.32:0/1130134100 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c34011d20 con 0x7f4c4c0d3730 2023-06-20T13:32:46.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.946+0000 7f4c51bff700 1 -- 172.21.15.32:0/1130134100 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c4c0d3730 msgr2=0x7f4c4c0cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:46.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.946+0000 7f4c51bff700 1 --2- 172.21.15.32:0/1130134100 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c4c0d3730 0x7f4c4c0cf550 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4c340098f0 tx=0x7f4c34009c00 comp rx=0 tx=0).stop 2023-06-20T13:32:46.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.946+0000 7f4c51bff700 1 -- 172.21.15.32:0/1130134100 shutdown_connections 2023-06-20T13:32:46.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.946+0000 7f4c51bff700 1 --2- 172.21.15.32:0/1130134100 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c4c0cfa90 0x7f4c4c0d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:46.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.946+0000 7f4c51bff700 1 --2- 172.21.15.32:0/1130134100 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c4c0d3730 0x7f4c4c0cf550 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:46.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.946+0000 7f4c51bff700 1 -- 172.21.15.32:0/1130134100 >> 172.21.15.32:0/1130134100 conn(0x7f4c4c06b3f0 msgr2=0x7f4c4c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:46.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.946+0000 7f4c51bff700 1 -- 172.21.15.32:0/1130134100 shutdown_connections 2023-06-20T13:32:46.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.946+0000 7f4c51bff700 1 -- 172.21.15.32:0/1130134100 wait complete. 2023-06-20T13:32:46.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.948+0000 7f4c51bff700 1 Processor -- start 2023-06-20T13:32:46.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.948+0000 7f4c51bff700 1 -- start start 2023-06-20T13:32:46.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.949+0000 7f4c51bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c4c0b8430 0x7f4c4c1f5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:46.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.949+0000 7f4c51bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c4c0cfa90 0x7f4c4c0c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:46.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.949+0000 7f4c51bff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c4c0d3730 0x7f4c4c0c7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:46.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.949+0000 7f4c51bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c0a9590 con 0x7f4c4c0cfa90 2023-06-20T13:32:46.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.949+0000 7f4c51bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c0c6710 con 0x7f4c4c0b8430 2023-06-20T13:32:46.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.949+0000 7f4c51bff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c1f62b0 con 0x7f4c4c0d3730 2023-06-20T13:32:46.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.950+0000 7f4c4b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c4c0b8430 0x7f4c4c1f5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:46.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.950+0000 7f4c4b7fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c4c0b8430 0x7f4c4c1f5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:58696/0 (socket says 172.21.15.32:58696) 2023-06-20T13:32:46.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.950+0000 7f4c4b7fe700 1 -- 172.21.15.32:0/4243572198 learned_addr learned my addr 172.21.15.32:0/4243572198 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:46.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.950+0000 7f4c43fff700 1 --2- 172.21.15.32:0/4243572198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c4c0cfa90 0x7f4c4c0c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:46.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.950+0000 7f4c4bfff700 1 --2- 172.21.15.32:0/4243572198 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c4c0d3730 0x7f4c4c0c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:46.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.950+0000 7f4c4b7fe700 1 -- 172.21.15.32:0/4243572198 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c4c0d3730 msgr2=0x7f4c4c0c7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:46.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.950+0000 7f4c4b7fe700 1 --2- 172.21.15.32:0/4243572198 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c4c0d3730 0x7f4c4c0c7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:46.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.950+0000 7f4c4b7fe700 1 -- 172.21.15.32:0/4243572198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c4c0cfa90 msgr2=0x7f4c4c0c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:46.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.950+0000 7f4c4b7fe700 1 --2- 172.21.15.32:0/4243572198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c4c0cfa90 0x7f4c4c0c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:46.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.950+0000 7f4c4b7fe700 1 -- 172.21.15.32:0/4243572198 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c44009a70 con 0x7f4c4c0b8430 2023-06-20T13:32:46.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.950+0000 7f4c43fff700 1 --2- 172.21.15.32:0/4243572198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c4c0cfa90 0x7f4c4c0c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:32:46.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.950+0000 7f4c4b7fe700 1 --2- 172.21.15.32:0/4243572198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c4c0b8430 0x7f4c4c1f5d70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c00c550 tx=0x7f4c3c00c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:46.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.951+0000 7f4c48ff9700 1 -- 172.21.15.32:0/4243572198 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c0054e0 con 0x7f4c4c0b8430 2023-06-20T13:32:46.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.951+0000 7f4c48ff9700 1 -- 172.21.15.32:0/4243572198 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3c003680 con 0x7f4c4c0b8430 2023-06-20T13:32:46.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.951+0000 7f4c48ff9700 1 -- 172.21.15.32:0/4243572198 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c003a30 con 0x7f4c4c0b8430 2023-06-20T13:32:46.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.951+0000 7f4c51bff700 1 -- 172.21.15.32:0/4243572198 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c34009550 con 0x7f4c4c0b8430 2023-06-20T13:32:46.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.951+0000 7f4c51bff700 1 -- 172.21.15.32:0/4243572198 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c4c0c6f40 con 0x7f4c4c0b8430 2023-06-20T13:32:46.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.952+0000 7f4c51bff700 1 -- 172.21.15.32:0/4243572198 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c4c0cd850 con 0x7f4c4c0b8430 2023-06-20T13:32:46.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.953+0000 7f4c48ff9700 1 -- 172.21.15.32:0/4243572198 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4c3c003b90 con 0x7f4c4c0b8430 2023-06-20T13:32:46.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.954+0000 7f4c48ff9700 1 --2- 172.21.15.32:0/4243572198 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4c2c06ace0 0x7f4c2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:46.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.954+0000 7f4c48ff9700 1 -- 172.21.15.32:0/4243572198 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4c3c088ea0 con 0x7f4c4c0b8430 2023-06-20T13:32:46.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.954+0000 7f4c43fff700 1 --2- 172.21.15.32:0/4243572198 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4c2c06ace0 0x7f4c2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:46.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.955+0000 7f4c43fff700 1 --2- 172.21.15.32:0/4243572198 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4c2c06ace0 0x7f4c2c06d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009c40 tx=0x7f4c34008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:46.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:46.958+0000 7f4c48ff9700 1 -- 172.21.15.32:0/4243572198 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4c3c053d40 con 0x7f4c4c0b8430 2023-06-20T13:32:47.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:47.217+0000 7f4c51bff700 1 -- 172.21.15.32:0/4243572198 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4c4c04ea60 con 0x7f4c4c0b8430 2023-06-20T13:32:48.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.008+0000 7f4c48ff9700 1 -- 172.21.15.32:0/4243572198 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4c3c017020 con 0x7f4c4c0b8430 2023-06-20T13:32:48.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.011+0000 7f4c51bff700 1 -- 172.21.15.32:0/4243572198 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4c2c06ace0 msgr2=0x7f4c2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:48.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.011+0000 7f4c51bff700 1 --2- 172.21.15.32:0/4243572198 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4c2c06ace0 0x7f4c2c06d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009c40 tx=0x7f4c34008030 comp rx=0 tx=0).stop 2023-06-20T13:32:48.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.011+0000 7f4c51bff700 1 -- 172.21.15.32:0/4243572198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c4c0b8430 msgr2=0x7f4c4c1f5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:48.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.011+0000 7f4c51bff700 1 --2- 172.21.15.32:0/4243572198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c4c0b8430 0x7f4c4c1f5d70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c00c550 tx=0x7f4c3c00c860 comp rx=0 tx=0).stop 2023-06-20T13:32:48.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.011+0000 7f4c51bff700 1 -- 172.21.15.32:0/4243572198 shutdown_connections 2023-06-20T13:32:48.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.011+0000 7f4c51bff700 1 --2- 172.21.15.32:0/4243572198 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4c2c06ace0 0x7f4c2c06d190 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:48.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.011+0000 7f4c51bff700 1 --2- 172.21.15.32:0/4243572198 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c4c0d3730 0x7f4c4c0c7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:48.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.011+0000 7f4c51bff700 1 --2- 172.21.15.32:0/4243572198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c4c0b8430 0x7f4c4c1f5d70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:48.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.011+0000 7f4c51bff700 1 --2- 172.21.15.32:0/4243572198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c4c0cfa90 0x7f4c4c0c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:48.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.011+0000 7f4c51bff700 1 -- 172.21.15.32:0/4243572198 >> 172.21.15.32:0/4243572198 conn(0x7f4c4c06b3f0 msgr2=0x7f4c4c15fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:48.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.011+0000 7f4c51bff700 1 -- 172.21.15.32:0/4243572198 shutdown_connections 2023-06-20T13:32:48.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.011+0000 7f4c51bff700 1 -- 172.21.15.32:0/4243572198 wait complete. 2023-06-20T13:32:48.034 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-06-20T13:32:48.035 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-20T13:32:48.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.240+0000 7fac043ff700 1 Processor -- start 2023-06-20T13:32:48.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.240+0000 7fac043ff700 1 -- start start 2023-06-20T13:32:48.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.241+0000 7fac043ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabfc0d3730 0x7fabfc0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:48.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.241+0000 7fac043ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fabfc0cfa90 0x7fabfc0d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:48.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.241+0000 7fac043ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabfc0d0b20 con 0x7fabfc0b8430 2023-06-20T13:32:48.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.241+0000 7fac043ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabfc0cda30 con 0x7fabfc0cfa90 2023-06-20T13:32:48.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.241+0000 7fac043ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc0b8800 con 0x7fabfc0d3730 2023-06-20T13:32:48.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.241+0000 7fac0299c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fabfc0cfa90 0x7fabfc0d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:48.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.241+0000 7fac0199a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabfc0d3730 0x7fabfc0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:48.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.241+0000 7fac0299c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fabfc0cfa90 0x7fabfc0d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:58698/0 (socket says 172.21.15.32:58698) 2023-06-20T13:32:48.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.241+0000 7fac0299c700 1 -- 172.21.15.32:0/922015400 learned_addr learned my addr 172.21.15.32:0/922015400 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:48.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.241+0000 7fac0219b700 1 --1- 172.21.15.32:0/922015400 >> v1:172.21.15.115:6789/0 conn(0x7fabfc0b8430 0x7fabfc0cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.32:37524/0 (socket says 172.21.15.32:37524) 2023-06-20T13:32:48.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.242+0000 7fac0299c700 1 -- 172.21.15.32:0/922015400 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabfc0d3730 msgr2=0x7fabfc0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:48.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.242+0000 7fac0299c700 1 --2- 172.21.15.32:0/922015400 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabfc0d3730 0x7fabfc0cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:48.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.242+0000 7fac0299c700 1 -- 172.21.15.32:0/922015400 >> v1:172.21.15.115:6789/0 conn(0x7fabfc0b8430 legacy=0x7fabfc0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:48.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.242+0000 7fac0299c700 1 -- 172.21.15.32:0/922015400 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabfc0cfeb0 con 0x7fabfc0cfa90 2023-06-20T13:32:48.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.242+0000 7fac0299c700 1 --2- 172.21.15.32:0/922015400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabfc0cfa90 0x7fabfc0d0fb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fabf4009e50 tx=0x7fabf400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6c2bbad3a57756f server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:48.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.242+0000 7fac01199700 1 -- 172.21.15.32:0/922015400 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf400e070 con 0x7fabfc0cfa90 2023-06-20T13:32:48.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.242+0000 7fac01199700 1 -- 172.21.15.32:0/922015400 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf400b910 con 0x7fabfc0cfa90 2023-06-20T13:32:48.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.242+0000 7fac01199700 1 -- 172.21.15.32:0/922015400 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf400bcc0 con 0x7fabfc0cfa90 2023-06-20T13:32:48.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.243+0000 7fac043ff700 1 -- 172.21.15.32:0/922015400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabfc0cfa90 msgr2=0x7fabfc0d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:48.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.243+0000 7fac043ff700 1 --2- 172.21.15.32:0/922015400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabfc0cfa90 0x7fabfc0d0fb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fabf4009e50 tx=0x7fabf400b330 comp rx=0 tx=0).stop 2023-06-20T13:32:48.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.243+0000 7fac043ff700 1 -- 172.21.15.32:0/922015400 shutdown_connections 2023-06-20T13:32:48.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.243+0000 7fac043ff700 1 --2- 172.21.15.32:0/922015400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabfc0cfa90 0x7fabfc0d0fb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:48.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.243+0000 7fac043ff700 1 --2- 172.21.15.32:0/922015400 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabfc0d3730 0x7fabfc0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:48.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.243+0000 7fac043ff700 1 -- 172.21.15.32:0/922015400 >> 172.21.15.32:0/922015400 conn(0x7fabfc06b3f0 msgr2=0x7fabfc06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:48.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.243+0000 7fac043ff700 1 -- 172.21.15.32:0/922015400 shutdown_connections 2023-06-20T13:32:48.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.243+0000 7fac043ff700 1 -- 172.21.15.32:0/922015400 wait complete. 2023-06-20T13:32:48.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.245+0000 7fac043ff700 1 Processor -- start 2023-06-20T13:32:48.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.245+0000 7fac043ff700 1 -- start start 2023-06-20T13:32:48.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.247+0000 7fac043ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabfc0b8430 0x7fabfc14d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:48.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.247+0000 7fac043ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabfc0cfa90 0x7fabfc0c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:48.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.247+0000 7fac043ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabfc0d3730 0x7fabfc14f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:48.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.247+0000 7fac043ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc14d5c0 con 0x7fabfc0d3730 2023-06-20T13:32:48.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.247+0000 7fac043ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc0c6ba0 con 0x7fabfc0cfa90 2023-06-20T13:32:48.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.247+0000 7fac043ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc14ed50 con 0x7fabfc0b8430 2023-06-20T13:32:48.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.247+0000 7fac0299c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabfc0d3730 0x7fabfc14f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:48.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.247+0000 7fac0299c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabfc0d3730 0x7fabfc14f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39362/0 (socket says 172.21.15.32:39362) 2023-06-20T13:32:48.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.247+0000 7fac0299c700 1 -- 172.21.15.32:0/1353295067 learned_addr learned my addr 172.21.15.32:0/1353295067 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:48.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.247+0000 7fac0199a700 1 --2- 172.21.15.32:0/1353295067 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabfc0cfa90 0x7fabfc0c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:48.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.247+0000 7fac0219b700 1 --2- 172.21.15.32:0/1353295067 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabfc0b8430 0x7fabfc14d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:48.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.247+0000 7fac0299c700 1 -- 172.21.15.32:0/1353295067 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabfc0b8430 msgr2=0x7fabfc14d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:48.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.247+0000 7fac0299c700 1 --2- 172.21.15.32:0/1353295067 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabfc0b8430 0x7fabfc14d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:48.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.247+0000 7fac0299c700 1 -- 172.21.15.32:0/1353295067 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabfc0cfa90 msgr2=0x7fabfc0c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:48.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.247+0000 7fac0299c700 1 --2- 172.21.15.32:0/1353295067 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabfc0cfa90 0x7fabfc0c8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:48.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.247+0000 7fac0299c700 1 -- 172.21.15.32:0/1353295067 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf4009b30 con 0x7fabfc0d3730 2023-06-20T13:32:48.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.247+0000 7fac0299c700 1 --2- 172.21.15.32:0/1353295067 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabfc0d3730 0x7fabfc14f830 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fabfc06c780 tx=0x7fabf4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:48.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.247+0000 7fabf2ffd700 1 -- 172.21.15.32:0/1353295067 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf4004800 con 0x7fabfc0d3730 2023-06-20T13:32:48.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.248+0000 7fabf2ffd700 1 -- 172.21.15.32:0/1353295067 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf4004960 con 0x7fabfc0d3730 2023-06-20T13:32:48.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.248+0000 7fabf2ffd700 1 -- 172.21.15.32:0/1353295067 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf401c680 con 0x7fabfc0d3730 2023-06-20T13:32:48.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.248+0000 7fac043ff700 1 -- 172.21.15.32:0/1353295067 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabfc14f030 con 0x7fabfc0d3730 2023-06-20T13:32:48.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.248+0000 7fac043ff700 1 -- 172.21.15.32:0/1353295067 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabfc0c93c0 con 0x7fabfc0d3730 2023-06-20T13:32:48.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.249+0000 7fac043ff700 1 -- 172.21.15.32:0/1353295067 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabfc14f550 con 0x7fabfc0d3730 2023-06-20T13:32:48.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.250+0000 7fabf2ffd700 1 -- 172.21.15.32:0/1353295067 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fabf401c7e0 con 0x7fabfc0d3730 2023-06-20T13:32:48.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.251+0000 7fabf2ffd700 1 --2- 172.21.15.32:0/1353295067 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fabe006ace0 0x7fabe006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:48.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.251+0000 7fabf2ffd700 1 -- 172.21.15.32:0/1353295067 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fabf408b3c0 con 0x7fabfc0d3730 2023-06-20T13:32:48.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.251+0000 7fac0219b700 1 --2- 172.21.15.32:0/1353295067 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fabe006ace0 0x7fabe006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:48.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.252+0000 7fac0219b700 1 --2- 172.21.15.32:0/1353295067 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fabe006ace0 0x7fabe006d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fabf8000f60 tx=0x7fabf8007ed0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:48.257 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.255+0000 7fabf2ffd700 1 -- 172.21.15.32:0/1353295067 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fabfc14f550 con 0x7fabfc0d3730 2023-06-20T13:32:48.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:48.506+0000 7fac043ff700 1 -- 172.21.15.32:0/1353295067 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fabfc14f550 con 0x7fabfc0d3730 2023-06-20T13:32:49.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.009+0000 7fabf2ffd700 1 -- 172.21.15.32:0/1353295067 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fabfc14f550 con 0x7fabfc0d3730 2023-06-20T13:32:49.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.012+0000 7fac043ff700 1 -- 172.21.15.32:0/1353295067 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fabe006ace0 msgr2=0x7fabe006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:49.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.012+0000 7fac043ff700 1 --2- 172.21.15.32:0/1353295067 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fabe006ace0 0x7fabe006d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fabf8000f60 tx=0x7fabf8007ed0 comp rx=0 tx=0).stop 2023-06-20T13:32:49.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.012+0000 7fac043ff700 1 -- 172.21.15.32:0/1353295067 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabfc0d3730 msgr2=0x7fabfc14f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:49.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.012+0000 7fac043ff700 1 --2- 172.21.15.32:0/1353295067 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabfc0d3730 0x7fabfc14f830 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fabfc06c780 tx=0x7fabf4004ad0 comp rx=0 tx=0).stop 2023-06-20T13:32:49.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.012+0000 7fac043ff700 1 -- 172.21.15.32:0/1353295067 shutdown_connections 2023-06-20T13:32:49.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.012+0000 7fac043ff700 1 --2- 172.21.15.32:0/1353295067 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fabe006ace0 0x7fabe006d190 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:49.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.012+0000 7fac043ff700 1 --2- 172.21.15.32:0/1353295067 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fabfc0d3730 0x7fabfc14f830 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:49.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.012+0000 7fac043ff700 1 --2- 172.21.15.32:0/1353295067 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fabfc0b8430 0x7fabfc14d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:49.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.012+0000 7fac043ff700 1 --2- 172.21.15.32:0/1353295067 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fabfc0cfa90 0x7fabfc0c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:49.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.012+0000 7fac043ff700 1 -- 172.21.15.32:0/1353295067 >> 172.21.15.32:0/1353295067 conn(0x7fabfc06b3f0 msgr2=0x7fabfc0d1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:49.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.012+0000 7fac043ff700 1 -- 172.21.15.32:0/1353295067 shutdown_connections 2023-06-20T13:32:49.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.012+0000 7fac043ff700 1 -- 172.21.15.32:0/1353295067 wait complete. 2023-06-20T13:32:49.034 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-20T13:32:49.035 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-20T13:32:49.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.239+0000 7fecb0bff700 1 Processor -- start 2023-06-20T13:32:49.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.239+0000 7fecb0bff700 1 -- start start 2023-06-20T13:32:49.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.240+0000 7fecb0bff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fecac0b59d0 0x7fecac1671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:49.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.240+0000 7fecb0bff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecac0d1790 con 0x7fecac15c460 2023-06-20T13:32:49.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.240+0000 7fecb0bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecac0cd950 con 0x7fecac0d2640 2023-06-20T13:32:49.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.240+0000 7fecb0bff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecac0b5e10 con 0x7fecac0b59d0 2023-06-20T13:32:49.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.240+0000 7fecaad9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fecac0b59d0 0x7fecac1671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:49.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.240+0000 7fecaa59c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fecac15c460 0x7fecac0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:45114/0 (socket says 172.21.15.32:45114) 2023-06-20T13:32:49.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.240+0000 7fecaa59c700 1 -- 172.21.15.32:0/38568436 learned_addr learned my addr 172.21.15.32:0/38568436 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:49.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.241+0000 7fecaad9d700 1 -- 172.21.15.32:0/38568436 >> v1:172.21.15.115:6789/0 conn(0x7fecac0d2640 legacy=0x7fecac0cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:49.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.241+0000 7fecaad9d700 1 -- 172.21.15.32:0/38568436 >> v1:172.21.15.32:6789/0 conn(0x7fecac15c460 legacy=0x7fecac0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:49.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.241+0000 7fecaad9d700 1 -- 172.21.15.32:0/38568436 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecac0d14b0 con 0x7fecac0b59d0 2023-06-20T13:32:49.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.241+0000 7feca9d9b700 1 -- 172.21.15.32:0/38568436 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2765868824 0 0) 0x7fecac0d1790 con 0x7fecac15c460 2023-06-20T13:32:49.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.241+0000 7fecaad9d700 1 --2- 172.21.15.32:0/38568436 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fecac0b59d0 0x7fecac1671b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feca4009d90 tx=0x7feca400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f74063e96e91c6 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:49.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.241+0000 7feca9d9b700 1 -- 172.21.15.32:0/38568436 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca400e070 con 0x7fecac0b59d0 2023-06-20T13:32:49.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.241+0000 7feca9d9b700 1 -- 172.21.15.32:0/38568436 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca400bbd0 con 0x7fecac0b59d0 2023-06-20T13:32:49.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.241+0000 7feca9d9b700 1 -- 172.21.15.32:0/38568436 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca4012430 con 0x7fecac0b59d0 2023-06-20T13:32:49.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.242+0000 7fecb0bff700 1 -- 172.21.15.32:0/38568436 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fecac0b59d0 msgr2=0x7fecac1671b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:49.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.242+0000 7fecb0bff700 1 --2- 172.21.15.32:0/38568436 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fecac0b59d0 0x7fecac1671b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feca4009d90 tx=0x7feca400b330 comp rx=0 tx=0).stop 2023-06-20T13:32:49.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.242+0000 7fecb0bff700 1 -- 172.21.15.32:0/38568436 shutdown_connections 2023-06-20T13:32:49.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.242+0000 7fecb0bff700 1 --2- 172.21.15.32:0/38568436 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fecac0b59d0 0x7fecac1671b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:49.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.242+0000 7fecb0bff700 1 -- 172.21.15.32:0/38568436 >> 172.21.15.32:0/38568436 conn(0x7fecac071660 msgr2=0x7fecac071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:49.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.242+0000 7fecb0bff700 1 -- 172.21.15.32:0/38568436 shutdown_connections 2023-06-20T13:32:49.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.242+0000 7fecb0bff700 1 -- 172.21.15.32:0/38568436 wait complete. 2023-06-20T13:32:49.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.244+0000 7fecb0bff700 1 Processor -- start 2023-06-20T13:32:49.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.244+0000 7fecb0bff700 1 -- start start 2023-06-20T13:32:49.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.245+0000 7fecb0bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fecac0b59d0 0x7fecac14cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:49.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.245+0000 7fecb0bff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecac0d2640 0x7fecac158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:49.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.245+0000 7fecb0bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecac15c460 0x7fecac0c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:49.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.245+0000 7fecb0bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecac14d0b0 con 0x7fecac0b59d0 2023-06-20T13:32:49.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.245+0000 7fecb0bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecac15dd80 con 0x7fecac15c460 2023-06-20T13:32:49.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.245+0000 7fecb0bff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecac15e060 con 0x7fecac0d2640 2023-06-20T13:32:49.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.245+0000 7fecaa59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fecac0b59d0 0x7fecac14cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:49.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.245+0000 7fecaa59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fecac0b59d0 0x7fecac14cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39386/0 (socket says 172.21.15.32:39386) 2023-06-20T13:32:49.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.245+0000 7fecaa59c700 1 -- 172.21.15.32:0/2097461435 learned_addr learned my addr 172.21.15.32:0/2097461435 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:49.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.245+0000 7fecaad9d700 1 --2- 172.21.15.32:0/2097461435 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecac15c460 0x7fecac0c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:49.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.245+0000 7feca3fff700 1 --2- 172.21.15.32:0/2097461435 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecac0d2640 0x7fecac158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:49.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.245+0000 7fecaa59c700 1 -- 172.21.15.32:0/2097461435 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecac0d2640 msgr2=0x7fecac158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:49.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.245+0000 7fecaa59c700 1 --2- 172.21.15.32:0/2097461435 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecac0d2640 0x7fecac158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:49.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.245+0000 7fecaa59c700 1 -- 172.21.15.32:0/2097461435 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecac15c460 msgr2=0x7fecac0c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:49.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.245+0000 7fecaa59c700 1 --2- 172.21.15.32:0/2097461435 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecac15c460 0x7fecac0c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:49.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.245+0000 7fecaa59c700 1 -- 172.21.15.32:0/2097461435 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca4009a70 con 0x7fecac0b59d0 2023-06-20T13:32:49.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.246+0000 7fecaa59c700 1 --2- 172.21.15.32:0/2097461435 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fecac0b59d0 0x7fecac14cb70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00c520 tx=0x7fec9c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:49.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.246+0000 7feca2ffd700 1 -- 172.21.15.32:0/2097461435 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c004c80 con 0x7fecac0b59d0 2023-06-20T13:32:49.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.246+0000 7feca2ffd700 1 -- 172.21.15.32:0/2097461435 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9c004e00 con 0x7fecac0b59d0 2023-06-20T13:32:49.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.246+0000 7fecb0bff700 1 -- 172.21.15.32:0/2097461435 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecac15e340 con 0x7fecac0b59d0 2023-06-20T13:32:49.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.246+0000 7feca2ffd700 1 -- 172.21.15.32:0/2097461435 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c007310 con 0x7fecac0b59d0 2023-06-20T13:32:49.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.246+0000 7fecb0bff700 1 -- 172.21.15.32:0/2097461435 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecac15e900 con 0x7fecac0b59d0 2023-06-20T13:32:49.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.247+0000 7fecb0bff700 1 -- 172.21.15.32:0/2097461435 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecac04ea60 con 0x7fecac0b59d0 2023-06-20T13:32:49.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.248+0000 7feca2ffd700 1 -- 172.21.15.32:0/2097461435 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fec9c007470 con 0x7fecac0b59d0 2023-06-20T13:32:49.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.250+0000 7feca2ffd700 1 --2- 172.21.15.32:0/2097461435 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fec8c06ace0 0x7fec8c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:49.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.250+0000 7feca2ffd700 1 -- 172.21.15.32:0/2097461435 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fec9c089540 con 0x7fecac0b59d0 2023-06-20T13:32:49.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.250+0000 7feca3fff700 1 --2- 172.21.15.32:0/2097461435 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fec8c06ace0 0x7fec8c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:49.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.250+0000 7feca3fff700 1 --2- 172.21.15.32:0/2097461435 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fec8c06ace0 0x7fec8c06d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fecac0c97b0 tx=0x7fec94009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:49.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.254+0000 7feca2ffd700 1 -- 172.21.15.32:0/2097461435 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fec9c054260 con 0x7fecac0b59d0 2023-06-20T13:32:49.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.506+0000 7fecb0bff700 1 -- 172.21.15.32:0/2097461435 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fecac0b4fa0 con 0x7fecac0b59d0 2023-06-20T13:32:49.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.507+0000 7feca2ffd700 1 -- 172.21.15.32:0/2097461435 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4670 (secure 0 0 0) 0x7fec9c057880 con 0x7fecac0b59d0 2023-06-20T13:32:49.508 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:32:49.508 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2171664589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2171664589},{"type":"v1","addr":"172.21.15.115:6834","nonce":2171664589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/959333888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":959333888},{"type":"v1","addr":"172.21.15.32:6837","nonce":959333888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3388117179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":3388117179},{"type":"v1","addr":"172.21.15.32:6835","nonce":3388117179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-20T13:32:20.527725+0000","modified":"2023-06-20T13:32:49.006923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3566362693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3566362693},{"type":"v1","addr":"172.21.15.115:6835","nonce":3566362693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-20T13:32:49.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.509+0000 7fecb0bff700 1 -- 172.21.15.32:0/2097461435 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fec8c06ace0 msgr2=0x7fec8c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:49.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.509+0000 7fecb0bff700 1 --2- 172.21.15.32:0/2097461435 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fec8c06ace0 0x7fec8c06d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fecac0c97b0 tx=0x7fec94009040 comp rx=0 tx=0).stop 2023-06-20T13:32:49.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.509+0000 7fecb0bff700 1 -- 172.21.15.32:0/2097461435 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fecac0b59d0 msgr2=0x7fecac14cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:49.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.509+0000 7fecb0bff700 1 --2- 172.21.15.32:0/2097461435 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fecac0b59d0 0x7fecac14cb70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00c520 tx=0x7fec9c00c8e0 comp rx=0 tx=0).stop 2023-06-20T13:32:49.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.509+0000 7fecb0bff700 1 -- 172.21.15.32:0/2097461435 shutdown_connections 2023-06-20T13:32:49.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.509+0000 7fecb0bff700 1 --2- 172.21.15.32:0/2097461435 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fec8c06ace0 0x7fec8c06d190 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:49.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.509+0000 7fecb0bff700 1 --2- 172.21.15.32:0/2097461435 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecac15c460 0x7fecac0c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:49.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.509+0000 7fecb0bff700 1 --2- 172.21.15.32:0/2097461435 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fecac0b59d0 0x7fecac14cb70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:49.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.509+0000 7fecb0bff700 1 --2- 172.21.15.32:0/2097461435 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecac0d2640 0x7fecac158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:49.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.509+0000 7fecb0bff700 1 -- 172.21.15.32:0/2097461435 >> 172.21.15.32:0/2097461435 conn(0x7fecac071660 msgr2=0x7fecac0b8040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:49.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.509+0000 7fecb0bff700 1 -- 172.21.15.32:0/2097461435 shutdown_connections 2023-06-20T13:32:49.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.510+0000 7fecb0bff700 1 -- 172.21.15.32:0/2097461435 wait complete. 2023-06-20T13:32:49.512 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2023-06-20T13:32:49.529 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:32:49.729 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.727+0000 7fd7c4fff700 1 Processor -- start 2023-06-20T13:32:49.729 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.727+0000 7fd7c4fff700 1 -- start start 2023-06-20T13:32:49.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.728+0000 7fd7c4fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd7c015c460 0x7fd7c00b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:49.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.729+0000 7fd7c4fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd7c00d2640 0x7fd7c00cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:49.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.729+0000 7fd7c4fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c00d1790 con 0x7fd7c00cf720 2023-06-20T13:32:49.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.729+0000 7fd7c4fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7c00cedd0 con 0x7fd7c015c460 2023-06-20T13:32:49.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.729+0000 7fd7c4fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c00cd950 con 0x7fd7c00d2640 2023-06-20T13:32:49.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.729+0000 7fd7b7fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd7c00d2640 0x7fd7c00cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:49.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.729+0000 7fd7be59c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd7c015c460 0x7fd7c00b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:49.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.729+0000 7fd7bed9d700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd7c00cf720 0x7fd7c00d2b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.32:37538/0 (socket says 172.21.15.32:37538) 2023-06-20T13:32:49.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.729+0000 7fd7bed9d700 1 -- 172.21.15.32:0/647345371 learned_addr learned my addr 172.21.15.32:0/647345371 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:49.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.730+0000 7fd7bdd9b700 1 -- 172.21.15.32:0/647345371 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508328893 0 0) 0x7fd7c00d1790 con 0x7fd7c00cf720 2023-06-20T13:32:49.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.730+0000 7fd7bdd9b700 1 -- 172.21.15.32:0/647345371 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7ac0035b0 con 0x7fd7c00cf720 2023-06-20T13:32:49.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.730+0000 7fd7b7fff700 1 -- 172.21.15.32:0/647345371 >> v2:172.21.15.115:3300/0 conn(0x7fd7c015c460 msgr2=0x7fd7c00b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:49.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.730+0000 7fd7b7fff700 1 --2- 172.21.15.32:0/647345371 >> v2:172.21.15.115:3300/0 conn(0x7fd7c015c460 0x7fd7c00b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:49.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.730+0000 7fd7b7fff700 1 -- 172.21.15.32:0/647345371 >> v1:172.21.15.115:6789/0 conn(0x7fd7c00cf720 legacy=0x7fd7c00d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:49.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.730+0000 7fd7b7fff700 1 -- 172.21.15.32:0/647345371 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c00d14b0 con 0x7fd7c00d2640 2023-06-20T13:32:49.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.730+0000 7fd7be59c700 1 --2- 172.21.15.32:0/647345371 >> v2:172.21.15.115:3300/0 conn(0x7fd7c015c460 0x7fd7c00b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:32:49.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.730+0000 7fd7b7fff700 1 --2- 172.21.15.32:0/647345371 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd7c00d2640 0x7fd7c00cf1e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009840 tx=0x7fd7a8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acb09c124aed1187 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:49.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.730+0000 7fd7bdd9b700 1 -- 172.21.15.32:0/647345371 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8011830 con 0x7fd7c00d2640 2023-06-20T13:32:49.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.730+0000 7fd7bdd9b700 1 -- 172.21.15.32:0/647345371 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a8011990 con 0x7fd7c00d2640 2023-06-20T13:32:49.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.731+0000 7fd7bdd9b700 1 -- 172.21.15.32:0/647345371 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8011d00 con 0x7fd7c00d2640 2023-06-20T13:32:49.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.731+0000 7fd7c4fff700 1 -- 172.21.15.32:0/647345371 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd7c00d2640 msgr2=0x7fd7c00cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:49.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.731+0000 7fd7c4fff700 1 --2- 172.21.15.32:0/647345371 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd7c00d2640 0x7fd7c00cf1e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009840 tx=0x7fd7a8009b50 comp rx=0 tx=0).stop 2023-06-20T13:32:49.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.731+0000 7fd7c4fff700 1 -- 172.21.15.32:0/647345371 shutdown_connections 2023-06-20T13:32:49.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.731+0000 7fd7c4fff700 1 --2- 172.21.15.32:0/647345371 >> v2:172.21.15.115:3300/0 conn(0x7fd7c015c460 0x7fd7c00b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:49.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.731+0000 7fd7c4fff700 1 --2- 172.21.15.32:0/647345371 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd7c00d2640 0x7fd7c00cf1e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:49.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.731+0000 7fd7c4fff700 1 -- 172.21.15.32:0/647345371 >> 172.21.15.32:0/647345371 conn(0x7fd7c0071660 msgr2=0x7fd7c0071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:49.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.731+0000 7fd7c4fff700 1 -- 172.21.15.32:0/647345371 shutdown_connections 2023-06-20T13:32:49.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.731+0000 7fd7c4fff700 1 -- 172.21.15.32:0/647345371 wait complete. 2023-06-20T13:32:49.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.733+0000 7fd7c4fff700 1 Processor -- start 2023-06-20T13:32:49.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.733+0000 7fd7c4fff700 1 -- start start 2023-06-20T13:32:49.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.734+0000 7fd7c4fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7c00cf720 0x7fd7c00c6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:49.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.734+0000 7fd7c4fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd7c00d2640 0x7fd7c00c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:49.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.734+0000 7fd7c4fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7c015c460 0x7fd7c014c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:49.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.734+0000 7fd7c4fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c014cfe0 con 0x7fd7c015c460 2023-06-20T13:32:49.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.734+0000 7fd7c4fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c00c77a0 con 0x7fd7c00cf720 2023-06-20T13:32:49.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.734+0000 7fd7c4fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c01e6940 con 0x7fd7c00d2640 2023-06-20T13:32:49.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.735+0000 7fd7be59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7c00cf720 0x7fd7c00c6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:49.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.735+0000 7fd7bed9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7c015c460 0x7fd7c014c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:49.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.735+0000 7fd7be59c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7c00cf720 0x7fd7c00c6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:58738/0 (socket says 172.21.15.32:58738) 2023-06-20T13:32:49.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.735+0000 7fd7be59c700 1 -- 172.21.15.32:0/1820833587 learned_addr learned my addr 172.21.15.32:0/1820833587 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:49.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.735+0000 7fd7b7fff700 1 --2- 172.21.15.32:0/1820833587 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd7c00d2640 0x7fd7c00c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:49.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.735+0000 7fd7be59c700 1 -- 172.21.15.32:0/1820833587 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd7c00d2640 msgr2=0x7fd7c00c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:49.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.735+0000 7fd7be59c700 1 --2- 172.21.15.32:0/1820833587 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd7c00d2640 0x7fd7c00c70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:49.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.735+0000 7fd7be59c700 1 -- 172.21.15.32:0/1820833587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7c015c460 msgr2=0x7fd7c014c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:49.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.735+0000 7fd7be59c700 1 --2- 172.21.15.32:0/1820833587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7c015c460 0x7fd7c014c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:49.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.735+0000 7fd7be59c700 1 -- 172.21.15.32:0/1820833587 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b00094a0 con 0x7fd7c00cf720 2023-06-20T13:32:49.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.735+0000 7fd7bed9d700 1 --2- 172.21.15.32:0/1820833587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7c015c460 0x7fd7c014c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:32:49.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.735+0000 7fd7be59c700 1 --2- 172.21.15.32:0/1820833587 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7c00cf720 0x7fd7c00c6b50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd7b000ec10 tx=0x7fd7b000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:49.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.736+0000 7fd7b6ffd700 1 -- 172.21.15.32:0/1820833587 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b000c850 con 0x7fd7c00cf720 2023-06-20T13:32:49.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.736+0000 7fd7b6ffd700 1 -- 172.21.15.32:0/1820833587 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b000c9b0 con 0x7fd7c00cf720 2023-06-20T13:32:49.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.736+0000 7fd7b6ffd700 1 -- 172.21.15.32:0/1820833587 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b000cd20 con 0x7fd7c00cf720 2023-06-20T13:32:49.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.736+0000 7fd7c4fff700 1 -- 172.21.15.32:0/1820833587 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a80094a0 con 0x7fd7c00cf720 2023-06-20T13:32:49.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.736+0000 7fd7c4fff700 1 -- 172.21.15.32:0/1820833587 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c01e6e70 con 0x7fd7c00cf720 2023-06-20T13:32:49.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.737+0000 7fd7c4fff700 1 -- 172.21.15.32:0/1820833587 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c01e77a0 con 0x7fd7c00cf720 2023-06-20T13:32:49.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.738+0000 7fd7b6ffd700 1 -- 172.21.15.32:0/1820833587 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd7b0013470 con 0x7fd7c00cf720 2023-06-20T13:32:49.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.739+0000 7fd7b6ffd700 1 --2- 172.21.15.32:0/1820833587 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd7a006ace0 0x7fd7a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:49.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.739+0000 7fd7b6ffd700 1 -- 172.21.15.32:0/1820833587 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd7b0089880 con 0x7fd7c00cf720 2023-06-20T13:32:49.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.739+0000 7fd7b7fff700 1 --2- 172.21.15.32:0/1820833587 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd7a006ace0 0x7fd7a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:49.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.740+0000 7fd7b7fff700 1 --2- 172.21.15.32:0/1820833587 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd7a006ace0 0x7fd7a006d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009fd0 tx=0x7fd7a801c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:49.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.744+0000 7fd7b6ffd700 1 -- 172.21.15.32:0/1820833587 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd7b0058030 con 0x7fd7c00cf720 2023-06-20T13:32:49.952 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.951+0000 7fd7c4fff700 1 -- 172.21.15.32:0/1820833587 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7c004ea60 con 0x7fd7c00cf720 2023-06-20T13:32:49.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.953+0000 7fd7b6ffd700 1 -- 172.21.15.32:0/1820833587 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20096 (secure 0 0 0) 0x7fd7b0057bc0 con 0x7fd7c00cf720 2023-06-20T13:32:49.954 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:32:49.955 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":27,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:32:25.570940+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-20T13:32:18.120021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-20T13:32:19.503624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-20T13:32:23.074912+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:32:49.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.955+0000 7fd7c4fff700 1 -- 172.21.15.32:0/1820833587 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd7a006ace0 msgr2=0x7fd7a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:49.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.955+0000 7fd7c4fff700 1 --2- 172.21.15.32:0/1820833587 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd7a006ace0 0x7fd7a006d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009fd0 tx=0x7fd7a801c040 comp rx=0 tx=0).stop 2023-06-20T13:32:49.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.955+0000 7fd7c4fff700 1 -- 172.21.15.32:0/1820833587 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7c00cf720 msgr2=0x7fd7c00c6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:49.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.955+0000 7fd7c4fff700 1 --2- 172.21.15.32:0/1820833587 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7c00cf720 0x7fd7c00c6b50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd7b000ec10 tx=0x7fd7b000ef20 comp rx=0 tx=0).stop 2023-06-20T13:32:49.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.955+0000 7fd7c4fff700 1 -- 172.21.15.32:0/1820833587 shutdown_connections 2023-06-20T13:32:49.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.955+0000 7fd7c4fff700 1 --2- 172.21.15.32:0/1820833587 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd7a006ace0 0x7fd7a006d190 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:49.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.955+0000 7fd7c4fff700 1 --2- 172.21.15.32:0/1820833587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd7c015c460 0x7fd7c014c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:49.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.955+0000 7fd7c4fff700 1 --2- 172.21.15.32:0/1820833587 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7c00cf720 0x7fd7c00c6b50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:49.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.955+0000 7fd7c4fff700 1 --2- 172.21.15.32:0/1820833587 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd7c00d2640 0x7fd7c00c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:49.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.955+0000 7fd7c4fff700 1 -- 172.21.15.32:0/1820833587 >> 172.21.15.32:0/1820833587 conn(0x7fd7c0071660 msgr2=0x7fd7c0071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:49.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.955+0000 7fd7c4fff700 1 -- 172.21.15.32:0/1820833587 shutdown_connections 2023-06-20T13:32:49.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:49.955+0000 7fd7c4fff700 1 -- 172.21.15.32:0/1820833587 wait complete. 2023-06-20T13:32:49.975 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-20T13:32:49.976 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-20T13:32:50.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.178+0000 7f32d8dff700 1 Processor -- start 2023-06-20T13:32:50.179 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.178+0000 7f32d8dff700 1 -- start start 2023-06-20T13:32:50.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.179+0000 7f32d8dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f32d4157f10 0x7f32d406a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:50.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.179+0000 7f32d8dff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f32d4070340 0x7f32d415e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:50.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.179+0000 7f32d8dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32d4070a50 0x7f32d4070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:50.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.179+0000 7f32d8dff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32d406d900 con 0x7f32d4070340 2023-06-20T13:32:50.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.179+0000 7f32d8dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32d40713f0 con 0x7f32d4157f10 2023-06-20T13:32:50.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.179+0000 7f32d8dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d415e210 con 0x7f32d4070a50 2023-06-20T13:32:50.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.179+0000 7f32d1d9b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f32d4070340 0x7f32d415e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:50.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.179+0000 7f32d1d9b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f32d4070340 0x7f32d415e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58936/0 (socket says 172.21.15.32:58936) 2023-06-20T13:32:50.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.179+0000 7f32d1d9b700 1 -- 172.21.15.32:0/1488501055 learned_addr learned my addr 172.21.15.32:0/1488501055 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:50.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.179+0000 7f32d2d9d700 1 --2- 172.21.15.32:0/1488501055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32d4070a50 0x7f32d4070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:50.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.179+0000 7f32d259c700 1 --2- 172.21.15.32:0/1488501055 >> v2:172.21.15.115:3300/0 conn(0x7f32d4157f10 0x7f32d406a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:50.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.180+0000 7f32d1d9b700 1 -- 172.21.15.32:0/1488501055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32d4070a50 msgr2=0x7f32d4070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:50.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.180+0000 7f32d1d9b700 1 --2- 172.21.15.32:0/1488501055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32d4070a50 0x7f32d4070eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:50.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.180+0000 7f32d1d9b700 1 -- 172.21.15.32:0/1488501055 >> v2:172.21.15.115:3300/0 conn(0x7f32d4157f10 msgr2=0x7f32d406a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:50.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.180+0000 7f32d1d9b700 1 --2- 172.21.15.32:0/1488501055 >> v2:172.21.15.115:3300/0 conn(0x7f32d4157f10 0x7f32d406a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:50.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.180+0000 7f32d1d9b700 1 -- 172.21.15.32:0/1488501055 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d415dee0 con 0x7f32d4070340 2023-06-20T13:32:50.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.180+0000 7f32d1d9b700 1 --2- 172.21.15.32:0/1488501055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32d4070340 0x7f32d415e6a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f32d40cc030 tx=0x7f32c8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1028fbaba52c4f server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:50.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.180+0000 7f32d159a700 1 -- 172.21.15.32:0/1488501055 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c800b870 con 0x7f32d4070340 2023-06-20T13:32:50.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.180+0000 7f32d159a700 1 -- 172.21.15.32:0/1488501055 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c800b9d0 con 0x7f32d4070340 2023-06-20T13:32:50.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.180+0000 7f32d159a700 1 -- 172.21.15.32:0/1488501055 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c800bd60 con 0x7f32d4070340 2023-06-20T13:32:50.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.181+0000 7f32d8dff700 1 -- 172.21.15.32:0/1488501055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32d4070340 msgr2=0x7f32d415e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:50.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.181+0000 7f32d8dff700 1 --2- 172.21.15.32:0/1488501055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32d4070340 0x7f32d415e6a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f32d40cc030 tx=0x7f32c8009bd0 comp rx=0 tx=0).stop 2023-06-20T13:32:50.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.181+0000 7f32d8dff700 1 -- 172.21.15.32:0/1488501055 shutdown_connections 2023-06-20T13:32:50.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.181+0000 7f32d8dff700 1 --2- 172.21.15.32:0/1488501055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32d4070a50 0x7f32d4070eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:50.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.181+0000 7f32d8dff700 1 --2- 172.21.15.32:0/1488501055 >> v2:172.21.15.115:3300/0 conn(0x7f32d4157f10 0x7f32d406a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:50.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.181+0000 7f32d8dff700 1 --2- 172.21.15.32:0/1488501055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32d4070340 0x7f32d415e6a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:50.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.181+0000 7f32d8dff700 1 -- 172.21.15.32:0/1488501055 >> 172.21.15.32:0/1488501055 conn(0x7f32d40b0390 msgr2=0x7f32d40b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:50.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.181+0000 7f32d8dff700 1 -- 172.21.15.32:0/1488501055 shutdown_connections 2023-06-20T13:32:50.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.181+0000 7f32d8dff700 1 -- 172.21.15.32:0/1488501055 wait complete. 2023-06-20T13:32:50.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.183+0000 7f32d8dff700 1 Processor -- start 2023-06-20T13:32:50.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.183+0000 7f32d8dff700 1 -- start start 2023-06-20T13:32:50.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.184+0000 7f32d8dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32d4070340 0x7f32d415c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:50.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.184+0000 7f32d8dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32d4070a50 0x7f32d415c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:50.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.184+0000 7f32d8dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32d4157f10 0x7f32d40ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:50.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.184+0000 7f32d8dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d40b3500 con 0x7f32d4070340 2023-06-20T13:32:50.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.184+0000 7f32d8dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d40ad6b0 con 0x7f32d4070a50 2023-06-20T13:32:50.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.184+0000 7f32d8dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d40b3920 con 0x7f32d4157f10 2023-06-20T13:32:50.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.184+0000 7f32d259c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32d4070340 0x7f32d415c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:50.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.184+0000 7f32d259c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32d4070340 0x7f32d415c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58946/0 (socket says 172.21.15.32:58946) 2023-06-20T13:32:50.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.184+0000 7f32d259c700 1 -- 172.21.15.32:0/2017052653 learned_addr learned my addr 172.21.15.32:0/2017052653 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:50.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.184+0000 7f32d2d9d700 1 --2- 172.21.15.32:0/2017052653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32d4157f10 0x7f32d40ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:50.190 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.184+0000 7f32d1d9b700 1 --2- 172.21.15.32:0/2017052653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32d4070a50 0x7f32d415c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:50.190 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.185+0000 7f32d259c700 1 -- 172.21.15.32:0/2017052653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32d4157f10 msgr2=0x7f32d40ab8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:50.190 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.185+0000 7f32d259c700 1 --2- 172.21.15.32:0/2017052653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32d4157f10 0x7f32d40ab8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:50.190 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.185+0000 7f32d259c700 1 -- 172.21.15.32:0/2017052653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32d4070a50 msgr2=0x7f32d415c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:50.190 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.185+0000 7f32d259c700 1 --2- 172.21.15.32:0/2017052653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32d4070a50 0x7f32d415c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:50.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.185+0000 7f32d259c700 1 -- 172.21.15.32:0/2017052653 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c8009550 con 0x7f32d4070340 2023-06-20T13:32:50.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.185+0000 7f32d2d9d700 1 --2- 172.21.15.32:0/2017052653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32d4157f10 0x7f32d40ab8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:32:50.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.185+0000 7f32d259c700 1 --2- 172.21.15.32:0/2017052653 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32d4070340 0x7f32d415c0e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f32c400d800 tx=0x7f32c400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:50.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.185+0000 7f32c2ffd700 1 -- 172.21.15.32:0/2017052653 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c40125f0 con 0x7f32d4070340 2023-06-20T13:32:50.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.185+0000 7f32c2ffd700 1 -- 172.21.15.32:0/2017052653 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c4012750 con 0x7f32d4070340 2023-06-20T13:32:50.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.185+0000 7f32d8dff700 1 -- 172.21.15.32:0/2017052653 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32d40b2880 con 0x7f32d4070340 2023-06-20T13:32:50.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.185+0000 7f32c2ffd700 1 -- 172.21.15.32:0/2017052653 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c4012b00 con 0x7f32d4070340 2023-06-20T13:32:50.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.185+0000 7f32d8dff700 1 -- 172.21.15.32:0/2017052653 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32d40b2e40 con 0x7f32d4070340 2023-06-20T13:32:50.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.186+0000 7f32d8dff700 1 -- 172.21.15.32:0/2017052653 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32d40b3770 con 0x7f32d4070340 2023-06-20T13:32:50.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.187+0000 7f32c2ffd700 1 -- 172.21.15.32:0/2017052653 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f32c4012c60 con 0x7f32d4070340 2023-06-20T13:32:50.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.188+0000 7f32c2ffd700 1 --2- 172.21.15.32:0/2017052653 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f32b406ace0 0x7f32b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:50.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.188+0000 7f32c2ffd700 1 -- 172.21.15.32:0/2017052653 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f32c4089ae0 con 0x7f32d4070340 2023-06-20T13:32:50.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.188+0000 7f32d1d9b700 1 --2- 172.21.15.32:0/2017052653 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f32b406ace0 0x7f32b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:50.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.189+0000 7f32d1d9b700 1 --2- 172.21.15.32:0/2017052653 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f32b406ace0 0x7f32b406d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f32c8000c00 tx=0x7f32c8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:50.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.192+0000 7f32c2ffd700 1 -- 172.21.15.32:0/2017052653 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f32c4054890 con 0x7f32d4070340 2023-06-20T13:32:50.395 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.394+0000 7f32d8dff700 1 -- 172.21.15.32:0/2017052653 --> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f32d40c9220 con 0x7f32b406ace0 2023-06-20T13:32:50.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.407+0000 7f32c2ffd700 1 -- 172.21.15.32:0/2017052653 <== mgr.4101 v2:172.21.15.32:6832/1136488437 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367335 (secure 0 0 0) 0x7f32c800bb40 con 0x7f32b406ace0 2023-06-20T13:32:50.412 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:32:50.414 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.411+0000 7f32d8dff700 1 -- 172.21.15.32:0/2017052653 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f32b406ace0 msgr2=0x7f32b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:50.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.411+0000 7f32d8dff700 1 --2- 172.21.15.32:0/2017052653 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f32b406ace0 0x7f32b406d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f32c8000c00 tx=0x7f32c8008030 comp rx=0 tx=0).stop 2023-06-20T13:32:50.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.412+0000 7f32d8dff700 1 -- 172.21.15.32:0/2017052653 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32d4070340 msgr2=0x7f32d415c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:50.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.412+0000 7f32d8dff700 1 --2- 172.21.15.32:0/2017052653 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32d4070340 0x7f32d415c0e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f32c400d800 tx=0x7f32c400db10 comp rx=0 tx=0).stop 2023-06-20T13:32:50.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.412+0000 7f32d8dff700 1 -- 172.21.15.32:0/2017052653 shutdown_connections 2023-06-20T13:32:50.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.412+0000 7f32d8dff700 1 --2- 172.21.15.32:0/2017052653 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f32b406ace0 0x7f32b406d190 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:50.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.412+0000 7f32d8dff700 1 --2- 172.21.15.32:0/2017052653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32d4157f10 0x7f32d40ab8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:50.415 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.412+0000 7f32d8dff700 1 --2- 172.21.15.32:0/2017052653 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f32d4070340 0x7f32d415c0e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:50.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.412+0000 7f32d8dff700 1 --2- 172.21.15.32:0/2017052653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32d4070a50 0x7f32d415c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:50.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.412+0000 7f32d8dff700 1 -- 172.21.15.32:0/2017052653 >> 172.21.15.32:0/2017052653 conn(0x7f32d40b0390 msgr2=0x7f32d40afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:50.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.412+0000 7f32d8dff700 1 -- 172.21.15.32:0/2017052653 shutdown_connections 2023-06-20T13:32:50.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.412+0000 7f32d8dff700 1 -- 172.21.15.32:0/2017052653 wait complete. 2023-06-20T13:32:50.416 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-06-20T13:32:50.431 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2023-06-20T13:32:49.260224+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219080,"kb_used_data":3464,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755640,"statfs":{"total":773094113280,"available":772869775360,"internally_reserved":0,"allocated":3547136,"data_stored":2140168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003090"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.048185+0000","last_change":"2023-06-20T13:32:21.033030+0000","last_active":"2023-06-20T13:32:26.048185+0000","last_peered":"2023-06-20T13:32:26.048185+0000","last_clean":"2023-06-20T13:32:26.048185+0000","last_became_active":"2023-06-20T13:32:21.032583+0000","last_became_peered":"2023-06-20T13:32:21.032583+0000","last_unstale":"2023-06-20T13:32:26.048185+0000","last_undegraded":"2023-06-20T13:32:26.048185+0000","last_fullsized":"2023-06-20T13:32:26.048185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:43:58.636715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225801+0000","last_change":"2023-06-20T13:32:21.028815+0000","last_active":"2023-06-20T13:32:27.225801+0000","last_peered":"2023-06-20T13:32:27.225801+0000","last_clean":"2023-06-20T13:32:27.225801+0000","last_became_active":"2023-06-20T13:32:21.026146+0000","last_became_peered":"2023-06-20T13:32:21.026146+0000","last_unstale":"2023-06-20T13:32:27.225801+0000","last_undegraded":"2023-06-20T13:32:27.225801+0000","last_fullsized":"2023-06-20T13:32:27.225801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:22:54.374851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288495+0000","last_change":"2023-06-20T13:32:21.031230+0000","last_active":"2023-06-20T13:32:26.288495+0000","last_peered":"2023-06-20T13:32:26.288495+0000","last_clean":"2023-06-20T13:32:26.288495+0000","last_became_active":"2023-06-20T13:32:21.030270+0000","last_became_peered":"2023-06-20T13:32:21.030270+0000","last_unstale":"2023-06-20T13:32:26.288495+0000","last_undegraded":"2023-06-20T13:32:26.288495+0000","last_fullsized":"2023-06-20T13:32:26.288495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:32:45.231640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225268+0000","last_change":"2023-06-20T13:32:21.033833+0000","last_active":"2023-06-20T13:32:27.225268+0000","last_peered":"2023-06-20T13:32:27.225268+0000","last_clean":"2023-06-20T13:32:27.225268+0000","last_became_active":"2023-06-20T13:32:21.033516+0000","last_became_peered":"2023-06-20T13:32:21.033516+0000","last_unstale":"2023-06-20T13:32:27.225268+0000","last_undegraded":"2023-06-20T13:32:27.225268+0000","last_fullsized":"2023-06-20T13:32:27.225268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:46:34.316386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050622+0000","last_change":"2023-06-20T13:32:21.033655+0000","last_active":"2023-06-20T13:32:26.050622+0000","last_peered":"2023-06-20T13:32:26.050622+0000","last_clean":"2023-06-20T13:32:26.050622+0000","last_became_active":"2023-06-20T13:32:21.033357+0000","last_became_peered":"2023-06-20T13:32:21.033357+0000","last_unstale":"2023-06-20T13:32:26.050622+0000","last_undegraded":"2023-06-20T13:32:26.050622+0000","last_fullsized":"2023-06-20T13:32:26.050622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:39:14.274571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288173+0000","last_change":"2023-06-20T13:32:21.032497+0000","last_active":"2023-06-20T13:32:26.288173+0000","last_peered":"2023-06-20T13:32:26.288173+0000","last_clean":"2023-06-20T13:32:26.288173+0000","last_became_active":"2023-06-20T13:32:21.032222+0000","last_became_peered":"2023-06-20T13:32:21.032222+0000","last_unstale":"2023-06-20T13:32:26.288173+0000","last_undegraded":"2023-06-20T13:32:26.288173+0000","last_fullsized":"2023-06-20T13:32:26.288173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:29:48.507048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049899+0000","last_change":"2023-06-20T13:32:21.022372+0000","last_active":"2023-06-20T13:32:26.049899+0000","last_peered":"2023-06-20T13:32:26.049899+0000","last_clean":"2023-06-20T13:32:26.049899+0000","last_became_active":"2023-06-20T13:32:21.021763+0000","last_became_peered":"2023-06-20T13:32:21.021763+0000","last_unstale":"2023-06-20T13:32:26.049899+0000","last_undegraded":"2023-06-20T13:32:26.049899+0000","last_fullsized":"2023-06-20T13:32:26.049899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:22:54.374851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224785+0000","last_change":"2023-06-20T13:32:21.040883+0000","last_active":"2023-06-20T13:32:27.224785+0000","last_peered":"2023-06-20T13:32:27.224785+0000","last_clean":"2023-06-20T13:32:27.224785+0000","last_became_active":"2023-06-20T13:32:21.040645+0000","last_became_peered":"2023-06-20T13:32:21.040645+0000","last_unstale":"2023-06-20T13:32:27.224785+0000","last_undegraded":"2023-06-20T13:32:27.224785+0000","last_fullsized":"2023-06-20T13:32:27.224785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:10:11.011524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049846+0000","last_change":"2023-06-20T13:32:21.032741+0000","last_active":"2023-06-20T13:32:26.049846+0000","last_peered":"2023-06-20T13:32:26.049846+0000","last_clean":"2023-06-20T13:32:26.049846+0000","last_became_active":"2023-06-20T13:32:21.031965+0000","last_became_peered":"2023-06-20T13:32:21.031965+0000","last_unstale":"2023-06-20T13:32:26.049846+0000","last_undegraded":"2023-06-20T13:32:26.049846+0000","last_fullsized":"2023-06-20T13:32:26.049846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:10:11.011524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.226123+0000","last_change":"2023-06-20T13:32:21.029077+0000","last_active":"2023-06-20T13:32:27.226123+0000","last_peered":"2023-06-20T13:32:27.226123+0000","last_clean":"2023-06-20T13:32:27.226123+0000","last_became_active":"2023-06-20T13:32:21.025779+0000","last_became_peered":"2023-06-20T13:32:21.025779+0000","last_unstale":"2023-06-20T13:32:27.226123+0000","last_undegraded":"2023-06-20T13:32:27.226123+0000","last_fullsized":"2023-06-20T13:32:27.226123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:12:08.369795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288693+0000","last_change":"2023-06-20T13:32:21.031418+0000","last_active":"2023-06-20T13:32:26.288693+0000","last_peered":"2023-06-20T13:32:26.288693+0000","last_clean":"2023-06-20T13:32:26.288693+0000","last_became_active":"2023-06-20T13:32:21.030652+0000","last_became_peered":"2023-06-20T13:32:21.030652+0000","last_unstale":"2023-06-20T13:32:26.288693+0000","last_undegraded":"2023-06-20T13:32:26.288693+0000","last_fullsized":"2023-06-20T13:32:26.288693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:34:05.805819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.048364+0000","last_change":"2023-06-20T13:32:21.038615+0000","last_active":"2023-06-20T13:32:26.048364+0000","last_peered":"2023-06-20T13:32:26.048364+0000","last_clean":"2023-06-20T13:32:26.048364+0000","last_became_active":"2023-06-20T13:32:21.038282+0000","last_became_peered":"2023-06-20T13:32:21.038282+0000","last_unstale":"2023-06-20T13:32:26.048364+0000","last_undegraded":"2023-06-20T13:32:26.048364+0000","last_fullsized":"2023-06-20T13:32:26.048364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:59:33.841139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.047994+0000","last_change":"2023-06-20T13:32:21.031597+0000","last_active":"2023-06-20T13:32:26.047994+0000","last_peered":"2023-06-20T13:32:26.047994+0000","last_clean":"2023-06-20T13:32:26.047994+0000","last_became_active":"2023-06-20T13:32:21.031271+0000","last_became_peered":"2023-06-20T13:32:21.031271+0000","last_unstale":"2023-06-20T13:32:26.047994+0000","last_undegraded":"2023-06-20T13:32:26.047994+0000","last_fullsized":"2023-06-20T13:32:26.047994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:44:15.228781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225403+0000","last_change":"2023-06-20T13:32:21.025613+0000","last_active":"2023-06-20T13:32:27.225403+0000","last_peered":"2023-06-20T13:32:27.225403+0000","last_clean":"2023-06-20T13:32:27.225403+0000","last_became_active":"2023-06-20T13:32:21.025299+0000","last_became_peered":"2023-06-20T13:32:21.025299+0000","last_unstale":"2023-06-20T13:32:27.225403+0000","last_undegraded":"2023-06-20T13:32:27.225403+0000","last_fullsized":"2023-06-20T13:32:27.225403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:02:59.622021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049134+0000","last_change":"2023-06-20T13:32:21.022539+0000","last_active":"2023-06-20T13:32:26.049134+0000","last_peered":"2023-06-20T13:32:26.049134+0000","last_clean":"2023-06-20T13:32:26.049134+0000","last_became_active":"2023-06-20T13:32:21.022066+0000","last_became_peered":"2023-06-20T13:32:21.022066+0000","last_unstale":"2023-06-20T13:32:26.049134+0000","last_undegraded":"2023-06-20T13:32:26.049134+0000","last_fullsized":"2023-06-20T13:32:26.049134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:41:51.423544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287835+0000","last_change":"2023-06-20T13:32:21.029934+0000","last_active":"2023-06-20T13:32:26.287835+0000","last_peered":"2023-06-20T13:32:26.287835+0000","last_clean":"2023-06-20T13:32:26.287835+0000","last_became_active":"2023-06-20T13:32:21.029620+0000","last_became_peered":"2023-06-20T13:32:21.029620+0000","last_unstale":"2023-06-20T13:32:26.287835+0000","last_undegraded":"2023-06-20T13:32:26.287835+0000","last_fullsized":"2023-06-20T13:32:26.287835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:24:59.969867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049998+0000","last_change":"2023-06-20T13:32:21.032911+0000","last_active":"2023-06-20T13:32:26.049998+0000","last_peered":"2023-06-20T13:32:26.049998+0000","last_clean":"2023-06-20T13:32:26.049998+0000","last_became_active":"2023-06-20T13:32:21.032330+0000","last_became_peered":"2023-06-20T13:32:21.032330+0000","last_unstale":"2023-06-20T13:32:26.049998+0000","last_undegraded":"2023-06-20T13:32:26.049998+0000","last_fullsized":"2023-06-20T13:32:26.049998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:25:29.097559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288480+0000","last_change":"2023-06-20T13:32:21.032286+0000","last_active":"2023-06-20T13:32:26.288480+0000","last_peered":"2023-06-20T13:32:26.288480+0000","last_clean":"2023-06-20T13:32:26.288480+0000","last_became_active":"2023-06-20T13:32:21.032026+0000","last_became_peered":"2023-06-20T13:32:21.032026+0000","last_unstale":"2023-06-20T13:32:26.288480+0000","last_undegraded":"2023-06-20T13:32:26.288480+0000","last_fullsized":"2023-06-20T13:32:26.288480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:20:54.027209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.047620+0000","last_change":"2023-06-20T13:32:21.038729+0000","last_active":"2023-06-20T13:32:26.047620+0000","last_peered":"2023-06-20T13:32:26.047620+0000","last_clean":"2023-06-20T13:32:26.047620+0000","last_became_active":"2023-06-20T13:32:21.038349+0000","last_became_peered":"2023-06-20T13:32:21.038349+0000","last_unstale":"2023-06-20T13:32:26.047620+0000","last_undegraded":"2023-06-20T13:32:26.047620+0000","last_fullsized":"2023-06-20T13:32:26.047620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:52:33.238643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288055+0000","last_change":"2023-06-20T13:32:21.038223+0000","last_active":"2023-06-20T13:32:26.288055+0000","last_peered":"2023-06-20T13:32:26.288055+0000","last_clean":"2023-06-20T13:32:26.288055+0000","last_became_active":"2023-06-20T13:32:21.037898+0000","last_became_peered":"2023-06-20T13:32:21.037898+0000","last_unstale":"2023-06-20T13:32:26.288055+0000","last_undegraded":"2023-06-20T13:32:26.288055+0000","last_fullsized":"2023-06-20T13:32:26.288055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:22:57.611066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049472+0000","last_change":"2023-06-20T13:32:21.031301+0000","last_active":"2023-06-20T13:32:26.049472+0000","last_peered":"2023-06-20T13:32:26.049472+0000","last_clean":"2023-06-20T13:32:26.049472+0000","last_became_active":"2023-06-20T13:32:21.031013+0000","last_became_peered":"2023-06-20T13:32:21.031013+0000","last_unstale":"2023-06-20T13:32:26.049472+0000","last_undegraded":"2023-06-20T13:32:26.049472+0000","last_fullsized":"2023-06-20T13:32:26.049472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:29:48.333437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049583+0000","last_change":"2023-06-20T13:32:21.025148+0000","last_active":"2023-06-20T13:32:26.049583+0000","last_peered":"2023-06-20T13:32:26.049583+0000","last_clean":"2023-06-20T13:32:26.049583+0000","last_became_active":"2023-06-20T13:32:21.024903+0000","last_became_peered":"2023-06-20T13:32:21.024903+0000","last_unstale":"2023-06-20T13:32:26.049583+0000","last_undegraded":"2023-06-20T13:32:26.049583+0000","last_fullsized":"2023-06-20T13:32:26.049583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:41:51.423544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224396+0000","last_change":"2023-06-20T13:32:21.028704+0000","last_active":"2023-06-20T13:32:27.224396+0000","last_peered":"2023-06-20T13:32:27.224396+0000","last_clean":"2023-06-20T13:32:27.224396+0000","last_became_active":"2023-06-20T13:32:21.028340+0000","last_became_peered":"2023-06-20T13:32:21.028340+0000","last_unstale":"2023-06-20T13:32:27.224396+0000","last_undegraded":"2023-06-20T13:32:27.224396+0000","last_fullsized":"2023-06-20T13:32:27.224396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:48:09.417634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049186+0000","last_change":"2023-06-20T13:32:21.034406+0000","last_active":"2023-06-20T13:32:26.049186+0000","last_peered":"2023-06-20T13:32:26.049186+0000","last_clean":"2023-06-20T13:32:26.049186+0000","last_became_active":"2023-06-20T13:32:21.034097+0000","last_became_peered":"2023-06-20T13:32:21.034097+0000","last_unstale":"2023-06-20T13:32:26.049186+0000","last_undegraded":"2023-06-20T13:32:26.049186+0000","last_fullsized":"2023-06-20T13:32:26.049186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:10:11.011524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998821+0000","last_change":"2023-06-20T13:32:21.038778+0000","last_active":"2023-06-20T13:32:26.998821+0000","last_peered":"2023-06-20T13:32:26.998821+0000","last_clean":"2023-06-20T13:32:26.998821+0000","last_became_active":"2023-06-20T13:32:21.038456+0000","last_became_peered":"2023-06-20T13:32:21.038456+0000","last_unstale":"2023-06-20T13:32:26.998821+0000","last_undegraded":"2023-06-20T13:32:26.998821+0000","last_fullsized":"2023-06-20T13:32:26.998821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:29:48.333437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998629+0000","last_change":"2023-06-20T13:32:21.023655+0000","last_active":"2023-06-20T13:32:26.998629+0000","last_peered":"2023-06-20T13:32:26.998629+0000","last_clean":"2023-06-20T13:32:26.998629+0000","last_became_active":"2023-06-20T13:32:21.023366+0000","last_became_peered":"2023-06-20T13:32:21.023366+0000","last_unstale":"2023-06-20T13:32:26.998629+0000","last_undegraded":"2023-06-20T13:32:26.998629+0000","last_fullsized":"2023-06-20T13:32:26.998629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:02:59.622021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225931+0000","last_change":"2023-06-20T13:32:21.040132+0000","last_active":"2023-06-20T13:32:27.225931+0000","last_peered":"2023-06-20T13:32:27.225931+0000","last_clean":"2023-06-20T13:32:27.225931+0000","last_became_active":"2023-06-20T13:32:21.039482+0000","last_became_peered":"2023-06-20T13:32:21.039482+0000","last_unstale":"2023-06-20T13:32:27.225931+0000","last_undegraded":"2023-06-20T13:32:27.225931+0000","last_fullsized":"2023-06-20T13:32:27.225931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:01:24.597870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288708+0000","last_change":"2023-06-20T13:32:25.083629+0000","last_active":"2023-06-20T13:32:26.288708+0000","last_peered":"2023-06-20T13:32:26.288708+0000","last_clean":"2023-06-20T13:32:26.288708+0000","last_became_active":"2023-06-20T13:32:25.083205+0000","last_became_peered":"2023-06-20T13:32:25.083205+0000","last_unstale":"2023-06-20T13:32:26.288708+0000","last_undegraded":"2023-06-20T13:32:26.288708+0000","last_fullsized":"2023-06-20T13:32:26.288708+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:05:12.289018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287897+0000","last_change":"2023-06-20T13:32:20.023586+0000","last_active":"2023-06-20T13:32:26.287897+0000","last_peered":"2023-06-20T13:32:26.287897+0000","last_clean":"2023-06-20T13:32:26.287897+0000","last_became_active":"2023-06-20T13:32:20.023257+0000","last_became_peered":"2023-06-20T13:32:20.023257+0000","last_unstale":"2023-06-20T13:32:26.287897+0000","last_undegraded":"2023-06-20T13:32:26.287897+0000","last_fullsized":"2023-06-20T13:32:26.287897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:28:06.073451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225087+0000","last_change":"2023-06-20T13:32:21.024146+0000","last_active":"2023-06-20T13:32:27.225087+0000","last_peered":"2023-06-20T13:32:27.225087+0000","last_clean":"2023-06-20T13:32:27.225087+0000","last_became_active":"2023-06-20T13:32:21.023861+0000","last_became_peered":"2023-06-20T13:32:21.023861+0000","last_unstale":"2023-06-20T13:32:27.225087+0000","last_undegraded":"2023-06-20T13:32:27.225087+0000","last_fullsized":"2023-06-20T13:32:27.225087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:19:16.766615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224818+0000","last_change":"2023-06-20T13:32:25.070665+0000","last_active":"2023-06-20T13:32:27.224818+0000","last_peered":"2023-06-20T13:32:27.224818+0000","last_clean":"2023-06-20T13:32:27.224818+0000","last_became_active":"2023-06-20T13:32:25.070238+0000","last_became_peered":"2023-06-20T13:32:25.070238+0000","last_unstale":"2023-06-20T13:32:27.224818+0000","last_undegraded":"2023-06-20T13:32:27.224818+0000","last_fullsized":"2023-06-20T13:32:27.224818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:49:58.213633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998000+0000","last_change":"2023-06-20T13:32:20.022478+0000","last_active":"2023-06-20T13:32:26.998000+0000","last_peered":"2023-06-20T13:32:26.998000+0000","last_clean":"2023-06-20T13:32:26.998000+0000","last_became_active":"2023-06-20T13:32:20.022166+0000","last_became_peered":"2023-06-20T13:32:20.022166+0000","last_unstale":"2023-06-20T13:32:26.998000+0000","last_undegraded":"2023-06-20T13:32:26.998000+0000","last_fullsized":"2023-06-20T13:32:26.998000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:19:18.352136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050275+0000","last_change":"2023-06-20T13:32:21.037532+0000","last_active":"2023-06-20T13:32:26.050275+0000","last_peered":"2023-06-20T13:32:26.050275+0000","last_clean":"2023-06-20T13:32:26.050275+0000","last_became_active":"2023-06-20T13:32:21.037127+0000","last_became_peered":"2023-06-20T13:32:21.037127+0000","last_unstale":"2023-06-20T13:32:26.050275+0000","last_undegraded":"2023-06-20T13:32:26.050275+0000","last_fullsized":"2023-06-20T13:32:26.050275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:26:47.720233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050558+0000","last_change":"2023-06-20T13:32:25.085925+0000","last_active":"2023-06-20T13:32:26.050558+0000","last_peered":"2023-06-20T13:32:26.050558+0000","last_clean":"2023-06-20T13:32:26.050558+0000","last_became_active":"2023-06-20T13:32:25.085537+0000","last_became_peered":"2023-06-20T13:32:25.085537+0000","last_unstale":"2023-06-20T13:32:26.050558+0000","last_undegraded":"2023-06-20T13:32:26.050558+0000","last_fullsized":"2023-06-20T13:32:26.050558+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:01:28.635985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224478+0000","last_change":"2023-06-20T13:32:20.028414+0000","last_active":"2023-06-20T13:32:27.224478+0000","last_peered":"2023-06-20T13:32:27.224478+0000","last_clean":"2023-06-20T13:32:27.224478+0000","last_became_active":"2023-06-20T13:32:20.028129+0000","last_became_peered":"2023-06-20T13:32:20.028129+0000","last_unstale":"2023-06-20T13:32:27.224478+0000","last_undegraded":"2023-06-20T13:32:27.224478+0000","last_fullsized":"2023-06-20T13:32:27.224478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:16:57.717945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225375+0000","last_change":"2023-06-20T13:32:21.036814+0000","last_active":"2023-06-20T13:32:27.225375+0000","last_peered":"2023-06-20T13:32:27.225375+0000","last_clean":"2023-06-20T13:32:27.225375+0000","last_became_active":"2023-06-20T13:32:21.036540+0000","last_became_peered":"2023-06-20T13:32:21.036540+0000","last_unstale":"2023-06-20T13:32:27.225375+0000","last_undegraded":"2023-06-20T13:32:27.225375+0000","last_fullsized":"2023-06-20T13:32:27.225375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:39:45.434194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224434+0000","last_change":"2023-06-20T13:32:25.070673+0000","last_active":"2023-06-20T13:32:27.224434+0000","last_peered":"2023-06-20T13:32:27.224434+0000","last_clean":"2023-06-20T13:32:27.224434+0000","last_became_active":"2023-06-20T13:32:25.070136+0000","last_became_peered":"2023-06-20T13:32:25.070136+0000","last_unstale":"2023-06-20T13:32:27.224434+0000","last_undegraded":"2023-06-20T13:32:27.224434+0000","last_fullsized":"2023-06-20T13:32:27.224434+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:57:00.983846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050185+0000","last_change":"2023-06-20T13:32:20.030153+0000","last_active":"2023-06-20T13:32:26.050185+0000","last_peered":"2023-06-20T13:32:26.050185+0000","last_clean":"2023-06-20T13:32:26.050185+0000","last_became_active":"2023-06-20T13:32:20.029794+0000","last_became_peered":"2023-06-20T13:32:20.029794+0000","last_unstale":"2023-06-20T13:32:26.050185+0000","last_undegraded":"2023-06-20T13:32:26.050185+0000","last_fullsized":"2023-06-20T13:32:26.050185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:04:42.004091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224386+0000","last_change":"2023-06-20T13:32:21.028713+0000","last_active":"2023-06-20T13:32:27.224386+0000","last_peered":"2023-06-20T13:32:27.224386+0000","last_clean":"2023-06-20T13:32:27.224386+0000","last_became_active":"2023-06-20T13:32:21.027969+0000","last_became_peered":"2023-06-20T13:32:21.027969+0000","last_unstale":"2023-06-20T13:32:27.224386+0000","last_undegraded":"2023-06-20T13:32:27.224386+0000","last_fullsized":"2023-06-20T13:32:27.224386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:26:47.720233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.048978+0000","last_change":"2023-06-20T13:32:25.072571+0000","last_active":"2023-06-20T13:32:26.048978+0000","last_peered":"2023-06-20T13:32:26.048978+0000","last_clean":"2023-06-20T13:32:26.048978+0000","last_became_active":"2023-06-20T13:32:25.072166+0000","last_became_peered":"2023-06-20T13:32:25.072166+0000","last_unstale":"2023-06-20T13:32:26.048978+0000","last_undegraded":"2023-06-20T13:32:26.048978+0000","last_fullsized":"2023-06-20T13:32:26.048978+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:02:49.608947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225983+0000","last_change":"2023-06-20T13:32:20.022108+0000","last_active":"2023-06-20T13:32:27.225983+0000","last_peered":"2023-06-20T13:32:27.225983+0000","last_clean":"2023-06-20T13:32:27.225983+0000","last_became_active":"2023-06-20T13:32:20.021836+0000","last_became_peered":"2023-06-20T13:32:20.021836+0000","last_unstale":"2023-06-20T13:32:27.225983+0000","last_undegraded":"2023-06-20T13:32:27.225983+0000","last_fullsized":"2023-06-20T13:32:27.225983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:32:35.608967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224530+0000","last_change":"2023-06-20T13:32:21.027141+0000","last_active":"2023-06-20T13:32:27.224530+0000","last_peered":"2023-06-20T13:32:27.224530+0000","last_clean":"2023-06-20T13:32:27.224530+0000","last_became_active":"2023-06-20T13:32:21.026831+0000","last_became_peered":"2023-06-20T13:32:21.026831+0000","last_unstale":"2023-06-20T13:32:27.224530+0000","last_undegraded":"2023-06-20T13:32:27.224530+0000","last_fullsized":"2023-06-20T13:32:27.224530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:01:24.597870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225358+0000","last_change":"2023-06-20T13:32:25.074657+0000","last_active":"2023-06-20T13:32:27.225358+0000","last_peered":"2023-06-20T13:32:27.225358+0000","last_clean":"2023-06-20T13:32:27.225358+0000","last_became_active":"2023-06-20T13:32:25.074234+0000","last_became_peered":"2023-06-20T13:32:25.074234+0000","last_unstale":"2023-06-20T13:32:27.225358+0000","last_undegraded":"2023-06-20T13:32:27.225358+0000","last_fullsized":"2023-06-20T13:32:27.225358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:34:34.823010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049629+0000","last_change":"2023-06-20T13:32:20.023105+0000","last_active":"2023-06-20T13:32:26.049629+0000","last_peered":"2023-06-20T13:32:26.049629+0000","last_clean":"2023-06-20T13:32:26.049629+0000","last_became_active":"2023-06-20T13:32:20.022845+0000","last_became_peered":"2023-06-20T13:32:20.022845+0000","last_unstale":"2023-06-20T13:32:26.049629+0000","last_undegraded":"2023-06-20T13:32:26.049629+0000","last_fullsized":"2023-06-20T13:32:26.049629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:04:42.004091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998524+0000","last_change":"2023-06-20T13:32:21.035337+0000","last_active":"2023-06-20T13:32:26.998524+0000","last_peered":"2023-06-20T13:32:26.998524+0000","last_clean":"2023-06-20T13:32:26.998524+0000","last_became_active":"2023-06-20T13:32:21.035026+0000","last_became_peered":"2023-06-20T13:32:21.035026+0000","last_unstale":"2023-06-20T13:32:26.998524+0000","last_undegraded":"2023-06-20T13:32:26.998524+0000","last_fullsized":"2023-06-20T13:32:26.998524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:08:50.174602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998117+0000","last_change":"2023-06-20T13:32:25.077778+0000","last_active":"2023-06-20T13:32:26.998117+0000","last_peered":"2023-06-20T13:32:26.998117+0000","last_clean":"2023-06-20T13:32:26.998117+0000","last_became_active":"2023-06-20T13:32:25.076300+0000","last_became_peered":"2023-06-20T13:32:25.076300+0000","last_unstale":"2023-06-20T13:32:26.998117+0000","last_undegraded":"2023-06-20T13:32:26.998117+0000","last_fullsized":"2023-06-20T13:32:26.998117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:38:55.235383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:39.667215+0000","last_change":"2023-06-20T13:32:20.020923+0000","last_active":"2023-06-20T13:32:39.667215+0000","last_peered":"2023-06-20T13:32:39.667215+0000","last_clean":"2023-06-20T13:32:39.667215+0000","last_became_active":"2023-06-20T13:32:20.020435+0000","last_became_peered":"2023-06-20T13:32:20.020435+0000","last_unstale":"2023-06-20T13:32:39.667215+0000","last_undegraded":"2023-06-20T13:32:39.667215+0000","last_fullsized":"2023-06-20T13:32:39.667215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:04:23.085234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288184+0000","last_change":"2023-06-20T13:32:21.035014+0000","last_active":"2023-06-20T13:32:26.288184+0000","last_peered":"2023-06-20T13:32:26.288184+0000","last_clean":"2023-06-20T13:32:26.288184+0000","last_became_active":"2023-06-20T13:32:21.034760+0000","last_became_peered":"2023-06-20T13:32:21.034760+0000","last_unstale":"2023-06-20T13:32:26.288184+0000","last_undegraded":"2023-06-20T13:32:26.288184+0000","last_fullsized":"2023-06-20T13:32:26.288184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:35:16.891724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.226159+0000","last_change":"2023-06-20T13:32:25.082529+0000","last_active":"2023-06-20T13:32:27.226159+0000","last_peered":"2023-06-20T13:32:27.226159+0000","last_clean":"2023-06-20T13:32:27.226159+0000","last_became_active":"2023-06-20T13:32:25.082205+0000","last_became_peered":"2023-06-20T13:32:25.082205+0000","last_unstale":"2023-06-20T13:32:27.226159+0000","last_undegraded":"2023-06-20T13:32:27.226159+0000","last_fullsized":"2023-06-20T13:32:27.226159+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:18:17.174644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049387+0000","last_change":"2023-06-20T13:32:20.022027+0000","last_active":"2023-06-20T13:32:26.049387+0000","last_peered":"2023-06-20T13:32:26.049387+0000","last_clean":"2023-06-20T13:32:26.049387+0000","last_became_active":"2023-06-20T13:32:20.021696+0000","last_became_peered":"2023-06-20T13:32:20.021696+0000","last_unstale":"2023-06-20T13:32:26.049387+0000","last_undegraded":"2023-06-20T13:32:26.049387+0000","last_fullsized":"2023-06-20T13:32:26.049387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:21:22.959916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224795+0000","last_change":"2023-06-20T13:32:21.035314+0000","last_active":"2023-06-20T13:32:27.224795+0000","last_peered":"2023-06-20T13:32:27.224795+0000","last_clean":"2023-06-20T13:32:27.224795+0000","last_became_active":"2023-06-20T13:32:21.035000+0000","last_became_peered":"2023-06-20T13:32:21.035000+0000","last_unstale":"2023-06-20T13:32:27.224795+0000","last_undegraded":"2023-06-20T13:32:27.224795+0000","last_fullsized":"2023-06-20T13:32:27.224795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:32:36.617660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224640+0000","last_change":"2023-06-20T13:32:25.067229+0000","last_active":"2023-06-20T13:32:27.224640+0000","last_peered":"2023-06-20T13:32:27.224640+0000","last_clean":"2023-06-20T13:32:27.224640+0000","last_became_active":"2023-06-20T13:32:25.066768+0000","last_became_peered":"2023-06-20T13:32:25.066768+0000","last_unstale":"2023-06-20T13:32:27.224640+0000","last_undegraded":"2023-06-20T13:32:27.224640+0000","last_fullsized":"2023-06-20T13:32:27.224640+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:53:30.164168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049398+0000","last_change":"2023-06-20T13:32:20.025271+0000","last_active":"2023-06-20T13:32:26.049398+0000","last_peered":"2023-06-20T13:32:26.049398+0000","last_clean":"2023-06-20T13:32:26.049398+0000","last_became_active":"2023-06-20T13:32:20.024881+0000","last_became_peered":"2023-06-20T13:32:20.024881+0000","last_unstale":"2023-06-20T13:32:26.049398+0000","last_undegraded":"2023-06-20T13:32:26.049398+0000","last_fullsized":"2023-06-20T13:32:26.049398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:08:49.165909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225931+0000","last_change":"2023-06-20T13:32:21.040302+0000","last_active":"2023-06-20T13:32:27.225931+0000","last_peered":"2023-06-20T13:32:27.225931+0000","last_clean":"2023-06-20T13:32:27.225931+0000","last_became_active":"2023-06-20T13:32:21.039807+0000","last_became_peered":"2023-06-20T13:32:21.039807+0000","last_unstale":"2023-06-20T13:32:27.225931+0000","last_undegraded":"2023-06-20T13:32:27.225931+0000","last_fullsized":"2023-06-20T13:32:27.225931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:39:14.274571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225542+0000","last_change":"2023-06-20T13:32:25.074563+0000","last_active":"2023-06-20T13:32:27.225542+0000","last_peered":"2023-06-20T13:32:27.225542+0000","last_clean":"2023-06-20T13:32:27.225542+0000","last_became_active":"2023-06-20T13:32:25.074142+0000","last_became_peered":"2023-06-20T13:32:25.074142+0000","last_unstale":"2023-06-20T13:32:27.225542+0000","last_undegraded":"2023-06-20T13:32:27.225542+0000","last_fullsized":"2023-06-20T13:32:27.225542+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:21:34.190318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049875+0000","last_change":"2023-06-20T13:32:20.022385+0000","last_active":"2023-06-20T13:32:26.049875+0000","last_peered":"2023-06-20T13:32:26.049875+0000","last_clean":"2023-06-20T13:32:26.049875+0000","last_became_active":"2023-06-20T13:32:20.022046+0000","last_became_peered":"2023-06-20T13:32:20.022046+0000","last_unstale":"2023-06-20T13:32:26.049875+0000","last_undegraded":"2023-06-20T13:32:26.049875+0000","last_fullsized":"2023-06-20T13:32:26.049875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:16:57.717945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050412+0000","last_change":"2023-06-20T13:32:21.037368+0000","last_active":"2023-06-20T13:32:26.050412+0000","last_peered":"2023-06-20T13:32:26.050412+0000","last_clean":"2023-06-20T13:32:26.050412+0000","last_became_active":"2023-06-20T13:32:21.036706+0000","last_became_peered":"2023-06-20T13:32:21.036706+0000","last_unstale":"2023-06-20T13:32:26.050412+0000","last_undegraded":"2023-06-20T13:32:26.050412+0000","last_fullsized":"2023-06-20T13:32:26.050412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:16:58.726638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225769+0000","last_change":"2023-06-20T13:32:25.081687+0000","last_active":"2023-06-20T13:32:27.225769+0000","last_peered":"2023-06-20T13:32:27.225769+0000","last_clean":"2023-06-20T13:32:27.225769+0000","last_became_active":"2023-06-20T13:32:25.081227+0000","last_became_peered":"2023-06-20T13:32:25.081227+0000","last_unstale":"2023-06-20T13:32:27.225769+0000","last_undegraded":"2023-06-20T13:32:27.225769+0000","last_fullsized":"2023-06-20T13:32:27.225769+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:17:02.764753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224793+0000","last_change":"2023-06-20T13:32:20.028572+0000","last_active":"2023-06-20T13:32:27.224793+0000","last_peered":"2023-06-20T13:32:27.224793+0000","last_clean":"2023-06-20T13:32:27.224793+0000","last_became_active":"2023-06-20T13:32:20.028266+0000","last_became_peered":"2023-06-20T13:32:20.028266+0000","last_unstale":"2023-06-20T13:32:27.224793+0000","last_undegraded":"2023-06-20T13:32:27.224793+0000","last_fullsized":"2023-06-20T13:32:27.224793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:28:13.559245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225547+0000","last_change":"2023-06-20T13:32:21.036385+0000","last_active":"2023-06-20T13:32:27.225547+0000","last_peered":"2023-06-20T13:32:27.225547+0000","last_clean":"2023-06-20T13:32:27.225547+0000","last_became_active":"2023-06-20T13:32:21.036013+0000","last_became_peered":"2023-06-20T13:32:21.036013+0000","last_unstale":"2023-06-20T13:32:27.225547+0000","last_undegraded":"2023-06-20T13:32:27.225547+0000","last_fullsized":"2023-06-20T13:32:27.225547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:04:01.696402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050107+0000","last_change":"2023-06-20T13:32:25.071698+0000","last_active":"2023-06-20T13:32:26.050107+0000","last_peered":"2023-06-20T13:32:26.050107+0000","last_clean":"2023-06-20T13:32:26.050107+0000","last_became_active":"2023-06-20T13:32:25.070889+0000","last_became_peered":"2023-06-20T13:32:25.070889+0000","last_unstale":"2023-06-20T13:32:26.050107+0000","last_undegraded":"2023-06-20T13:32:26.050107+0000","last_fullsized":"2023-06-20T13:32:26.050107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:53:30.164168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050078+0000","last_change":"2023-06-20T13:32:20.027675+0000","last_active":"2023-06-20T13:32:26.050078+0000","last_peered":"2023-06-20T13:32:26.050078+0000","last_clean":"2023-06-20T13:32:26.050078+0000","last_became_active":"2023-06-20T13:32:20.027273+0000","last_became_peered":"2023-06-20T13:32:20.027273+0000","last_unstale":"2023-06-20T13:32:26.050078+0000","last_undegraded":"2023-06-20T13:32:26.050078+0000","last_fullsized":"2023-06-20T13:32:26.050078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:01:23.589176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224638+0000","last_change":"2023-06-20T13:32:21.025518+0000","last_active":"2023-06-20T13:32:27.224638+0000","last_peered":"2023-06-20T13:32:27.224638+0000","last_clean":"2023-06-20T13:32:27.224638+0000","last_became_active":"2023-06-20T13:32:21.025151+0000","last_became_peered":"2023-06-20T13:32:21.025151+0000","last_unstale":"2023-06-20T13:32:27.224638+0000","last_undegraded":"2023-06-20T13:32:27.224638+0000","last_fullsized":"2023-06-20T13:32:27.224638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:41:51.423544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.047440+0000","last_change":"2023-06-20T13:32:25.078296+0000","last_active":"2023-06-20T13:32:26.047440+0000","last_peered":"2023-06-20T13:32:26.047440+0000","last_clean":"2023-06-20T13:32:26.047440+0000","last_became_active":"2023-06-20T13:32:25.076656+0000","last_became_peered":"2023-06-20T13:32:25.076656+0000","last_unstale":"2023-06-20T13:32:26.047440+0000","last_undegraded":"2023-06-20T13:32:26.047440+0000","last_fullsized":"2023-06-20T13:32:26.047440+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:04:34.188995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049640+0000","last_change":"2023-06-20T13:32:20.022015+0000","last_active":"2023-06-20T13:32:26.049640+0000","last_peered":"2023-06-20T13:32:26.049640+0000","last_clean":"2023-06-20T13:32:26.049640+0000","last_became_active":"2023-06-20T13:32:20.021716+0000","last_became_peered":"2023-06-20T13:32:20.021716+0000","last_unstale":"2023-06-20T13:32:26.049640+0000","last_undegraded":"2023-06-20T13:32:26.049640+0000","last_fullsized":"2023-06-20T13:32:26.049640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:48:59.452870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288000+0000","last_change":"2023-06-20T13:32:21.022058+0000","last_active":"2023-06-20T13:32:26.288000+0000","last_peered":"2023-06-20T13:32:26.288000+0000","last_clean":"2023-06-20T13:32:26.288000+0000","last_became_active":"2023-06-20T13:32:21.021798+0000","last_became_peered":"2023-06-20T13:32:21.021798+0000","last_unstale":"2023-06-20T13:32:26.288000+0000","last_undegraded":"2023-06-20T13:32:26.288000+0000","last_fullsized":"2023-06-20T13:32:26.288000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:20:17.077026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.047790+0000","last_change":"2023-06-20T13:32:25.077838+0000","last_active":"2023-06-20T13:32:26.047790+0000","last_peered":"2023-06-20T13:32:26.047790+0000","last_clean":"2023-06-20T13:32:26.047790+0000","last_became_active":"2023-06-20T13:32:25.077296+0000","last_became_peered":"2023-06-20T13:32:25.077296+0000","last_unstale":"2023-06-20T13:32:26.047790+0000","last_undegraded":"2023-06-20T13:32:26.047790+0000","last_fullsized":"2023-06-20T13:32:26.047790+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T01:06:17.814845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049856+0000","last_change":"2023-06-20T13:32:20.027368+0000","last_active":"2023-06-20T13:32:26.049856+0000","last_peered":"2023-06-20T13:32:26.049856+0000","last_clean":"2023-06-20T13:32:26.049856+0000","last_became_active":"2023-06-20T13:32:20.027052+0000","last_became_peered":"2023-06-20T13:32:20.027052+0000","last_unstale":"2023-06-20T13:32:26.049856+0000","last_undegraded":"2023-06-20T13:32:26.049856+0000","last_fullsized":"2023-06-20T13:32:26.049856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:48:08.408940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224398+0000","last_change":"2023-06-20T13:32:21.034964+0000","last_active":"2023-06-20T13:32:27.224398+0000","last_peered":"2023-06-20T13:32:27.224398+0000","last_clean":"2023-06-20T13:32:27.224398+0000","last_became_active":"2023-06-20T13:32:21.034681+0000","last_became_peered":"2023-06-20T13:32:21.034681+0000","last_unstale":"2023-06-20T13:32:27.224398+0000","last_undegraded":"2023-06-20T13:32:27.224398+0000","last_fullsized":"2023-06-20T13:32:27.224398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:36:48.688763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.048245+0000","last_change":"2023-06-20T13:32:25.070289+0000","last_active":"2023-06-20T13:32:26.048245+0000","last_peered":"2023-06-20T13:32:26.048245+0000","last_clean":"2023-06-20T13:32:26.048245+0000","last_became_active":"2023-06-20T13:32:25.069805+0000","last_became_peered":"2023-06-20T13:32:25.069805+0000","last_unstale":"2023-06-20T13:32:26.048245+0000","last_undegraded":"2023-06-20T13:32:26.048245+0000","last_fullsized":"2023-06-20T13:32:26.048245+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:36:52.726879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225702+0000","last_change":"2023-06-20T13:32:20.024117+0000","last_active":"2023-06-20T13:32:27.225702+0000","last_peered":"2023-06-20T13:32:27.225702+0000","last_clean":"2023-06-20T13:32:27.225702+0000","last_became_active":"2023-06-20T13:32:20.023863+0000","last_became_peered":"2023-06-20T13:32:20.023863+0000","last_unstale":"2023-06-20T13:32:27.225702+0000","last_undegraded":"2023-06-20T13:32:27.225702+0000","last_fullsized":"2023-06-20T13:32:27.225702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:48:08.408940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050083+0000","last_change":"2023-06-20T13:32:21.033767+0000","last_active":"2023-06-20T13:32:26.050083+0000","last_peered":"2023-06-20T13:32:26.050083+0000","last_clean":"2023-06-20T13:32:26.050083+0000","last_became_active":"2023-06-20T13:32:21.033502+0000","last_became_peered":"2023-06-20T13:32:21.033502+0000","last_unstale":"2023-06-20T13:32:26.050083+0000","last_undegraded":"2023-06-20T13:32:26.050083+0000","last_fullsized":"2023-06-20T13:32:26.050083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:49:00.461563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.047814+0000","last_change":"2023-06-20T13:32:25.077964+0000","last_active":"2023-06-20T13:32:26.047814+0000","last_peered":"2023-06-20T13:32:26.047814+0000","last_clean":"2023-06-20T13:32:26.047814+0000","last_became_active":"2023-06-20T13:32:25.077026+0000","last_became_peered":"2023-06-20T13:32:25.077026+0000","last_unstale":"2023-06-20T13:32:26.047814+0000","last_undegraded":"2023-06-20T13:32:26.047814+0000","last_fullsized":"2023-06-20T13:32:26.047814+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:58:41.932351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224687+0000","last_change":"2023-06-20T13:32:20.028575+0000","last_active":"2023-06-20T13:32:27.224687+0000","last_peered":"2023-06-20T13:32:27.224687+0000","last_clean":"2023-06-20T13:32:27.224687+0000","last_became_active":"2023-06-20T13:32:20.028182+0000","last_became_peered":"2023-06-20T13:32:20.028182+0000","last_unstale":"2023-06-20T13:32:27.224687+0000","last_undegraded":"2023-06-20T13:32:27.224687+0000","last_fullsized":"2023-06-20T13:32:27.224687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:39:13.265878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287817+0000","last_change":"2023-06-20T13:32:21.032963+0000","last_active":"2023-06-20T13:32:26.287817+0000","last_peered":"2023-06-20T13:32:26.287817+0000","last_clean":"2023-06-20T13:32:26.287817+0000","last_became_active":"2023-06-20T13:32:21.032688+0000","last_became_peered":"2023-06-20T13:32:21.032688+0000","last_unstale":"2023-06-20T13:32:26.287817+0000","last_undegraded":"2023-06-20T13:32:26.287817+0000","last_fullsized":"2023-06-20T13:32:26.287817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:04:01.696402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998304+0000","last_change":"2023-06-20T13:32:25.077326+0000","last_active":"2023-06-20T13:32:26.998304+0000","last_peered":"2023-06-20T13:32:26.998304+0000","last_clean":"2023-06-20T13:32:26.998304+0000","last_became_active":"2023-06-20T13:32:25.076929+0000","last_became_peered":"2023-06-20T13:32:25.076929+0000","last_unstale":"2023-06-20T13:32:26.998304+0000","last_undegraded":"2023-06-20T13:32:26.998304+0000","last_fullsized":"2023-06-20T13:32:26.998304+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:56:29.417379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224597+0000","last_change":"2023-06-20T13:32:20.030260+0000","last_active":"2023-06-20T13:32:27.224597+0000","last_peered":"2023-06-20T13:32:27.224597+0000","last_clean":"2023-06-20T13:32:27.224597+0000","last_became_active":"2023-06-20T13:32:20.029938+0000","last_became_peered":"2023-06-20T13:32:20.029938+0000","last_unstale":"2023-06-20T13:32:27.224597+0000","last_undegraded":"2023-06-20T13:32:27.224597+0000","last_fullsized":"2023-06-20T13:32:27.224597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:59:32.832446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288271+0000","last_change":"2023-06-20T13:32:21.030989+0000","last_active":"2023-06-20T13:32:26.288271+0000","last_peered":"2023-06-20T13:32:26.288271+0000","last_clean":"2023-06-20T13:32:26.288271+0000","last_became_active":"2023-06-20T13:32:21.029954+0000","last_became_peered":"2023-06-20T13:32:21.029954+0000","last_unstale":"2023-06-20T13:32:26.288271+0000","last_undegraded":"2023-06-20T13:32:26.288271+0000","last_fullsized":"2023-06-20T13:32:26.288271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:12:40.689219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225889+0000","last_change":"2023-06-20T13:32:25.087926+0000","last_active":"2023-06-20T13:32:27.225889+0000","last_peered":"2023-06-20T13:32:27.225889+0000","last_clean":"2023-06-20T13:32:27.225889+0000","last_became_active":"2023-06-20T13:32:25.087469+0000","last_became_peered":"2023-06-20T13:32:25.087469+0000","last_unstale":"2023-06-20T13:32:27.225889+0000","last_undegraded":"2023-06-20T13:32:27.225889+0000","last_fullsized":"2023-06-20T13:32:27.225889+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:53:30.164168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287510+0000","last_change":"2023-06-20T13:32:20.028180+0000","last_active":"2023-06-20T13:32:26.287510+0000","last_peered":"2023-06-20T13:32:26.287510+0000","last_clean":"2023-06-20T13:32:26.287510+0000","last_became_active":"2023-06-20T13:32:20.027835+0000","last_became_peered":"2023-06-20T13:32:20.027835+0000","last_unstale":"2023-06-20T13:32:26.287510+0000","last_undegraded":"2023-06-20T13:32:26.287510+0000","last_fullsized":"2023-06-20T13:32:26.287510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:34:29.776201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288742+0000","last_change":"2023-06-20T13:32:21.039550+0000","last_active":"2023-06-20T13:32:26.288742+0000","last_peered":"2023-06-20T13:32:26.288742+0000","last_clean":"2023-06-20T13:32:26.288742+0000","last_became_active":"2023-06-20T13:32:21.039297+0000","last_became_peered":"2023-06-20T13:32:21.039297+0000","last_unstale":"2023-06-20T13:32:26.288742+0000","last_undegraded":"2023-06-20T13:32:26.288742+0000","last_fullsized":"2023-06-20T13:32:26.288742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:36:43.451301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288495+0000","last_change":"2023-06-20T13:32:25.084491+0000","last_active":"2023-06-20T13:32:26.288495+0000","last_peered":"2023-06-20T13:32:26.288495+0000","last_clean":"2023-06-20T13:32:26.288495+0000","last_became_active":"2023-06-20T13:32:25.084072+0000","last_became_peered":"2023-06-20T13:32:25.084072+0000","last_unstale":"2023-06-20T13:32:26.288495+0000","last_undegraded":"2023-06-20T13:32:26.288495+0000","last_fullsized":"2023-06-20T13:32:26.288495+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:01:48.702402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224341+0000","last_change":"2023-06-20T13:32:20.022743+0000","last_active":"2023-06-20T13:32:27.224341+0000","last_peered":"2023-06-20T13:32:27.224341+0000","last_clean":"2023-06-20T13:32:27.224341+0000","last_became_active":"2023-06-20T13:32:20.022384+0000","last_became_peered":"2023-06-20T13:32:20.022384+0000","last_unstale":"2023-06-20T13:32:27.224341+0000","last_undegraded":"2023-06-20T13:32:27.224341+0000","last_fullsized":"2023-06-20T13:32:27.224341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:04:42.004091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998918+0000","last_change":"2023-06-20T13:32:21.032771+0000","last_active":"2023-06-20T13:32:26.998918+0000","last_peered":"2023-06-20T13:32:26.998918+0000","last_clean":"2023-06-20T13:32:26.998918+0000","last_became_active":"2023-06-20T13:32:21.032459+0000","last_became_peered":"2023-06-20T13:32:21.032459+0000","last_unstale":"2023-06-20T13:32:26.998918+0000","last_undegraded":"2023-06-20T13:32:26.998918+0000","last_fullsized":"2023-06-20T13:32:26.998918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:51:29.356444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049993+0000","last_change":"2023-06-20T13:32:25.080253+0000","last_active":"2023-06-20T13:32:26.049993+0000","last_peered":"2023-06-20T13:32:26.049993+0000","last_clean":"2023-06-20T13:32:26.049993+0000","last_became_active":"2023-06-20T13:32:25.079626+0000","last_became_peered":"2023-06-20T13:32:25.079626+0000","last_unstale":"2023-06-20T13:32:26.049993+0000","last_undegraded":"2023-06-20T13:32:26.049993+0000","last_fullsized":"2023-06-20T13:32:26.049993+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:21:28.006725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998581+0000","last_change":"2023-06-20T13:32:14.847834+0000","last_active":"2023-06-20T13:32:26.998581+0000","last_peered":"2023-06-20T13:32:26.998581+0000","last_clean":"2023-06-20T13:32:26.998581+0000","last_became_active":"2023-06-20T13:32:14.847518+0000","last_became_peered":"2023-06-20T13:32:14.847518+0000","last_unstale":"2023-06-20T13:32:26.998581+0000","last_undegraded":"2023-06-20T13:32:26.998581+0000","last_fullsized":"2023-06-20T13:32:26.998581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:10:03.973904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225597+0000","last_change":"2023-06-20T13:32:20.025034+0000","last_active":"2023-06-20T13:32:27.225597+0000","last_peered":"2023-06-20T13:32:27.225597+0000","last_clean":"2023-06-20T13:32:27.225597+0000","last_became_active":"2023-06-20T13:32:20.024436+0000","last_became_peered":"2023-06-20T13:32:20.024436+0000","last_unstale":"2023-06-20T13:32:27.225597+0000","last_undegraded":"2023-06-20T13:32:27.225597+0000","last_fullsized":"2023-06-20T13:32:27.225597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:21:22.959916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998113+0000","last_change":"2023-06-20T13:32:21.031761+0000","last_active":"2023-06-20T13:32:26.998113+0000","last_peered":"2023-06-20T13:32:26.998113+0000","last_clean":"2023-06-20T13:32:26.998113+0000","last_became_active":"2023-06-20T13:32:21.031474+0000","last_became_peered":"2023-06-20T13:32:21.031474+0000","last_unstale":"2023-06-20T13:32:26.998113+0000","last_undegraded":"2023-06-20T13:32:26.998113+0000","last_fullsized":"2023-06-20T13:32:26.998113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:38:03.196793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049886+0000","last_change":"2023-06-20T13:32:25.081982+0000","last_active":"2023-06-20T13:32:26.049886+0000","last_peered":"2023-06-20T13:32:26.049886+0000","last_clean":"2023-06-20T13:32:26.049886+0000","last_became_active":"2023-06-20T13:32:25.081414+0000","last_became_peered":"2023-06-20T13:32:25.081414+0000","last_unstale":"2023-06-20T13:32:26.049886+0000","last_undegraded":"2023-06-20T13:32:26.049886+0000","last_fullsized":"2023-06-20T13:32:26.049886+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:03:03.660136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225550+0000","last_change":"2023-06-20T13:32:13.979189+0000","last_active":"2023-06-20T13:32:27.225550+0000","last_peered":"2023-06-20T13:32:27.225550+0000","last_clean":"2023-06-20T13:32:27.225550+0000","last_became_active":"2023-06-20T13:32:13.978675+0000","last_became_peered":"2023-06-20T13:32:13.978675+0000","last_unstale":"2023-06-20T13:32:27.225550+0000","last_undegraded":"2023-06-20T13:32:27.225550+0000","last_fullsized":"2023-06-20T13:32:27.225550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:25:22.059939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288140+0000","last_change":"2023-06-20T13:32:20.029884+0000","last_active":"2023-06-20T13:32:26.288140+0000","last_peered":"2023-06-20T13:32:26.288140+0000","last_clean":"2023-06-20T13:32:26.288140+0000","last_became_active":"2023-06-20T13:32:20.029589+0000","last_became_peered":"2023-06-20T13:32:20.029589+0000","last_unstale":"2023-06-20T13:32:26.288140+0000","last_undegraded":"2023-06-20T13:32:26.288140+0000","last_fullsized":"2023-06-20T13:32:26.288140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:04:36.254532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998444+0000","last_change":"2023-06-20T13:32:21.024248+0000","last_active":"2023-06-20T13:32:26.998444+0000","last_peered":"2023-06-20T13:32:26.998444+0000","last_clean":"2023-06-20T13:32:26.998444+0000","last_became_active":"2023-06-20T13:32:21.023949+0000","last_became_peered":"2023-06-20T13:32:21.023949+0000","last_unstale":"2023-06-20T13:32:26.998444+0000","last_undegraded":"2023-06-20T13:32:26.998444+0000","last_fullsized":"2023-06-20T13:32:26.998444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:27:37.100680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.048226+0000","last_change":"2023-06-20T13:32:25.076311+0000","last_active":"2023-06-20T13:32:26.048226+0000","last_peered":"2023-06-20T13:32:26.048226+0000","last_clean":"2023-06-20T13:32:26.048226+0000","last_became_active":"2023-06-20T13:32:25.075855+0000","last_became_peered":"2023-06-20T13:32:25.075855+0000","last_unstale":"2023-06-20T13:32:26.048226+0000","last_undegraded":"2023-06-20T13:32:26.048226+0000","last_fullsized":"2023-06-20T13:32:26.048226+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:32:42.525847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.047620+0000","last_change":"2023-06-20T13:32:14.567022+0000","last_active":"2023-06-20T13:32:26.047620+0000","last_peered":"2023-06-20T13:32:26.047620+0000","last_clean":"2023-06-20T13:32:26.047620+0000","last_became_active":"2023-06-20T13:32:14.566671+0000","last_became_peered":"2023-06-20T13:32:14.566671+0000","last_unstale":"2023-06-20T13:32:26.047620+0000","last_undegraded":"2023-06-20T13:32:26.047620+0000","last_fullsized":"2023-06-20T13:32:26.047620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:56:49.908110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998274+0000","last_change":"2023-06-20T13:32:20.028715+0000","last_active":"2023-06-20T13:32:26.998274+0000","last_peered":"2023-06-20T13:32:26.998274+0000","last_clean":"2023-06-20T13:32:26.998274+0000","last_became_active":"2023-06-20T13:32:20.028414+0000","last_became_peered":"2023-06-20T13:32:20.028414+0000","last_unstale":"2023-06-20T13:32:26.998274+0000","last_undegraded":"2023-06-20T13:32:26.998274+0000","last_fullsized":"2023-06-20T13:32:26.998274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:15:12.926553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998963+0000","last_change":"2023-06-20T13:32:21.030732+0000","last_active":"2023-06-20T13:32:26.998963+0000","last_peered":"2023-06-20T13:32:26.998963+0000","last_clean":"2023-06-20T13:32:26.998963+0000","last_became_active":"2023-06-20T13:32:21.030452+0000","last_became_peered":"2023-06-20T13:32:21.030452+0000","last_unstale":"2023-06-20T13:32:26.998963+0000","last_undegraded":"2023-06-20T13:32:26.998963+0000","last_fullsized":"2023-06-20T13:32:26.998963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:04:43.012785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049792+0000","last_change":"2023-06-20T13:32:25.078650+0000","last_active":"2023-06-20T13:32:26.049792+0000","last_peered":"2023-06-20T13:32:26.049792+0000","last_clean":"2023-06-20T13:32:26.049792+0000","last_became_active":"2023-06-20T13:32:25.078187+0000","last_became_peered":"2023-06-20T13:32:25.078187+0000","last_unstale":"2023-06-20T13:32:26.049792+0000","last_undegraded":"2023-06-20T13:32:26.049792+0000","last_fullsized":"2023-06-20T13:32:26.049792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:26:51.758348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225609+0000","last_change":"2023-06-20T13:32:13.978856+0000","last_active":"2023-06-20T13:32:27.225609+0000","last_peered":"2023-06-20T13:32:27.225609+0000","last_clean":"2023-06-20T13:32:27.225609+0000","last_became_active":"2023-06-20T13:32:13.978454+0000","last_became_peered":"2023-06-20T13:32:13.978454+0000","last_unstale":"2023-06-20T13:32:27.225609+0000","last_undegraded":"2023-06-20T13:32:27.225609+0000","last_fullsized":"2023-06-20T13:32:27.225609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:29:41.295818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049111+0000","last_change":"2023-06-20T13:32:06.907663+0000","last_active":"2023-06-20T13:32:26.049111+0000","last_peered":"2023-06-20T13:32:26.049111+0000","last_clean":"2023-06-20T13:32:26.049111+0000","last_became_active":"2023-06-20T13:32:06.906687+0000","last_became_peered":"2023-06-20T13:32:06.906687+0000","last_unstale":"2023-06-20T13:32:26.049111+0000","last_undegraded":"2023-06-20T13:32:26.049111+0000","last_fullsized":"2023-06-20T13:32:26.049111+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:05.521263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:05.521263+0000","last_clean_scrub_stamp":"2023-06-20T13:32:05.521263+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:08:35.702344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224861+0000","last_change":"2023-06-20T13:32:20.019895+0000","last_active":"2023-06-20T13:32:27.224861+0000","last_peered":"2023-06-20T13:32:27.224861+0000","last_clean":"2023-06-20T13:32:27.224861+0000","last_became_active":"2023-06-20T13:32:20.019522+0000","last_became_peered":"2023-06-20T13:32:20.019522+0000","last_unstale":"2023-06-20T13:32:27.224861+0000","last_undegraded":"2023-06-20T13:32:27.224861+0000","last_fullsized":"2023-06-20T13:32:27.224861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:18:12.127836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225154+0000","last_change":"2023-06-20T13:32:21.036376+0000","last_active":"2023-06-20T13:32:27.225154+0000","last_peered":"2023-06-20T13:32:27.225154+0000","last_clean":"2023-06-20T13:32:27.225154+0000","last_became_active":"2023-06-20T13:32:21.036065+0000","last_became_peered":"2023-06-20T13:32:21.036065+0000","last_unstale":"2023-06-20T13:32:27.225154+0000","last_undegraded":"2023-06-20T13:32:27.225154+0000","last_fullsized":"2023-06-20T13:32:27.225154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:44:44.788880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225647+0000","last_change":"2023-06-20T13:32:25.087122+0000","last_active":"2023-06-20T13:32:27.225647+0000","last_peered":"2023-06-20T13:32:27.225647+0000","last_clean":"2023-06-20T13:32:27.225647+0000","last_became_active":"2023-06-20T13:32:25.086746+0000","last_became_peered":"2023-06-20T13:32:25.086746+0000","last_unstale":"2023-06-20T13:32:27.225647+0000","last_undegraded":"2023-06-20T13:32:27.225647+0000","last_fullsized":"2023-06-20T13:32:27.225647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:51:33.394559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049273+0000","last_change":"2023-06-20T13:32:13.977027+0000","last_active":"2023-06-20T13:32:26.049273+0000","last_peered":"2023-06-20T13:32:26.049273+0000","last_clean":"2023-06-20T13:32:26.049273+0000","last_became_active":"2023-06-20T13:32:13.975895+0000","last_became_peered":"2023-06-20T13:32:13.975895+0000","last_unstale":"2023-06-20T13:32:26.049273+0000","last_undegraded":"2023-06-20T13:32:26.049273+0000","last_fullsized":"2023-06-20T13:32:26.049273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:25:22.059939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049300+0000","last_change":"2023-06-20T13:32:20.024292+0000","last_active":"2023-06-20T13:32:26.049300+0000","last_peered":"2023-06-20T13:32:26.049300+0000","last_clean":"2023-06-20T13:32:26.049300+0000","last_became_active":"2023-06-20T13:32:20.023931+0000","last_became_peered":"2023-06-20T13:32:20.023931+0000","last_unstale":"2023-06-20T13:32:26.049300+0000","last_undegraded":"2023-06-20T13:32:26.049300+0000","last_fullsized":"2023-06-20T13:32:26.049300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:02:44.562138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050028+0000","last_change":"2023-06-20T13:32:21.024724+0000","last_active":"2023-06-20T13:32:26.050028+0000","last_peered":"2023-06-20T13:32:26.050028+0000","last_clean":"2023-06-20T13:32:26.050028+0000","last_became_active":"2023-06-20T13:32:21.024485+0000","last_became_peered":"2023-06-20T13:32:21.024485+0000","last_unstale":"2023-06-20T13:32:26.050028+0000","last_undegraded":"2023-06-20T13:32:26.050028+0000","last_fullsized":"2023-06-20T13:32:26.050028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:51:29.356444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225119+0000","last_change":"2023-06-20T13:32:25.076508+0000","last_active":"2023-06-20T13:32:27.225119+0000","last_peered":"2023-06-20T13:32:27.225119+0000","last_clean":"2023-06-20T13:32:27.225119+0000","last_became_active":"2023-06-20T13:32:25.076181+0000","last_became_peered":"2023-06-20T13:32:25.076181+0000","last_unstale":"2023-06-20T13:32:27.225119+0000","last_undegraded":"2023-06-20T13:32:27.225119+0000","last_fullsized":"2023-06-20T13:32:27.225119+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:19:55.667242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049673+0000","last_change":"2023-06-20T13:32:14.848215+0000","last_active":"2023-06-20T13:32:26.049673+0000","last_peered":"2023-06-20T13:32:26.049673+0000","last_clean":"2023-06-20T13:32:26.049673+0000","last_became_active":"2023-06-20T13:32:14.847950+0000","last_became_peered":"2023-06-20T13:32:14.847950+0000","last_unstale":"2023-06-20T13:32:26.049673+0000","last_undegraded":"2023-06-20T13:32:26.049673+0000","last_fullsized":"2023-06-20T13:32:26.049673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:51:22.318824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998709+0000","last_change":"2023-06-20T13:32:20.032594+0000","last_active":"2023-06-20T13:32:26.998709+0000","last_peered":"2023-06-20T13:32:26.998709+0000","last_clean":"2023-06-20T13:32:26.998709+0000","last_became_active":"2023-06-20T13:32:20.032291+0000","last_became_peered":"2023-06-20T13:32:20.032291+0000","last_unstale":"2023-06-20T13:32:26.998709+0000","last_undegraded":"2023-06-20T13:32:26.998709+0000","last_fullsized":"2023-06-20T13:32:26.998709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:21:22.959916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050508+0000","last_change":"2023-06-20T13:32:21.040885+0000","last_active":"2023-06-20T13:32:26.050508+0000","last_peered":"2023-06-20T13:32:26.050508+0000","last_clean":"2023-06-20T13:32:26.050508+0000","last_became_active":"2023-06-20T13:32:21.040606+0000","last_became_peered":"2023-06-20T13:32:21.040606+0000","last_unstale":"2023-06-20T13:32:26.050508+0000","last_undegraded":"2023-06-20T13:32:26.050508+0000","last_fullsized":"2023-06-20T13:32:26.050508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:53:26.126053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288157+0000","last_change":"2023-06-20T13:32:25.074482+0000","last_active":"2023-06-20T13:32:26.288157+0000","last_peered":"2023-06-20T13:32:26.288157+0000","last_clean":"2023-06-20T13:32:26.288157+0000","last_became_active":"2023-06-20T13:32:25.071535+0000","last_became_peered":"2023-06-20T13:32:25.071535+0000","last_unstale":"2023-06-20T13:32:26.288157+0000","last_undegraded":"2023-06-20T13:32:26.288157+0000","last_fullsized":"2023-06-20T13:32:26.288157+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:34:53.709352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225674+0000","last_change":"2023-06-20T13:32:20.023465+0000","last_active":"2023-06-20T13:32:27.225674+0000","last_peered":"2023-06-20T13:32:27.225674+0000","last_clean":"2023-06-20T13:32:27.225674+0000","last_became_active":"2023-06-20T13:32:20.023069+0000","last_became_peered":"2023-06-20T13:32:20.023069+0000","last_unstale":"2023-06-20T13:32:27.225674+0000","last_undegraded":"2023-06-20T13:32:27.225674+0000","last_fullsized":"2023-06-20T13:32:27.225674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:24:58.961174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998839+0000","last_change":"2023-06-20T13:32:13.978089+0000","last_active":"2023-06-20T13:32:26.998839+0000","last_peered":"2023-06-20T13:32:26.998839+0000","last_clean":"2023-06-20T13:32:26.998839+0000","last_became_active":"2023-06-20T13:32:13.977748+0000","last_became_peered":"2023-06-20T13:32:13.977748+0000","last_unstale":"2023-06-20T13:32:26.998839+0000","last_undegraded":"2023-06-20T13:32:26.998839+0000","last_fullsized":"2023-06-20T13:32:26.998839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:48:53.423943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224252+0000","last_change":"2023-06-20T13:32:21.028939+0000","last_active":"2023-06-20T13:32:27.224252+0000","last_peered":"2023-06-20T13:32:27.224252+0000","last_clean":"2023-06-20T13:32:27.224252+0000","last_became_active":"2023-06-20T13:32:21.028355+0000","last_became_peered":"2023-06-20T13:32:21.028355+0000","last_unstale":"2023-06-20T13:32:27.224252+0000","last_undegraded":"2023-06-20T13:32:27.224252+0000","last_fullsized":"2023-06-20T13:32:27.224252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:51:29.356444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224186+0000","last_change":"2023-06-20T13:32:25.076159+0000","last_active":"2023-06-20T13:32:27.224186+0000","last_peered":"2023-06-20T13:32:27.224186+0000","last_clean":"2023-06-20T13:32:27.224186+0000","last_became_active":"2023-06-20T13:32:25.074781+0000","last_became_peered":"2023-06-20T13:32:25.074781+0000","last_unstale":"2023-06-20T13:32:27.224186+0000","last_undegraded":"2023-06-20T13:32:27.224186+0000","last_fullsized":"2023-06-20T13:32:27.224186+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:49:04.499679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224965+0000","last_change":"2023-06-20T13:32:13.977875+0000","last_active":"2023-06-20T13:32:27.224965+0000","last_peered":"2023-06-20T13:32:27.224965+0000","last_clean":"2023-06-20T13:32:27.224965+0000","last_became_active":"2023-06-20T13:32:13.977589+0000","last_became_peered":"2023-06-20T13:32:13.977589+0000","last_unstale":"2023-06-20T13:32:27.224965+0000","last_undegraded":"2023-06-20T13:32:27.224965+0000","last_fullsized":"2023-06-20T13:32:27.224965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:21:46.859788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050052+0000","last_change":"2023-06-20T13:32:20.026066+0000","last_active":"2023-06-20T13:32:26.050052+0000","last_peered":"2023-06-20T13:32:26.050052+0000","last_clean":"2023-06-20T13:32:26.050052+0000","last_became_active":"2023-06-20T13:32:20.025801+0000","last_became_peered":"2023-06-20T13:32:20.025801+0000","last_unstale":"2023-06-20T13:32:26.050052+0000","last_undegraded":"2023-06-20T13:32:26.050052+0000","last_fullsized":"2023-06-20T13:32:26.050052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:29:47.324744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287504+0000","last_change":"2023-06-20T13:32:21.030547+0000","last_active":"2023-06-20T13:32:26.287504+0000","last_peered":"2023-06-20T13:32:26.287504+0000","last_clean":"2023-06-20T13:32:26.287504+0000","last_became_active":"2023-06-20T13:32:21.030257+0000","last_became_peered":"2023-06-20T13:32:21.030257+0000","last_unstale":"2023-06-20T13:32:26.287504+0000","last_undegraded":"2023-06-20T13:32:26.287504+0000","last_fullsized":"2023-06-20T13:32:26.287504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:23:42.344527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998540+0000","last_change":"2023-06-20T13:32:25.078236+0000","last_active":"2023-06-20T13:32:26.998540+0000","last_peered":"2023-06-20T13:32:26.998540+0000","last_clean":"2023-06-20T13:32:26.998540+0000","last_became_active":"2023-06-20T13:32:25.077747+0000","last_became_peered":"2023-06-20T13:32:25.077747+0000","last_unstale":"2023-06-20T13:32:26.998540+0000","last_undegraded":"2023-06-20T13:32:26.998540+0000","last_fullsized":"2023-06-20T13:32:26.998540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:41:55.461660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050484+0000","last_change":"2023-06-20T13:32:20.027046+0000","last_active":"2023-06-20T13:32:26.050484+0000","last_peered":"2023-06-20T13:32:26.050484+0000","last_clean":"2023-06-20T13:32:26.050484+0000","last_became_active":"2023-06-20T13:32:20.026741+0000","last_became_peered":"2023-06-20T13:32:20.026741+0000","last_unstale":"2023-06-20T13:32:26.050484+0000","last_undegraded":"2023-06-20T13:32:26.050484+0000","last_fullsized":"2023-06-20T13:32:26.050484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:22:53.366158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.047799+0000","last_change":"2023-06-20T13:32:21.015867+0000","last_active":"2023-06-20T13:32:26.047799+0000","last_peered":"2023-06-20T13:32:26.047799+0000","last_clean":"2023-06-20T13:32:26.047799+0000","last_became_active":"2023-06-20T13:32:21.015563+0000","last_became_peered":"2023-06-20T13:32:21.015563+0000","last_unstale":"2023-06-20T13:32:26.047799+0000","last_undegraded":"2023-06-20T13:32:26.047799+0000","last_fullsized":"2023-06-20T13:32:26.047799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:54:58.955740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049263+0000","last_change":"2023-06-20T13:32:25.069092+0000","last_active":"2023-06-20T13:32:26.049263+0000","last_peered":"2023-06-20T13:32:26.049263+0000","last_clean":"2023-06-20T13:32:26.049263+0000","last_became_active":"2023-06-20T13:32:25.068638+0000","last_became_peered":"2023-06-20T13:32:25.068638+0000","last_unstale":"2023-06-20T13:32:26.049263+0000","last_undegraded":"2023-06-20T13:32:26.049263+0000","last_fullsized":"2023-06-20T13:32:26.049263+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:03:03.660136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225596+0000","last_change":"2023-06-20T13:32:20.025796+0000","last_active":"2023-06-20T13:32:27.225596+0000","last_peered":"2023-06-20T13:32:27.225596+0000","last_clean":"2023-06-20T13:32:27.225596+0000","last_became_active":"2023-06-20T13:32:20.025522+0000","last_became_peered":"2023-06-20T13:32:20.025522+0000","last_unstale":"2023-06-20T13:32:27.225596+0000","last_undegraded":"2023-06-20T13:32:27.225596+0000","last_fullsized":"2023-06-20T13:32:27.225596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:04:42.004091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287773+0000","last_change":"2023-06-20T13:32:21.033490+0000","last_active":"2023-06-20T13:32:26.287773+0000","last_peered":"2023-06-20T13:32:26.287773+0000","last_clean":"2023-06-20T13:32:26.287773+0000","last_became_active":"2023-06-20T13:32:21.033237+0000","last_became_peered":"2023-06-20T13:32:21.033237+0000","last_unstale":"2023-06-20T13:32:26.287773+0000","last_undegraded":"2023-06-20T13:32:26.287773+0000","last_fullsized":"2023-06-20T13:32:26.287773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:19:16.766615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225649+0000","last_change":"2023-06-20T13:32:25.081885+0000","last_active":"2023-06-20T13:32:27.225649+0000","last_peered":"2023-06-20T13:32:27.225649+0000","last_clean":"2023-06-20T13:32:27.225649+0000","last_became_active":"2023-06-20T13:32:25.081228+0000","last_became_peered":"2023-06-20T13:32:25.081228+0000","last_unstale":"2023-06-20T13:32:27.225649+0000","last_undegraded":"2023-06-20T13:32:27.225649+0000","last_fullsized":"2023-06-20T13:32:27.225649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:49:04.499679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225509+0000","last_change":"2023-06-20T13:32:20.025197+0000","last_active":"2023-06-20T13:32:27.225509+0000","last_peered":"2023-06-20T13:32:27.225509+0000","last_clean":"2023-06-20T13:32:27.225509+0000","last_became_active":"2023-06-20T13:32:20.024758+0000","last_became_peered":"2023-06-20T13:32:20.024758+0000","last_unstale":"2023-06-20T13:32:27.225509+0000","last_undegraded":"2023-06-20T13:32:27.225509+0000","last_fullsized":"2023-06-20T13:32:27.225509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:26:46.711540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287663+0000","last_change":"2023-06-20T13:32:21.031954+0000","last_active":"2023-06-20T13:32:26.287663+0000","last_peered":"2023-06-20T13:32:26.287663+0000","last_clean":"2023-06-20T13:32:26.287663+0000","last_became_active":"2023-06-20T13:32:21.031666+0000","last_became_peered":"2023-06-20T13:32:21.031666+0000","last_unstale":"2023-06-20T13:32:26.287663+0000","last_undegraded":"2023-06-20T13:32:26.287663+0000","last_fullsized":"2023-06-20T13:32:26.287663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:57:30.492657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287583+0000","last_change":"2023-06-20T13:32:25.084390+0000","last_active":"2023-06-20T13:32:26.287583+0000","last_peered":"2023-06-20T13:32:26.287583+0000","last_clean":"2023-06-20T13:32:26.287583+0000","last_became_active":"2023-06-20T13:32:25.083962+0000","last_became_peered":"2023-06-20T13:32:25.083962+0000","last_unstale":"2023-06-20T13:32:26.287583+0000","last_undegraded":"2023-06-20T13:32:26.287583+0000","last_fullsized":"2023-06-20T13:32:26.287583+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:18:17.174644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225215+0000","last_change":"2023-06-20T13:32:20.023402+0000","last_active":"2023-06-20T13:32:27.225215+0000","last_peered":"2023-06-20T13:32:27.225215+0000","last_clean":"2023-06-20T13:32:27.225215+0000","last_became_active":"2023-06-20T13:32:20.021613+0000","last_became_peered":"2023-06-20T13:32:20.021613+0000","last_unstale":"2023-06-20T13:32:27.225215+0000","last_undegraded":"2023-06-20T13:32:27.225215+0000","last_fullsized":"2023-06-20T13:32:27.225215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:23:41.335834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224909+0000","last_change":"2023-06-20T13:32:21.022492+0000","last_active":"2023-06-20T13:32:27.224909+0000","last_peered":"2023-06-20T13:32:27.224909+0000","last_clean":"2023-06-20T13:32:27.224909+0000","last_became_active":"2023-06-20T13:32:21.022206+0000","last_became_peered":"2023-06-20T13:32:21.022206+0000","last_unstale":"2023-06-20T13:32:27.224909+0000","last_undegraded":"2023-06-20T13:32:27.224909+0000","last_fullsized":"2023-06-20T13:32:27.224909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:12:08.369795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998506+0000","last_change":"2023-06-20T13:32:25.076299+0000","last_active":"2023-06-20T13:32:26.998506+0000","last_peered":"2023-06-20T13:32:26.998506+0000","last_clean":"2023-06-20T13:32:26.998506+0000","last_became_active":"2023-06-20T13:32:25.075767+0000","last_became_peered":"2023-06-20T13:32:25.075767+0000","last_unstale":"2023-06-20T13:32:26.998506+0000","last_undegraded":"2023-06-20T13:32:26.998506+0000","last_fullsized":"2023-06-20T13:32:26.998506+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:02:49.608947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050335+0000","last_change":"2023-06-20T13:32:20.030050+0000","last_active":"2023-06-20T13:32:26.050335+0000","last_peered":"2023-06-20T13:32:26.050335+0000","last_clean":"2023-06-20T13:32:26.050335+0000","last_became_active":"2023-06-20T13:32:20.029733+0000","last_became_peered":"2023-06-20T13:32:20.029733+0000","last_unstale":"2023-06-20T13:32:26.050335+0000","last_undegraded":"2023-06-20T13:32:26.050335+0000","last_fullsized":"2023-06-20T13:32:26.050335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:48:08.408940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287814+0000","last_change":"2023-06-20T13:32:21.038936+0000","last_active":"2023-06-20T13:32:26.287814+0000","last_peered":"2023-06-20T13:32:26.287814+0000","last_clean":"2023-06-20T13:32:26.287814+0000","last_became_active":"2023-06-20T13:32:21.038680+0000","last_became_peered":"2023-06-20T13:32:21.038680+0000","last_unstale":"2023-06-20T13:32:26.287814+0000","last_undegraded":"2023-06-20T13:32:26.287814+0000","last_fullsized":"2023-06-20T13:32:26.287814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:21:30.152203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224604+0000","last_change":"2023-06-20T13:32:21.033221+0000","last_active":"2023-06-20T13:32:27.224604+0000","last_peered":"2023-06-20T13:32:27.224604+0000","last_clean":"2023-06-20T13:32:27.224604+0000","last_became_active":"2023-06-20T13:32:21.032926+0000","last_became_peered":"2023-06-20T13:32:21.032926+0000","last_unstale":"2023-06-20T13:32:27.224604+0000","last_undegraded":"2023-06-20T13:32:27.224604+0000","last_fullsized":"2023-06-20T13:32:27.224604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:42:28.774705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225379+0000","last_change":"2023-06-20T13:32:21.024688+0000","last_active":"2023-06-20T13:32:27.225379+0000","last_peered":"2023-06-20T13:32:27.225379+0000","last_clean":"2023-06-20T13:32:27.225379+0000","last_became_active":"2023-06-20T13:32:21.024425+0000","last_became_peered":"2023-06-20T13:32:21.024425+0000","last_unstale":"2023-06-20T13:32:27.225379+0000","last_undegraded":"2023-06-20T13:32:27.225379+0000","last_fullsized":"2023-06-20T13:32:27.225379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:57:30.492657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288448+0000","last_change":"2023-06-20T13:32:21.038363+0000","last_active":"2023-06-20T13:32:26.288448+0000","last_peered":"2023-06-20T13:32:26.288448+0000","last_clean":"2023-06-20T13:32:26.288448+0000","last_became_active":"2023-06-20T13:32:21.038067+0000","last_became_peered":"2023-06-20T13:32:21.038067+0000","last_unstale":"2023-06-20T13:32:26.288448+0000","last_undegraded":"2023-06-20T13:32:26.288448+0000","last_fullsized":"2023-06-20T13:32:26.288448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:39:38.079107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224630+0000","last_change":"2023-06-20T13:32:21.027425+0000","last_active":"2023-06-20T13:32:27.224630+0000","last_peered":"2023-06-20T13:32:27.224630+0000","last_clean":"2023-06-20T13:32:27.224630+0000","last_became_active":"2023-06-20T13:32:21.026535+0000","last_became_peered":"2023-06-20T13:32:21.026535+0000","last_unstale":"2023-06-20T13:32:27.224630+0000","last_undegraded":"2023-06-20T13:32:27.224630+0000","last_fullsized":"2023-06-20T13:32:27.224630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:22:54.374851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998680+0000","last_change":"2023-06-20T13:32:21.027385+0000","last_active":"2023-06-20T13:32:26.998680+0000","last_peered":"2023-06-20T13:32:26.998680+0000","last_clean":"2023-06-20T13:32:26.998680+0000","last_became_active":"2023-06-20T13:32:21.027089+0000","last_became_peered":"2023-06-20T13:32:21.027089+0000","last_unstale":"2023-06-20T13:32:26.998680+0000","last_undegraded":"2023-06-20T13:32:26.998680+0000","last_fullsized":"2023-06-20T13:32:26.998680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:25:29.097559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":909312,"data_stored":713159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":286720,"data_stored":118781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":286720,"data_stored":118781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":884736,"data_stored":709731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":286720,"data_stored":118781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":118871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]}]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":122631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":119433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-20T13:32:50.441 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-20T13:32:50.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.670+0000 7ff02afff700 1 Processor -- start 2023-06-20T13:32:50.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.670+0000 7ff02afff700 1 -- start start 2023-06-20T13:32:50.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.671+0000 7ff02afff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff02415c460 0x7ff0240b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:50.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.672+0000 7ff02afff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0240d1790 con 0x7ff0240d2640 2023-06-20T13:32:50.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.672+0000 7ff02afff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0240cd950 con 0x7ff0240cf8f0 2023-06-20T13:32:50.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.672+0000 7ff02afff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0240cedd0 con 0x7ff02415c460 2023-06-20T13:32:50.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.672+0000 7ff023fff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff0240d2640 0x7ff0240cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:52786/0 (socket says 172.21.15.32:52786) 2023-06-20T13:32:50.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.672+0000 7ff023fff700 1 -- 172.21.15.32:0/1884960607 learned_addr learned my addr 172.21.15.32:0/1884960607 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:50.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.672+0000 7ff028d9b700 1 --2- 172.21.15.32:0/1884960607 >> v2:172.21.15.115:3300/0 conn(0x7ff02415c460 0x7ff0240b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:50.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.672+0000 7ff0237fe700 1 -- 172.21.15.32:0/1884960607 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 307055487 0 0) 0x7ff0240d1790 con 0x7ff0240d2640 2023-06-20T13:32:50.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.672+0000 7ff0237fe700 1 -- 172.21.15.32:0/1884960607 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0140035b0 con 0x7ff0240d2640 2023-06-20T13:32:50.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.673+0000 7ff028d9b700 1 -- 172.21.15.32:0/1884960607 >> v1:172.21.15.115:6789/0 conn(0x7ff0240cf8f0 legacy=0x7ff02415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:50.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.673+0000 7ff0237fe700 1 -- 172.21.15.32:0/1884960607 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 601903640 0 0) 0x7ff0140035b0 con 0x7ff0240d2640 2023-06-20T13:32:50.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.673+0000 7ff028d9b700 1 -- 172.21.15.32:0/1884960607 >> v1:172.21.15.32:6789/0 conn(0x7ff0240d2640 legacy=0x7ff0240cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:50.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.673+0000 7ff028d9b700 1 -- 172.21.15.32:0/1884960607 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0240d14b0 con 0x7ff02415c460 2023-06-20T13:32:50.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.673+0000 7ff028d9b700 1 --2- 172.21.15.32:0/1884960607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff02415c460 0x7ff0240b59d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff018009840 tx=0x7ff018009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74ad8ce689466e0e server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:50.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.673+0000 7ff0237fe700 1 -- 172.21.15.32:0/1884960607 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff010001670 con 0x7ff02415c460 2023-06-20T13:32:50.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.673+0000 7ff0237fe700 1 -- 172.21.15.32:0/1884960607 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff018004030 con 0x7ff02415c460 2023-06-20T13:32:50.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.673+0000 7ff0237fe700 1 -- 172.21.15.32:0/1884960607 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0180043c0 con 0x7ff02415c460 2023-06-20T13:32:50.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.674+0000 7ff02afff700 1 -- 172.21.15.32:0/1884960607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff02415c460 msgr2=0x7ff0240b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:50.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.674+0000 7ff02afff700 1 --2- 172.21.15.32:0/1884960607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff02415c460 0x7ff0240b59d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff018009840 tx=0x7ff018009b50 comp rx=0 tx=0).stop 2023-06-20T13:32:50.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.674+0000 7ff02afff700 1 -- 172.21.15.32:0/1884960607 shutdown_connections 2023-06-20T13:32:50.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.674+0000 7ff02afff700 1 --2- 172.21.15.32:0/1884960607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff02415c460 0x7ff0240b59d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:50.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.674+0000 7ff02afff700 1 -- 172.21.15.32:0/1884960607 >> 172.21.15.32:0/1884960607 conn(0x7ff024071660 msgr2=0x7ff024071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:50.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.674+0000 7ff02afff700 1 -- 172.21.15.32:0/1884960607 shutdown_connections 2023-06-20T13:32:50.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.674+0000 7ff02afff700 1 -- 172.21.15.32:0/1884960607 wait complete. 2023-06-20T13:32:50.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.676+0000 7ff02afff700 1 Processor -- start 2023-06-20T13:32:50.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.676+0000 7ff02afff700 1 -- start start 2023-06-20T13:32:50.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.677+0000 7ff02afff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0240cf8f0 0x7ff0241e5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:50.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.677+0000 7ff02afff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0240d2640 0x7ff024155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:50.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.677+0000 7ff02afff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff02415c460 0x7ff024157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:50.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.677+0000 7ff02afff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0241e6180 con 0x7ff02415c460 2023-06-20T13:32:50.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.677+0000 7ff02afff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0241559a0 con 0x7ff0240d2640 2023-06-20T13:32:50.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.677+0000 7ff02afff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0240ca740 con 0x7ff0240cf8f0 2023-06-20T13:32:50.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.677+0000 7ff02959c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff02415c460 0x7ff024157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:50.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.677+0000 7ff02959c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff02415c460 0x7ff024157140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58948/0 (socket says 172.21.15.32:58948) 2023-06-20T13:32:50.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.677+0000 7ff02959c700 1 -- 172.21.15.32:0/2670500016 learned_addr learned my addr 172.21.15.32:0/2670500016 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:50.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.677+0000 7ff023fff700 1 --2- 172.21.15.32:0/2670500016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0240d2640 0x7ff024155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:50.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.677+0000 7ff028d9b700 1 --2- 172.21.15.32:0/2670500016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0240cf8f0 0x7ff0241e5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:50.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.678+0000 7ff02959c700 1 -- 172.21.15.32:0/2670500016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0240cf8f0 msgr2=0x7ff0241e5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:50.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.678+0000 7ff02959c700 1 --2- 172.21.15.32:0/2670500016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0240cf8f0 0x7ff0241e5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:50.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.678+0000 7ff02959c700 1 -- 172.21.15.32:0/2670500016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0240d2640 msgr2=0x7ff024155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:50.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.678+0000 7ff02959c700 1 --2- 172.21.15.32:0/2670500016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0240d2640 0x7ff024155460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:50.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.678+0000 7ff02959c700 1 -- 172.21.15.32:0/2670500016 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0180094a0 con 0x7ff02415c460 2023-06-20T13:32:50.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.678+0000 7ff02959c700 1 --2- 172.21.15.32:0/2670500016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff02415c460 0x7ff024157140 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff01c00cb50 tx=0x7ff01c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:50.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.678+0000 7ff0217fa700 1 -- 172.21.15.32:0/2670500016 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c003c00 con 0x7ff02415c460 2023-06-20T13:32:50.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.678+0000 7ff0217fa700 1 -- 172.21.15.32:0/2670500016 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01c003d60 con 0x7ff02415c460 2023-06-20T13:32:50.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.678+0000 7ff0217fa700 1 -- 172.21.15.32:0/2670500016 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c00aa20 con 0x7ff02415c460 2023-06-20T13:32:50.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.678+0000 7ff02afff700 1 -- 172.21.15.32:0/2670500016 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0240ca9e0 con 0x7ff02415c460 2023-06-20T13:32:50.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.678+0000 7ff02afff700 1 -- 172.21.15.32:0/2670500016 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0240cafa0 con 0x7ff02415c460 2023-06-20T13:32:50.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.679+0000 7ff02afff700 1 -- 172.21.15.32:0/2670500016 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff02404ea60 con 0x7ff02415c460 2023-06-20T13:32:50.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.680+0000 7ff0217fa700 1 -- 172.21.15.32:0/2670500016 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff01c00ab80 con 0x7ff02415c460 2023-06-20T13:32:50.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.681+0000 7ff0217fa700 1 --2- 172.21.15.32:0/2670500016 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff00806ace0 0x7ff00806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:50.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.681+0000 7ff0217fa700 1 -- 172.21.15.32:0/2670500016 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff01c089740 con 0x7ff02415c460 2023-06-20T13:32:50.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.682+0000 7ff028d9b700 1 --2- 172.21.15.32:0/2670500016 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff00806ace0 0x7ff00806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:50.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.682+0000 7ff028d9b700 1 --2- 172.21.15.32:0/2670500016 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff00806ace0 0x7ff00806d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff0180090b0 tx=0x7ff018008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:50.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.685+0000 7ff0217fa700 1 -- 172.21.15.32:0/2670500016 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff01c0544f0 con 0x7ff02415c460 2023-06-20T13:32:50.888 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.887+0000 7ff02afff700 1 -- 172.21.15.32:0/2670500016 --> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff0240cd5e0 con 0x7ff00806ace0 2023-06-20T13:32:50.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.898+0000 7ff0217fa700 1 -- 172.21.15.32:0/2670500016 <== mgr.4101 v2:172.21.15.32:6832/1136488437 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367335 (secure 0 0 0) 0x7ff0180036a0 con 0x7ff00806ace0 2023-06-20T13:32:50.905 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:32:50.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.902+0000 7ff02afff700 1 -- 172.21.15.32:0/2670500016 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff00806ace0 msgr2=0x7ff00806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:50.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.902+0000 7ff02afff700 1 --2- 172.21.15.32:0/2670500016 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff00806ace0 0x7ff00806d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff0180090b0 tx=0x7ff018008030 comp rx=0 tx=0).stop 2023-06-20T13:32:50.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.902+0000 7ff02afff700 1 -- 172.21.15.32:0/2670500016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff02415c460 msgr2=0x7ff024157140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:50.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.902+0000 7ff02afff700 1 --2- 172.21.15.32:0/2670500016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff02415c460 0x7ff024157140 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff01c00cb50 tx=0x7ff01c00ce60 comp rx=0 tx=0).stop 2023-06-20T13:32:50.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.902+0000 7ff02afff700 1 -- 172.21.15.32:0/2670500016 shutdown_connections 2023-06-20T13:32:50.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.902+0000 7ff02afff700 1 --2- 172.21.15.32:0/2670500016 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff00806ace0 0x7ff00806d190 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:50.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.902+0000 7ff02afff700 1 --2- 172.21.15.32:0/2670500016 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff02415c460 0x7ff024157140 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:50.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.902+0000 7ff02afff700 1 --2- 172.21.15.32:0/2670500016 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0240cf8f0 0x7ff0241e5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:50.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.902+0000 7ff02afff700 1 --2- 172.21.15.32:0/2670500016 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0240d2640 0x7ff024155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:50.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.902+0000 7ff02afff700 1 -- 172.21.15.32:0/2670500016 >> 172.21.15.32:0/2670500016 conn(0x7ff024071660 msgr2=0x7ff0240d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:50.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.903+0000 7ff02afff700 1 -- 172.21.15.32:0/2670500016 shutdown_connections 2023-06-20T13:32:50.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:50.903+0000 7ff02afff700 1 -- 172.21.15.32:0/2670500016 wait complete. 2023-06-20T13:32:50.909 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-06-20T13:32:50.922 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2023-06-20T13:32:49.260224+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219080,"kb_used_data":3464,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755640,"statfs":{"total":773094113280,"available":772869775360,"internally_reserved":0,"allocated":3547136,"data_stored":2140168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003090"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.048185+0000","last_change":"2023-06-20T13:32:21.033030+0000","last_active":"2023-06-20T13:32:26.048185+0000","last_peered":"2023-06-20T13:32:26.048185+0000","last_clean":"2023-06-20T13:32:26.048185+0000","last_became_active":"2023-06-20T13:32:21.032583+0000","last_became_peered":"2023-06-20T13:32:21.032583+0000","last_unstale":"2023-06-20T13:32:26.048185+0000","last_undegraded":"2023-06-20T13:32:26.048185+0000","last_fullsized":"2023-06-20T13:32:26.048185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:43:58.636715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225801+0000","last_change":"2023-06-20T13:32:21.028815+0000","last_active":"2023-06-20T13:32:27.225801+0000","last_peered":"2023-06-20T13:32:27.225801+0000","last_clean":"2023-06-20T13:32:27.225801+0000","last_became_active":"2023-06-20T13:32:21.026146+0000","last_became_peered":"2023-06-20T13:32:21.026146+0000","last_unstale":"2023-06-20T13:32:27.225801+0000","last_undegraded":"2023-06-20T13:32:27.225801+0000","last_fullsized":"2023-06-20T13:32:27.225801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:22:54.374851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288495+0000","last_change":"2023-06-20T13:32:21.031230+0000","last_active":"2023-06-20T13:32:26.288495+0000","last_peered":"2023-06-20T13:32:26.288495+0000","last_clean":"2023-06-20T13:32:26.288495+0000","last_became_active":"2023-06-20T13:32:21.030270+0000","last_became_peered":"2023-06-20T13:32:21.030270+0000","last_unstale":"2023-06-20T13:32:26.288495+0000","last_undegraded":"2023-06-20T13:32:26.288495+0000","last_fullsized":"2023-06-20T13:32:26.288495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:32:45.231640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225268+0000","last_change":"2023-06-20T13:32:21.033833+0000","last_active":"2023-06-20T13:32:27.225268+0000","last_peered":"2023-06-20T13:32:27.225268+0000","last_clean":"2023-06-20T13:32:27.225268+0000","last_became_active":"2023-06-20T13:32:21.033516+0000","last_became_peered":"2023-06-20T13:32:21.033516+0000","last_unstale":"2023-06-20T13:32:27.225268+0000","last_undegraded":"2023-06-20T13:32:27.225268+0000","last_fullsized":"2023-06-20T13:32:27.225268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:46:34.316386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050622+0000","last_change":"2023-06-20T13:32:21.033655+0000","last_active":"2023-06-20T13:32:26.050622+0000","last_peered":"2023-06-20T13:32:26.050622+0000","last_clean":"2023-06-20T13:32:26.050622+0000","last_became_active":"2023-06-20T13:32:21.033357+0000","last_became_peered":"2023-06-20T13:32:21.033357+0000","last_unstale":"2023-06-20T13:32:26.050622+0000","last_undegraded":"2023-06-20T13:32:26.050622+0000","last_fullsized":"2023-06-20T13:32:26.050622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:39:14.274571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288173+0000","last_change":"2023-06-20T13:32:21.032497+0000","last_active":"2023-06-20T13:32:26.288173+0000","last_peered":"2023-06-20T13:32:26.288173+0000","last_clean":"2023-06-20T13:32:26.288173+0000","last_became_active":"2023-06-20T13:32:21.032222+0000","last_became_peered":"2023-06-20T13:32:21.032222+0000","last_unstale":"2023-06-20T13:32:26.288173+0000","last_undegraded":"2023-06-20T13:32:26.288173+0000","last_fullsized":"2023-06-20T13:32:26.288173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:29:48.507048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049899+0000","last_change":"2023-06-20T13:32:21.022372+0000","last_active":"2023-06-20T13:32:26.049899+0000","last_peered":"2023-06-20T13:32:26.049899+0000","last_clean":"2023-06-20T13:32:26.049899+0000","last_became_active":"2023-06-20T13:32:21.021763+0000","last_became_peered":"2023-06-20T13:32:21.021763+0000","last_unstale":"2023-06-20T13:32:26.049899+0000","last_undegraded":"2023-06-20T13:32:26.049899+0000","last_fullsized":"2023-06-20T13:32:26.049899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:22:54.374851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224785+0000","last_change":"2023-06-20T13:32:21.040883+0000","last_active":"2023-06-20T13:32:27.224785+0000","last_peered":"2023-06-20T13:32:27.224785+0000","last_clean":"2023-06-20T13:32:27.224785+0000","last_became_active":"2023-06-20T13:32:21.040645+0000","last_became_peered":"2023-06-20T13:32:21.040645+0000","last_unstale":"2023-06-20T13:32:27.224785+0000","last_undegraded":"2023-06-20T13:32:27.224785+0000","last_fullsized":"2023-06-20T13:32:27.224785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:10:11.011524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049846+0000","last_change":"2023-06-20T13:32:21.032741+0000","last_active":"2023-06-20T13:32:26.049846+0000","last_peered":"2023-06-20T13:32:26.049846+0000","last_clean":"2023-06-20T13:32:26.049846+0000","last_became_active":"2023-06-20T13:32:21.031965+0000","last_became_peered":"2023-06-20T13:32:21.031965+0000","last_unstale":"2023-06-20T13:32:26.049846+0000","last_undegraded":"2023-06-20T13:32:26.049846+0000","last_fullsized":"2023-06-20T13:32:26.049846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:10:11.011524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.226123+0000","last_change":"2023-06-20T13:32:21.029077+0000","last_active":"2023-06-20T13:32:27.226123+0000","last_peered":"2023-06-20T13:32:27.226123+0000","last_clean":"2023-06-20T13:32:27.226123+0000","last_became_active":"2023-06-20T13:32:21.025779+0000","last_became_peered":"2023-06-20T13:32:21.025779+0000","last_unstale":"2023-06-20T13:32:27.226123+0000","last_undegraded":"2023-06-20T13:32:27.226123+0000","last_fullsized":"2023-06-20T13:32:27.226123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:12:08.369795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288693+0000","last_change":"2023-06-20T13:32:21.031418+0000","last_active":"2023-06-20T13:32:26.288693+0000","last_peered":"2023-06-20T13:32:26.288693+0000","last_clean":"2023-06-20T13:32:26.288693+0000","last_became_active":"2023-06-20T13:32:21.030652+0000","last_became_peered":"2023-06-20T13:32:21.030652+0000","last_unstale":"2023-06-20T13:32:26.288693+0000","last_undegraded":"2023-06-20T13:32:26.288693+0000","last_fullsized":"2023-06-20T13:32:26.288693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:34:05.805819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.048364+0000","last_change":"2023-06-20T13:32:21.038615+0000","last_active":"2023-06-20T13:32:26.048364+0000","last_peered":"2023-06-20T13:32:26.048364+0000","last_clean":"2023-06-20T13:32:26.048364+0000","last_became_active":"2023-06-20T13:32:21.038282+0000","last_became_peered":"2023-06-20T13:32:21.038282+0000","last_unstale":"2023-06-20T13:32:26.048364+0000","last_undegraded":"2023-06-20T13:32:26.048364+0000","last_fullsized":"2023-06-20T13:32:26.048364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:59:33.841139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.047994+0000","last_change":"2023-06-20T13:32:21.031597+0000","last_active":"2023-06-20T13:32:26.047994+0000","last_peered":"2023-06-20T13:32:26.047994+0000","last_clean":"2023-06-20T13:32:26.047994+0000","last_became_active":"2023-06-20T13:32:21.031271+0000","last_became_peered":"2023-06-20T13:32:21.031271+0000","last_unstale":"2023-06-20T13:32:26.047994+0000","last_undegraded":"2023-06-20T13:32:26.047994+0000","last_fullsized":"2023-06-20T13:32:26.047994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:44:15.228781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225403+0000","last_change":"2023-06-20T13:32:21.025613+0000","last_active":"2023-06-20T13:32:27.225403+0000","last_peered":"2023-06-20T13:32:27.225403+0000","last_clean":"2023-06-20T13:32:27.225403+0000","last_became_active":"2023-06-20T13:32:21.025299+0000","last_became_peered":"2023-06-20T13:32:21.025299+0000","last_unstale":"2023-06-20T13:32:27.225403+0000","last_undegraded":"2023-06-20T13:32:27.225403+0000","last_fullsized":"2023-06-20T13:32:27.225403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:02:59.622021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049134+0000","last_change":"2023-06-20T13:32:21.022539+0000","last_active":"2023-06-20T13:32:26.049134+0000","last_peered":"2023-06-20T13:32:26.049134+0000","last_clean":"2023-06-20T13:32:26.049134+0000","last_became_active":"2023-06-20T13:32:21.022066+0000","last_became_peered":"2023-06-20T13:32:21.022066+0000","last_unstale":"2023-06-20T13:32:26.049134+0000","last_undegraded":"2023-06-20T13:32:26.049134+0000","last_fullsized":"2023-06-20T13:32:26.049134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:41:51.423544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287835+0000","last_change":"2023-06-20T13:32:21.029934+0000","last_active":"2023-06-20T13:32:26.287835+0000","last_peered":"2023-06-20T13:32:26.287835+0000","last_clean":"2023-06-20T13:32:26.287835+0000","last_became_active":"2023-06-20T13:32:21.029620+0000","last_became_peered":"2023-06-20T13:32:21.029620+0000","last_unstale":"2023-06-20T13:32:26.287835+0000","last_undegraded":"2023-06-20T13:32:26.287835+0000","last_fullsized":"2023-06-20T13:32:26.287835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:24:59.969867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049998+0000","last_change":"2023-06-20T13:32:21.032911+0000","last_active":"2023-06-20T13:32:26.049998+0000","last_peered":"2023-06-20T13:32:26.049998+0000","last_clean":"2023-06-20T13:32:26.049998+0000","last_became_active":"2023-06-20T13:32:21.032330+0000","last_became_peered":"2023-06-20T13:32:21.032330+0000","last_unstale":"2023-06-20T13:32:26.049998+0000","last_undegraded":"2023-06-20T13:32:26.049998+0000","last_fullsized":"2023-06-20T13:32:26.049998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:25:29.097559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288480+0000","last_change":"2023-06-20T13:32:21.032286+0000","last_active":"2023-06-20T13:32:26.288480+0000","last_peered":"2023-06-20T13:32:26.288480+0000","last_clean":"2023-06-20T13:32:26.288480+0000","last_became_active":"2023-06-20T13:32:21.032026+0000","last_became_peered":"2023-06-20T13:32:21.032026+0000","last_unstale":"2023-06-20T13:32:26.288480+0000","last_undegraded":"2023-06-20T13:32:26.288480+0000","last_fullsized":"2023-06-20T13:32:26.288480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:20:54.027209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.047620+0000","last_change":"2023-06-20T13:32:21.038729+0000","last_active":"2023-06-20T13:32:26.047620+0000","last_peered":"2023-06-20T13:32:26.047620+0000","last_clean":"2023-06-20T13:32:26.047620+0000","last_became_active":"2023-06-20T13:32:21.038349+0000","last_became_peered":"2023-06-20T13:32:21.038349+0000","last_unstale":"2023-06-20T13:32:26.047620+0000","last_undegraded":"2023-06-20T13:32:26.047620+0000","last_fullsized":"2023-06-20T13:32:26.047620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:52:33.238643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288055+0000","last_change":"2023-06-20T13:32:21.038223+0000","last_active":"2023-06-20T13:32:26.288055+0000","last_peered":"2023-06-20T13:32:26.288055+0000","last_clean":"2023-06-20T13:32:26.288055+0000","last_became_active":"2023-06-20T13:32:21.037898+0000","last_became_peered":"2023-06-20T13:32:21.037898+0000","last_unstale":"2023-06-20T13:32:26.288055+0000","last_undegraded":"2023-06-20T13:32:26.288055+0000","last_fullsized":"2023-06-20T13:32:26.288055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:22:57.611066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049472+0000","last_change":"2023-06-20T13:32:21.031301+0000","last_active":"2023-06-20T13:32:26.049472+0000","last_peered":"2023-06-20T13:32:26.049472+0000","last_clean":"2023-06-20T13:32:26.049472+0000","last_became_active":"2023-06-20T13:32:21.031013+0000","last_became_peered":"2023-06-20T13:32:21.031013+0000","last_unstale":"2023-06-20T13:32:26.049472+0000","last_undegraded":"2023-06-20T13:32:26.049472+0000","last_fullsized":"2023-06-20T13:32:26.049472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:29:48.333437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049583+0000","last_change":"2023-06-20T13:32:21.025148+0000","last_active":"2023-06-20T13:32:26.049583+0000","last_peered":"2023-06-20T13:32:26.049583+0000","last_clean":"2023-06-20T13:32:26.049583+0000","last_became_active":"2023-06-20T13:32:21.024903+0000","last_became_peered":"2023-06-20T13:32:21.024903+0000","last_unstale":"2023-06-20T13:32:26.049583+0000","last_undegraded":"2023-06-20T13:32:26.049583+0000","last_fullsized":"2023-06-20T13:32:26.049583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:41:51.423544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224396+0000","last_change":"2023-06-20T13:32:21.028704+0000","last_active":"2023-06-20T13:32:27.224396+0000","last_peered":"2023-06-20T13:32:27.224396+0000","last_clean":"2023-06-20T13:32:27.224396+0000","last_became_active":"2023-06-20T13:32:21.028340+0000","last_became_peered":"2023-06-20T13:32:21.028340+0000","last_unstale":"2023-06-20T13:32:27.224396+0000","last_undegraded":"2023-06-20T13:32:27.224396+0000","last_fullsized":"2023-06-20T13:32:27.224396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:48:09.417634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049186+0000","last_change":"2023-06-20T13:32:21.034406+0000","last_active":"2023-06-20T13:32:26.049186+0000","last_peered":"2023-06-20T13:32:26.049186+0000","last_clean":"2023-06-20T13:32:26.049186+0000","last_became_active":"2023-06-20T13:32:21.034097+0000","last_became_peered":"2023-06-20T13:32:21.034097+0000","last_unstale":"2023-06-20T13:32:26.049186+0000","last_undegraded":"2023-06-20T13:32:26.049186+0000","last_fullsized":"2023-06-20T13:32:26.049186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:10:11.011524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998821+0000","last_change":"2023-06-20T13:32:21.038778+0000","last_active":"2023-06-20T13:32:26.998821+0000","last_peered":"2023-06-20T13:32:26.998821+0000","last_clean":"2023-06-20T13:32:26.998821+0000","last_became_active":"2023-06-20T13:32:21.038456+0000","last_became_peered":"2023-06-20T13:32:21.038456+0000","last_unstale":"2023-06-20T13:32:26.998821+0000","last_undegraded":"2023-06-20T13:32:26.998821+0000","last_fullsized":"2023-06-20T13:32:26.998821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:29:48.333437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998629+0000","last_change":"2023-06-20T13:32:21.023655+0000","last_active":"2023-06-20T13:32:26.998629+0000","last_peered":"2023-06-20T13:32:26.998629+0000","last_clean":"2023-06-20T13:32:26.998629+0000","last_became_active":"2023-06-20T13:32:21.023366+0000","last_became_peered":"2023-06-20T13:32:21.023366+0000","last_unstale":"2023-06-20T13:32:26.998629+0000","last_undegraded":"2023-06-20T13:32:26.998629+0000","last_fullsized":"2023-06-20T13:32:26.998629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:02:59.622021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225931+0000","last_change":"2023-06-20T13:32:21.040132+0000","last_active":"2023-06-20T13:32:27.225931+0000","last_peered":"2023-06-20T13:32:27.225931+0000","last_clean":"2023-06-20T13:32:27.225931+0000","last_became_active":"2023-06-20T13:32:21.039482+0000","last_became_peered":"2023-06-20T13:32:21.039482+0000","last_unstale":"2023-06-20T13:32:27.225931+0000","last_undegraded":"2023-06-20T13:32:27.225931+0000","last_fullsized":"2023-06-20T13:32:27.225931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:01:24.597870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288708+0000","last_change":"2023-06-20T13:32:25.083629+0000","last_active":"2023-06-20T13:32:26.288708+0000","last_peered":"2023-06-20T13:32:26.288708+0000","last_clean":"2023-06-20T13:32:26.288708+0000","last_became_active":"2023-06-20T13:32:25.083205+0000","last_became_peered":"2023-06-20T13:32:25.083205+0000","last_unstale":"2023-06-20T13:32:26.288708+0000","last_undegraded":"2023-06-20T13:32:26.288708+0000","last_fullsized":"2023-06-20T13:32:26.288708+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:05:12.289018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287897+0000","last_change":"2023-06-20T13:32:20.023586+0000","last_active":"2023-06-20T13:32:26.287897+0000","last_peered":"2023-06-20T13:32:26.287897+0000","last_clean":"2023-06-20T13:32:26.287897+0000","last_became_active":"2023-06-20T13:32:20.023257+0000","last_became_peered":"2023-06-20T13:32:20.023257+0000","last_unstale":"2023-06-20T13:32:26.287897+0000","last_undegraded":"2023-06-20T13:32:26.287897+0000","last_fullsized":"2023-06-20T13:32:26.287897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:28:06.073451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225087+0000","last_change":"2023-06-20T13:32:21.024146+0000","last_active":"2023-06-20T13:32:27.225087+0000","last_peered":"2023-06-20T13:32:27.225087+0000","last_clean":"2023-06-20T13:32:27.225087+0000","last_became_active":"2023-06-20T13:32:21.023861+0000","last_became_peered":"2023-06-20T13:32:21.023861+0000","last_unstale":"2023-06-20T13:32:27.225087+0000","last_undegraded":"2023-06-20T13:32:27.225087+0000","last_fullsized":"2023-06-20T13:32:27.225087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:19:16.766615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224818+0000","last_change":"2023-06-20T13:32:25.070665+0000","last_active":"2023-06-20T13:32:27.224818+0000","last_peered":"2023-06-20T13:32:27.224818+0000","last_clean":"2023-06-20T13:32:27.224818+0000","last_became_active":"2023-06-20T13:32:25.070238+0000","last_became_peered":"2023-06-20T13:32:25.070238+0000","last_unstale":"2023-06-20T13:32:27.224818+0000","last_undegraded":"2023-06-20T13:32:27.224818+0000","last_fullsized":"2023-06-20T13:32:27.224818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:49:58.213633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998000+0000","last_change":"2023-06-20T13:32:20.022478+0000","last_active":"2023-06-20T13:32:26.998000+0000","last_peered":"2023-06-20T13:32:26.998000+0000","last_clean":"2023-06-20T13:32:26.998000+0000","last_became_active":"2023-06-20T13:32:20.022166+0000","last_became_peered":"2023-06-20T13:32:20.022166+0000","last_unstale":"2023-06-20T13:32:26.998000+0000","last_undegraded":"2023-06-20T13:32:26.998000+0000","last_fullsized":"2023-06-20T13:32:26.998000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:19:18.352136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050275+0000","last_change":"2023-06-20T13:32:21.037532+0000","last_active":"2023-06-20T13:32:26.050275+0000","last_peered":"2023-06-20T13:32:26.050275+0000","last_clean":"2023-06-20T13:32:26.050275+0000","last_became_active":"2023-06-20T13:32:21.037127+0000","last_became_peered":"2023-06-20T13:32:21.037127+0000","last_unstale":"2023-06-20T13:32:26.050275+0000","last_undegraded":"2023-06-20T13:32:26.050275+0000","last_fullsized":"2023-06-20T13:32:26.050275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:26:47.720233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050558+0000","last_change":"2023-06-20T13:32:25.085925+0000","last_active":"2023-06-20T13:32:26.050558+0000","last_peered":"2023-06-20T13:32:26.050558+0000","last_clean":"2023-06-20T13:32:26.050558+0000","last_became_active":"2023-06-20T13:32:25.085537+0000","last_became_peered":"2023-06-20T13:32:25.085537+0000","last_unstale":"2023-06-20T13:32:26.050558+0000","last_undegraded":"2023-06-20T13:32:26.050558+0000","last_fullsized":"2023-06-20T13:32:26.050558+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:01:28.635985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224478+0000","last_change":"2023-06-20T13:32:20.028414+0000","last_active":"2023-06-20T13:32:27.224478+0000","last_peered":"2023-06-20T13:32:27.224478+0000","last_clean":"2023-06-20T13:32:27.224478+0000","last_became_active":"2023-06-20T13:32:20.028129+0000","last_became_peered":"2023-06-20T13:32:20.028129+0000","last_unstale":"2023-06-20T13:32:27.224478+0000","last_undegraded":"2023-06-20T13:32:27.224478+0000","last_fullsized":"2023-06-20T13:32:27.224478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:16:57.717945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225375+0000","last_change":"2023-06-20T13:32:21.036814+0000","last_active":"2023-06-20T13:32:27.225375+0000","last_peered":"2023-06-20T13:32:27.225375+0000","last_clean":"2023-06-20T13:32:27.225375+0000","last_became_active":"2023-06-20T13:32:21.036540+0000","last_became_peered":"2023-06-20T13:32:21.036540+0000","last_unstale":"2023-06-20T13:32:27.225375+0000","last_undegraded":"2023-06-20T13:32:27.225375+0000","last_fullsized":"2023-06-20T13:32:27.225375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:39:45.434194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224434+0000","last_change":"2023-06-20T13:32:25.070673+0000","last_active":"2023-06-20T13:32:27.224434+0000","last_peered":"2023-06-20T13:32:27.224434+0000","last_clean":"2023-06-20T13:32:27.224434+0000","last_became_active":"2023-06-20T13:32:25.070136+0000","last_became_peered":"2023-06-20T13:32:25.070136+0000","last_unstale":"2023-06-20T13:32:27.224434+0000","last_undegraded":"2023-06-20T13:32:27.224434+0000","last_fullsized":"2023-06-20T13:32:27.224434+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:57:00.983846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050185+0000","last_change":"2023-06-20T13:32:20.030153+0000","last_active":"2023-06-20T13:32:26.050185+0000","last_peered":"2023-06-20T13:32:26.050185+0000","last_clean":"2023-06-20T13:32:26.050185+0000","last_became_active":"2023-06-20T13:32:20.029794+0000","last_became_peered":"2023-06-20T13:32:20.029794+0000","last_unstale":"2023-06-20T13:32:26.050185+0000","last_undegraded":"2023-06-20T13:32:26.050185+0000","last_fullsized":"2023-06-20T13:32:26.050185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:04:42.004091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224386+0000","last_change":"2023-06-20T13:32:21.028713+0000","last_active":"2023-06-20T13:32:27.224386+0000","last_peered":"2023-06-20T13:32:27.224386+0000","last_clean":"2023-06-20T13:32:27.224386+0000","last_became_active":"2023-06-20T13:32:21.027969+0000","last_became_peered":"2023-06-20T13:32:21.027969+0000","last_unstale":"2023-06-20T13:32:27.224386+0000","last_undegraded":"2023-06-20T13:32:27.224386+0000","last_fullsized":"2023-06-20T13:32:27.224386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:26:47.720233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.048978+0000","last_change":"2023-06-20T13:32:25.072571+0000","last_active":"2023-06-20T13:32:26.048978+0000","last_peered":"2023-06-20T13:32:26.048978+0000","last_clean":"2023-06-20T13:32:26.048978+0000","last_became_active":"2023-06-20T13:32:25.072166+0000","last_became_peered":"2023-06-20T13:32:25.072166+0000","last_unstale":"2023-06-20T13:32:26.048978+0000","last_undegraded":"2023-06-20T13:32:26.048978+0000","last_fullsized":"2023-06-20T13:32:26.048978+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:02:49.608947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225983+0000","last_change":"2023-06-20T13:32:20.022108+0000","last_active":"2023-06-20T13:32:27.225983+0000","last_peered":"2023-06-20T13:32:27.225983+0000","last_clean":"2023-06-20T13:32:27.225983+0000","last_became_active":"2023-06-20T13:32:20.021836+0000","last_became_peered":"2023-06-20T13:32:20.021836+0000","last_unstale":"2023-06-20T13:32:27.225983+0000","last_undegraded":"2023-06-20T13:32:27.225983+0000","last_fullsized":"2023-06-20T13:32:27.225983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:32:35.608967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224530+0000","last_change":"2023-06-20T13:32:21.027141+0000","last_active":"2023-06-20T13:32:27.224530+0000","last_peered":"2023-06-20T13:32:27.224530+0000","last_clean":"2023-06-20T13:32:27.224530+0000","last_became_active":"2023-06-20T13:32:21.026831+0000","last_became_peered":"2023-06-20T13:32:21.026831+0000","last_unstale":"2023-06-20T13:32:27.224530+0000","last_undegraded":"2023-06-20T13:32:27.224530+0000","last_fullsized":"2023-06-20T13:32:27.224530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:01:24.597870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225358+0000","last_change":"2023-06-20T13:32:25.074657+0000","last_active":"2023-06-20T13:32:27.225358+0000","last_peered":"2023-06-20T13:32:27.225358+0000","last_clean":"2023-06-20T13:32:27.225358+0000","last_became_active":"2023-06-20T13:32:25.074234+0000","last_became_peered":"2023-06-20T13:32:25.074234+0000","last_unstale":"2023-06-20T13:32:27.225358+0000","last_undegraded":"2023-06-20T13:32:27.225358+0000","last_fullsized":"2023-06-20T13:32:27.225358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:34:34.823010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049629+0000","last_change":"2023-06-20T13:32:20.023105+0000","last_active":"2023-06-20T13:32:26.049629+0000","last_peered":"2023-06-20T13:32:26.049629+0000","last_clean":"2023-06-20T13:32:26.049629+0000","last_became_active":"2023-06-20T13:32:20.022845+0000","last_became_peered":"2023-06-20T13:32:20.022845+0000","last_unstale":"2023-06-20T13:32:26.049629+0000","last_undegraded":"2023-06-20T13:32:26.049629+0000","last_fullsized":"2023-06-20T13:32:26.049629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:04:42.004091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998524+0000","last_change":"2023-06-20T13:32:21.035337+0000","last_active":"2023-06-20T13:32:26.998524+0000","last_peered":"2023-06-20T13:32:26.998524+0000","last_clean":"2023-06-20T13:32:26.998524+0000","last_became_active":"2023-06-20T13:32:21.035026+0000","last_became_peered":"2023-06-20T13:32:21.035026+0000","last_unstale":"2023-06-20T13:32:26.998524+0000","last_undegraded":"2023-06-20T13:32:26.998524+0000","last_fullsized":"2023-06-20T13:32:26.998524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:08:50.174602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998117+0000","last_change":"2023-06-20T13:32:25.077778+0000","last_active":"2023-06-20T13:32:26.998117+0000","last_peered":"2023-06-20T13:32:26.998117+0000","last_clean":"2023-06-20T13:32:26.998117+0000","last_became_active":"2023-06-20T13:32:25.076300+0000","last_became_peered":"2023-06-20T13:32:25.076300+0000","last_unstale":"2023-06-20T13:32:26.998117+0000","last_undegraded":"2023-06-20T13:32:26.998117+0000","last_fullsized":"2023-06-20T13:32:26.998117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:38:55.235383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:39.667215+0000","last_change":"2023-06-20T13:32:20.020923+0000","last_active":"2023-06-20T13:32:39.667215+0000","last_peered":"2023-06-20T13:32:39.667215+0000","last_clean":"2023-06-20T13:32:39.667215+0000","last_became_active":"2023-06-20T13:32:20.020435+0000","last_became_peered":"2023-06-20T13:32:20.020435+0000","last_unstale":"2023-06-20T13:32:39.667215+0000","last_undegraded":"2023-06-20T13:32:39.667215+0000","last_fullsized":"2023-06-20T13:32:39.667215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:04:23.085234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288184+0000","last_change":"2023-06-20T13:32:21.035014+0000","last_active":"2023-06-20T13:32:26.288184+0000","last_peered":"2023-06-20T13:32:26.288184+0000","last_clean":"2023-06-20T13:32:26.288184+0000","last_became_active":"2023-06-20T13:32:21.034760+0000","last_became_peered":"2023-06-20T13:32:21.034760+0000","last_unstale":"2023-06-20T13:32:26.288184+0000","last_undegraded":"2023-06-20T13:32:26.288184+0000","last_fullsized":"2023-06-20T13:32:26.288184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:35:16.891724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.226159+0000","last_change":"2023-06-20T13:32:25.082529+0000","last_active":"2023-06-20T13:32:27.226159+0000","last_peered":"2023-06-20T13:32:27.226159+0000","last_clean":"2023-06-20T13:32:27.226159+0000","last_became_active":"2023-06-20T13:32:25.082205+0000","last_became_peered":"2023-06-20T13:32:25.082205+0000","last_unstale":"2023-06-20T13:32:27.226159+0000","last_undegraded":"2023-06-20T13:32:27.226159+0000","last_fullsized":"2023-06-20T13:32:27.226159+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:18:17.174644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049387+0000","last_change":"2023-06-20T13:32:20.022027+0000","last_active":"2023-06-20T13:32:26.049387+0000","last_peered":"2023-06-20T13:32:26.049387+0000","last_clean":"2023-06-20T13:32:26.049387+0000","last_became_active":"2023-06-20T13:32:20.021696+0000","last_became_peered":"2023-06-20T13:32:20.021696+0000","last_unstale":"2023-06-20T13:32:26.049387+0000","last_undegraded":"2023-06-20T13:32:26.049387+0000","last_fullsized":"2023-06-20T13:32:26.049387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:21:22.959916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224795+0000","last_change":"2023-06-20T13:32:21.035314+0000","last_active":"2023-06-20T13:32:27.224795+0000","last_peered":"2023-06-20T13:32:27.224795+0000","last_clean":"2023-06-20T13:32:27.224795+0000","last_became_active":"2023-06-20T13:32:21.035000+0000","last_became_peered":"2023-06-20T13:32:21.035000+0000","last_unstale":"2023-06-20T13:32:27.224795+0000","last_undegraded":"2023-06-20T13:32:27.224795+0000","last_fullsized":"2023-06-20T13:32:27.224795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:32:36.617660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224640+0000","last_change":"2023-06-20T13:32:25.067229+0000","last_active":"2023-06-20T13:32:27.224640+0000","last_peered":"2023-06-20T13:32:27.224640+0000","last_clean":"2023-06-20T13:32:27.224640+0000","last_became_active":"2023-06-20T13:32:25.066768+0000","last_became_peered":"2023-06-20T13:32:25.066768+0000","last_unstale":"2023-06-20T13:32:27.224640+0000","last_undegraded":"2023-06-20T13:32:27.224640+0000","last_fullsized":"2023-06-20T13:32:27.224640+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:53:30.164168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049398+0000","last_change":"2023-06-20T13:32:20.025271+0000","last_active":"2023-06-20T13:32:26.049398+0000","last_peered":"2023-06-20T13:32:26.049398+0000","last_clean":"2023-06-20T13:32:26.049398+0000","last_became_active":"2023-06-20T13:32:20.024881+0000","last_became_peered":"2023-06-20T13:32:20.024881+0000","last_unstale":"2023-06-20T13:32:26.049398+0000","last_undegraded":"2023-06-20T13:32:26.049398+0000","last_fullsized":"2023-06-20T13:32:26.049398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:08:49.165909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225931+0000","last_change":"2023-06-20T13:32:21.040302+0000","last_active":"2023-06-20T13:32:27.225931+0000","last_peered":"2023-06-20T13:32:27.225931+0000","last_clean":"2023-06-20T13:32:27.225931+0000","last_became_active":"2023-06-20T13:32:21.039807+0000","last_became_peered":"2023-06-20T13:32:21.039807+0000","last_unstale":"2023-06-20T13:32:27.225931+0000","last_undegraded":"2023-06-20T13:32:27.225931+0000","last_fullsized":"2023-06-20T13:32:27.225931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:39:14.274571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225542+0000","last_change":"2023-06-20T13:32:25.074563+0000","last_active":"2023-06-20T13:32:27.225542+0000","last_peered":"2023-06-20T13:32:27.225542+0000","last_clean":"2023-06-20T13:32:27.225542+0000","last_became_active":"2023-06-20T13:32:25.074142+0000","last_became_peered":"2023-06-20T13:32:25.074142+0000","last_unstale":"2023-06-20T13:32:27.225542+0000","last_undegraded":"2023-06-20T13:32:27.225542+0000","last_fullsized":"2023-06-20T13:32:27.225542+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:21:34.190318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049875+0000","last_change":"2023-06-20T13:32:20.022385+0000","last_active":"2023-06-20T13:32:26.049875+0000","last_peered":"2023-06-20T13:32:26.049875+0000","last_clean":"2023-06-20T13:32:26.049875+0000","last_became_active":"2023-06-20T13:32:20.022046+0000","last_became_peered":"2023-06-20T13:32:20.022046+0000","last_unstale":"2023-06-20T13:32:26.049875+0000","last_undegraded":"2023-06-20T13:32:26.049875+0000","last_fullsized":"2023-06-20T13:32:26.049875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:16:57.717945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050412+0000","last_change":"2023-06-20T13:32:21.037368+0000","last_active":"2023-06-20T13:32:26.050412+0000","last_peered":"2023-06-20T13:32:26.050412+0000","last_clean":"2023-06-20T13:32:26.050412+0000","last_became_active":"2023-06-20T13:32:21.036706+0000","last_became_peered":"2023-06-20T13:32:21.036706+0000","last_unstale":"2023-06-20T13:32:26.050412+0000","last_undegraded":"2023-06-20T13:32:26.050412+0000","last_fullsized":"2023-06-20T13:32:26.050412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:16:58.726638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225769+0000","last_change":"2023-06-20T13:32:25.081687+0000","last_active":"2023-06-20T13:32:27.225769+0000","last_peered":"2023-06-20T13:32:27.225769+0000","last_clean":"2023-06-20T13:32:27.225769+0000","last_became_active":"2023-06-20T13:32:25.081227+0000","last_became_peered":"2023-06-20T13:32:25.081227+0000","last_unstale":"2023-06-20T13:32:27.225769+0000","last_undegraded":"2023-06-20T13:32:27.225769+0000","last_fullsized":"2023-06-20T13:32:27.225769+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:17:02.764753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224793+0000","last_change":"2023-06-20T13:32:20.028572+0000","last_active":"2023-06-20T13:32:27.224793+0000","last_peered":"2023-06-20T13:32:27.224793+0000","last_clean":"2023-06-20T13:32:27.224793+0000","last_became_active":"2023-06-20T13:32:20.028266+0000","last_became_peered":"2023-06-20T13:32:20.028266+0000","last_unstale":"2023-06-20T13:32:27.224793+0000","last_undegraded":"2023-06-20T13:32:27.224793+0000","last_fullsized":"2023-06-20T13:32:27.224793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:28:13.559245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225547+0000","last_change":"2023-06-20T13:32:21.036385+0000","last_active":"2023-06-20T13:32:27.225547+0000","last_peered":"2023-06-20T13:32:27.225547+0000","last_clean":"2023-06-20T13:32:27.225547+0000","last_became_active":"2023-06-20T13:32:21.036013+0000","last_became_peered":"2023-06-20T13:32:21.036013+0000","last_unstale":"2023-06-20T13:32:27.225547+0000","last_undegraded":"2023-06-20T13:32:27.225547+0000","last_fullsized":"2023-06-20T13:32:27.225547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:04:01.696402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050107+0000","last_change":"2023-06-20T13:32:25.071698+0000","last_active":"2023-06-20T13:32:26.050107+0000","last_peered":"2023-06-20T13:32:26.050107+0000","last_clean":"2023-06-20T13:32:26.050107+0000","last_became_active":"2023-06-20T13:32:25.070889+0000","last_became_peered":"2023-06-20T13:32:25.070889+0000","last_unstale":"2023-06-20T13:32:26.050107+0000","last_undegraded":"2023-06-20T13:32:26.050107+0000","last_fullsized":"2023-06-20T13:32:26.050107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:53:30.164168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050078+0000","last_change":"2023-06-20T13:32:20.027675+0000","last_active":"2023-06-20T13:32:26.050078+0000","last_peered":"2023-06-20T13:32:26.050078+0000","last_clean":"2023-06-20T13:32:26.050078+0000","last_became_active":"2023-06-20T13:32:20.027273+0000","last_became_peered":"2023-06-20T13:32:20.027273+0000","last_unstale":"2023-06-20T13:32:26.050078+0000","last_undegraded":"2023-06-20T13:32:26.050078+0000","last_fullsized":"2023-06-20T13:32:26.050078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:01:23.589176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224638+0000","last_change":"2023-06-20T13:32:21.025518+0000","last_active":"2023-06-20T13:32:27.224638+0000","last_peered":"2023-06-20T13:32:27.224638+0000","last_clean":"2023-06-20T13:32:27.224638+0000","last_became_active":"2023-06-20T13:32:21.025151+0000","last_became_peered":"2023-06-20T13:32:21.025151+0000","last_unstale":"2023-06-20T13:32:27.224638+0000","last_undegraded":"2023-06-20T13:32:27.224638+0000","last_fullsized":"2023-06-20T13:32:27.224638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:41:51.423544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.047440+0000","last_change":"2023-06-20T13:32:25.078296+0000","last_active":"2023-06-20T13:32:26.047440+0000","last_peered":"2023-06-20T13:32:26.047440+0000","last_clean":"2023-06-20T13:32:26.047440+0000","last_became_active":"2023-06-20T13:32:25.076656+0000","last_became_peered":"2023-06-20T13:32:25.076656+0000","last_unstale":"2023-06-20T13:32:26.047440+0000","last_undegraded":"2023-06-20T13:32:26.047440+0000","last_fullsized":"2023-06-20T13:32:26.047440+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:04:34.188995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049640+0000","last_change":"2023-06-20T13:32:20.022015+0000","last_active":"2023-06-20T13:32:26.049640+0000","last_peered":"2023-06-20T13:32:26.049640+0000","last_clean":"2023-06-20T13:32:26.049640+0000","last_became_active":"2023-06-20T13:32:20.021716+0000","last_became_peered":"2023-06-20T13:32:20.021716+0000","last_unstale":"2023-06-20T13:32:26.049640+0000","last_undegraded":"2023-06-20T13:32:26.049640+0000","last_fullsized":"2023-06-20T13:32:26.049640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:48:59.452870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288000+0000","last_change":"2023-06-20T13:32:21.022058+0000","last_active":"2023-06-20T13:32:26.288000+0000","last_peered":"2023-06-20T13:32:26.288000+0000","last_clean":"2023-06-20T13:32:26.288000+0000","last_became_active":"2023-06-20T13:32:21.021798+0000","last_became_peered":"2023-06-20T13:32:21.021798+0000","last_unstale":"2023-06-20T13:32:26.288000+0000","last_undegraded":"2023-06-20T13:32:26.288000+0000","last_fullsized":"2023-06-20T13:32:26.288000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:20:17.077026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.047790+0000","last_change":"2023-06-20T13:32:25.077838+0000","last_active":"2023-06-20T13:32:26.047790+0000","last_peered":"2023-06-20T13:32:26.047790+0000","last_clean":"2023-06-20T13:32:26.047790+0000","last_became_active":"2023-06-20T13:32:25.077296+0000","last_became_peered":"2023-06-20T13:32:25.077296+0000","last_unstale":"2023-06-20T13:32:26.047790+0000","last_undegraded":"2023-06-20T13:32:26.047790+0000","last_fullsized":"2023-06-20T13:32:26.047790+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T01:06:17.814845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049856+0000","last_change":"2023-06-20T13:32:20.027368+0000","last_active":"2023-06-20T13:32:26.049856+0000","last_peered":"2023-06-20T13:32:26.049856+0000","last_clean":"2023-06-20T13:32:26.049856+0000","last_became_active":"2023-06-20T13:32:20.027052+0000","last_became_peered":"2023-06-20T13:32:20.027052+0000","last_unstale":"2023-06-20T13:32:26.049856+0000","last_undegraded":"2023-06-20T13:32:26.049856+0000","last_fullsized":"2023-06-20T13:32:26.049856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:48:08.408940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224398+0000","last_change":"2023-06-20T13:32:21.034964+0000","last_active":"2023-06-20T13:32:27.224398+0000","last_peered":"2023-06-20T13:32:27.224398+0000","last_clean":"2023-06-20T13:32:27.224398+0000","last_became_active":"2023-06-20T13:32:21.034681+0000","last_became_peered":"2023-06-20T13:32:21.034681+0000","last_unstale":"2023-06-20T13:32:27.224398+0000","last_undegraded":"2023-06-20T13:32:27.224398+0000","last_fullsized":"2023-06-20T13:32:27.224398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:36:48.688763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.048245+0000","last_change":"2023-06-20T13:32:25.070289+0000","last_active":"2023-06-20T13:32:26.048245+0000","last_peered":"2023-06-20T13:32:26.048245+0000","last_clean":"2023-06-20T13:32:26.048245+0000","last_became_active":"2023-06-20T13:32:25.069805+0000","last_became_peered":"2023-06-20T13:32:25.069805+0000","last_unstale":"2023-06-20T13:32:26.048245+0000","last_undegraded":"2023-06-20T13:32:26.048245+0000","last_fullsized":"2023-06-20T13:32:26.048245+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:36:52.726879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225702+0000","last_change":"2023-06-20T13:32:20.024117+0000","last_active":"2023-06-20T13:32:27.225702+0000","last_peered":"2023-06-20T13:32:27.225702+0000","last_clean":"2023-06-20T13:32:27.225702+0000","last_became_active":"2023-06-20T13:32:20.023863+0000","last_became_peered":"2023-06-20T13:32:20.023863+0000","last_unstale":"2023-06-20T13:32:27.225702+0000","last_undegraded":"2023-06-20T13:32:27.225702+0000","last_fullsized":"2023-06-20T13:32:27.225702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:48:08.408940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050083+0000","last_change":"2023-06-20T13:32:21.033767+0000","last_active":"2023-06-20T13:32:26.050083+0000","last_peered":"2023-06-20T13:32:26.050083+0000","last_clean":"2023-06-20T13:32:26.050083+0000","last_became_active":"2023-06-20T13:32:21.033502+0000","last_became_peered":"2023-06-20T13:32:21.033502+0000","last_unstale":"2023-06-20T13:32:26.050083+0000","last_undegraded":"2023-06-20T13:32:26.050083+0000","last_fullsized":"2023-06-20T13:32:26.050083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:49:00.461563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.047814+0000","last_change":"2023-06-20T13:32:25.077964+0000","last_active":"2023-06-20T13:32:26.047814+0000","last_peered":"2023-06-20T13:32:26.047814+0000","last_clean":"2023-06-20T13:32:26.047814+0000","last_became_active":"2023-06-20T13:32:25.077026+0000","last_became_peered":"2023-06-20T13:32:25.077026+0000","last_unstale":"2023-06-20T13:32:26.047814+0000","last_undegraded":"2023-06-20T13:32:26.047814+0000","last_fullsized":"2023-06-20T13:32:26.047814+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:58:41.932351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224687+0000","last_change":"2023-06-20T13:32:20.028575+0000","last_active":"2023-06-20T13:32:27.224687+0000","last_peered":"2023-06-20T13:32:27.224687+0000","last_clean":"2023-06-20T13:32:27.224687+0000","last_became_active":"2023-06-20T13:32:20.028182+0000","last_became_peered":"2023-06-20T13:32:20.028182+0000","last_unstale":"2023-06-20T13:32:27.224687+0000","last_undegraded":"2023-06-20T13:32:27.224687+0000","last_fullsized":"2023-06-20T13:32:27.224687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:39:13.265878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287817+0000","last_change":"2023-06-20T13:32:21.032963+0000","last_active":"2023-06-20T13:32:26.287817+0000","last_peered":"2023-06-20T13:32:26.287817+0000","last_clean":"2023-06-20T13:32:26.287817+0000","last_became_active":"2023-06-20T13:32:21.032688+0000","last_became_peered":"2023-06-20T13:32:21.032688+0000","last_unstale":"2023-06-20T13:32:26.287817+0000","last_undegraded":"2023-06-20T13:32:26.287817+0000","last_fullsized":"2023-06-20T13:32:26.287817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:04:01.696402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998304+0000","last_change":"2023-06-20T13:32:25.077326+0000","last_active":"2023-06-20T13:32:26.998304+0000","last_peered":"2023-06-20T13:32:26.998304+0000","last_clean":"2023-06-20T13:32:26.998304+0000","last_became_active":"2023-06-20T13:32:25.076929+0000","last_became_peered":"2023-06-20T13:32:25.076929+0000","last_unstale":"2023-06-20T13:32:26.998304+0000","last_undegraded":"2023-06-20T13:32:26.998304+0000","last_fullsized":"2023-06-20T13:32:26.998304+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:56:29.417379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224597+0000","last_change":"2023-06-20T13:32:20.030260+0000","last_active":"2023-06-20T13:32:27.224597+0000","last_peered":"2023-06-20T13:32:27.224597+0000","last_clean":"2023-06-20T13:32:27.224597+0000","last_became_active":"2023-06-20T13:32:20.029938+0000","last_became_peered":"2023-06-20T13:32:20.029938+0000","last_unstale":"2023-06-20T13:32:27.224597+0000","last_undegraded":"2023-06-20T13:32:27.224597+0000","last_fullsized":"2023-06-20T13:32:27.224597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:59:32.832446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288271+0000","last_change":"2023-06-20T13:32:21.030989+0000","last_active":"2023-06-20T13:32:26.288271+0000","last_peered":"2023-06-20T13:32:26.288271+0000","last_clean":"2023-06-20T13:32:26.288271+0000","last_became_active":"2023-06-20T13:32:21.029954+0000","last_became_peered":"2023-06-20T13:32:21.029954+0000","last_unstale":"2023-06-20T13:32:26.288271+0000","last_undegraded":"2023-06-20T13:32:26.288271+0000","last_fullsized":"2023-06-20T13:32:26.288271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:12:40.689219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225889+0000","last_change":"2023-06-20T13:32:25.087926+0000","last_active":"2023-06-20T13:32:27.225889+0000","last_peered":"2023-06-20T13:32:27.225889+0000","last_clean":"2023-06-20T13:32:27.225889+0000","last_became_active":"2023-06-20T13:32:25.087469+0000","last_became_peered":"2023-06-20T13:32:25.087469+0000","last_unstale":"2023-06-20T13:32:27.225889+0000","last_undegraded":"2023-06-20T13:32:27.225889+0000","last_fullsized":"2023-06-20T13:32:27.225889+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:53:30.164168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287510+0000","last_change":"2023-06-20T13:32:20.028180+0000","last_active":"2023-06-20T13:32:26.287510+0000","last_peered":"2023-06-20T13:32:26.287510+0000","last_clean":"2023-06-20T13:32:26.287510+0000","last_became_active":"2023-06-20T13:32:20.027835+0000","last_became_peered":"2023-06-20T13:32:20.027835+0000","last_unstale":"2023-06-20T13:32:26.287510+0000","last_undegraded":"2023-06-20T13:32:26.287510+0000","last_fullsized":"2023-06-20T13:32:26.287510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:34:29.776201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288742+0000","last_change":"2023-06-20T13:32:21.039550+0000","last_active":"2023-06-20T13:32:26.288742+0000","last_peered":"2023-06-20T13:32:26.288742+0000","last_clean":"2023-06-20T13:32:26.288742+0000","last_became_active":"2023-06-20T13:32:21.039297+0000","last_became_peered":"2023-06-20T13:32:21.039297+0000","last_unstale":"2023-06-20T13:32:26.288742+0000","last_undegraded":"2023-06-20T13:32:26.288742+0000","last_fullsized":"2023-06-20T13:32:26.288742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:36:43.451301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288495+0000","last_change":"2023-06-20T13:32:25.084491+0000","last_active":"2023-06-20T13:32:26.288495+0000","last_peered":"2023-06-20T13:32:26.288495+0000","last_clean":"2023-06-20T13:32:26.288495+0000","last_became_active":"2023-06-20T13:32:25.084072+0000","last_became_peered":"2023-06-20T13:32:25.084072+0000","last_unstale":"2023-06-20T13:32:26.288495+0000","last_undegraded":"2023-06-20T13:32:26.288495+0000","last_fullsized":"2023-06-20T13:32:26.288495+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:01:48.702402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224341+0000","last_change":"2023-06-20T13:32:20.022743+0000","last_active":"2023-06-20T13:32:27.224341+0000","last_peered":"2023-06-20T13:32:27.224341+0000","last_clean":"2023-06-20T13:32:27.224341+0000","last_became_active":"2023-06-20T13:32:20.022384+0000","last_became_peered":"2023-06-20T13:32:20.022384+0000","last_unstale":"2023-06-20T13:32:27.224341+0000","last_undegraded":"2023-06-20T13:32:27.224341+0000","last_fullsized":"2023-06-20T13:32:27.224341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:04:42.004091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998918+0000","last_change":"2023-06-20T13:32:21.032771+0000","last_active":"2023-06-20T13:32:26.998918+0000","last_peered":"2023-06-20T13:32:26.998918+0000","last_clean":"2023-06-20T13:32:26.998918+0000","last_became_active":"2023-06-20T13:32:21.032459+0000","last_became_peered":"2023-06-20T13:32:21.032459+0000","last_unstale":"2023-06-20T13:32:26.998918+0000","last_undegraded":"2023-06-20T13:32:26.998918+0000","last_fullsized":"2023-06-20T13:32:26.998918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:51:29.356444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049993+0000","last_change":"2023-06-20T13:32:25.080253+0000","last_active":"2023-06-20T13:32:26.049993+0000","last_peered":"2023-06-20T13:32:26.049993+0000","last_clean":"2023-06-20T13:32:26.049993+0000","last_became_active":"2023-06-20T13:32:25.079626+0000","last_became_peered":"2023-06-20T13:32:25.079626+0000","last_unstale":"2023-06-20T13:32:26.049993+0000","last_undegraded":"2023-06-20T13:32:26.049993+0000","last_fullsized":"2023-06-20T13:32:26.049993+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:21:28.006725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998581+0000","last_change":"2023-06-20T13:32:14.847834+0000","last_active":"2023-06-20T13:32:26.998581+0000","last_peered":"2023-06-20T13:32:26.998581+0000","last_clean":"2023-06-20T13:32:26.998581+0000","last_became_active":"2023-06-20T13:32:14.847518+0000","last_became_peered":"2023-06-20T13:32:14.847518+0000","last_unstale":"2023-06-20T13:32:26.998581+0000","last_undegraded":"2023-06-20T13:32:26.998581+0000","last_fullsized":"2023-06-20T13:32:26.998581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:10:03.973904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225597+0000","last_change":"2023-06-20T13:32:20.025034+0000","last_active":"2023-06-20T13:32:27.225597+0000","last_peered":"2023-06-20T13:32:27.225597+0000","last_clean":"2023-06-20T13:32:27.225597+0000","last_became_active":"2023-06-20T13:32:20.024436+0000","last_became_peered":"2023-06-20T13:32:20.024436+0000","last_unstale":"2023-06-20T13:32:27.225597+0000","last_undegraded":"2023-06-20T13:32:27.225597+0000","last_fullsized":"2023-06-20T13:32:27.225597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:21:22.959916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998113+0000","last_change":"2023-06-20T13:32:21.031761+0000","last_active":"2023-06-20T13:32:26.998113+0000","last_peered":"2023-06-20T13:32:26.998113+0000","last_clean":"2023-06-20T13:32:26.998113+0000","last_became_active":"2023-06-20T13:32:21.031474+0000","last_became_peered":"2023-06-20T13:32:21.031474+0000","last_unstale":"2023-06-20T13:32:26.998113+0000","last_undegraded":"2023-06-20T13:32:26.998113+0000","last_fullsized":"2023-06-20T13:32:26.998113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:38:03.196793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049886+0000","last_change":"2023-06-20T13:32:25.081982+0000","last_active":"2023-06-20T13:32:26.049886+0000","last_peered":"2023-06-20T13:32:26.049886+0000","last_clean":"2023-06-20T13:32:26.049886+0000","last_became_active":"2023-06-20T13:32:25.081414+0000","last_became_peered":"2023-06-20T13:32:25.081414+0000","last_unstale":"2023-06-20T13:32:26.049886+0000","last_undegraded":"2023-06-20T13:32:26.049886+0000","last_fullsized":"2023-06-20T13:32:26.049886+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:03:03.660136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225550+0000","last_change":"2023-06-20T13:32:13.979189+0000","last_active":"2023-06-20T13:32:27.225550+0000","last_peered":"2023-06-20T13:32:27.225550+0000","last_clean":"2023-06-20T13:32:27.225550+0000","last_became_active":"2023-06-20T13:32:13.978675+0000","last_became_peered":"2023-06-20T13:32:13.978675+0000","last_unstale":"2023-06-20T13:32:27.225550+0000","last_undegraded":"2023-06-20T13:32:27.225550+0000","last_fullsized":"2023-06-20T13:32:27.225550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:25:22.059939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288140+0000","last_change":"2023-06-20T13:32:20.029884+0000","last_active":"2023-06-20T13:32:26.288140+0000","last_peered":"2023-06-20T13:32:26.288140+0000","last_clean":"2023-06-20T13:32:26.288140+0000","last_became_active":"2023-06-20T13:32:20.029589+0000","last_became_peered":"2023-06-20T13:32:20.029589+0000","last_unstale":"2023-06-20T13:32:26.288140+0000","last_undegraded":"2023-06-20T13:32:26.288140+0000","last_fullsized":"2023-06-20T13:32:26.288140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:04:36.254532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998444+0000","last_change":"2023-06-20T13:32:21.024248+0000","last_active":"2023-06-20T13:32:26.998444+0000","last_peered":"2023-06-20T13:32:26.998444+0000","last_clean":"2023-06-20T13:32:26.998444+0000","last_became_active":"2023-06-20T13:32:21.023949+0000","last_became_peered":"2023-06-20T13:32:21.023949+0000","last_unstale":"2023-06-20T13:32:26.998444+0000","last_undegraded":"2023-06-20T13:32:26.998444+0000","last_fullsized":"2023-06-20T13:32:26.998444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:27:37.100680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.048226+0000","last_change":"2023-06-20T13:32:25.076311+0000","last_active":"2023-06-20T13:32:26.048226+0000","last_peered":"2023-06-20T13:32:26.048226+0000","last_clean":"2023-06-20T13:32:26.048226+0000","last_became_active":"2023-06-20T13:32:25.075855+0000","last_became_peered":"2023-06-20T13:32:25.075855+0000","last_unstale":"2023-06-20T13:32:26.048226+0000","last_undegraded":"2023-06-20T13:32:26.048226+0000","last_fullsized":"2023-06-20T13:32:26.048226+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:32:42.525847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.047620+0000","last_change":"2023-06-20T13:32:14.567022+0000","last_active":"2023-06-20T13:32:26.047620+0000","last_peered":"2023-06-20T13:32:26.047620+0000","last_clean":"2023-06-20T13:32:26.047620+0000","last_became_active":"2023-06-20T13:32:14.566671+0000","last_became_peered":"2023-06-20T13:32:14.566671+0000","last_unstale":"2023-06-20T13:32:26.047620+0000","last_undegraded":"2023-06-20T13:32:26.047620+0000","last_fullsized":"2023-06-20T13:32:26.047620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:56:49.908110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998274+0000","last_change":"2023-06-20T13:32:20.028715+0000","last_active":"2023-06-20T13:32:26.998274+0000","last_peered":"2023-06-20T13:32:26.998274+0000","last_clean":"2023-06-20T13:32:26.998274+0000","last_became_active":"2023-06-20T13:32:20.028414+0000","last_became_peered":"2023-06-20T13:32:20.028414+0000","last_unstale":"2023-06-20T13:32:26.998274+0000","last_undegraded":"2023-06-20T13:32:26.998274+0000","last_fullsized":"2023-06-20T13:32:26.998274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:15:12.926553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998963+0000","last_change":"2023-06-20T13:32:21.030732+0000","last_active":"2023-06-20T13:32:26.998963+0000","last_peered":"2023-06-20T13:32:26.998963+0000","last_clean":"2023-06-20T13:32:26.998963+0000","last_became_active":"2023-06-20T13:32:21.030452+0000","last_became_peered":"2023-06-20T13:32:21.030452+0000","last_unstale":"2023-06-20T13:32:26.998963+0000","last_undegraded":"2023-06-20T13:32:26.998963+0000","last_fullsized":"2023-06-20T13:32:26.998963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:04:43.012785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049792+0000","last_change":"2023-06-20T13:32:25.078650+0000","last_active":"2023-06-20T13:32:26.049792+0000","last_peered":"2023-06-20T13:32:26.049792+0000","last_clean":"2023-06-20T13:32:26.049792+0000","last_became_active":"2023-06-20T13:32:25.078187+0000","last_became_peered":"2023-06-20T13:32:25.078187+0000","last_unstale":"2023-06-20T13:32:26.049792+0000","last_undegraded":"2023-06-20T13:32:26.049792+0000","last_fullsized":"2023-06-20T13:32:26.049792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:26:51.758348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225609+0000","last_change":"2023-06-20T13:32:13.978856+0000","last_active":"2023-06-20T13:32:27.225609+0000","last_peered":"2023-06-20T13:32:27.225609+0000","last_clean":"2023-06-20T13:32:27.225609+0000","last_became_active":"2023-06-20T13:32:13.978454+0000","last_became_peered":"2023-06-20T13:32:13.978454+0000","last_unstale":"2023-06-20T13:32:27.225609+0000","last_undegraded":"2023-06-20T13:32:27.225609+0000","last_fullsized":"2023-06-20T13:32:27.225609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:29:41.295818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049111+0000","last_change":"2023-06-20T13:32:06.907663+0000","last_active":"2023-06-20T13:32:26.049111+0000","last_peered":"2023-06-20T13:32:26.049111+0000","last_clean":"2023-06-20T13:32:26.049111+0000","last_became_active":"2023-06-20T13:32:06.906687+0000","last_became_peered":"2023-06-20T13:32:06.906687+0000","last_unstale":"2023-06-20T13:32:26.049111+0000","last_undegraded":"2023-06-20T13:32:26.049111+0000","last_fullsized":"2023-06-20T13:32:26.049111+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:05.521263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:05.521263+0000","last_clean_scrub_stamp":"2023-06-20T13:32:05.521263+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:08:35.702344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224861+0000","last_change":"2023-06-20T13:32:20.019895+0000","last_active":"2023-06-20T13:32:27.224861+0000","last_peered":"2023-06-20T13:32:27.224861+0000","last_clean":"2023-06-20T13:32:27.224861+0000","last_became_active":"2023-06-20T13:32:20.019522+0000","last_became_peered":"2023-06-20T13:32:20.019522+0000","last_unstale":"2023-06-20T13:32:27.224861+0000","last_undegraded":"2023-06-20T13:32:27.224861+0000","last_fullsized":"2023-06-20T13:32:27.224861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:18:12.127836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225154+0000","last_change":"2023-06-20T13:32:21.036376+0000","last_active":"2023-06-20T13:32:27.225154+0000","last_peered":"2023-06-20T13:32:27.225154+0000","last_clean":"2023-06-20T13:32:27.225154+0000","last_became_active":"2023-06-20T13:32:21.036065+0000","last_became_peered":"2023-06-20T13:32:21.036065+0000","last_unstale":"2023-06-20T13:32:27.225154+0000","last_undegraded":"2023-06-20T13:32:27.225154+0000","last_fullsized":"2023-06-20T13:32:27.225154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:44:44.788880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225647+0000","last_change":"2023-06-20T13:32:25.087122+0000","last_active":"2023-06-20T13:32:27.225647+0000","last_peered":"2023-06-20T13:32:27.225647+0000","last_clean":"2023-06-20T13:32:27.225647+0000","last_became_active":"2023-06-20T13:32:25.086746+0000","last_became_peered":"2023-06-20T13:32:25.086746+0000","last_unstale":"2023-06-20T13:32:27.225647+0000","last_undegraded":"2023-06-20T13:32:27.225647+0000","last_fullsized":"2023-06-20T13:32:27.225647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:51:33.394559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049273+0000","last_change":"2023-06-20T13:32:13.977027+0000","last_active":"2023-06-20T13:32:26.049273+0000","last_peered":"2023-06-20T13:32:26.049273+0000","last_clean":"2023-06-20T13:32:26.049273+0000","last_became_active":"2023-06-20T13:32:13.975895+0000","last_became_peered":"2023-06-20T13:32:13.975895+0000","last_unstale":"2023-06-20T13:32:26.049273+0000","last_undegraded":"2023-06-20T13:32:26.049273+0000","last_fullsized":"2023-06-20T13:32:26.049273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:25:22.059939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049300+0000","last_change":"2023-06-20T13:32:20.024292+0000","last_active":"2023-06-20T13:32:26.049300+0000","last_peered":"2023-06-20T13:32:26.049300+0000","last_clean":"2023-06-20T13:32:26.049300+0000","last_became_active":"2023-06-20T13:32:20.023931+0000","last_became_peered":"2023-06-20T13:32:20.023931+0000","last_unstale":"2023-06-20T13:32:26.049300+0000","last_undegraded":"2023-06-20T13:32:26.049300+0000","last_fullsized":"2023-06-20T13:32:26.049300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:02:44.562138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050028+0000","last_change":"2023-06-20T13:32:21.024724+0000","last_active":"2023-06-20T13:32:26.050028+0000","last_peered":"2023-06-20T13:32:26.050028+0000","last_clean":"2023-06-20T13:32:26.050028+0000","last_became_active":"2023-06-20T13:32:21.024485+0000","last_became_peered":"2023-06-20T13:32:21.024485+0000","last_unstale":"2023-06-20T13:32:26.050028+0000","last_undegraded":"2023-06-20T13:32:26.050028+0000","last_fullsized":"2023-06-20T13:32:26.050028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:51:29.356444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225119+0000","last_change":"2023-06-20T13:32:25.076508+0000","last_active":"2023-06-20T13:32:27.225119+0000","last_peered":"2023-06-20T13:32:27.225119+0000","last_clean":"2023-06-20T13:32:27.225119+0000","last_became_active":"2023-06-20T13:32:25.076181+0000","last_became_peered":"2023-06-20T13:32:25.076181+0000","last_unstale":"2023-06-20T13:32:27.225119+0000","last_undegraded":"2023-06-20T13:32:27.225119+0000","last_fullsized":"2023-06-20T13:32:27.225119+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:19:55.667242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049673+0000","last_change":"2023-06-20T13:32:14.848215+0000","last_active":"2023-06-20T13:32:26.049673+0000","last_peered":"2023-06-20T13:32:26.049673+0000","last_clean":"2023-06-20T13:32:26.049673+0000","last_became_active":"2023-06-20T13:32:14.847950+0000","last_became_peered":"2023-06-20T13:32:14.847950+0000","last_unstale":"2023-06-20T13:32:26.049673+0000","last_undegraded":"2023-06-20T13:32:26.049673+0000","last_fullsized":"2023-06-20T13:32:26.049673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:51:22.318824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998709+0000","last_change":"2023-06-20T13:32:20.032594+0000","last_active":"2023-06-20T13:32:26.998709+0000","last_peered":"2023-06-20T13:32:26.998709+0000","last_clean":"2023-06-20T13:32:26.998709+0000","last_became_active":"2023-06-20T13:32:20.032291+0000","last_became_peered":"2023-06-20T13:32:20.032291+0000","last_unstale":"2023-06-20T13:32:26.998709+0000","last_undegraded":"2023-06-20T13:32:26.998709+0000","last_fullsized":"2023-06-20T13:32:26.998709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:21:22.959916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050508+0000","last_change":"2023-06-20T13:32:21.040885+0000","last_active":"2023-06-20T13:32:26.050508+0000","last_peered":"2023-06-20T13:32:26.050508+0000","last_clean":"2023-06-20T13:32:26.050508+0000","last_became_active":"2023-06-20T13:32:21.040606+0000","last_became_peered":"2023-06-20T13:32:21.040606+0000","last_unstale":"2023-06-20T13:32:26.050508+0000","last_undegraded":"2023-06-20T13:32:26.050508+0000","last_fullsized":"2023-06-20T13:32:26.050508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:53:26.126053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288157+0000","last_change":"2023-06-20T13:32:25.074482+0000","last_active":"2023-06-20T13:32:26.288157+0000","last_peered":"2023-06-20T13:32:26.288157+0000","last_clean":"2023-06-20T13:32:26.288157+0000","last_became_active":"2023-06-20T13:32:25.071535+0000","last_became_peered":"2023-06-20T13:32:25.071535+0000","last_unstale":"2023-06-20T13:32:26.288157+0000","last_undegraded":"2023-06-20T13:32:26.288157+0000","last_fullsized":"2023-06-20T13:32:26.288157+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:34:53.709352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225674+0000","last_change":"2023-06-20T13:32:20.023465+0000","last_active":"2023-06-20T13:32:27.225674+0000","last_peered":"2023-06-20T13:32:27.225674+0000","last_clean":"2023-06-20T13:32:27.225674+0000","last_became_active":"2023-06-20T13:32:20.023069+0000","last_became_peered":"2023-06-20T13:32:20.023069+0000","last_unstale":"2023-06-20T13:32:27.225674+0000","last_undegraded":"2023-06-20T13:32:27.225674+0000","last_fullsized":"2023-06-20T13:32:27.225674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:24:58.961174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998839+0000","last_change":"2023-06-20T13:32:13.978089+0000","last_active":"2023-06-20T13:32:26.998839+0000","last_peered":"2023-06-20T13:32:26.998839+0000","last_clean":"2023-06-20T13:32:26.998839+0000","last_became_active":"2023-06-20T13:32:13.977748+0000","last_became_peered":"2023-06-20T13:32:13.977748+0000","last_unstale":"2023-06-20T13:32:26.998839+0000","last_undegraded":"2023-06-20T13:32:26.998839+0000","last_fullsized":"2023-06-20T13:32:26.998839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:48:53.423943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224252+0000","last_change":"2023-06-20T13:32:21.028939+0000","last_active":"2023-06-20T13:32:27.224252+0000","last_peered":"2023-06-20T13:32:27.224252+0000","last_clean":"2023-06-20T13:32:27.224252+0000","last_became_active":"2023-06-20T13:32:21.028355+0000","last_became_peered":"2023-06-20T13:32:21.028355+0000","last_unstale":"2023-06-20T13:32:27.224252+0000","last_undegraded":"2023-06-20T13:32:27.224252+0000","last_fullsized":"2023-06-20T13:32:27.224252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:51:29.356444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224186+0000","last_change":"2023-06-20T13:32:25.076159+0000","last_active":"2023-06-20T13:32:27.224186+0000","last_peered":"2023-06-20T13:32:27.224186+0000","last_clean":"2023-06-20T13:32:27.224186+0000","last_became_active":"2023-06-20T13:32:25.074781+0000","last_became_peered":"2023-06-20T13:32:25.074781+0000","last_unstale":"2023-06-20T13:32:27.224186+0000","last_undegraded":"2023-06-20T13:32:27.224186+0000","last_fullsized":"2023-06-20T13:32:27.224186+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:49:04.499679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224965+0000","last_change":"2023-06-20T13:32:13.977875+0000","last_active":"2023-06-20T13:32:27.224965+0000","last_peered":"2023-06-20T13:32:27.224965+0000","last_clean":"2023-06-20T13:32:27.224965+0000","last_became_active":"2023-06-20T13:32:13.977589+0000","last_became_peered":"2023-06-20T13:32:13.977589+0000","last_unstale":"2023-06-20T13:32:27.224965+0000","last_undegraded":"2023-06-20T13:32:27.224965+0000","last_fullsized":"2023-06-20T13:32:27.224965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:21:46.859788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050052+0000","last_change":"2023-06-20T13:32:20.026066+0000","last_active":"2023-06-20T13:32:26.050052+0000","last_peered":"2023-06-20T13:32:26.050052+0000","last_clean":"2023-06-20T13:32:26.050052+0000","last_became_active":"2023-06-20T13:32:20.025801+0000","last_became_peered":"2023-06-20T13:32:20.025801+0000","last_unstale":"2023-06-20T13:32:26.050052+0000","last_undegraded":"2023-06-20T13:32:26.050052+0000","last_fullsized":"2023-06-20T13:32:26.050052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:29:47.324744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287504+0000","last_change":"2023-06-20T13:32:21.030547+0000","last_active":"2023-06-20T13:32:26.287504+0000","last_peered":"2023-06-20T13:32:26.287504+0000","last_clean":"2023-06-20T13:32:26.287504+0000","last_became_active":"2023-06-20T13:32:21.030257+0000","last_became_peered":"2023-06-20T13:32:21.030257+0000","last_unstale":"2023-06-20T13:32:26.287504+0000","last_undegraded":"2023-06-20T13:32:26.287504+0000","last_fullsized":"2023-06-20T13:32:26.287504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:23:42.344527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998540+0000","last_change":"2023-06-20T13:32:25.078236+0000","last_active":"2023-06-20T13:32:26.998540+0000","last_peered":"2023-06-20T13:32:26.998540+0000","last_clean":"2023-06-20T13:32:26.998540+0000","last_became_active":"2023-06-20T13:32:25.077747+0000","last_became_peered":"2023-06-20T13:32:25.077747+0000","last_unstale":"2023-06-20T13:32:26.998540+0000","last_undegraded":"2023-06-20T13:32:26.998540+0000","last_fullsized":"2023-06-20T13:32:26.998540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:41:55.461660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050484+0000","last_change":"2023-06-20T13:32:20.027046+0000","last_active":"2023-06-20T13:32:26.050484+0000","last_peered":"2023-06-20T13:32:26.050484+0000","last_clean":"2023-06-20T13:32:26.050484+0000","last_became_active":"2023-06-20T13:32:20.026741+0000","last_became_peered":"2023-06-20T13:32:20.026741+0000","last_unstale":"2023-06-20T13:32:26.050484+0000","last_undegraded":"2023-06-20T13:32:26.050484+0000","last_fullsized":"2023-06-20T13:32:26.050484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:22:53.366158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.047799+0000","last_change":"2023-06-20T13:32:21.015867+0000","last_active":"2023-06-20T13:32:26.047799+0000","last_peered":"2023-06-20T13:32:26.047799+0000","last_clean":"2023-06-20T13:32:26.047799+0000","last_became_active":"2023-06-20T13:32:21.015563+0000","last_became_peered":"2023-06-20T13:32:21.015563+0000","last_unstale":"2023-06-20T13:32:26.047799+0000","last_undegraded":"2023-06-20T13:32:26.047799+0000","last_fullsized":"2023-06-20T13:32:26.047799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:54:58.955740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049263+0000","last_change":"2023-06-20T13:32:25.069092+0000","last_active":"2023-06-20T13:32:26.049263+0000","last_peered":"2023-06-20T13:32:26.049263+0000","last_clean":"2023-06-20T13:32:26.049263+0000","last_became_active":"2023-06-20T13:32:25.068638+0000","last_became_peered":"2023-06-20T13:32:25.068638+0000","last_unstale":"2023-06-20T13:32:26.049263+0000","last_undegraded":"2023-06-20T13:32:26.049263+0000","last_fullsized":"2023-06-20T13:32:26.049263+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:03:03.660136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225596+0000","last_change":"2023-06-20T13:32:20.025796+0000","last_active":"2023-06-20T13:32:27.225596+0000","last_peered":"2023-06-20T13:32:27.225596+0000","last_clean":"2023-06-20T13:32:27.225596+0000","last_became_active":"2023-06-20T13:32:20.025522+0000","last_became_peered":"2023-06-20T13:32:20.025522+0000","last_unstale":"2023-06-20T13:32:27.225596+0000","last_undegraded":"2023-06-20T13:32:27.225596+0000","last_fullsized":"2023-06-20T13:32:27.225596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:04:42.004091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287773+0000","last_change":"2023-06-20T13:32:21.033490+0000","last_active":"2023-06-20T13:32:26.287773+0000","last_peered":"2023-06-20T13:32:26.287773+0000","last_clean":"2023-06-20T13:32:26.287773+0000","last_became_active":"2023-06-20T13:32:21.033237+0000","last_became_peered":"2023-06-20T13:32:21.033237+0000","last_unstale":"2023-06-20T13:32:26.287773+0000","last_undegraded":"2023-06-20T13:32:26.287773+0000","last_fullsized":"2023-06-20T13:32:26.287773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:19:16.766615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225649+0000","last_change":"2023-06-20T13:32:25.081885+0000","last_active":"2023-06-20T13:32:27.225649+0000","last_peered":"2023-06-20T13:32:27.225649+0000","last_clean":"2023-06-20T13:32:27.225649+0000","last_became_active":"2023-06-20T13:32:25.081228+0000","last_became_peered":"2023-06-20T13:32:25.081228+0000","last_unstale":"2023-06-20T13:32:27.225649+0000","last_undegraded":"2023-06-20T13:32:27.225649+0000","last_fullsized":"2023-06-20T13:32:27.225649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:49:04.499679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225509+0000","last_change":"2023-06-20T13:32:20.025197+0000","last_active":"2023-06-20T13:32:27.225509+0000","last_peered":"2023-06-20T13:32:27.225509+0000","last_clean":"2023-06-20T13:32:27.225509+0000","last_became_active":"2023-06-20T13:32:20.024758+0000","last_became_peered":"2023-06-20T13:32:20.024758+0000","last_unstale":"2023-06-20T13:32:27.225509+0000","last_undegraded":"2023-06-20T13:32:27.225509+0000","last_fullsized":"2023-06-20T13:32:27.225509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:26:46.711540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287663+0000","last_change":"2023-06-20T13:32:21.031954+0000","last_active":"2023-06-20T13:32:26.287663+0000","last_peered":"2023-06-20T13:32:26.287663+0000","last_clean":"2023-06-20T13:32:26.287663+0000","last_became_active":"2023-06-20T13:32:21.031666+0000","last_became_peered":"2023-06-20T13:32:21.031666+0000","last_unstale":"2023-06-20T13:32:26.287663+0000","last_undegraded":"2023-06-20T13:32:26.287663+0000","last_fullsized":"2023-06-20T13:32:26.287663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:57:30.492657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287583+0000","last_change":"2023-06-20T13:32:25.084390+0000","last_active":"2023-06-20T13:32:26.287583+0000","last_peered":"2023-06-20T13:32:26.287583+0000","last_clean":"2023-06-20T13:32:26.287583+0000","last_became_active":"2023-06-20T13:32:25.083962+0000","last_became_peered":"2023-06-20T13:32:25.083962+0000","last_unstale":"2023-06-20T13:32:26.287583+0000","last_undegraded":"2023-06-20T13:32:26.287583+0000","last_fullsized":"2023-06-20T13:32:26.287583+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:18:17.174644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225215+0000","last_change":"2023-06-20T13:32:20.023402+0000","last_active":"2023-06-20T13:32:27.225215+0000","last_peered":"2023-06-20T13:32:27.225215+0000","last_clean":"2023-06-20T13:32:27.225215+0000","last_became_active":"2023-06-20T13:32:20.021613+0000","last_became_peered":"2023-06-20T13:32:20.021613+0000","last_unstale":"2023-06-20T13:32:27.225215+0000","last_undegraded":"2023-06-20T13:32:27.225215+0000","last_fullsized":"2023-06-20T13:32:27.225215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:23:41.335834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224909+0000","last_change":"2023-06-20T13:32:21.022492+0000","last_active":"2023-06-20T13:32:27.224909+0000","last_peered":"2023-06-20T13:32:27.224909+0000","last_clean":"2023-06-20T13:32:27.224909+0000","last_became_active":"2023-06-20T13:32:21.022206+0000","last_became_peered":"2023-06-20T13:32:21.022206+0000","last_unstale":"2023-06-20T13:32:27.224909+0000","last_undegraded":"2023-06-20T13:32:27.224909+0000","last_fullsized":"2023-06-20T13:32:27.224909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:12:08.369795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998506+0000","last_change":"2023-06-20T13:32:25.076299+0000","last_active":"2023-06-20T13:32:26.998506+0000","last_peered":"2023-06-20T13:32:26.998506+0000","last_clean":"2023-06-20T13:32:26.998506+0000","last_became_active":"2023-06-20T13:32:25.075767+0000","last_became_peered":"2023-06-20T13:32:25.075767+0000","last_unstale":"2023-06-20T13:32:26.998506+0000","last_undegraded":"2023-06-20T13:32:26.998506+0000","last_fullsized":"2023-06-20T13:32:26.998506+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:02:49.608947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050335+0000","last_change":"2023-06-20T13:32:20.030050+0000","last_active":"2023-06-20T13:32:26.050335+0000","last_peered":"2023-06-20T13:32:26.050335+0000","last_clean":"2023-06-20T13:32:26.050335+0000","last_became_active":"2023-06-20T13:32:20.029733+0000","last_became_peered":"2023-06-20T13:32:20.029733+0000","last_unstale":"2023-06-20T13:32:26.050335+0000","last_undegraded":"2023-06-20T13:32:26.050335+0000","last_fullsized":"2023-06-20T13:32:26.050335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:48:08.408940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287814+0000","last_change":"2023-06-20T13:32:21.038936+0000","last_active":"2023-06-20T13:32:26.287814+0000","last_peered":"2023-06-20T13:32:26.287814+0000","last_clean":"2023-06-20T13:32:26.287814+0000","last_became_active":"2023-06-20T13:32:21.038680+0000","last_became_peered":"2023-06-20T13:32:21.038680+0000","last_unstale":"2023-06-20T13:32:26.287814+0000","last_undegraded":"2023-06-20T13:32:26.287814+0000","last_fullsized":"2023-06-20T13:32:26.287814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:21:30.152203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224604+0000","last_change":"2023-06-20T13:32:21.033221+0000","last_active":"2023-06-20T13:32:27.224604+0000","last_peered":"2023-06-20T13:32:27.224604+0000","last_clean":"2023-06-20T13:32:27.224604+0000","last_became_active":"2023-06-20T13:32:21.032926+0000","last_became_peered":"2023-06-20T13:32:21.032926+0000","last_unstale":"2023-06-20T13:32:27.224604+0000","last_undegraded":"2023-06-20T13:32:27.224604+0000","last_fullsized":"2023-06-20T13:32:27.224604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:42:28.774705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225379+0000","last_change":"2023-06-20T13:32:21.024688+0000","last_active":"2023-06-20T13:32:27.225379+0000","last_peered":"2023-06-20T13:32:27.225379+0000","last_clean":"2023-06-20T13:32:27.225379+0000","last_became_active":"2023-06-20T13:32:21.024425+0000","last_became_peered":"2023-06-20T13:32:21.024425+0000","last_unstale":"2023-06-20T13:32:27.225379+0000","last_undegraded":"2023-06-20T13:32:27.225379+0000","last_fullsized":"2023-06-20T13:32:27.225379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:57:30.492657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288448+0000","last_change":"2023-06-20T13:32:21.038363+0000","last_active":"2023-06-20T13:32:26.288448+0000","last_peered":"2023-06-20T13:32:26.288448+0000","last_clean":"2023-06-20T13:32:26.288448+0000","last_became_active":"2023-06-20T13:32:21.038067+0000","last_became_peered":"2023-06-20T13:32:21.038067+0000","last_unstale":"2023-06-20T13:32:26.288448+0000","last_undegraded":"2023-06-20T13:32:26.288448+0000","last_fullsized":"2023-06-20T13:32:26.288448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:39:38.079107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224630+0000","last_change":"2023-06-20T13:32:21.027425+0000","last_active":"2023-06-20T13:32:27.224630+0000","last_peered":"2023-06-20T13:32:27.224630+0000","last_clean":"2023-06-20T13:32:27.224630+0000","last_became_active":"2023-06-20T13:32:21.026535+0000","last_became_peered":"2023-06-20T13:32:21.026535+0000","last_unstale":"2023-06-20T13:32:27.224630+0000","last_undegraded":"2023-06-20T13:32:27.224630+0000","last_fullsized":"2023-06-20T13:32:27.224630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:22:54.374851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998680+0000","last_change":"2023-06-20T13:32:21.027385+0000","last_active":"2023-06-20T13:32:26.998680+0000","last_peered":"2023-06-20T13:32:26.998680+0000","last_clean":"2023-06-20T13:32:26.998680+0000","last_became_active":"2023-06-20T13:32:21.027089+0000","last_became_peered":"2023-06-20T13:32:21.027089+0000","last_unstale":"2023-06-20T13:32:26.998680+0000","last_undegraded":"2023-06-20T13:32:26.998680+0000","last_fullsized":"2023-06-20T13:32:26.998680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:25:29.097559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":909312,"data_stored":713159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":286720,"data_stored":118781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":286720,"data_stored":118781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":884736,"data_stored":709731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":286720,"data_stored":118781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":118871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]}]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":122631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":119433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-20T13:32:50.930 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-20T13:32:50.931 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-06-20T13:32:50.931 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-06-20T13:32:50.931 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-06-20T13:32:50.932 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-06-20T13:32:51.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.162+0000 7f2296fff700 1 Processor -- start 2023-06-20T13:32:51.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.163+0000 7f2296fff700 1 -- start start 2023-06-20T13:32:51.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.164+0000 7f2296fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f22900cb6c0 0x7f2290163ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:51.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.164+0000 7f2296fff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22900cbc00 con 0x7f22900cd7d0 2023-06-20T13:32:51.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.164+0000 7f2296fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f229015cc80 con 0x7f2290156be0 2023-06-20T13:32:51.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.164+0000 7f2296fff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2290156fb0 con 0x7f22900cb6c0 2023-06-20T13:32:51.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.164+0000 7f229559c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f22900cb6c0 0x7f2290163ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:51.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.164+0000 7f228ffff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f22900cd7d0 0x7f22900cafb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:52796/0 (socket says 172.21.15.32:52796) 2023-06-20T13:32:51.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.164+0000 7f228ffff700 1 -- 172.21.15.32:0/2566066990 learned_addr learned my addr 172.21.15.32:0/2566066990 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:51.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.164+0000 7f229559c700 1 -- 172.21.15.32:0/2566066990 >> v1:172.21.15.115:6789/0 conn(0x7f2290156be0 legacy=0x7f22900cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:51.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.165+0000 7f229559c700 1 -- 172.21.15.32:0/2566066990 >> v1:172.21.15.32:6789/0 conn(0x7f22900cd7d0 legacy=0x7f22900cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:51.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.164+0000 7f228f7fe700 1 -- 172.21.15.32:0/2566066990 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3850191095 0 0) 0x7f229015cc80 con 0x7f2290156be0 2023-06-20T13:32:51.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.165+0000 7f229559c700 1 -- 172.21.15.32:0/2566066990 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229015cf60 con 0x7f22900cb6c0 2023-06-20T13:32:51.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.165+0000 7f229559c700 1 --2- 172.21.15.32:0/2566066990 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22900cb6c0 0x7f2290163ee0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2288009d90 tx=0x7f228800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70231bbfe15b00c5 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:51.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.165+0000 7f228f7fe700 1 -- 172.21.15.32:0/2566066990 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228800e070 con 0x7f22900cb6c0 2023-06-20T13:32:51.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.165+0000 7f228f7fe700 1 -- 172.21.15.32:0/2566066990 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228800bad0 con 0x7f22900cb6c0 2023-06-20T13:32:51.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.165+0000 7f228f7fe700 1 -- 172.21.15.32:0/2566066990 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228800be80 con 0x7f22900cb6c0 2023-06-20T13:32:51.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.166+0000 7f2296fff700 1 -- 172.21.15.32:0/2566066990 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22900cb6c0 msgr2=0x7f2290163ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:51.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.166+0000 7f2296fff700 1 --2- 172.21.15.32:0/2566066990 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22900cb6c0 0x7f2290163ee0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2288009d90 tx=0x7f228800b330 comp rx=0 tx=0).stop 2023-06-20T13:32:51.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.166+0000 7f2296fff700 1 -- 172.21.15.32:0/2566066990 shutdown_connections 2023-06-20T13:32:51.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.166+0000 7f2296fff700 1 --2- 172.21.15.32:0/2566066990 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22900cb6c0 0x7f2290163ee0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:51.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.166+0000 7f2296fff700 1 -- 172.21.15.32:0/2566066990 >> 172.21.15.32:0/2566066990 conn(0x7f22900b0390 msgr2=0x7f22900b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:51.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.166+0000 7f2296fff700 1 -- 172.21.15.32:0/2566066990 shutdown_connections 2023-06-20T13:32:51.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.166+0000 7f2296fff700 1 -- 172.21.15.32:0/2566066990 wait complete. 2023-06-20T13:32:51.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.167+0000 7f2296fff700 1 Processor -- start 2023-06-20T13:32:51.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.168+0000 7f2296fff700 1 -- start start 2023-06-20T13:32:51.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.169+0000 7f2296fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22900cb6c0 0x7f2290158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:51.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.169+0000 7f2296fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22900cd7d0 0x7f229015af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:51.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.169+0000 7f2296fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2290156be0 0x7f22900ae720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:51.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.169+0000 7f2296fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229015ab80 con 0x7f2290156be0 2023-06-20T13:32:51.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.169+0000 7f2296fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2290159800 con 0x7f22900cd7d0 2023-06-20T13:32:51.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.169+0000 7f2296fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2290158fc0 con 0x7f22900cb6c0 2023-06-20T13:32:51.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.169+0000 7f229559c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2290156be0 0x7f22900ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:51.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.169+0000 7f229559c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2290156be0 0x7f22900ae720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58964/0 (socket says 172.21.15.32:58964) 2023-06-20T13:32:51.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.169+0000 7f229559c700 1 -- 172.21.15.32:0/899600825 learned_addr learned my addr 172.21.15.32:0/899600825 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:51.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.169+0000 7f228ffff700 1 --2- 172.21.15.32:0/899600825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22900cd7d0 0x7f229015af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:51.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.169+0000 7f2294d9b700 1 --2- 172.21.15.32:0/899600825 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22900cb6c0 0x7f2290158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:51.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.169+0000 7f229559c700 1 -- 172.21.15.32:0/899600825 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22900cb6c0 msgr2=0x7f2290158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:51.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.169+0000 7f229559c700 1 --2- 172.21.15.32:0/899600825 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22900cb6c0 0x7f2290158a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:51.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.169+0000 7f229559c700 1 -- 172.21.15.32:0/899600825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22900cd7d0 msgr2=0x7f229015af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:51.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.169+0000 7f229559c700 1 --2- 172.21.15.32:0/899600825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22900cd7d0 0x7f229015af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:51.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.169+0000 7f229559c700 1 -- 172.21.15.32:0/899600825 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2288009a70 con 0x7f2290156be0 2023-06-20T13:32:51.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.170+0000 7f229559c700 1 --2- 172.21.15.32:0/899600825 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2290156be0 0x7f22900ae720 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f228800b730 tx=0x7f2288004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:51.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.170+0000 7f228d7fa700 1 -- 172.21.15.32:0/899600825 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2288012630 con 0x7f2290156be0 2023-06-20T13:32:51.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.170+0000 7f228d7fa700 1 -- 172.21.15.32:0/899600825 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2288012790 con 0x7f2290156be0 2023-06-20T13:32:51.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.170+0000 7f228d7fa700 1 -- 172.21.15.32:0/899600825 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2288012b40 con 0x7f2290156be0 2023-06-20T13:32:51.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.170+0000 7f2296fff700 1 -- 172.21.15.32:0/899600825 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2290159240 con 0x7f2290156be0 2023-06-20T13:32:51.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.170+0000 7f2296fff700 1 -- 172.21.15.32:0/899600825 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f229015a7a0 con 0x7f2290156be0 2023-06-20T13:32:51.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.171+0000 7f2296fff700 1 -- 172.21.15.32:0/899600825 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f229004ea60 con 0x7f2290156be0 2023-06-20T13:32:51.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.172+0000 7f228d7fa700 1 -- 172.21.15.32:0/899600825 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2288012ca0 con 0x7f2290156be0 2023-06-20T13:32:51.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.173+0000 7f228d7fa700 1 --2- 172.21.15.32:0/899600825 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f227406ace0 0x7f227406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:51.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.173+0000 7f228d7fa700 1 -- 172.21.15.32:0/899600825 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f228808be80 con 0x7f2290156be0 2023-06-20T13:32:51.175 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.173+0000 7f2294d9b700 1 --2- 172.21.15.32:0/899600825 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f227406ace0 0x7f227406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:51.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.174+0000 7f2294d9b700 1 --2- 172.21.15.32:0/899600825 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f227406ace0 0x7f227406d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2284000f60 tx=0x7f2284009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:51.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.177+0000 7f228d7fa700 1 -- 172.21.15.32:0/899600825 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2288056ce0 con 0x7f2290156be0 2023-06-20T13:32:51.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.440+0000 7f2296fff700 1 -- 172.21.15.32:0/899600825 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f22900cab80 con 0x7f2290156be0 2023-06-20T13:32:51.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.444+0000 7f228d7fa700 1 -- 172.21.15.32:0/899600825 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170841 (secure 0 0 0) 0x7f228805a300 con 0x7f2290156be0 2023-06-20T13:32:51.447 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:32:51.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.448+0000 7f2296fff700 1 -- 172.21.15.32:0/899600825 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f227406ace0 msgr2=0x7f227406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:51.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.448+0000 7f2296fff700 1 --2- 172.21.15.32:0/899600825 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f227406ace0 0x7f227406d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2284000f60 tx=0x7f2284009040 comp rx=0 tx=0).stop 2023-06-20T13:32:51.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.448+0000 7f2296fff700 1 -- 172.21.15.32:0/899600825 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2290156be0 msgr2=0x7f22900ae720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:51.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.448+0000 7f2296fff700 1 --2- 172.21.15.32:0/899600825 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2290156be0 0x7f22900ae720 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f228800b730 tx=0x7f2288004ad0 comp rx=0 tx=0).stop 2023-06-20T13:32:51.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.448+0000 7f2296fff700 1 -- 172.21.15.32:0/899600825 shutdown_connections 2023-06-20T13:32:51.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.448+0000 7f2296fff700 1 --2- 172.21.15.32:0/899600825 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f227406ace0 0x7f227406d190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:51.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.448+0000 7f2296fff700 1 --2- 172.21.15.32:0/899600825 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2290156be0 0x7f22900ae720 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:51.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.448+0000 7f2296fff700 1 --2- 172.21.15.32:0/899600825 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22900cb6c0 0x7f2290158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:51.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.448+0000 7f2296fff700 1 --2- 172.21.15.32:0/899600825 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22900cd7d0 0x7f229015af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:51.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.448+0000 7f2296fff700 1 -- 172.21.15.32:0/899600825 >> 172.21.15.32:0/899600825 conn(0x7f22900b0390 msgr2=0x7f22900b0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:51.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.448+0000 7f2296fff700 1 -- 172.21.15.32:0/899600825 shutdown_connections 2023-06-20T13:32:51.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.448+0000 7f2296fff700 1 -- 172.21.15.32:0/899600825 wait complete. 2023-06-20T13:32:51.467 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":5,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6832","nonce":1136488437},{"type":"v1","addr":"172.21.15.32:6833","nonce":1136488437}]},"active_addr":"172.21.15.32:6833/1136488437","active_change":"2023-06-20T13:31:59.240555+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.32:0","nonce":2357846957}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.32:0","nonce":4076656025}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.32:0","nonce":3320003094}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.32:0","nonce":566670066}]}]} 2023-06-20T13:32:51.472 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-06-20T13:32:51.472 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-06-20T13:32:51.472 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:32:51.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.671+0000 7f77b0fff700 1 Processor -- start 2023-06-20T13:32:51.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.671+0000 7f77b0fff700 1 -- start start 2023-06-20T13:32:51.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.672+0000 7f77b0fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f77ac0b59d0 0x7f77ac1671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:51.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.672+0000 7f77b0fff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77ac0d1790 con 0x7f77ac15c460 2023-06-20T13:32:51.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.672+0000 7f77b0fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77ac0cd950 con 0x7f77ac0d2640 2023-06-20T13:32:51.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.672+0000 7f77b0fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac0cedd0 con 0x7f77ac0b59d0 2023-06-20T13:32:51.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.673+0000 7f77aa59c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f77ac15c460 0x7f77ac0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:52802/0 (socket says 172.21.15.32:52802) 2023-06-20T13:32:51.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.673+0000 7f77aa59c700 1 -- 172.21.15.32:0/4098754537 learned_addr learned my addr 172.21.15.32:0/4098754537 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:51.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.673+0000 7f77aad9d700 1 --2- 172.21.15.32:0/4098754537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f77ac0b59d0 0x7f77ac1671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:51.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.673+0000 7f77a9d9b700 1 -- 172.21.15.32:0/4098754537 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560088461 0 0) 0x7f77ac0d1790 con 0x7f77ac15c460 2023-06-20T13:32:51.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.673+0000 7f77a9d9b700 1 -- 172.21.15.32:0/4098754537 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77980035b0 con 0x7f77ac15c460 2023-06-20T13:32:51.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.673+0000 7f77a9d9b700 1 -- 172.21.15.32:0/4098754537 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3775737939 0 0) 0x7f77ac0cd950 con 0x7f77ac0d2640 2023-06-20T13:32:51.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.673+0000 7f77a9d9b700 1 -- 172.21.15.32:0/4098754537 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77ac0d1790 con 0x7f77ac0d2640 2023-06-20T13:32:51.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.673+0000 7f77aad9d700 1 -- 172.21.15.32:0/4098754537 >> v1:172.21.15.115:6789/0 conn(0x7f77ac0d2640 legacy=0x7f77ac0cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:51.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.673+0000 7f77aad9d700 1 -- 172.21.15.32:0/4098754537 >> v1:172.21.15.32:6789/0 conn(0x7f77ac15c460 legacy=0x7f77ac0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:51.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.673+0000 7f77aad9d700 1 -- 172.21.15.32:0/4098754537 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ac0d14b0 con 0x7f77ac0b59d0 2023-06-20T13:32:51.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.674+0000 7f77aad9d700 1 --2- 172.21.15.32:0/4098754537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f77ac0b59d0 0x7f77ac1671b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f77a4009dc0 tx=0x7f77a400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a52f2f6464e69588 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:51.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.674+0000 7f77a9d9b700 1 -- 172.21.15.32:0/4098754537 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a400e070 con 0x7f77ac0b59d0 2023-06-20T13:32:51.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.674+0000 7f77a9d9b700 1 -- 172.21.15.32:0/4098754537 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a400bb20 con 0x7f77ac0b59d0 2023-06-20T13:32:51.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.674+0000 7f77a9d9b700 1 -- 172.21.15.32:0/4098754537 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a4012430 con 0x7f77ac0b59d0 2023-06-20T13:32:51.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.674+0000 7f77b0fff700 1 -- 172.21.15.32:0/4098754537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f77ac0b59d0 msgr2=0x7f77ac1671b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:51.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.674+0000 7f77b0fff700 1 --2- 172.21.15.32:0/4098754537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f77ac0b59d0 0x7f77ac1671b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f77a4009dc0 tx=0x7f77a400b330 comp rx=0 tx=0).stop 2023-06-20T13:32:51.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.675+0000 7f77b0fff700 1 -- 172.21.15.32:0/4098754537 shutdown_connections 2023-06-20T13:32:51.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.675+0000 7f77b0fff700 1 --2- 172.21.15.32:0/4098754537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f77ac0b59d0 0x7f77ac1671b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:51.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.675+0000 7f77b0fff700 1 -- 172.21.15.32:0/4098754537 >> 172.21.15.32:0/4098754537 conn(0x7f77ac071660 msgr2=0x7f77ac071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:51.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.675+0000 7f77b0fff700 1 -- 172.21.15.32:0/4098754537 shutdown_connections 2023-06-20T13:32:51.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.675+0000 7f77b0fff700 1 -- 172.21.15.32:0/4098754537 wait complete. 2023-06-20T13:32:51.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.676+0000 7f77b0fff700 1 Processor -- start 2023-06-20T13:32:51.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.676+0000 7f77b0fff700 1 -- start start 2023-06-20T13:32:51.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.677+0000 7f77b0fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77ac0b59d0 0x7f77ac156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:51.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.677+0000 7f77b0fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f77ac0d2640 0x7f77ac0c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:51.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.677+0000 7f77b0fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77ac15c460 0x7f77ac0c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:51.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.677+0000 7f77b0fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac1594d0 con 0x7f77ac0b59d0 2023-06-20T13:32:51.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.677+0000 7f77b0fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac156790 con 0x7f77ac15c460 2023-06-20T13:32:51.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.677+0000 7f77b0fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac159640 con 0x7f77ac0d2640 2023-06-20T13:32:51.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.678+0000 7f77aa59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77ac0b59d0 0x7f77ac156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:51.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.678+0000 7f77aa59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77ac0b59d0 0x7f77ac156250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58980/0 (socket says 172.21.15.32:58980) 2023-06-20T13:32:51.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.678+0000 7f77aa59c700 1 -- 172.21.15.32:0/1086235778 learned_addr learned my addr 172.21.15.32:0/1086235778 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:51.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.678+0000 7f77aad9d700 1 --2- 172.21.15.32:0/1086235778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77ac15c460 0x7f77ac0c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:51.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.678+0000 7f77a3fff700 1 --2- 172.21.15.32:0/1086235778 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f77ac0d2640 0x7f77ac0c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:51.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.678+0000 7f77aa59c700 1 -- 172.21.15.32:0/1086235778 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f77ac0d2640 msgr2=0x7f77ac0c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:51.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.678+0000 7f77aa59c700 1 --2- 172.21.15.32:0/1086235778 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f77ac0d2640 0x7f77ac0c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:51.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.678+0000 7f77aa59c700 1 -- 172.21.15.32:0/1086235778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77ac15c460 msgr2=0x7f77ac0c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:51.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.678+0000 7f77aa59c700 1 --2- 172.21.15.32:0/1086235778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77ac15c460 0x7f77ac0c8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:51.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.678+0000 7f77aa59c700 1 -- 172.21.15.32:0/1086235778 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a4009a70 con 0x7f77ac0b59d0 2023-06-20T13:32:51.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.678+0000 7f77aa59c700 1 --2- 172.21.15.32:0/1086235778 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77ac0b59d0 0x7f77ac156250 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f779c00c700 tx=0x7f779c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:51.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.679+0000 7f77a2ffd700 1 -- 172.21.15.32:0/1086235778 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c005d70 con 0x7f77ac0b59d0 2023-06-20T13:32:51.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.679+0000 7f77a2ffd700 1 -- 172.21.15.32:0/1086235778 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779c0070d0 con 0x7f77ac0b59d0 2023-06-20T13:32:51.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.679+0000 7f77b0fff700 1 -- 172.21.15.32:0/1086235778 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77ac1e65b0 con 0x7f77ac0b59d0 2023-06-20T13:32:51.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.679+0000 7f77a2ffd700 1 -- 172.21.15.32:0/1086235778 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c007480 con 0x7f77ac0b59d0 2023-06-20T13:32:51.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.679+0000 7f77b0fff700 1 -- 172.21.15.32:0/1086235778 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77ac1e6b70 con 0x7f77ac0b59d0 2023-06-20T13:32:51.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.680+0000 7f77b0fff700 1 -- 172.21.15.32:0/1086235778 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77ac04ea60 con 0x7f77ac0b59d0 2023-06-20T13:32:51.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.681+0000 7f77a2ffd700 1 -- 172.21.15.32:0/1086235778 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f779c0075e0 con 0x7f77ac0b59d0 2023-06-20T13:32:51.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.682+0000 7f77a2ffd700 1 --2- 172.21.15.32:0/1086235778 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f778c06ace0 0x7f778c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:51.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.682+0000 7f77a2ffd700 1 -- 172.21.15.32:0/1086235778 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f779c088bb0 con 0x7f77ac0b59d0 2023-06-20T13:32:51.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.682+0000 7f77a3fff700 1 --2- 172.21.15.32:0/1086235778 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f778c06ace0 0x7f778c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:51.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.683+0000 7f77a3fff700 1 --2- 172.21.15.32:0/1086235778 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f778c06ace0 0x7f778c06d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f77ac0c9650 tx=0x7f7794009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:51.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.686+0000 7f77a2ffd700 1 -- 172.21.15.32:0/1086235778 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f779c053a00 con 0x7f77ac0b59d0 2023-06-20T13:32:51.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.894+0000 7f77b0fff700 1 -- 172.21.15.32:0/1086235778 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77ac15b430 con 0x7f77ac0b59d0 2023-06-20T13:32:51.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.896+0000 7f77a2ffd700 1 -- 172.21.15.32:0/1086235778 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20096 (secure 0 0 0) 0x7f779c057020 con 0x7f77ac0b59d0 2023-06-20T13:32:51.897 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:32:51.897 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":27,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:32:25.570940+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-20T13:32:18.120021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-20T13:32:19.503624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-20T13:32:23.074912+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:32:51.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.898+0000 7f77b0fff700 1 -- 172.21.15.32:0/1086235778 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f778c06ace0 msgr2=0x7f778c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:51.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.898+0000 7f77b0fff700 1 --2- 172.21.15.32:0/1086235778 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f778c06ace0 0x7f778c06d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f77ac0c9650 tx=0x7f7794009040 comp rx=0 tx=0).stop 2023-06-20T13:32:51.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.898+0000 7f77b0fff700 1 -- 172.21.15.32:0/1086235778 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77ac0b59d0 msgr2=0x7f77ac156250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:51.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.898+0000 7f77b0fff700 1 --2- 172.21.15.32:0/1086235778 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77ac0b59d0 0x7f77ac156250 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f779c00c700 tx=0x7f779c00ca10 comp rx=0 tx=0).stop 2023-06-20T13:32:51.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.898+0000 7f77b0fff700 1 -- 172.21.15.32:0/1086235778 shutdown_connections 2023-06-20T13:32:51.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.898+0000 7f77b0fff700 1 --2- 172.21.15.32:0/1086235778 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f778c06ace0 0x7f778c06d190 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:51.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.898+0000 7f77b0fff700 1 --2- 172.21.15.32:0/1086235778 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f77ac15c460 0x7f77ac0c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:51.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.898+0000 7f77b0fff700 1 --2- 172.21.15.32:0/1086235778 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f77ac0b59d0 0x7f77ac156250 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:51.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.898+0000 7f77b0fff700 1 --2- 172.21.15.32:0/1086235778 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f77ac0d2640 0x7f77ac0c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:51.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.898+0000 7f77b0fff700 1 -- 172.21.15.32:0/1086235778 >> 172.21.15.32:0/1086235778 conn(0x7f77ac071660 msgr2=0x7f77ac15fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:51.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.898+0000 7f77b0fff700 1 -- 172.21.15.32:0/1086235778 shutdown_connections 2023-06-20T13:32:51.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:51.898+0000 7f77b0fff700 1 -- 172.21.15.32:0/1086235778 wait complete. 2023-06-20T13:32:51.918 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-06-20T13:32:51.919 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:32:52.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.121+0000 7f3c06bff700 1 Processor -- start 2023-06-20T13:32:52.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.121+0000 7f3c06bff700 1 -- start start 2023-06-20T13:32:52.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.122+0000 7f3c06bff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c000b59d0 0x7f3c001671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.122+0000 7f3c06bff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c000d1790 con 0x7f3c000d2640 2023-06-20T13:32:52.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.122+0000 7f3c06bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c000cd950 con 0x7f3c0015c460 2023-06-20T13:32:52.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.122+0000 7f3c06bff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000cedd0 con 0x7f3c000b59d0 2023-06-20T13:32:52.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.123+0000 7f3bfffff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f3c000d2640 0x7f3c000cf8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:52808/0 (socket says 172.21.15.32:52808) 2023-06-20T13:32:52.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.123+0000 7f3bfffff700 1 -- 172.21.15.32:0/1502265275 learned_addr learned my addr 172.21.15.32:0/1502265275 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:52.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.123+0000 7f3c0519c700 1 --2- 172.21.15.32:0/1502265275 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c000b59d0 0x7f3c001671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.123+0000 7f3bff7fe700 1 -- 172.21.15.32:0/1502265275 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2025575409 0 0) 0x7f3c000d1790 con 0x7f3c000d2640 2023-06-20T13:32:52.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.123+0000 7f3bff7fe700 1 -- 172.21.15.32:0/1502265275 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bf00035b0 con 0x7f3c000d2640 2023-06-20T13:32:52.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.123+0000 7f3bff7fe700 1 -- 172.21.15.32:0/1502265275 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426717260 0 0) 0x7f3c000cd950 con 0x7f3c0015c460 2023-06-20T13:32:52.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.123+0000 7f3bff7fe700 1 -- 172.21.15.32:0/1502265275 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c000d1790 con 0x7f3c0015c460 2023-06-20T13:32:52.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.123+0000 7f3bff7fe700 1 -- 172.21.15.32:0/1502265275 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1722668145 0 0) 0x7f3bf00035b0 con 0x7f3c000d2640 2023-06-20T13:32:52.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.123+0000 7f3bff7fe700 1 -- 172.21.15.32:0/1502265275 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c000b59d0 msgr2=0x7f3c001671b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:52.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.123+0000 7f3bff7fe700 1 --2- 172.21.15.32:0/1502265275 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c000b59d0 0x7f3c001671b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.123+0000 7f3bff7fe700 1 -- 172.21.15.32:0/1502265275 >> v1:172.21.15.115:6789/0 conn(0x7f3c0015c460 legacy=0x7f3c000cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.123+0000 7f3bff7fe700 1 -- 172.21.15.32:0/1502265275 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c000d14b0 con 0x7f3c000d2640 2023-06-20T13:32:52.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.123+0000 7f3bff7fe700 1 -- 172.21.15.32:0/1502265275 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3380058562 0 0) 0x7f3bec001670 con 0x7f3c000d2640 2023-06-20T13:32:52.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.123+0000 7f3bff7fe700 1 -- 172.21.15.32:0/1502265275 >> v1:172.21.15.32:6789/0 conn(0x7f3c000d2640 legacy=0x7f3c000cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.123+0000 7f3bff7fe700 1 --2- 172.21.15.32:0/1502265275 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3bf0003bc0 0x7f3bf0003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.123+0000 7f3bff7fe700 1 --2- 172.21.15.32:0/1502265275 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bf0004850 0x7f3bf0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.123+0000 7f3bff7fe700 1 --2- 172.21.15.32:0/1502265275 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bf0005200 0x7f3bf000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.123+0000 7f3bff7fe700 1 -- 172.21.15.32:0/1502265275 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000cedd0 con 0x7f3bf0004850 2023-06-20T13:32:52.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.123+0000 7f3bff7fe700 1 -- 172.21.15.32:0/1502265275 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf000c160 con 0x7f3bf0005200 2023-06-20T13:32:52.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.123+0000 7f3bff7fe700 1 -- 172.21.15.32:0/1502265275 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf000c320 con 0x7f3bf0003bc0 2023-06-20T13:32:52.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.123+0000 7f3c0519c700 1 --2- 172.21.15.32:0/1502265275 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c000b59d0 0x7f3c001671b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:32:52.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.124+0000 7f3bfffff700 1 --2- 172.21.15.32:0/1502265275 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bf0004850 0x7f3bf0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.124+0000 7f3c0499b700 1 --2- 172.21.15.32:0/1502265275 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3bf0003bc0 0x7f3bf0003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.124+0000 7f3c0519c700 1 --2- 172.21.15.32:0/1502265275 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bf0005200 0x7f3bf000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.124+0000 7f3bfffff700 1 -- 172.21.15.32:0/1502265275 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3bf0003bc0 msgr2=0x7f3bf0003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:52.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.124+0000 7f3bfffff700 1 --2- 172.21.15.32:0/1502265275 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3bf0003bc0 0x7f3bf0003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.124+0000 7f3bfffff700 1 -- 172.21.15.32:0/1502265275 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bf0005200 msgr2=0x7f3bf000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:52.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.124+0000 7f3bfffff700 1 --2- 172.21.15.32:0/1502265275 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bf0005200 0x7f3bf000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.124+0000 7f3bfffff700 1 -- 172.21.15.32:0/1502265275 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf00035b0 con 0x7f3bf0004850 2023-06-20T13:32:52.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.124+0000 7f3bfffff700 1 --2- 172.21.15.32:0/1502265275 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bf0004850 0x7f3bf0004cc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00c210 tx=0x7f3bf0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5a1c61c494211a server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.125+0000 7f3bff7fe700 1 -- 172.21.15.32:0/1502265275 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec00cd50 con 0x7f3bf0004850 2023-06-20T13:32:52.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.125+0000 7f3bff7fe700 1 -- 172.21.15.32:0/1502265275 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bec005960 con 0x7f3bf0004850 2023-06-20T13:32:52.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.125+0000 7f3bff7fe700 1 -- 172.21.15.32:0/1502265275 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec005d10 con 0x7f3bf0004850 2023-06-20T13:32:52.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.125+0000 7f3c06bff700 1 -- 172.21.15.32:0/1502265275 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bf0004850 msgr2=0x7f3bf0004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.125+0000 7f3c06bff700 1 --2- 172.21.15.32:0/1502265275 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bf0004850 0x7f3bf0004cc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00c210 tx=0x7f3bf0005880 comp rx=0 tx=0).stop 2023-06-20T13:32:52.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.125+0000 7f3c0519c700 1 -- 172.21.15.32:0/1502265275 reap_dead start 2023-06-20T13:32:52.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.125+0000 7f3c06bff700 1 -- 172.21.15.32:0/1502265275 shutdown_connections 2023-06-20T13:32:52.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.125+0000 7f3c06bff700 1 -- 172.21.15.32:0/1502265275 >> 172.21.15.32:0/1502265275 conn(0x7f3c00071660 msgr2=0x7f3c00071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:52.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.125+0000 7f3c06bff700 1 -- 172.21.15.32:0/1502265275 shutdown_connections 2023-06-20T13:32:52.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.125+0000 7f3c06bff700 1 -- 172.21.15.32:0/1502265275 wait complete. 2023-06-20T13:32:52.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.127+0000 7f3c06bff700 1 Processor -- start 2023-06-20T13:32:52.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.127+0000 7f3c06bff700 1 -- start start 2023-06-20T13:32:52.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.128+0000 7f3c06bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bf0004850 0x7f3c00153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.128+0000 7f3c06bff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c00151850 0x7f3c000cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.128+0000 7f3c06bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c00154090 0x7f3c000cc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.128+0000 7f3c06bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000cb6c0 con 0x7f3bf0004850 2023-06-20T13:32:52.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.128+0000 7f3c06bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000cc5d0 con 0x7f3c00154090 2023-06-20T13:32:52.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.128+0000 7f3c06bff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c00151d10 con 0x7f3c00151850 2023-06-20T13:32:52.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.129+0000 7f3c0499b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bf0004850 0x7f3c00153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.129+0000 7f3c0499b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bf0004850 0x7f3c00153b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:58998/0 (socket says 172.21.15.32:58998) 2023-06-20T13:32:52.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.129+0000 7f3c0499b700 1 -- 172.21.15.32:0/774723164 learned_addr learned my addr 172.21.15.32:0/774723164 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:52.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.129+0000 7f3c0519c700 1 --2- 172.21.15.32:0/774723164 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c00154090 0x7f3c000cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.129+0000 7f3bfffff700 1 --2- 172.21.15.32:0/774723164 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c00151850 0x7f3c000cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.129+0000 7f3c0499b700 1 -- 172.21.15.32:0/774723164 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c00151850 msgr2=0x7f3c000cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.129+0000 7f3c0499b700 1 --2- 172.21.15.32:0/774723164 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c00151850 0x7f3c000cbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.129+0000 7f3c0499b700 1 -- 172.21.15.32:0/774723164 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c00154090 msgr2=0x7f3c000cc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.129+0000 7f3c0499b700 1 --2- 172.21.15.32:0/774723164 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c00154090 0x7f3c000cc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.129+0000 7f3c0499b700 1 -- 172.21.15.32:0/774723164 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c000cadd0 con 0x7f3bf0004850 2023-06-20T13:32:52.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.129+0000 7f3bfffff700 1 --2- 172.21.15.32:0/774723164 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c00151850 0x7f3c000cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:32:52.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.129+0000 7f3c0519c700 1 --2- 172.21.15.32:0/774723164 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c00154090 0x7f3c000cc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:32:52.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.129+0000 7f3c0499b700 1 --2- 172.21.15.32:0/774723164 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bf0004850 0x7f3c00153b50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4007a30 tx=0x7f3bf400fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.130+0000 7f3bfd7fa700 1 -- 172.21.15.32:0/774723164 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4005320 con 0x7f3bf0004850 2023-06-20T13:32:52.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.130+0000 7f3bfd7fa700 1 -- 172.21.15.32:0/774723164 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf4005480 con 0x7f3bf0004850 2023-06-20T13:32:52.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.130+0000 7f3c06bff700 1 -- 172.21.15.32:0/774723164 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c000cb070 con 0x7f3bf0004850 2023-06-20T13:32:52.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.130+0000 7f3bfd7fa700 1 -- 172.21.15.32:0/774723164 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4006aa0 con 0x7f3bf0004850 2023-06-20T13:32:52.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.130+0000 7f3c06bff700 1 -- 172.21.15.32:0/774723164 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c0014ef60 con 0x7f3bf0004850 2023-06-20T13:32:52.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.131+0000 7f3c06bff700 1 -- 172.21.15.32:0/774723164 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c00066a00 con 0x7f3bf0004850 2023-06-20T13:32:52.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.132+0000 7f3bfd7fa700 1 -- 172.21.15.32:0/774723164 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3bf4006c00 con 0x7f3bf0004850 2023-06-20T13:32:52.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.133+0000 7f3bfd7fa700 1 --2- 172.21.15.32:0/774723164 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f3be406ace0 0x7f3be406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.133+0000 7f3bfd7fa700 1 -- 172.21.15.32:0/774723164 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3bf4089070 con 0x7f3bf0004850 2023-06-20T13:32:52.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.133+0000 7f3bfffff700 1 --2- 172.21.15.32:0/774723164 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f3be406ace0 0x7f3be406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.134+0000 7f3bfffff700 1 --2- 172.21.15.32:0/774723164 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f3be406ace0 0x7f3be406d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3bec015040 tx=0x7f3bec007f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.137+0000 7f3bfd7fa700 1 -- 172.21.15.32:0/774723164 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3bf40bb310 con 0x7f3bf0004850 2023-06-20T13:32:52.342 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.341+0000 7f3c06bff700 1 -- 172.21.15.32:0/774723164 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c000cb9a0 con 0x7f3bf0004850 2023-06-20T13:32:52.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.342+0000 7f3bfd7fa700 1 -- 172.21.15.32:0/774723164 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20096 (secure 0 0 0) 0x7f3c00066a00 con 0x7f3bf0004850 2023-06-20T13:32:52.344 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:32:52.344 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":27,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:32:25.570940+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-20T13:32:18.120021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-20T13:32:19.503624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-20T13:32:23.074912+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:32:52.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.345+0000 7f3c06bff700 1 -- 172.21.15.32:0/774723164 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f3be406ace0 msgr2=0x7f3be406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.345+0000 7f3c06bff700 1 --2- 172.21.15.32:0/774723164 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f3be406ace0 0x7f3be406d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3bec015040 tx=0x7f3bec007f90 comp rx=0 tx=0).stop 2023-06-20T13:32:52.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.345+0000 7f3c06bff700 1 -- 172.21.15.32:0/774723164 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bf0004850 msgr2=0x7f3c00153b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.345+0000 7f3c06bff700 1 --2- 172.21.15.32:0/774723164 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bf0004850 0x7f3c00153b50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4007a30 tx=0x7f3bf400fb00 comp rx=0 tx=0).stop 2023-06-20T13:32:52.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.345+0000 7f3c06bff700 1 -- 172.21.15.32:0/774723164 shutdown_connections 2023-06-20T13:32:52.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.345+0000 7f3c06bff700 1 --2- 172.21.15.32:0/774723164 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f3be406ace0 0x7f3be406d190 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.345+0000 7f3c06bff700 1 --2- 172.21.15.32:0/774723164 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3c00154090 0x7f3c000cc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.345+0000 7f3c06bff700 1 --2- 172.21.15.32:0/774723164 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3bf0004850 0x7f3c00153b50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.345+0000 7f3c06bff700 1 --2- 172.21.15.32:0/774723164 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3c00151850 0x7f3c000cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.345+0000 7f3c06bff700 1 -- 172.21.15.32:0/774723164 >> 172.21.15.32:0/774723164 conn(0x7f3c00071660 msgr2=0x7f3c000b6480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:52.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.345+0000 7f3c06bff700 1 -- 172.21.15.32:0/774723164 shutdown_connections 2023-06-20T13:32:52.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.345+0000 7f3c06bff700 1 -- 172.21.15.32:0/774723164 wait complete. 2023-06-20T13:32:52.365 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-06-20T13:32:52.365 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-06-20T13:32:52.366 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-06-20T13:32:52.366 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-06-20T13:32:52.367 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-06-20T13:32:52.367 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-06-20T13:32:52.368 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-06-20T13:32:52.368 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-06-20T13:32:52.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.725+0000 7f2beadff700 1 Processor -- start 2023-06-20T13:32:52.727 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.726+0000 7fdd281ff700 1 Processor -- start 2023-06-20T13:32:52.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.726+0000 7fdd281ff700 1 -- start start 2023-06-20T13:32:52.728 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.725+0000 7f2beadff700 1 -- start start 2023-06-20T13:32:52.729 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.727+0000 7f2beadff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2be40b0aa0 0x7f2be40cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.729 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.727+0000 7f2beadff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2be40c98e0 0x7f2be40cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.727+0000 7f2beadff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2be40cce20 con 0x7f2be40c9d50 2023-06-20T13:32:52.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.727+0000 7f2beadff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2be40cd100 con 0x7f2be40c98e0 2023-06-20T13:32:52.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.727+0000 7f2beadff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be40cd3e0 con 0x7f2be40b0aa0 2023-06-20T13:32:52.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.728+0000 7f2be3fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2be40c98e0 0x7f2be40cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.728+0000 7f2be3fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2be40c98e0 0x7f2be40cb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:45798/0 (socket says 172.21.15.32:45798) 2023-06-20T13:32:52.730 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.728+0000 7f2be3fff700 1 -- 172.21.15.32:0/2013710628 learned_addr learned my addr 172.21.15.32:0/2013710628 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:52.731 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.730+0000 7f2be3fff700 1 -- 172.21.15.32:0/2013710628 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2be40b0aa0 msgr2=0x7f2be40cdec0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-20T13:32:52.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.730+0000 7f2be3fff700 1 --2- 172.21.15.32:0/2013710628 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2be40b0aa0 0x7f2be40cdec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.730+0000 7f2be3fff700 1 -- 172.21.15.32:0/2013710628 >> v1:172.21.15.115:6789/0 conn(0x7f2be40c9d50 legacy=0x7f2be40cb6e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-20T13:32:52.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.730+0000 7f2be3fff700 1 -- 172.21.15.32:0/2013710628 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be40cd6c0 con 0x7f2be40c98e0 2023-06-20T13:32:52.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.730+0000 7fdd281ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdd201606e0 0x7fdd200ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.730+0000 7fdd281ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdd20160ab0 0x7fdd2006c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.730+0000 7fdd281ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd200ad710 0x7fdd200cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.730+0000 7fdd281ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd200ce670 con 0x7fdd20160ab0 2023-06-20T13:32:52.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.730+0000 7fdd281ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd200c1d30 con 0x7fdd201606e0 2023-06-20T13:32:52.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.730+0000 7fdd281ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd200cc840 con 0x7fdd200ad710 2023-06-20T13:32:52.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.730+0000 7f2be3fff700 1 --2- 172.21.15.32:0/2013710628 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2be40c98e0 0x7f2be40cb1a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2bd80098f0 tx=0x7f2bd8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=468922d01075cf13 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.731+0000 7f2be37fe700 1 -- 172.21.15.32:0/2013710628 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd8004230 con 0x7f2be40c98e0 2023-06-20T13:32:52.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.731+0000 7f2be37fe700 1 -- 172.21.15.32:0/2013710628 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd8004390 con 0x7f2be40c98e0 2023-06-20T13:32:52.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.731+0000 7f2be37fe700 1 -- 172.21.15.32:0/2013710628 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd80036a0 con 0x7f2be40c98e0 2023-06-20T13:32:52.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.732+0000 7f2beadff700 1 -- 172.21.15.32:0/2013710628 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2be40c98e0 msgr2=0x7f2be40cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.732+0000 7f2beadff700 1 --2- 172.21.15.32:0/2013710628 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2be40c98e0 0x7f2be40cb1a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2bd80098f0 tx=0x7f2bd8009c00 comp rx=0 tx=0).stop 2023-06-20T13:32:52.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.732+0000 7f2beadff700 1 -- 172.21.15.32:0/2013710628 shutdown_connections 2023-06-20T13:32:52.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.732+0000 7f2beadff700 1 --2- 172.21.15.32:0/2013710628 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2be40b0aa0 0x7f2be40cdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.732+0000 7f2beadff700 1 --2- 172.21.15.32:0/2013710628 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2be40c98e0 0x7f2be40cb1a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.732+0000 7f2beadff700 1 -- 172.21.15.32:0/2013710628 >> 172.21.15.32:0/2013710628 conn(0x7f2be406abc0 msgr2=0x7f2be40b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:52.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.731+0000 7fdd2579a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdd20160ab0 0x7fdd2006c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.731+0000 7fdd2579a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdd20160ab0 0x7fdd2006c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59010/0 (socket says 172.21.15.32:59010) 2023-06-20T13:32:52.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.731+0000 7fdd2579a700 1 -- 172.21.15.32:0/2326708994 learned_addr learned my addr 172.21.15.32:0/2326708994 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:52.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.731+0000 7fdd2579a700 1 -- 172.21.15.32:0/2326708994 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd200ad710 msgr2=0x7fdd200cb1b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-20T13:32:52.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.731+0000 7fdd2579a700 1 --2- 172.21.15.32:0/2326708994 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd200ad710 0x7fdd200cb1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.731+0000 7fdd2579a700 1 -- 172.21.15.32:0/2326708994 >> v2:172.21.15.115:3300/0 conn(0x7fdd201606e0 msgr2=0x7fdd200ce130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-20T13:32:52.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.731+0000 7fdd2579a700 1 --2- 172.21.15.32:0/2326708994 >> v2:172.21.15.115:3300/0 conn(0x7fdd201606e0 0x7fdd200ce130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.732+0000 7fdd2579a700 1 -- 172.21.15.32:0/2326708994 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2006c930 con 0x7fdd20160ab0 2023-06-20T13:32:52.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.732+0000 7fdd2579a700 1 --2- 172.21.15.32:0/2326708994 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd20160ab0 0x7fdd2006c3f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdd200cf8c0 tx=0x7fdd10009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb84b0949abb1e34 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.733+0000 7fdd24f99700 1 -- 172.21.15.32:0/2326708994 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1000b870 con 0x7fdd20160ab0 2023-06-20T13:32:52.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.733+0000 7fdd24f99700 1 -- 172.21.15.32:0/2326708994 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1000b9d0 con 0x7fdd20160ab0 2023-06-20T13:32:52.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.733+0000 7fdd24f99700 1 -- 172.21.15.32:0/2326708994 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1000bd60 con 0x7fdd20160ab0 2023-06-20T13:32:52.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.733+0000 7f2beadff700 1 -- 172.21.15.32:0/2013710628 shutdown_connections 2023-06-20T13:32:52.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.734+0000 7fdd281ff700 1 -- 172.21.15.32:0/2326708994 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd20160ab0 msgr2=0x7fdd2006c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.734+0000 7fdd281ff700 1 --2- 172.21.15.32:0/2326708994 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd20160ab0 0x7fdd2006c3f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdd200cf8c0 tx=0x7fdd10009bd0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.733+0000 7f2beadff700 1 -- 172.21.15.32:0/2013710628 wait complete. 2023-06-20T13:32:52.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.736+0000 7f2beadff700 1 Processor -- start 2023-06-20T13:32:52.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.739+0000 7fdd281ff700 1 -- 172.21.15.32:0/2326708994 shutdown_connections 2023-06-20T13:32:52.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.739+0000 7fdd281ff700 1 --2- 172.21.15.32:0/2326708994 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd200ad710 0x7fdd200cb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.739+0000 7fdd281ff700 1 --2- 172.21.15.32:0/2326708994 >> v2:172.21.15.115:3300/0 conn(0x7fdd201606e0 0x7fdd200ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.739+0000 7fdd281ff700 1 --2- 172.21.15.32:0/2326708994 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd20160ab0 0x7fdd2006c3f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.740 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.739+0000 7fdd281ff700 1 -- 172.21.15.32:0/2326708994 >> 172.21.15.32:0/2326708994 conn(0x7fdd2006abc0 msgr2=0x7fdd200b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:52.741 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.736+0000 7f2beadff700 1 -- start start 2023-06-20T13:32:52.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.738+0000 7f2beadff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2be40b0aa0 0x7f2be4147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.738+0000 7f2beadff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2be40c98e0 0x7f2be40c2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.738+0000 7f2beadff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2be40c9d50 0x7f2be414dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.738+0000 7f2beadff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be4148230 con 0x7f2be40b0aa0 2023-06-20T13:32:52.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.738+0000 7f2beadff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be40c4580 con 0x7f2be40c98e0 2023-06-20T13:32:52.742 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.738+0000 7f2beadff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be40c3970 con 0x7f2be40c9d50 2023-06-20T13:32:52.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.739+0000 7f2be8b9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2be40b0aa0 0x7f2be4147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.740+0000 7f2be8b9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2be40b0aa0 0x7f2be4147cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59020/0 (socket says 172.21.15.32:59020) 2023-06-20T13:32:52.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.740+0000 7f2be8b9b700 1 -- 172.21.15.32:0/3314475374 learned_addr learned my addr 172.21.15.32:0/3314475374 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:52.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.739+0000 7fdd281ff700 1 -- 172.21.15.32:0/2326708994 shutdown_connections 2023-06-20T13:32:52.743 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.740+0000 7fdd281ff700 1 -- 172.21.15.32:0/2326708994 wait complete. 2023-06-20T13:32:52.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.741+0000 7f2be8b9b700 1 -- 172.21.15.32:0/3314475374 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2be40c9d50 msgr2=0x7f2be414dd00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-20T13:32:52.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.741+0000 7f2be8b9b700 1 --2- 172.21.15.32:0/3314475374 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2be40c9d50 0x7f2be414dd00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.741+0000 7f2be8b9b700 1 -- 172.21.15.32:0/3314475374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2be40c98e0 msgr2=0x7f2be40c2f70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-20T13:32:52.744 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.741+0000 7f2be8b9b700 1 --2- 172.21.15.32:0/3314475374 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2be40c98e0 0x7f2be40c2f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.741+0000 7f2be8b9b700 1 -- 172.21.15.32:0/3314475374 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd8009550 con 0x7f2be40b0aa0 2023-06-20T13:32:52.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.741+0000 7f2be8b9b700 1 --2- 172.21.15.32:0/3314475374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2be40b0aa0 0x7f2be4147cf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc00b840 tx=0x7f2bdc00bc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.742+0000 7f2be17fa700 1 -- 172.21.15.32:0/3314475374 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc00d890 con 0x7f2be40b0aa0 2023-06-20T13:32:52.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.742+0000 7f2be17fa700 1 -- 172.21.15.32:0/3314475374 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bdc00d9f0 con 0x7f2be40b0aa0 2023-06-20T13:32:52.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.742+0000 7f2be17fa700 1 -- 172.21.15.32:0/3314475374 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc00dda0 con 0x7f2be40b0aa0 2023-06-20T13:32:52.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.742+0000 7f2beadff700 1 -- 172.21.15.32:0/3314475374 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2be40c3c50 con 0x7f2be40b0aa0 2023-06-20T13:32:52.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.743+0000 7fdd281ff700 1 Processor -- start 2023-06-20T13:32:52.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.743+0000 7f2beadff700 1 -- 172.21.15.32:0/3314475374 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2be40c4210 con 0x7f2be40b0aa0 2023-06-20T13:32:52.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.744+0000 7fdd281ff700 1 -- start start 2023-06-20T13:32:52.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.745+0000 7fdd281ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd200ad710 0x7fdd200b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.745+0000 7fdd281ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd201606e0 0x7fdd200b0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.745+0000 7fdd281ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd20160ab0 0x7fdd201594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.745+0000 7fdd281ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd200b45b0 con 0x7fdd201606e0 2023-06-20T13:32:52.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.745+0000 7fdd281ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd200b3510 con 0x7fdd200ad710 2023-06-20T13:32:52.747 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.745+0000 7fdd281ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd200b37f0 con 0x7fdd20160ab0 2023-06-20T13:32:52.748 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.746+0000 7f06e21ff700 1 Processor -- start 2023-06-20T13:32:52.748 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.746+0000 7f2beadff700 1 -- 172.21.15.32:0/3314475374 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2be40cd9a0 con 0x7f2be40b0aa0 2023-06-20T13:32:52.748 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.747+0000 7fdd2579a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd201606e0 0x7fdd200b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.747+0000 7fdd2579a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd201606e0 0x7fdd200b0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59024/0 (socket says 172.21.15.32:59024) 2023-06-20T13:32:52.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.747+0000 7fdd2579a700 1 -- 172.21.15.32:0/1715057041 learned_addr learned my addr 172.21.15.32:0/1715057041 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:52.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.748+0000 7fdd2579a700 1 -- 172.21.15.32:0/1715057041 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd20160ab0 msgr2=0x7fdd201594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.748+0000 7fdd2579a700 1 --2- 172.21.15.32:0/1715057041 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd20160ab0 0x7fdd201594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.748+0000 7fdd2579a700 1 -- 172.21.15.32:0/1715057041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd200ad710 msgr2=0x7fdd200b2cc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-20T13:32:52.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.748+0000 7fdd2579a700 1 --2- 172.21.15.32:0/1715057041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd200ad710 0x7fdd200b2cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.748+0000 7fdd2579a700 1 -- 172.21.15.32:0/1715057041 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd10009550 con 0x7fdd201606e0 2023-06-20T13:32:52.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.746+0000 7f06e21ff700 1 -- start start 2023-06-20T13:32:52.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.748+0000 7f06e21ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f06dc0c9970 0x7f06dc0cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.748+0000 7f06e21ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06dc0c9d40 0x7f06dc0cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.748+0000 7f06e21ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06dc0cce20 con 0x7f06dc0cb6e0 2023-06-20T13:32:52.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.748+0000 7f06e21ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06dc0cd100 con 0x7f06dc0c9970 2023-06-20T13:32:52.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.748+0000 7f06e21ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc0cd3e0 con 0x7f06dc0c9d40 2023-06-20T13:32:52.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.749+0000 7fb1c71ff700 1 Processor -- start 2023-06-20T13:32:52.753 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.749+0000 7fdd2579a700 1 --2- 172.21.15.32:0/1715057041 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd201606e0 0x7fdd200b0020 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdd10009c10 tx=0x7fdd10004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.753 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.749+0000 7f06daffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06dc0c9d40 0x7f06dc0cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.749+0000 7f06daffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06dc0c9d40 0x7f06dc0cb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.32:35342/0 (socket says 172.21.15.32:35342) 2023-06-20T13:32:52.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.749+0000 7f06daffd700 1 -- 172.21.15.32:0/2532534906 learned_addr learned my addr 172.21.15.32:0/2532534906 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:52.755 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.749+0000 7f2be17fa700 1 -- 172.21.15.32:0/3314475374 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2bdc00e430 con 0x7f2be40b0aa0 2023-06-20T13:32:52.755 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.749+0000 7f73bedff700 1 Processor -- start 2023-06-20T13:32:52.756 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.749+0000 7f06da7fc700 1 -- 172.21.15.32:0/2532534906 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4249500615 0 0) 0x7f06dc0cce20 con 0x7f06dc0cb6e0 2023-06-20T13:32:52.757 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.750+0000 7f06da7fc700 1 -- 172.21.15.32:0/2532534906 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06c40035b0 con 0x7f06dc0cb6e0 2023-06-20T13:32:52.757 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.750+0000 7f06daffd700 1 -- 172.21.15.32:0/2532534906 >> v2:172.21.15.32:3300/0 conn(0x7f06dc0c9970 msgr2=0x7f06dc0cdec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-20T13:32:52.757 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.750+0000 7f73bedff700 1 -- start start 2023-06-20T13:32:52.758 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.750+0000 7f06daffd700 1 --2- 172.21.15.32:0/2532534906 >> v2:172.21.15.32:3300/0 conn(0x7f06dc0c9970 0x7f06dc0cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.758 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.750+0000 7f06daffd700 1 -- 172.21.15.32:0/2532534906 >> v1:172.21.15.115:6789/0 conn(0x7f06dc0cb6e0 legacy=0x7f06dc157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.758 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.750+0000 7f06daffd700 1 -- 172.21.15.32:0/2532534906 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc0cd6c0 con 0x7f06dc0c9d40 2023-06-20T13:32:52.758 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.751+0000 7f06daffd700 1 --2- 172.21.15.32:0/2532534906 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06dc0c9d40 0x7f06dc0cb1a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f06cc0098f0 tx=0x7f06cc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dad870500414899 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.751+0000 7f2be17fa700 1 --2- 172.21.15.32:0/3314475374 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f2bd006adb0 0x7f2bd006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.751+0000 7fdd167fc700 1 -- 172.21.15.32:0/1715057041 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd100119f0 con 0x7fdd201606e0 2023-06-20T13:32:52.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.751+0000 7fdd167fc700 1 -- 172.21.15.32:0/1715057041 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1001f070 con 0x7fdd201606e0 2023-06-20T13:32:52.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.751+0000 7fdd167fc700 1 -- 172.21.15.32:0/1715057041 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd10011d50 con 0x7fdd201606e0 2023-06-20T13:32:52.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.751+0000 7f2be17fa700 1 -- 172.21.15.32:0/3314475374 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2bdc0898a0 con 0x7f2be40b0aa0 2023-06-20T13:32:52.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.751+0000 7f06da7fc700 1 -- 172.21.15.32:0/2532534906 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d0001670 con 0x7f06dc0c9d40 2023-06-20T13:32:52.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.751+0000 7f06da7fc700 1 -- 172.21.15.32:0/2532534906 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06cc004030 con 0x7f06dc0c9d40 2023-06-20T13:32:52.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.751+0000 7f06da7fc700 1 -- 172.21.15.32:0/2532534906 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc0043a0 con 0x7f06dc0c9d40 2023-06-20T13:32:52.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.751+0000 7f2be17fa700 1 --2- 172.21.15.32:0/3314475374 >> [v2:172.21.15.32:6800/3795707735,v1:172.21.15.32:6801/3795707735] conn(0x7f2bd0074a80 0x7f2bd0076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.751+0000 7f2be17fa700 1 -- 172.21.15.32:0/3314475374 --> [v2:172.21.15.32:6800/3795707735,v1:172.21.15.32:6801/3795707735] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2bd0077580 con 0x7f2bd0074a80 2023-06-20T13:32:52.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.751+0000 7f2be17fa700 1 -- 172.21.15.32:0/3314475374 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2bdc08e2a0 con 0x7f2be40b0aa0 2023-06-20T13:32:52.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.751+0000 7f2be3fff700 1 --2- 172.21.15.32:0/3314475374 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f2bd006adb0 0x7f2bd006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.752+0000 7f2be939c700 1 --2- 172.21.15.32:0/3314475374 >> [v2:172.21.15.32:6800/3795707735,v1:172.21.15.32:6801/3795707735] conn(0x7f2bd0074a80 0x7f2bd0076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.752+0000 7fdd281ff700 1 -- 172.21.15.32:0/1715057041 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd200b3ad0 con 0x7fdd201606e0 2023-06-20T13:32:52.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.752+0000 7f06e21ff700 1 -- 172.21.15.32:0/2532534906 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06dc0c9d40 msgr2=0x7f06dc0cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.752+0000 7f06e21ff700 1 --2- 172.21.15.32:0/2532534906 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06dc0c9d40 0x7f06dc0cb1a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f06cc0098f0 tx=0x7f06cc009c00 comp rx=0 tx=0).stop 2023-06-20T13:32:52.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.752+0000 7fdd281ff700 1 -- 172.21.15.32:0/1715057041 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd200b4090 con 0x7fdd201606e0 2023-06-20T13:32:52.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.753+0000 7f2be3fff700 1 --2- 172.21.15.32:0/3314475374 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f2bd006adb0 0x7f2bd006d260 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2be4165d60 tx=0x7f2bd8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.753+0000 7f06e21ff700 1 -- 172.21.15.32:0/2532534906 shutdown_connections 2023-06-20T13:32:52.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.753+0000 7f06e21ff700 1 --2- 172.21.15.32:0/2532534906 >> v2:172.21.15.32:3300/0 conn(0x7f06dc0c9970 0x7f06dc0cdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.753+0000 7f06e21ff700 1 --2- 172.21.15.32:0/2532534906 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06dc0c9d40 0x7f06dc0cb1a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.753+0000 7f06e21ff700 1 -- 172.21.15.32:0/2532534906 >> 172.21.15.32:0/2532534906 conn(0x7f06dc06abc0 msgr2=0x7f06dc0b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:52.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.753+0000 7f2be939c700 1 --2- 172.21.15.32:0/3314475374 >> [v2:172.21.15.32:6800/3795707735,v1:172.21.15.32:6801/3795707735] conn(0x7f2bd0074a80 0x7f2bd0076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.753+0000 7f06e21ff700 1 -- 172.21.15.32:0/2532534906 shutdown_connections 2023-06-20T13:32:52.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.753+0000 7fb1c71ff700 1 -- start start 2023-06-20T13:32:52.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.753+0000 7f06e21ff700 1 -- 172.21.15.32:0/2532534906 wait complete. 2023-06-20T13:32:52.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.754+0000 7fdd281ff700 1 -- 172.21.15.32:0/1715057041 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdd200adf40 con 0x7fdd201606e0 2023-06-20T13:32:52.766 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.755+0000 7f73bedff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73b8070a80 0x7f73b80ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.766 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.755+0000 7f73bedff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b80ae130 con 0x7f73b8160930 2023-06-20T13:32:52.766 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.755+0000 7f73bedff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b80ccb70 con 0x7f73b80adce0 2023-06-20T13:32:52.766 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.755+0000 7f73bedff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b8165400 con 0x7f73b8070a80 2023-06-20T13:32:52.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.755+0000 7fb1c71ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb1c00b8320 0x7fb1c00cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.755+0000 7fb1c71ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1c00b4cc0 0x7fb1c01608e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.755+0000 7fb1c71ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c00cf3b0 con 0x7fb1c00d1cd0 2023-06-20T13:32:52.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.755+0000 7fb1c71ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c0160e20 con 0x7fb1c00b8320 2023-06-20T13:32:52.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.755+0000 7fb1c71ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c00b86f0 con 0x7fb1c00b4cc0 2023-06-20T13:32:52.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.756+0000 7f73bd39c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f73b80adce0 0x7f73b806c340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.32:34206/0 (socket says 172.21.15.32:34206) 2023-06-20T13:32:52.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.756+0000 7f73bd39c700 1 -- 172.21.15.32:0/3117937916 learned_addr learned my addr 172.21.15.32:0/3117937916 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:52.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.757+0000 7fb1bffff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb1c00d1cd0 0x7fb1c00b45b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:52830/0 (socket says 172.21.15.32:52830) 2023-06-20T13:32:52.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.757+0000 7fb1bffff700 1 -- 172.21.15.32:0/1342082613 learned_addr learned my addr 172.21.15.32:0/1342082613 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:52.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.757+0000 7fb1c4f9b700 1 --2- 172.21.15.32:0/1342082613 >> v2:172.21.15.115:3300/0 conn(0x7fb1c00b8320 0x7fb1c00cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.757+0000 7fb1c579c700 1 --2- 172.21.15.32:0/1342082613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1c00b4cc0 0x7fb1c01608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.756+0000 7f06e21ff700 1 Processor -- start 2023-06-20T13:32:52.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.756+0000 7f06e21ff700 1 -- start start 2023-06-20T13:32:52.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.758+0000 7f06e21ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06dc0c9970 0x7f06dc1498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.757+0000 7f73b77fe700 1 -- 172.21.15.32:0/3117937916 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2118120415 0 0) 0x7f73ac001110 con 0x7f73b8160930 2023-06-20T13:32:52.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.757+0000 7f73b77fe700 1 -- 172.21.15.32:0/3117937916 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73a00035b0 con 0x7f73b8160930 2023-06-20T13:32:52.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.758+0000 7f73b77fe700 1 -- 172.21.15.32:0/3117937916 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 587963773 0 0) 0x7f73b80ccb70 con 0x7f73b80adce0 2023-06-20T13:32:52.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.758+0000 7f73b77fe700 1 -- 172.21.15.32:0/3117937916 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73ac001110 con 0x7f73b80adce0 2023-06-20T13:32:52.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.758+0000 7f73b7fff700 1 --2- 172.21.15.32:0/3117937916 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73b8070a80 0x7f73b80ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.758+0000 7f06e21ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06dc0c9d40 0x7f06dc1f5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.758+0000 7f06e21ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06dc0cb6e0 0x7f06dc0ae970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.758+0000 7f06e21ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc147490 con 0x7f06dc0c9d40 2023-06-20T13:32:52.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.758+0000 7f06e21ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc0aeeb0 con 0x7f06dc0cb6e0 2023-06-20T13:32:52.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.758+0000 7f06e21ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc1482a0 con 0x7f06dc0c9970 2023-06-20T13:32:52.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.758+0000 7f73b77fe700 1 -- 172.21.15.32:0/3117937916 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 591261725 0 0) 0x7f73a00035b0 con 0x7f73b8160930 2023-06-20T13:32:52.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.758+0000 7f73b77fe700 1 -- 172.21.15.32:0/3117937916 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73b8070a80 msgr2=0x7f73b80ad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:52.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.758+0000 7f73b77fe700 1 --2- 172.21.15.32:0/3117937916 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73b8070a80 0x7f73b80ad7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.758+0000 7f73b77fe700 1 -- 172.21.15.32:0/3117937916 >> v1:172.21.15.115:6789/0 conn(0x7f73b80adce0 legacy=0x7f73b806c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.758+0000 7f73b77fe700 1 -- 172.21.15.32:0/3117937916 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b8164640 con 0x7f73b8160930 2023-06-20T13:32:52.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.758+0000 7f73b77fe700 1 -- 172.21.15.32:0/3117937916 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3380058562 0 0) 0x7f73ac001800 con 0x7f73b8160930 2023-06-20T13:32:52.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.758+0000 7f73b77fe700 1 -- 172.21.15.32:0/3117937916 >> v1:172.21.15.32:6789/0 conn(0x7f73b8160930 legacy=0x7f73b80cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.758+0000 7fb1bf7fe700 1 -- 172.21.15.32:0/1342082613 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4045900966 0 0) 0x7fb1c00cf3b0 con 0x7fb1c00d1cd0 2023-06-20T13:32:52.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.758+0000 7fb1bf7fe700 1 -- 172.21.15.32:0/1342082613 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1a80035b0 con 0x7fb1c00d1cd0 2023-06-20T13:32:52.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.758+0000 7f73b77fe700 1 --2- 172.21.15.32:0/3117937916 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73a0004c50 0x7f73a0005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.758+0000 7f2be17fa700 1 -- 172.21.15.32:0/3314475374 <== osd.0 v2:172.21.15.32:6800/3795707735 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2bd0077580 con 0x7f2bd0074a80 2023-06-20T13:32:52.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.758+0000 7f73b77fe700 1 --2- 172.21.15.32:0/3117937916 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73a00037f0 0x7f73a0003c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.758+0000 7f73b77fe700 1 --2- 172.21.15.32:0/3117937916 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73a00041a0 0x7f73a000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.758+0000 7f73b77fe700 1 -- 172.21.15.32:0/3117937916 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a8001270 con 0x7f73a00037f0 2023-06-20T13:32:52.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.758+0000 7f73b77fe700 1 -- 172.21.15.32:0/3117937916 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b8165400 con 0x7f73a0004c50 2023-06-20T13:32:52.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.758+0000 7f73b77fe700 1 -- 172.21.15.32:0/3117937916 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a000c0b0 con 0x7f73a00041a0 2023-06-20T13:32:52.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.758+0000 7f73b7fff700 1 --2- 172.21.15.32:0/3117937916 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73b8070a80 0x7f73b80ad7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:32:52.776 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.757+0000 7fdd167fc700 1 -- 172.21.15.32:0/1715057041 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdd1001a430 con 0x7fdd201606e0 2023-06-20T13:32:52.776 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.758+0000 7fdd167fc700 1 --2- 172.21.15.32:0/1715057041 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdd0406adb0 0x7fdd0406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.776 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.759+0000 7fdd167fc700 1 -- 172.21.15.32:0/1715057041 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdd10021070 con 0x7fdd201606e0 2023-06-20T13:32:52.776 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.759+0000 7f73bcb9b700 1 --2- 172.21.15.32:0/3117937916 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73a0004c50 0x7f73a0005020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.777 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.759+0000 7fdd167fc700 1 --2- 172.21.15.32:0/1715057041 >> [v2:172.21.15.32:6824/2743925394,v1:172.21.15.32:6825/2743925394] conn(0x7fdd04074a00 0x7fdd04076e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.777 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.759+0000 7fdd167fc700 1 -- 172.21.15.32:0/1715057041 --> [v2:172.21.15.32:6824/2743925394,v1:172.21.15.32:6825/2743925394] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdd04077500 con 0x7fdd04074a00 2023-06-20T13:32:52.777 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.759+0000 7fdd167fc700 1 -- 172.21.15.32:0/1715057041 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd10055c30 con 0x7fdd201606e0 2023-06-20T13:32:52.777 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.759+0000 7f73bcb9b700 1 -- 172.21.15.32:0/3117937916 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73a00041a0 msgr2=0x7f73a000ba10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-20T13:32:52.778 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.759+0000 7f73bcb9b700 1 --2- 172.21.15.32:0/3117937916 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73a00041a0 0x7f73a000ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.778 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.759+0000 7f73bcb9b700 1 -- 172.21.15.32:0/3117937916 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73a00037f0 msgr2=0x7f73a0003c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:52.778 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.759+0000 7f73bcb9b700 1 --2- 172.21.15.32:0/3117937916 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73a00037f0 0x7f73a0003c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.778 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.759+0000 7f73bcb9b700 1 -- 172.21.15.32:0/3117937916 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b8164640 con 0x7f73a0004c50 2023-06-20T13:32:52.778 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.760+0000 7fdd2679c700 1 --2- 172.21.15.32:0/1715057041 >> [v2:172.21.15.32:6824/2743925394,v1:172.21.15.32:6825/2743925394] conn(0x7fdd04074a00 0x7fdd04076e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.760+0000 7f73bcb9b700 1 --2- 172.21.15.32:0/3117937916 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73a0004c50 0x7f73a0005020 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f73ac00c1e0 tx=0x7f73a0005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d433677d24d44b49 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.760+0000 7f73b77fe700 1 -- 172.21.15.32:0/3117937916 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ac00cc80 con 0x7f73a0004c50 2023-06-20T13:32:52.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.760+0000 7f73b77fe700 1 -- 172.21.15.32:0/3117937916 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73ac00cde0 con 0x7f73a0004c50 2023-06-20T13:32:52.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.760+0000 7f73b77fe700 1 -- 172.21.15.32:0/3117937916 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ac012660 con 0x7f73a0004c50 2023-06-20T13:32:52.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.760+0000 7fb1c4f9b700 1 -- 172.21.15.32:0/1342082613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1c00b4cc0 msgr2=0x7fb1c01608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:52.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.760+0000 7fb1c4f9b700 1 --2- 172.21.15.32:0/1342082613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1c00b4cc0 0x7fb1c01608e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.760+0000 7fb1c4f9b700 1 -- 172.21.15.32:0/1342082613 >> v1:172.21.15.32:6789/0 conn(0x7fb1c00d1cd0 legacy=0x7fb1c00b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.760+0000 7fb1c4f9b700 1 -- 172.21.15.32:0/1342082613 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c00cf0d0 con 0x7fb1c00b8320 2023-06-20T13:32:52.781 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.761+0000 7fb1c4f9b700 1 --2- 172.21.15.32:0/1342082613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1c00b8320 0x7fb1c00cd4f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8009d90 tx=0x7fb1b800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8df74197900bd975 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.781 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.761+0000 7fdd2679c700 1 --2- 172.21.15.32:0/1715057041 >> [v2:172.21.15.32:6824/2743925394,v1:172.21.15.32:6825/2743925394] conn(0x7fdd04074a00 0x7fdd04076e30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.781 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.761+0000 7fdd25f9b700 1 --2- 172.21.15.32:0/1715057041 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdd0406adb0 0x7fdd0406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.781 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.760+0000 7f06db7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06dc0c9970 0x7f06dc1498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.760+0000 7f06dbfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06dc0cb6e0 0x7f06dc0ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.760+0000 7f06dbfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06dc0cb6e0 0x7f06dc0ae970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:45858/0 (socket says 172.21.15.32:45858) 2023-06-20T13:32:52.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.760+0000 7f06dbfff700 1 -- 172.21.15.32:0/2281153704 learned_addr learned my addr 172.21.15.32:0/2281153704 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:52.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.760+0000 7f06daffd700 1 --2- 172.21.15.32:0/2281153704 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06dc0c9d40 0x7f06dc1f5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.761+0000 7f06daffd700 1 -- 172.21.15.32:0/2281153704 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06dc0c9970 msgr2=0x7f06dc1498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.761+0000 7f06daffd700 1 --2- 172.21.15.32:0/2281153704 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06dc0c9970 0x7f06dc1498f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.761+0000 7f06daffd700 1 -- 172.21.15.32:0/2281153704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06dc0cb6e0 msgr2=0x7f06dc0ae970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.761+0000 7f06daffd700 1 --2- 172.21.15.32:0/2281153704 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06dc0cb6e0 0x7f06dc0ae970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.761+0000 7f06daffd700 1 -- 172.21.15.32:0/2281153704 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06cc009550 con 0x7f06dc0c9d40 2023-06-20T13:32:52.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.761+0000 7f06daffd700 1 --2- 172.21.15.32:0/2281153704 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06dc0c9d40 0x7f06dc1f5bc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f06cc014000 tx=0x7f06cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.762+0000 7fb1bf7fe700 1 -- 172.21.15.32:0/1342082613 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b800e070 con 0x7fb1c00b8320 2023-06-20T13:32:52.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.762+0000 7fb1bf7fe700 1 -- 172.21.15.32:0/1342082613 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b800bb20 con 0x7fb1c00b8320 2023-06-20T13:32:52.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.762+0000 7fb1bf7fe700 1 -- 172.21.15.32:0/1342082613 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b8012430 con 0x7fb1c00b8320 2023-06-20T13:32:52.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.762+0000 7f06c3fff700 1 -- 172.21.15.32:0/2281153704 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc003cf0 con 0x7f06dc0c9d40 2023-06-20T13:32:52.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.762+0000 7f06c3fff700 1 -- 172.21.15.32:0/2281153704 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06cc003e70 con 0x7f06dc0c9d40 2023-06-20T13:32:52.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.762+0000 7f06c3fff700 1 -- 172.21.15.32:0/2281153704 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc0107b0 con 0x7f06dc0c9d40 2023-06-20T13:32:52.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.762+0000 7fdd25f9b700 1 --2- 172.21.15.32:0/1715057041 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdd0406adb0 0x7fdd0406d260 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdd1800ab90 tx=0x7fdd18009230 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.763+0000 7fdd167fc700 1 -- 172.21.15.32:0/1715057041 <== osd.1 v2:172.21.15.32:6824/2743925394 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fdd04077500 con 0x7fdd04074a00 2023-06-20T13:32:52.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.763+0000 7fb1c71ff700 1 -- 172.21.15.32:0/1342082613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1c00b8320 msgr2=0x7fb1c00cd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.763+0000 7fb1c71ff700 1 --2- 172.21.15.32:0/1342082613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1c00b8320 0x7fb1c00cd4f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8009d90 tx=0x7fb1b800b330 comp rx=0 tx=0).stop 2023-06-20T13:32:52.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.763+0000 7f73bedff700 1 -- 172.21.15.32:0/3117937916 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73a0004c50 msgr2=0x7f73a0005020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.763+0000 7f73bedff700 1 --2- 172.21.15.32:0/3117937916 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73a0004c50 0x7f73a0005020 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f73ac00c1e0 tx=0x7f73a0005880 comp rx=0 tx=0).stop 2023-06-20T13:32:52.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.763+0000 7f73bd39c700 1 -- 172.21.15.32:0/3117937916 reap_dead start 2023-06-20T13:32:52.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.763+0000 7fb1c71ff700 1 -- 172.21.15.32:0/1342082613 shutdown_connections 2023-06-20T13:32:52.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.763+0000 7fb1c71ff700 1 --2- 172.21.15.32:0/1342082613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1c00b4cc0 0x7fb1c01608e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.763+0000 7fb1c71ff700 1 --2- 172.21.15.32:0/1342082613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1c00b8320 0x7fb1c00cd4f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.763+0000 7fb1c71ff700 1 -- 172.21.15.32:0/1342082613 >> 172.21.15.32:0/1342082613 conn(0x7fb1c00722b0 msgr2=0x7fb1c00cf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:52.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.763+0000 7f73bedff700 1 -- 172.21.15.32:0/3117937916 shutdown_connections 2023-06-20T13:32:52.788 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.763+0000 7f73bedff700 1 -- 172.21.15.32:0/3117937916 >> 172.21.15.32:0/3117937916 conn(0x7f73b80b0390 msgr2=0x7f73b80b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:52.788 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.763+0000 7f06e21ff700 1 -- 172.21.15.32:0/2281153704 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06dc148580 con 0x7f06dc0c9d40 2023-06-20T13:32:52.788 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.763+0000 7f06e21ff700 1 -- 172.21.15.32:0/2281153704 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06dc165d20 con 0x7f06dc0c9d40 2023-06-20T13:32:52.788 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.765+0000 7fb1c71ff700 1 -- 172.21.15.32:0/1342082613 shutdown_connections 2023-06-20T13:32:52.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.764+0000 7f06e21ff700 1 -- 172.21.15.32:0/2281153704 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f06dc0cbb40 con 0x7f06dc0c9d40 2023-06-20T13:32:52.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.765+0000 7f73bedff700 1 -- 172.21.15.32:0/3117937916 shutdown_connections 2023-06-20T13:32:52.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.765+0000 7f73bedff700 1 -- 172.21.15.32:0/3117937916 wait complete. 2023-06-20T13:32:52.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.766+0000 7fb1c71ff700 1 -- 172.21.15.32:0/1342082613 wait complete. 2023-06-20T13:32:52.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.768+0000 7f73bedff700 1 Processor -- start 2023-06-20T13:32:52.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.768+0000 7f73bedff700 1 -- start start 2023-06-20T13:32:52.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.770+0000 7f73bedff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73a0004c50 0x7f73b8150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.770+0000 7f73bedff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73b8161190 0x7f73b80b4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.770+0000 7f73bedff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73b80b2460 0x7f73b80b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.770+0000 7f73bedff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b8151230 con 0x7f73b80b2460 2023-06-20T13:32:52.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.770+0000 7f73bedff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b80b2df0 con 0x7f73a0004c50 2023-06-20T13:32:52.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.770+0000 7f73bedff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b80b1ad0 con 0x7f73b8161190 2023-06-20T13:32:52.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.768+0000 7fb1c71ff700 1 Processor -- start 2023-06-20T13:32:52.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.769+0000 7fb1c71ff700 1 -- start start 2023-06-20T13:32:52.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.770+0000 7fb1c71ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1c00b8320 0x7fb1c0147630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.770+0000 7fb1c71ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1c00d1cd0 0x7fb1c00ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.770+0000 7fb1c71ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1c014eb90 0x7fb1c014dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.770+0000 7fb1c71ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c00cb710 con 0x7fb1c00d1cd0 2023-06-20T13:32:52.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.770+0000 7fb1c71ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c015d8e0 con 0x7fb1c014eb90 2023-06-20T13:32:52.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.770+0000 7fb1c71ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c00cb150 con 0x7fb1c00b8320 2023-06-20T13:32:52.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.771+0000 7fb1c4f9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1c00b8320 0x7fb1c0147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.771+0000 7fb1c4f9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1c00b8320 0x7fb1c0147630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.32:35398/0 (socket says 172.21.15.32:35398) 2023-06-20T13:32:52.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.771+0000 7fb1c4f9b700 1 -- 172.21.15.32:0/1496809956 learned_addr learned my addr 172.21.15.32:0/1496809956 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:52.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.771+0000 7fb1c579c700 1 --2- 172.21.15.32:0/1496809956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1c014eb90 0x7fb1c014dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.767+0000 7f68541ff700 1 Processor -- start 2023-06-20T13:32:52.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.767+0000 7f68541ff700 1 -- start start 2023-06-20T13:32:52.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.770+0000 7f68541ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f684c0cfed0 0x7f684c0ce650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.770+0000 7f68541ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f684c0d1e00 0x7f684c0d2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.770+0000 7f68541ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f684c0d27a0 con 0x7f684c160a10 2023-06-20T13:32:52.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.770+0000 7f68541ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f684c0cec60 con 0x7f684c0d1e00 2023-06-20T13:32:52.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.770+0000 7f68541ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f684c0cef40 con 0x7f684c0cfed0 2023-06-20T13:32:52.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.771+0000 7f685279c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f684c0d1e00 0x7f684c0d2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.771+0000 7f685279c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f684c0d1e00 0x7f684c0d2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59058/0 (socket says 172.21.15.32:59058) 2023-06-20T13:32:52.795 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.771+0000 7f685279c700 1 -- 172.21.15.32:0/2443164269 learned_addr learned my addr 172.21.15.32:0/2443164269 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:52.795 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.771+0000 7fb1bffff700 1 --2- 172.21.15.32:0/1496809956 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1c00d1cd0 0x7fb1c00ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.795 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.772+0000 7f73bcb9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73a0004c50 0x7f73b8150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.795 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.772+0000 7f73bd39c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73b80b2460 0x7f73b80b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.772+0000 7f73bd39c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73b80b2460 0x7f73b80b28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59068/0 (socket says 172.21.15.32:59068) 2023-06-20T13:32:52.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.772+0000 7f73bd39c700 1 -- 172.21.15.32:0/149590519 learned_addr learned my addr 172.21.15.32:0/149590519 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:52.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.771+0000 7f685279c700 1 -- 172.21.15.32:0/2443164269 >> v2:172.21.15.115:3300/0 conn(0x7f684c0cfed0 msgr2=0x7f684c0ce650 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-20T13:32:52.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.771+0000 7f685279c700 1 --2- 172.21.15.32:0/2443164269 >> v2:172.21.15.115:3300/0 conn(0x7f684c0cfed0 0x7f684c0ce650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.771+0000 7f685279c700 1 -- 172.21.15.32:0/2443164269 >> v1:172.21.15.115:6789/0 conn(0x7f684c160a10 legacy=0x7f684c06bb60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-20T13:32:52.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.772+0000 7f685279c700 1 -- 172.21.15.32:0/2443164269 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f684c0cf220 con 0x7f684c0d1e00 2023-06-20T13:32:52.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.772+0000 7f685279c700 1 --2- 172.21.15.32:0/2443164269 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f684c0d1e00 0x7f684c0d2260 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f684c0cf510 tx=0x7f684400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee464832d746be4a server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.772+0000 7fb1c579c700 1 -- 172.21.15.32:0/1496809956 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1c00b8320 msgr2=0x7fb1c0147630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.772+0000 7fb1c579c700 1 --2- 172.21.15.32:0/1496809956 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb1c00b8320 0x7fb1c0147630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.772+0000 7fb1c579c700 1 -- 172.21.15.32:0/1496809956 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1c00d1cd0 msgr2=0x7fb1c00ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.772+0000 7fb1c579c700 1 --2- 172.21.15.32:0/1496809956 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1c00d1cd0 0x7fb1c00ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.772+0000 7fb1c579c700 1 -- 172.21.15.32:0/1496809956 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b8009a70 con 0x7fb1c014eb90 2023-06-20T13:32:52.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.773+0000 7f73bd39c700 1 -- 172.21.15.32:0/149590519 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73b8161190 msgr2=0x7f73b80b4180 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-20T13:32:52.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.773+0000 7f73bd39c700 1 --2- 172.21.15.32:0/149590519 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73b8161190 0x7f73b80b4180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.773+0000 7f73bd39c700 1 -- 172.21.15.32:0/149590519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73a0004c50 msgr2=0x7f73b8150cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.773+0000 7f73bd39c700 1 --2- 172.21.15.32:0/149590519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73a0004c50 0x7f73b8150cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.773+0000 7f73bd39c700 1 -- 172.21.15.32:0/149590519 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b8160d00 con 0x7f73b80b2460 2023-06-20T13:32:52.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.773+0000 7f6850f99700 1 -- 172.21.15.32:0/2443164269 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684400e070 con 0x7f684c0d1e00 2023-06-20T13:32:52.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.773+0000 7fb1c579c700 1 --2- 172.21.15.32:0/1496809956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1c014eb90 0x7fb1c014dc20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00b50b0 tx=0x7fb1b400eb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.773+0000 7f6850f99700 1 -- 172.21.15.32:0/2443164269 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6844003a20 con 0x7f684c0d1e00 2023-06-20T13:32:52.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.773+0000 7f6850f99700 1 -- 172.21.15.32:0/2443164269 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6844003dd0 con 0x7f684c0d1e00 2023-06-20T13:32:52.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.773+0000 7f73bd39c700 1 --2- 172.21.15.32:0/149590519 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73b80b2460 0x7f73b80b28b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f73b80cdb00 tx=0x7f73a800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.773+0000 7fb1bd7fa700 1 -- 172.21.15.32:0/1496809956 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4013680 con 0x7fb1c014eb90 2023-06-20T13:32:52.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.773+0000 7fb1bd7fa700 1 -- 172.21.15.32:0/1496809956 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b40137e0 con 0x7fb1c014eb90 2023-06-20T13:32:52.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.773+0000 7fb1bd7fa700 1 -- 172.21.15.32:0/1496809956 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4013b90 con 0x7fb1c014eb90 2023-06-20T13:32:52.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.774+0000 7f73b57fa700 1 -- 172.21.15.32:0/149590519 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a8004c80 con 0x7f73b80b2460 2023-06-20T13:32:52.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.774+0000 7f73b57fa700 1 -- 172.21.15.32:0/149590519 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a8004de0 con 0x7f73b80b2460 2023-06-20T13:32:52.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.774+0000 7f73b57fa700 1 -- 172.21.15.32:0/149590519 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a8007270 con 0x7f73b80b2460 2023-06-20T13:32:52.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.774+0000 7f68541ff700 1 -- 172.21.15.32:0/2443164269 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f684c0d1e00 msgr2=0x7f684c0d2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.774+0000 7f68541ff700 1 --2- 172.21.15.32:0/2443164269 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f684c0d1e00 0x7f684c0d2260 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f684c0cf510 tx=0x7f684400b330 comp rx=0 tx=0).stop 2023-06-20T13:32:52.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.774+0000 7f68541ff700 1 -- 172.21.15.32:0/2443164269 shutdown_connections 2023-06-20T13:32:52.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.774+0000 7f68541ff700 1 --2- 172.21.15.32:0/2443164269 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f684c0d1e00 0x7f684c0d2260 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.774+0000 7f68541ff700 1 --2- 172.21.15.32:0/2443164269 >> v2:172.21.15.115:3300/0 conn(0x7f684c0cfed0 0x7f684c0ce650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.774+0000 7f68541ff700 1 -- 172.21.15.32:0/2443164269 >> 172.21.15.32:0/2443164269 conn(0x7f684c0722b0 msgr2=0x7f684c0cf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:52.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.774+0000 7f73bedff700 1 -- 172.21.15.32:0/149590519 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b80b46c0 con 0x7f73b80b2460 2023-06-20T13:32:52.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.774+0000 7f73bedff700 1 -- 172.21.15.32:0/149590519 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b80b1d20 con 0x7f73b80b2460 2023-06-20T13:32:52.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.775+0000 7fb1c71ff700 1 -- 172.21.15.32:0/1496809956 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c00cb430 con 0x7fb1c014eb90 2023-06-20T13:32:52.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.775+0000 7fb1c71ff700 1 -- 172.21.15.32:0/1496809956 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c0147b70 con 0x7fb1c014eb90 2023-06-20T13:32:52.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.769+0000 7f06c3fff700 1 -- 172.21.15.32:0/2281153704 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f06cc010910 con 0x7f06dc0c9d40 2023-06-20T13:32:52.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.773+0000 7f06c3fff700 1 --2- 172.21.15.32:0/2281153704 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f06c806adb0 0x7f06c806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.773+0000 7f06c3fff700 1 -- 172.21.15.32:0/2281153704 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f06cc08b7a0 con 0x7f06dc0c9d40 2023-06-20T13:32:52.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.774+0000 7f06c3fff700 1 --2- 172.21.15.32:0/2281153704 >> [v2:172.21.15.115:6800/1219874985,v1:172.21.15.115:6801/1219874985] conn(0x7f06c8074a80 0x7f06c8076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.774+0000 7f06c3fff700 1 -- 172.21.15.32:0/2281153704 --> [v2:172.21.15.115:6800/1219874985,v1:172.21.15.115:6801/1219874985] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f06c8077580 con 0x7f06c8074a80 2023-06-20T13:32:52.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.774+0000 7f06c3fff700 1 -- 172.21.15.32:0/2281153704 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06cc08bb50 con 0x7f06dc0c9d40 2023-06-20T13:32:52.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.775+0000 7f06db7fe700 1 --2- 172.21.15.32:0/2281153704 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f06c806adb0 0x7f06c806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.775+0000 7f06dbfff700 1 --2- 172.21.15.32:0/2281153704 >> [v2:172.21.15.115:6800/1219874985,v1:172.21.15.115:6801/1219874985] conn(0x7f06c8074a80 0x7f06c8076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.776+0000 7f06db7fe700 1 --2- 172.21.15.32:0/2281153704 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f06c806adb0 0x7f06c806d260 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f06dc165ae0 tx=0x7f06d400d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.776+0000 7f73bedff700 1 -- 172.21.15.32:0/149590519 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f73b8164c00 con 0x7f73b80b2460 2023-06-20T13:32:52.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.775+0000 7f0032bff700 1 Processor -- start 2023-06-20T13:32:52.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.775+0000 7f0032bff700 1 -- start start 2023-06-20T13:32:52.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.777+0000 7f0032bff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f002c16c7e0 0x7f002c0cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.777+0000 7f0032bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f002c089570 0x7f002c0ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.778+0000 7f0032bff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f002c0ce620 con 0x7f002c0cb190 2023-06-20T13:32:52.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.778+0000 7f0032bff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f002c089e70 con 0x7f002c16c7e0 2023-06-20T13:32:52.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.778+0000 7f0032bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f002c0caac0 con 0x7f002c089570 2023-06-20T13:32:52.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.778+0000 7f003099b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f002c16c7e0 0x7f002c0cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.778+0000 7f003119c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f002c0cb190 0x7f002c0cb5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:52842/0 (socket says 172.21.15.32:52842) 2023-06-20T13:32:52.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.778+0000 7f003099b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f002c16c7e0 0x7f002c0cda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59090/0 (socket says 172.21.15.32:59090) 2023-06-20T13:32:52.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.778+0000 7f003119c700 1 -- 172.21.15.32:0/2615990617 learned_addr learned my addr 172.21.15.32:0/2615990617 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:52.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.779+0000 7f002bfff700 1 --2- 172.21.15.32:0/2615990617 >> v2:172.21.15.115:3300/0 conn(0x7f002c089570 0x7f002c0ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.779+0000 7f06dbfff700 1 --2- 172.21.15.32:0/2281153704 >> [v2:172.21.15.115:6800/1219874985,v1:172.21.15.115:6801/1219874985] conn(0x7f06c8074a80 0x7f06c8076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.780+0000 7f002bfff700 1 -- 172.21.15.32:0/2615990617 >> v2:172.21.15.32:3300/0 conn(0x7f002c16c7e0 msgr2=0x7f002c0cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:52.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.780+0000 7f002bfff700 1 --2- 172.21.15.32:0/2615990617 >> v2:172.21.15.32:3300/0 conn(0x7f002c16c7e0 0x7f002c0cda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.780+0000 7f002bfff700 1 -- 172.21.15.32:0/2615990617 >> v1:172.21.15.32:6789/0 conn(0x7f002c0cb190 legacy=0x7f002c0cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.780+0000 7fe3585ff700 1 Processor -- start 2023-06-20T13:32:52.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.780+0000 7f002bfff700 1 -- 172.21.15.32:0/2615990617 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002c0cc970 con 0x7f002c089570 2023-06-20T13:32:52.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.780+0000 7f002bfff700 1 --2- 172.21.15.32:0/2615990617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f002c089570 0x7f002c0ce0e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f002c0ca730 tx=0x7f0020009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f6bb58813086960 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.780+0000 7f68541ff700 1 -- 172.21.15.32:0/2443164269 shutdown_connections 2023-06-20T13:32:52.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.779+0000 7fb1bd7fa700 1 -- 172.21.15.32:0/1496809956 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb1b4013cf0 con 0x7fb1c014eb90 2023-06-20T13:32:52.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.780+0000 7fb1c71ff700 1 -- 172.21.15.32:0/1496809956 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb1c00d25a0 con 0x7fb1c014eb90 2023-06-20T13:32:52.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.781+0000 7fb1bd7fa700 1 --2- 172.21.15.32:0/1496809956 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fb1ac06adb0 0x7fb1ac06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.781+0000 7fb1bd7fa700 1 -- 172.21.15.32:0/1496809956 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb1b4089670 con 0x7fb1c014eb90 2023-06-20T13:32:52.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.781+0000 7fb1bd7fa700 1 --2- 172.21.15.32:0/1496809956 >> [v2:172.21.15.32:6816/2342106296,v1:172.21.15.32:6817/2342106296] conn(0x7fb1ac074a00 0x7fb1ac076e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.781+0000 7fb1bd7fa700 1 -- 172.21.15.32:0/1496809956 --> [v2:172.21.15.32:6816/2342106296,v1:172.21.15.32:6817/2342106296] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb1ac077500 con 0x7fb1ac074a00 2023-06-20T13:32:52.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.780+0000 7fe3585ff700 1 -- start start 2023-06-20T13:32:52.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.782+0000 7f06c3fff700 1 -- 172.21.15.32:0/2281153704 <== osd.4 v2:172.21.15.115:6800/1219874985 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f06c8077580 con 0x7f06c8074a80 2023-06-20T13:32:52.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.782+0000 7fe3585ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe3500d2640 0x7fe3500b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.782+0000 7fe3585ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3500d1790 con 0x7fe3500cf8f0 2023-06-20T13:32:52.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.782+0000 7fe3585ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3500cd950 con 0x7fe35015c460 2023-06-20T13:32:52.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.782+0000 7fe3585ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3500cedd0 con 0x7fe3500d2640 2023-06-20T13:32:52.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.783+0000 7fe355b9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe3500d2640 0x7fe3500b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.783+0000 7fe355b9a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe3500d2640 0x7fe3500b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:45924/0 (socket says 172.21.15.32:45924) 2023-06-20T13:32:52.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.783+0000 7fe355b9a700 1 -- 172.21.15.32:0/4113188361 learned_addr learned my addr 172.21.15.32:0/4113188361 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:52.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.781+0000 7f002b7fe700 1 -- 172.21.15.32:0/2615990617 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020011830 con 0x7f002c089570 2023-06-20T13:32:52.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.781+0000 7f002b7fe700 1 -- 172.21.15.32:0/2615990617 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0020011990 con 0x7f002c089570 2023-06-20T13:32:52.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.781+0000 7f002b7fe700 1 -- 172.21.15.32:0/2615990617 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020011d00 con 0x7f002c089570 2023-06-20T13:32:52.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.782+0000 7f0032bff700 1 -- 172.21.15.32:0/2615990617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f002c089570 msgr2=0x7f002c0ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.782+0000 7f0032bff700 1 --2- 172.21.15.32:0/2615990617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f002c089570 0x7f002c0ce0e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f002c0ca730 tx=0x7f0020009b20 comp rx=0 tx=0).stop 2023-06-20T13:32:52.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.780+0000 7f68541ff700 1 -- 172.21.15.32:0/2443164269 wait complete. 2023-06-20T13:32:52.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.783+0000 7f68541ff700 1 Processor -- start 2023-06-20T13:32:52.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.783+0000 7f68541ff700 1 -- start start 2023-06-20T13:32:52.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.784+0000 7f0032bff700 1 -- 172.21.15.32:0/2615990617 shutdown_connections 2023-06-20T13:32:52.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.784+0000 7f0032bff700 1 --2- 172.21.15.32:0/2615990617 >> v2:172.21.15.32:3300/0 conn(0x7f002c16c7e0 0x7f002c0cda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.784+0000 7f0032bff700 1 --2- 172.21.15.32:0/2615990617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f002c089570 0x7f002c0ce0e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.784+0000 7f0032bff700 1 -- 172.21.15.32:0/2615990617 >> 172.21.15.32:0/2615990617 conn(0x7f002c06abc0 msgr2=0x7f002c0b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:52.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.782+0000 7f73b57fa700 1 -- 172.21.15.32:0/149590519 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f73a80073d0 con 0x7f73b80b2460 2023-06-20T13:32:52.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.784+0000 7f73b57fa700 1 --2- 172.21.15.32:0/149590519 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f73a406adb0 0x7f73a406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.784+0000 7f73b57fa700 1 -- 172.21.15.32:0/149590519 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f73a8088950 con 0x7f73b80b2460 2023-06-20T13:32:52.820 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.784+0000 7f0032bff700 1 -- 172.21.15.32:0/2615990617 shutdown_connections 2023-06-20T13:32:52.820 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.784+0000 7f73b57fa700 1 --2- 172.21.15.32:0/149590519 >> [v2:172.21.15.32:6802/253057972,v1:172.21.15.32:6804/253057972] conn(0x7f73a4074a00 0x7f73a4076e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.821 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.784+0000 7f73b57fa700 1 -- 172.21.15.32:0/149590519 --> [v2:172.21.15.32:6802/253057972,v1:172.21.15.32:6804/253057972] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f73a4077500 con 0x7f73a4074a00 2023-06-20T13:32:52.821 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.785+0000 7f73b57fa700 1 -- 172.21.15.32:0/149590519 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73a80536f0 con 0x7f73b80b2460 2023-06-20T13:32:52.821 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.785+0000 7f73bcb9b700 1 --2- 172.21.15.32:0/149590519 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f73a406adb0 0x7f73a406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.785+0000 7f68541ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f684c15f290 0x7f684c14c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.785+0000 7f68541ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f684c0b69b0 0x7f684c15f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.785+0000 7f68541ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f684c0c6660 0x7f684c14af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.785+0000 7f68541ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684c0c94e0 con 0x7f684c0b69b0 2023-06-20T13:32:52.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.785+0000 7f68541ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684c0b8590 con 0x7f684c15f290 2023-06-20T13:32:52.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.785+0000 7f68541ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684c15fba0 con 0x7f684c0c6660 2023-06-20T13:32:52.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.786+0000 7f73b7fff700 1 --2- 172.21.15.32:0/149590519 >> [v2:172.21.15.32:6802/253057972,v1:172.21.15.32:6804/253057972] conn(0x7f73a4074a00 0x7f73a4076e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.786+0000 7f685279c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f684c0c6660 0x7f684c14af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.825 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.786+0000 7f6851f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f684c15f290 0x7f684c14c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.825 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.786+0000 7f6851f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f684c15f290 0x7f684c14c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:45940/0 (socket says 172.21.15.32:45940) 2023-06-20T13:32:52.825 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.786+0000 7f6851f9b700 1 -- 172.21.15.32:0/2832655480 learned_addr learned my addr 172.21.15.32:0/2832655480 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:52.826 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.786+0000 7f73bcb9b700 1 --2- 172.21.15.32:0/149590519 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f73a406adb0 0x7f73a406d260 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f73ac000c00 tx=0x7f73ac00a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.826 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.781+0000 7fb1c4f9b700 1 --2- 172.21.15.32:0/1496809956 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fb1ac06adb0 0x7fb1ac06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.826 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.783+0000 7fb1c4f9b700 1 --2- 172.21.15.32:0/1496809956 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fb1ac06adb0 0x7fb1ac06d260 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00ce530 tx=0x7fb1b8011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.827 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.787+0000 7fb1bffff700 1 --2- 172.21.15.32:0/1496809956 >> [v2:172.21.15.32:6816/2342106296,v1:172.21.15.32:6817/2342106296] conn(0x7fb1ac074a00 0x7fb1ac076e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.827 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.786+0000 7f6851f9b700 1 -- 172.21.15.32:0/2832655480 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f684c0c6660 msgr2=0x7f684c14af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.786+0000 7f6851f9b700 1 --2- 172.21.15.32:0/2832655480 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f684c0c6660 0x7f684c14af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.786+0000 7f6851f9b700 1 -- 172.21.15.32:0/2832655480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f684c0b69b0 msgr2=0x7f684c15f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.786+0000 7f6851f9b700 1 --2- 172.21.15.32:0/2832655480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f684c0b69b0 0x7f684c15f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.828 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.787+0000 7f6851f9b700 1 -- 172.21.15.32:0/2832655480 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6844009b30 con 0x7f684c15f290 2023-06-20T13:32:52.829 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.787+0000 7fb1bd7fa700 1 -- 172.21.15.32:0/1496809956 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1b40544a0 con 0x7fb1c014eb90 2023-06-20T13:32:52.829 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.787+0000 7f6851f9b700 1 --2- 172.21.15.32:0/2832655480 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f684c15f290 0x7f684c14c210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f684800b4d0 tx=0x7f684800b7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.830 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.787+0000 7f73b7fff700 1 --2- 172.21.15.32:0/149590519 >> [v2:172.21.15.32:6802/253057972,v1:172.21.15.32:6804/253057972] conn(0x7f73a4074a00 0x7f73a4076e30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.784+0000 7f0032bff700 1 -- 172.21.15.32:0/2615990617 wait complete. 2023-06-20T13:32:52.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.789+0000 7f73b57fa700 1 -- 172.21.15.32:0/149590519 <== osd.2 v2:172.21.15.32:6802/253057972 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f73a4077500 con 0x7f73a4074a00 2023-06-20T13:32:52.832 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.788+0000 7fb1bffff700 1 --2- 172.21.15.32:0/1496809956 >> [v2:172.21.15.32:6816/2342106296,v1:172.21.15.32:6817/2342106296] conn(0x7fb1ac074a00 0x7fb1ac076e30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.832 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.788+0000 7f68427fc700 1 -- 172.21.15.32:0/2832655480 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848011830 con 0x7f684c15f290 2023-06-20T13:32:52.833 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.788+0000 7f68427fc700 1 -- 172.21.15.32:0/2832655480 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68480119b0 con 0x7f684c15f290 2023-06-20T13:32:52.833 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.788+0000 7f68427fc700 1 -- 172.21.15.32:0/2832655480 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848011d60 con 0x7f684c15f290 2023-06-20T13:32:52.833 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.788+0000 7f68541ff700 1 -- 172.21.15.32:0/2832655480 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f684c0b6eb0 con 0x7f684c15f290 2023-06-20T13:32:52.833 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.788+0000 7f68541ff700 1 -- 172.21.15.32:0/2832655480 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f684c0b7470 con 0x7f684c15f290 2023-06-20T13:32:52.834 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.789+0000 7f68541ff700 1 -- 172.21.15.32:0/2832655480 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6834000fc0 con 0x7f684c15f290 2023-06-20T13:32:52.834 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.787+0000 7f0032bff700 1 Processor -- start 2023-06-20T13:32:52.835 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.788+0000 7f0032bff700 1 -- start start 2023-06-20T13:32:52.835 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.789+0000 7f0032bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f002c089570 0x7f002c1584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.835 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.789+0000 7f0032bff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f002c0cb190 0x7f002c164e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.836 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.789+0000 7f0032bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f002c16c7e0 0x7f002c0c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.836 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.789+0000 7f0032bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002c0b2440 con 0x7f002c089570 2023-06-20T13:32:52.836 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.789+0000 7f0032bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002c088730 con 0x7f002c16c7e0 2023-06-20T13:32:52.836 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.789+0000 7f0032bff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002c0b17c0 con 0x7f002c0cb190 2023-06-20T13:32:52.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.790+0000 7fb1bd7fa700 1 -- 172.21.15.32:0/1496809956 <== osd.3 v2:172.21.15.32:6816/2342106296 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb1ac077500 con 0x7fb1ac074a00 2023-06-20T13:32:52.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.785+0000 7fe355399700 1 -- 172.21.15.32:0/4113188361 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2756261473 0 0) 0x7fe3500cd950 con 0x7fe35015c460 2023-06-20T13:32:52.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.785+0000 7fe355399700 1 -- 172.21.15.32:0/4113188361 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe33c0035b0 con 0x7fe35015c460 2023-06-20T13:32:52.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.785+0000 7fe355399700 1 -- 172.21.15.32:0/4113188361 <== mon.1 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1196005188 0 0) 0x7fe33c0035b0 con 0x7fe35015c460 2023-06-20T13:32:52.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.785+0000 7fe355399700 1 -- 172.21.15.32:0/4113188361 >> v2:172.21.15.115:3300/0 conn(0x7fe3500d2640 msgr2=0x7fe3500b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:52.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.785+0000 7fe355399700 1 --2- 172.21.15.32:0/4113188361 >> v2:172.21.15.115:3300/0 conn(0x7fe3500d2640 0x7fe3500b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.785+0000 7fe355399700 1 -- 172.21.15.32:0/4113188361 >> v1:172.21.15.32:6789/0 conn(0x7fe3500cf8f0 legacy=0x7fe35015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:52.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.785+0000 7fe355399700 1 -- 172.21.15.32:0/4113188361 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3500d14b0 con 0x7fe35015c460 2023-06-20T13:32:52.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.785+0000 7fe355399700 1 -- 172.21.15.32:0/4113188361 <== mon.1 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3380058562 0 0) 0x7fe34c001670 con 0x7fe35015c460 2023-06-20T13:32:52.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.785+0000 7fe355399700 1 -- 172.21.15.32:0/4113188361 >> v1:172.21.15.115:6789/0 conn(0x7fe35015c460 legacy=0x7fe3500cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.785+0000 7fe355399700 1 --2- 172.21.15.32:0/4113188361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe33c003a00 0x7fe33c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.785+0000 7fe355399700 1 --2- 172.21.15.32:0/4113188361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe33c004850 0x7fe33c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.785+0000 7fe355399700 1 --2- 172.21.15.32:0/4113188361 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe33c005320 0x7fe33c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.785+0000 7fe355399700 1 -- 172.21.15.32:0/4113188361 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3500cedd0 con 0x7fe33c004850 2023-06-20T13:32:52.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.785+0000 7fe355399700 1 -- 172.21.15.32:0/4113188361 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c00c250 con 0x7fe33c003a00 2023-06-20T13:32:52.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.785+0000 7fe355399700 1 -- 172.21.15.32:0/4113188361 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c00c410 con 0x7fe33c005320 2023-06-20T13:32:52.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.786+0000 7fe35639b700 1 --2- 172.21.15.32:0/4113188361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe33c003a00 0x7fe33c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.786+0000 7fe35639b700 1 -- 172.21.15.32:0/4113188361 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe33c005320 msgr2=0x7fe33c00ba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-20T13:32:52.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.786+0000 7fe35639b700 1 --2- 172.21.15.32:0/4113188361 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe33c005320 0x7fe33c00ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.786+0000 7fe35639b700 1 -- 172.21.15.32:0/4113188361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe33c004850 msgr2=0x7fe33c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:52.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.786+0000 7fe35639b700 1 --2- 172.21.15.32:0/4113188361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe33c004850 0x7fe33c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.786+0000 7fe35639b700 1 -- 172.21.15.32:0/4113188361 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3500d14b0 con 0x7fe33c003a00 2023-06-20T13:32:52.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.790+0000 7fe356b9c700 1 -- 172.21.15.32:0/4113188361 reap_dead start 2023-06-20T13:32:52.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.790+0000 7f003119c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f002c16c7e0 0x7f002c0c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.790+0000 7f003119c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f002c16c7e0 0x7f002c0c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:45960/0 (socket says 172.21.15.32:45960) 2023-06-20T13:32:52.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.790+0000 7f003119c700 1 -- 172.21.15.32:0/1087181040 learned_addr learned my addr 172.21.15.32:0/1087181040 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:52.842 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.790+0000 7fe35639b700 1 --2- 172.21.15.32:0/4113188361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe33c003a00 0x7fe33c003df0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe34c00c1e0 tx=0x7fe33c005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0bba22cba3cfc8c server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.790+0000 7f003099b700 1 --2- 172.21.15.32:0/1087181040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f002c089570 0x7f002c1584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.791+0000 7f003119c700 1 -- 172.21.15.32:0/1087181040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f002c0cb190 msgr2=0x7f002c164e50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-20T13:32:52.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.791+0000 7f003119c700 1 --2- 172.21.15.32:0/1087181040 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f002c0cb190 0x7f002c164e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.791+0000 7f003119c700 1 -- 172.21.15.32:0/1087181040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f002c089570 msgr2=0x7f002c1584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.843 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.791+0000 7f003119c700 1 --2- 172.21.15.32:0/1087181040 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f002c089570 0x7f002c1584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.791+0000 7f003119c700 1 -- 172.21.15.32:0/1087181040 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00200094a0 con 0x7f002c16c7e0 2023-06-20T13:32:52.844 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.792+0000 7f2beadff700 1 -- 172.21.15.32:0/3314475374 --> [v2:172.21.15.32:6800/3795707735,v1:172.21.15.32:6801/3795707735] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2be40c5870 con 0x7f2bd0074a80 2023-06-20T13:32:52.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.792+0000 7fe355399700 1 -- 172.21.15.32:0/4113188361 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c007b60 con 0x7fe33c003a00 2023-06-20T13:32:52.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.792+0000 7fe355399700 1 -- 172.21.15.32:0/4113188361 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34c00cce0 con 0x7fe33c003a00 2023-06-20T13:32:52.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.792+0000 7fe355399700 1 -- 172.21.15.32:0/4113188361 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c006aa0 con 0x7fe33c003a00 2023-06-20T13:32:52.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.793+0000 7f2be17fa700 1 -- 172.21.15.32:0/3314475374 <== osd.0 v2:172.21.15.32:6800/3795707735 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2be40c5870 con 0x7f2bd0074a80 2023-06-20T13:32:52.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.793+0000 7fe3585ff700 1 -- 172.21.15.32:0/4113188361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe33c003a00 msgr2=0x7fe33c003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.793+0000 7fe3585ff700 1 --2- 172.21.15.32:0/4113188361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe33c003a00 0x7fe33c003df0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe34c00c1e0 tx=0x7fe33c005880 comp rx=0 tx=0).stop 2023-06-20T13:32:52.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.793+0000 7fe3585ff700 1 -- 172.21.15.32:0/4113188361 shutdown_connections 2023-06-20T13:32:52.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.793+0000 7fe3585ff700 1 --2- 172.21.15.32:0/4113188361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe33c003a00 0x7fe33c003df0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.846 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.793+0000 7fe3585ff700 1 -- 172.21.15.32:0/4113188361 >> 172.21.15.32:0/4113188361 conn(0x7fe350071660 msgr2=0x7fe350071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:52.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.794+0000 7f003119c700 1 --2- 172.21.15.32:0/1087181040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f002c16c7e0 0x7f002c0c7bb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f002400caa0 tx=0x7f002400ce60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.794+0000 7f68427fc700 1 -- 172.21.15.32:0/2832655480 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f684801a400 con 0x7f684c15f290 2023-06-20T13:32:52.847 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.794+0000 7f2beadff700 1 -- 172.21.15.32:0/3314475374 >> [v2:172.21.15.32:6800/3795707735,v1:172.21.15.32:6801/3795707735] conn(0x7f2bd0074a80 msgr2=0x7f2bd0076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.794+0000 7f2beadff700 1 --2- 172.21.15.32:0/3314475374 >> [v2:172.21.15.32:6800/3795707735,v1:172.21.15.32:6801/3795707735] conn(0x7f2bd0074a80 0x7f2bd0076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.794+0000 7f2beadff700 1 -- 172.21.15.32:0/3314475374 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f2bd006adb0 msgr2=0x7f2bd006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.794+0000 7f2beadff700 1 --2- 172.21.15.32:0/3314475374 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f2bd006adb0 0x7f2bd006d260 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2be4165d60 tx=0x7f2bd8008030 comp rx=0 tx=0).stop 2023-06-20T13:32:52.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.794+0000 7f2beadff700 1 -- 172.21.15.32:0/3314475374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2be40b0aa0 msgr2=0x7f2be4147cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.794+0000 7f2beadff700 1 --2- 172.21.15.32:0/3314475374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2be40b0aa0 0x7f2be4147cf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc00b840 tx=0x7f2bdc00bc00 comp rx=0 tx=0).stop 2023-06-20T13:32:52.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.795+0000 7f2be939c700 1 -- 172.21.15.32:0/3314475374 reap_dead start 2023-06-20T13:32:52.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.795+0000 7f2beadff700 1 -- 172.21.15.32:0/3314475374 shutdown_connections 2023-06-20T13:32:52.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.795+0000 7f2beadff700 1 -- 172.21.15.32:0/3314475374 >> 172.21.15.32:0/3314475374 conn(0x7f2be406abc0 msgr2=0x7f2be406d740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:52.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.795+0000 7f68427fc700 1 --2- 172.21.15.32:0/2832655480 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f683006adb0 0x7f683006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.795+0000 7f68427fc700 1 -- 172.21.15.32:0/2832655480 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6848089dd0 con 0x7f684c15f290 2023-06-20T13:32:52.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.795+0000 7f2beadff700 1 -- 172.21.15.32:0/3314475374 shutdown_connections 2023-06-20T13:32:52.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.795+0000 7f2beadff700 1 -- 172.21.15.32:0/3314475374 wait complete. 2023-06-20T13:32:52.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.795+0000 7f68427fc700 1 --2- 172.21.15.32:0/2832655480 >> [v2:172.21.15.115:6816/121241249,v1:172.21.15.115:6817/121241249] conn(0x7f6830074a80 0x7f6830076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.795+0000 7f68427fc700 1 -- 172.21.15.32:0/2832655480 --> [v2:172.21.15.115:6816/121241249,v1:172.21.15.115:6817/121241249] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6830077580 con 0x7f6830074a80 2023-06-20T13:32:52.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.795+0000 7f68427fc700 1 -- 172.21.15.32:0/2832655480 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f684808a180 con 0x7f684c15f290 2023-06-20T13:32:52.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.796+0000 7f685179a700 1 --2- 172.21.15.32:0/2832655480 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f683006adb0 0x7f683006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.796+0000 7f685279c700 1 --2- 172.21.15.32:0/2832655480 >> [v2:172.21.15.115:6816/121241249,v1:172.21.15.115:6817/121241249] conn(0x7f6830074a80 0x7f6830076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.796+0000 7fe3585ff700 1 -- 172.21.15.32:0/4113188361 shutdown_connections 2023-06-20T13:32:52.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.796+0000 7fe3585ff700 1 -- 172.21.15.32:0/4113188361 wait complete. 2023-06-20T13:32:52.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.797+0000 7fdd281ff700 1 -- 172.21.15.32:0/1715057041 --> [v2:172.21.15.32:6824/2743925394,v1:172.21.15.32:6825/2743925394] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdd200adc60 con 0x7fdd04074a00 2023-06-20T13:32:52.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.797+0000 7fdd167fc700 1 -- 172.21.15.32:0/1715057041 <== osd.1 v2:172.21.15.32:6824/2743925394 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdd1c009800 con 0x7fdd04074a00 2023-06-20T13:32:52.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.797+0000 7f685279c700 1 --2- 172.21.15.32:0/2832655480 >> [v2:172.21.15.115:6816/121241249,v1:172.21.15.115:6817/121241249] conn(0x7f6830074a80 0x7f6830076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.852 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.797+0000 7f685179a700 1 --2- 172.21.15.32:0/2832655480 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f683006adb0 0x7f683006d260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f684c15a080 tx=0x7f683c006cb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.798+0000 7fdd281ff700 1 -- 172.21.15.32:0/1715057041 >> [v2:172.21.15.32:6824/2743925394,v1:172.21.15.32:6825/2743925394] conn(0x7fdd04074a00 msgr2=0x7fdd04076e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.798+0000 7fdd281ff700 1 --2- 172.21.15.32:0/1715057041 >> [v2:172.21.15.32:6824/2743925394,v1:172.21.15.32:6825/2743925394] conn(0x7fdd04074a00 0x7fdd04076e30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.798+0000 7fdd281ff700 1 -- 172.21.15.32:0/1715057041 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdd0406adb0 msgr2=0x7fdd0406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.798+0000 7fdd281ff700 1 --2- 172.21.15.32:0/1715057041 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdd0406adb0 0x7fdd0406d260 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdd1800ab90 tx=0x7fdd18009230 comp rx=0 tx=0).stop 2023-06-20T13:32:52.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.798+0000 7fdd281ff700 1 -- 172.21.15.32:0/1715057041 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd201606e0 msgr2=0x7fdd200b0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.853 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.798+0000 7fdd281ff700 1 --2- 172.21.15.32:0/1715057041 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd201606e0 0x7fdd200b0020 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdd10009c10 tx=0x7fdd10004750 comp rx=0 tx=0).stop 2023-06-20T13:32:52.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.798+0000 7fdd2679c700 1 -- 172.21.15.32:0/1715057041 reap_dead start 2023-06-20T13:32:52.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.799+0000 7fdd281ff700 1 -- 172.21.15.32:0/1715057041 shutdown_connections 2023-06-20T13:32:52.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.799+0000 7fdd281ff700 1 -- 172.21.15.32:0/1715057041 >> 172.21.15.32:0/1715057041 conn(0x7fdd2006abc0 msgr2=0x7fdd2015ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:52.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.799+0000 7f68427fc700 1 -- 172.21.15.32:0/2832655480 <== osd.5 v2:172.21.15.115:6816/121241249 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6830077580 con 0x7f6830074a80 2023-06-20T13:32:52.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.800+0000 7f00297fa700 1 -- 172.21.15.32:0/1087181040 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002400aa80 con 0x7f002c16c7e0 2023-06-20T13:32:52.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.800+0000 7f00297fa700 1 -- 172.21.15.32:0/1087181040 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002400abe0 con 0x7f002c16c7e0 2023-06-20T13:32:52.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.800+0000 7f00297fa700 1 -- 172.21.15.32:0/1087181040 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0024012400 con 0x7f002c16c7e0 2023-06-20T13:32:52.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.800+0000 7fdd281ff700 1 -- 172.21.15.32:0/1715057041 shutdown_connections 2023-06-20T13:32:52.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.800+0000 7fdd281ff700 1 -- 172.21.15.32:0/1715057041 wait complete. 2023-06-20T13:32:52.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.799+0000 7fe3585ff700 1 Processor -- start 2023-06-20T13:32:52.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.799+0000 7fe3585ff700 1 -- start start 2023-06-20T13:32:52.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.801+0000 7fe3585ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe33c003a00 0x7fe35015d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.801+0000 7fe3585ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe350149a90 0x7fe3500cc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.801+0000 7fe3585ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3500ca440 0x7fe3500ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.801+0000 7fe3585ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3500c77d0 con 0x7fe350149a90 2023-06-20T13:32:52.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.801+0000 7fe3585ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3500cae00 con 0x7fe3500ca440 2023-06-20T13:32:52.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.801+0000 7fe3585ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3500c79b0 con 0x7fe33c003a00 2023-06-20T13:32:52.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.801+0000 7fe356b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3500ca440 0x7fe3500ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.801+0000 7fe356b9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3500ca440 0x7fe3500ca8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:45970/0 (socket says 172.21.15.32:45970) 2023-06-20T13:32:52.857 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.801+0000 7fe356b9c700 1 -- 172.21.15.32:0/961120241 learned_addr learned my addr 172.21.15.32:0/961120241 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:52.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.802+0000 7fe35639b700 1 --2- 172.21.15.32:0/961120241 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe33c003a00 0x7fe35015d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.802+0000 7fe356b9c700 1 -- 172.21.15.32:0/961120241 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe33c003a00 msgr2=0x7fe35015d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.802+0000 7fe356b9c700 1 --2- 172.21.15.32:0/961120241 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe33c003a00 0x7fe35015d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.802+0000 7fe356b9c700 1 -- 172.21.15.32:0/961120241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe350149a90 msgr2=0x7fe3500cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.802+0000 7fe356b9c700 1 --2- 172.21.15.32:0/961120241 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe350149a90 0x7fe3500cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.858 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.802+0000 7fe356b9c700 1 -- 172.21.15.32:0/961120241 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3500c7c90 con 0x7fe3500ca440 2023-06-20T13:32:52.859 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.803+0000 7f0032bff700 1 -- 172.21.15.32:0/1087181040 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f002c0b1aa0 con 0x7f002c16c7e0 2023-06-20T13:32:52.859 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.803+0000 7f0032bff700 1 -- 172.21.15.32:0/1087181040 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f002c0b2060 con 0x7f002c16c7e0 2023-06-20T13:32:52.859 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.805+0000 7f0032bff700 1 -- 172.21.15.32:0/1087181040 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f002c0ccf30 con 0x7f002c16c7e0 2023-06-20T13:32:52.860 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.806+0000 7fe356b9c700 1 --2- 172.21.15.32:0/961120241 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3500ca440 0x7fe3500ca8c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe35008be00 tx=0x7fe34800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.860 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.807+0000 7fe346ffd700 1 -- 172.21.15.32:0/961120241 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe348007070 con 0x7fe3500ca440 2023-06-20T13:32:52.860 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.807+0000 7fe346ffd700 1 -- 172.21.15.32:0/961120241 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3480071f0 con 0x7fe3500ca440 2023-06-20T13:32:52.860 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.807+0000 7fe346ffd700 1 -- 172.21.15.32:0/961120241 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3480075a0 con 0x7fe3500ca440 2023-06-20T13:32:52.860 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.808+0000 7fe3585ff700 1 -- 172.21.15.32:0/961120241 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3500c7f70 con 0x7fe3500ca440 2023-06-20T13:32:52.860 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.808+0000 7fe3585ff700 1 -- 172.21.15.32:0/961120241 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe35015bd40 con 0x7fe3500ca440 2023-06-20T13:32:52.861 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.811+0000 7fe3585ff700 1 -- 172.21.15.32:0/961120241 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe3500cd5e0 con 0x7fe3500ca440 2023-06-20T13:32:52.861 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.812+0000 7fe346ffd700 1 -- 172.21.15.32:0/961120241 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe348007700 con 0x7fe3500ca440 2023-06-20T13:32:52.861 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.811+0000 7f00297fa700 1 -- 172.21.15.32:0/1087181040 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f002401b3b0 con 0x7f002c16c7e0 2023-06-20T13:32:52.861 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.813+0000 7f00297fa700 1 --2- 172.21.15.32:0/1087181040 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f001806adb0 0x7f001806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.861 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.813+0000 7f00297fa700 1 -- 172.21.15.32:0/1087181040 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0024089a50 con 0x7f002c16c7e0 2023-06-20T13:32:52.861 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.813+0000 7f00297fa700 1 --2- 172.21.15.32:0/1087181040 >> [v2:172.21.15.115:6823/2723705964,v1:172.21.15.115:6825/2723705964] conn(0x7f0018074a80 0x7f0018076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.813+0000 7f00297fa700 1 -- 172.21.15.32:0/1087181040 --> [v2:172.21.15.115:6823/2723705964,v1:172.21.15.115:6825/2723705964] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0018077580 con 0x7f0018074a80 2023-06-20T13:32:52.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.813+0000 7f00297fa700 1 -- 172.21.15.32:0/1087181040 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0024089e00 con 0x7f002c16c7e0 2023-06-20T13:32:52.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.814+0000 7f003099b700 1 --2- 172.21.15.32:0/1087181040 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f001806adb0 0x7f001806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.814+0000 7fe346ffd700 1 --2- 172.21.15.32:0/961120241 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe33406adb0 0x7fe33406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.814+0000 7fe346ffd700 1 -- 172.21.15.32:0/961120241 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe348088f70 con 0x7fe3500ca440 2023-06-20T13:32:52.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.814+0000 7fe346ffd700 1 --2- 172.21.15.32:0/961120241 >> [v2:172.21.15.115:6808/555708777,v1:172.21.15.115:6809/555708777] conn(0x7fe334074a00 0x7fe334076e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:52.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.814+0000 7fe346ffd700 1 -- 172.21.15.32:0/961120241 --> [v2:172.21.15.115:6808/555708777,v1:172.21.15.115:6809/555708777] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe334077500 con 0x7fe334074a00 2023-06-20T13:32:52.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.816+0000 7fe35639b700 1 --2- 172.21.15.32:0/961120241 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe33406adb0 0x7fe33406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.816+0000 7fe355b9a700 1 --2- 172.21.15.32:0/961120241 >> [v2:172.21.15.115:6808/555708777,v1:172.21.15.115:6809/555708777] conn(0x7fe334074a00 0x7fe334076e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.863 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.816+0000 7f003099b700 1 --2- 172.21.15.32:0/1087181040 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f001806adb0 0x7f001806d260 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f001c00b9b0 tx=0x7f001c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.817+0000 7f002bfff700 1 --2- 172.21.15.32:0/1087181040 >> [v2:172.21.15.115:6823/2723705964,v1:172.21.15.115:6825/2723705964] conn(0x7f0018074a80 0x7f0018076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:52.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.816+0000 7fe346ffd700 1 -- 172.21.15.32:0/961120241 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3480015f0 con 0x7fe3500ca440 2023-06-20T13:32:52.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.816+0000 7fe35639b700 1 --2- 172.21.15.32:0/961120241 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe33406adb0 0x7fe33406d260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe35015d6a0 tx=0x7fe34c00a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.817+0000 7f06e21ff700 1 -- 172.21.15.32:0/2281153704 --> [v2:172.21.15.115:6800/1219874985,v1:172.21.15.115:6801/1219874985] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f06dc0cd9a0 con 0x7f06c8074a80 2023-06-20T13:32:52.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.817+0000 7fe355b9a700 1 --2- 172.21.15.32:0/961120241 >> [v2:172.21.15.115:6808/555708777,v1:172.21.15.115:6809/555708777] conn(0x7fe334074a00 0x7fe334076e30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.817+0000 7f002bfff700 1 --2- 172.21.15.32:0/1087181040 >> [v2:172.21.15.115:6823/2723705964,v1:172.21.15.115:6825/2723705964] conn(0x7f0018074a80 0x7f0018076eb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:52.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.818+0000 7fe346ffd700 1 -- 172.21.15.32:0/961120241 <== osd.6 v2:172.21.15.115:6808/555708777 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe334077500 con 0x7fe334074a00 2023-06-20T13:32:52.866 INFO:teuthology.orchestra.run.smithi032.stdout:55834574860 2023-06-20T13:32:52.867 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-06-20T13:32:52.867 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.820+0000 7f73bedff700 1 -- 172.21.15.32:0/149590519 --> [v2:172.21.15.32:6802/253057972,v1:172.21.15.32:6804/253057972] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f73b8164920 con 0x7f73a4074a00 2023-06-20T13:32:52.867 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.821+0000 7f73b57fa700 1 -- 172.21.15.32:0/149590519 <== osd.2 v2:172.21.15.32:6802/253057972 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f73b000f040 con 0x7f73a4074a00 2023-06-20T13:32:52.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.821+0000 7f73bedff700 1 -- 172.21.15.32:0/149590519 >> [v2:172.21.15.32:6802/253057972,v1:172.21.15.32:6804/253057972] conn(0x7f73a4074a00 msgr2=0x7f73a4076e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.821+0000 7f73bedff700 1 --2- 172.21.15.32:0/149590519 >> [v2:172.21.15.32:6802/253057972,v1:172.21.15.32:6804/253057972] conn(0x7f73a4074a00 0x7f73a4076e30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.825+0000 7f00297fa700 1 -- 172.21.15.32:0/1087181040 <== osd.7 v2:172.21.15.115:6823/2723705964 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0018077580 con 0x7f0018074a80 2023-06-20T13:32:52.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.827+0000 7f06c3fff700 1 -- 172.21.15.32:0/2281153704 <== osd.4 v2:172.21.15.115:6800/1219874985 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f06d0007bd0 con 0x7f06c8074a80 2023-06-20T13:32:52.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.827+0000 7f73bedff700 1 -- 172.21.15.32:0/149590519 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f73a406adb0 msgr2=0x7f73a406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.827+0000 7f73bedff700 1 --2- 172.21.15.32:0/149590519 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f73a406adb0 0x7f73a406d260 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f73ac000c00 tx=0x7f73ac00a000 comp rx=0 tx=0).stop 2023-06-20T13:32:52.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.827+0000 7f73bedff700 1 -- 172.21.15.32:0/149590519 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73b80b2460 msgr2=0x7f73b80b28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.827+0000 7f73bedff700 1 --2- 172.21.15.32:0/149590519 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73b80b2460 0x7f73b80b28b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f73b80cdb00 tx=0x7f73a800c9e0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.827+0000 7f73bd39c700 1 -- 172.21.15.32:0/149590519 reap_dead start 2023-06-20T13:32:52.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.827+0000 7f73bedff700 1 -- 172.21.15.32:0/149590519 shutdown_connections 2023-06-20T13:32:52.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.827+0000 7f73bedff700 1 -- 172.21.15.32:0/149590519 >> 172.21.15.32:0/149590519 conn(0x7f73b80b0390 msgr2=0x7f73b80aedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:52.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.827+0000 7f73bedff700 1 -- 172.21.15.32:0/149590519 shutdown_connections 2023-06-20T13:32:52.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.827+0000 7f73bedff700 1 -- 172.21.15.32:0/149590519 wait complete. 2023-06-20T13:32:52.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.827+0000 7fb1c71ff700 1 -- 172.21.15.32:0/1496809956 --> [v2:172.21.15.32:6816/2342106296,v1:172.21.15.32:6817/2342106296] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb1c00d22c0 con 0x7fb1ac074a00 2023-06-20T13:32:52.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.828+0000 7f06e21ff700 1 -- 172.21.15.32:0/2281153704 >> [v2:172.21.15.115:6800/1219874985,v1:172.21.15.115:6801/1219874985] conn(0x7f06c8074a80 msgr2=0x7f06c8076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.828+0000 7f06e21ff700 1 --2- 172.21.15.32:0/2281153704 >> [v2:172.21.15.115:6800/1219874985,v1:172.21.15.115:6801/1219874985] conn(0x7f06c8074a80 0x7f06c8076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.828+0000 7f06e21ff700 1 -- 172.21.15.32:0/2281153704 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f06c806adb0 msgr2=0x7f06c806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.828+0000 7f06e21ff700 1 --2- 172.21.15.32:0/2281153704 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f06c806adb0 0x7f06c806d260 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f06dc165ae0 tx=0x7f06d400d040 comp rx=0 tx=0).stop 2023-06-20T13:32:52.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.828+0000 7f06e21ff700 1 -- 172.21.15.32:0/2281153704 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06dc0c9d40 msgr2=0x7f06dc1f5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.828+0000 7f06e21ff700 1 --2- 172.21.15.32:0/2281153704 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06dc0c9d40 0x7f06dc1f5bc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f06cc014000 tx=0x7f06cc004750 comp rx=0 tx=0).stop 2023-06-20T13:32:52.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.828+0000 7f06dbfff700 1 -- 172.21.15.32:0/2281153704 reap_dead start 2023-06-20T13:32:52.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.829+0000 7f06e21ff700 1 -- 172.21.15.32:0/2281153704 shutdown_connections 2023-06-20T13:32:52.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.829+0000 7f06e21ff700 1 -- 172.21.15.32:0/2281153704 >> 172.21.15.32:0/2281153704 conn(0x7f06dc06abc0 msgr2=0x7f06dc15bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:52.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.829+0000 7f06e21ff700 1 -- 172.21.15.32:0/2281153704 shutdown_connections 2023-06-20T13:32:52.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.829+0000 7f06e21ff700 1 -- 172.21.15.32:0/2281153704 wait complete. 2023-06-20T13:32:52.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.830+0000 7fb1bd7fa700 1 -- 172.21.15.32:0/1496809956 <== osd.3 v2:172.21.15.32:6816/2342106296 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb1b00013b0 con 0x7fb1ac074a00 2023-06-20T13:32:52.874 INFO:teuthology.orchestra.run.smithi032.stdout:55834574860 2023-06-20T13:32:52.875 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-06-20T13:32:52.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.831+0000 7fb1c71ff700 1 -- 172.21.15.32:0/1496809956 >> [v2:172.21.15.32:6816/2342106296,v1:172.21.15.32:6817/2342106296] conn(0x7fb1ac074a00 msgr2=0x7fb1ac076e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.831+0000 7fb1c71ff700 1 --2- 172.21.15.32:0/1496809956 >> [v2:172.21.15.32:6816/2342106296,v1:172.21.15.32:6817/2342106296] conn(0x7fb1ac074a00 0x7fb1ac076e30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.831+0000 7fb1c71ff700 1 -- 172.21.15.32:0/1496809956 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fb1ac06adb0 msgr2=0x7fb1ac06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.831+0000 7fb1c71ff700 1 --2- 172.21.15.32:0/1496809956 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fb1ac06adb0 0x7fb1ac06d260 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00ce530 tx=0x7fb1b8011000 comp rx=0 tx=0).stop 2023-06-20T13:32:52.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.832+0000 7fb1c71ff700 1 -- 172.21.15.32:0/1496809956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1c014eb90 msgr2=0x7fb1c014dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.832+0000 7fb1c71ff700 1 --2- 172.21.15.32:0/1496809956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1c014eb90 0x7fb1c014dc20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00b50b0 tx=0x7fb1b400eb30 comp rx=0 tx=0).stop 2023-06-20T13:32:52.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.832+0000 7fb1c579c700 1 -- 172.21.15.32:0/1496809956 reap_dead start 2023-06-20T13:32:52.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.832+0000 7fb1c71ff700 1 -- 172.21.15.32:0/1496809956 shutdown_connections 2023-06-20T13:32:52.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.832+0000 7fb1c71ff700 1 -- 172.21.15.32:0/1496809956 >> 172.21.15.32:0/1496809956 conn(0x7fb1c00b4cc0 msgr2=0x7fb1c006bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:52.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.833+0000 7fb1c71ff700 1 -- 172.21.15.32:0/1496809956 shutdown_connections 2023-06-20T13:32:52.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.833+0000 7fb1c71ff700 1 -- 172.21.15.32:0/1496809956 wait complete. 2023-06-20T13:32:52.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.835+0000 7f68541ff700 1 -- 172.21.15.32:0/2832655480 --> [v2:172.21.15.115:6816/121241249,v1:172.21.15.115:6817/121241249] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6834002d40 con 0x7f6830074a80 2023-06-20T13:32:52.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.835+0000 7f68427fc700 1 -- 172.21.15.32:0/2832655480 <== osd.5 v2:172.21.15.115:6816/121241249 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6834002d40 con 0x7f6830074a80 2023-06-20T13:32:52.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.836+0000 7f68541ff700 1 -- 172.21.15.32:0/2832655480 >> [v2:172.21.15.115:6816/121241249,v1:172.21.15.115:6817/121241249] conn(0x7f6830074a80 msgr2=0x7f6830076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.836+0000 7f68541ff700 1 --2- 172.21.15.32:0/2832655480 >> [v2:172.21.15.115:6816/121241249,v1:172.21.15.115:6817/121241249] conn(0x7f6830074a80 0x7f6830076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.836+0000 7f68541ff700 1 -- 172.21.15.32:0/2832655480 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f683006adb0 msgr2=0x7f683006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.836+0000 7f68541ff700 1 --2- 172.21.15.32:0/2832655480 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f683006adb0 0x7f683006d260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f684c15a080 tx=0x7f683c006cb0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.836+0000 7f68541ff700 1 -- 172.21.15.32:0/2832655480 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f684c15f290 msgr2=0x7f684c14c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.836+0000 7f68541ff700 1 --2- 172.21.15.32:0/2832655480 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f684c15f290 0x7f684c14c210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f684800b4d0 tx=0x7f684800b7e0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.836+0000 7f685279c700 1 -- 172.21.15.32:0/2832655480 reap_dead start 2023-06-20T13:32:52.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.836+0000 7f68541ff700 1 -- 172.21.15.32:0/2832655480 shutdown_connections 2023-06-20T13:32:52.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.836+0000 7f68541ff700 1 -- 172.21.15.32:0/2832655480 >> 172.21.15.32:0/2832655480 conn(0x7f684c0d1e00 msgr2=0x7f684c14d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:52.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.837+0000 7f68541ff700 1 -- 172.21.15.32:0/2832655480 shutdown_connections 2023-06-20T13:32:52.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.837+0000 7f68541ff700 1 -- 172.21.15.32:0/2832655480 wait complete. 2023-06-20T13:32:52.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.843+0000 7fe3585ff700 1 -- 172.21.15.32:0/961120241 --> [v2:172.21.15.115:6808/555708777,v1:172.21.15.115:6809/555708777] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe3500cd300 con 0x7fe334074a00 2023-06-20T13:32:52.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.844+0000 7fe346ffd700 1 -- 172.21.15.32:0/961120241 <== osd.6 v2:172.21.15.115:6808/555708777 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe340009300 con 0x7fe334074a00 2023-06-20T13:32:52.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.845+0000 7fe3585ff700 1 -- 172.21.15.32:0/961120241 >> [v2:172.21.15.115:6808/555708777,v1:172.21.15.115:6809/555708777] conn(0x7fe334074a00 msgr2=0x7fe334076e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.845+0000 7fe3585ff700 1 --2- 172.21.15.32:0/961120241 >> [v2:172.21.15.115:6808/555708777,v1:172.21.15.115:6809/555708777] conn(0x7fe334074a00 0x7fe334076e30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.845+0000 7fe3585ff700 1 -- 172.21.15.32:0/961120241 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe33406adb0 msgr2=0x7fe33406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.845+0000 7fe3585ff700 1 --2- 172.21.15.32:0/961120241 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe33406adb0 0x7fe33406d260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe35015d6a0 tx=0x7fe34c00a000 comp rx=0 tx=0).stop 2023-06-20T13:32:52.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.845+0000 7fe3585ff700 1 -- 172.21.15.32:0/961120241 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3500ca440 msgr2=0x7fe3500ca8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.845+0000 7fe3585ff700 1 --2- 172.21.15.32:0/961120241 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3500ca440 0x7fe3500ca8c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe35008be00 tx=0x7fe34800c880 comp rx=0 tx=0).stop 2023-06-20T13:32:52.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.845+0000 7fe356b9c700 1 -- 172.21.15.32:0/961120241 reap_dead start 2023-06-20T13:32:52.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.845+0000 7fe3585ff700 1 -- 172.21.15.32:0/961120241 shutdown_connections 2023-06-20T13:32:52.883 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.845+0000 7fe3585ff700 1 -- 172.21.15.32:0/961120241 >> 172.21.15.32:0/961120241 conn(0x7fe350071660 msgr2=0x7fe350071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:52.883 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.846+0000 7fe3585ff700 1 -- 172.21.15.32:0/961120241 shutdown_connections 2023-06-20T13:32:52.883 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.846+0000 7fe3585ff700 1 -- 172.21.15.32:0/961120241 wait complete. 2023-06-20T13:32:52.883 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.858+0000 7f0032bff700 1 -- 172.21.15.32:0/1087181040 --> [v2:172.21.15.115:6823/2723705964,v1:172.21.15.115:6825/2723705964] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f002c0ccc50 con 0x7f0018074a80 2023-06-20T13:32:52.883 INFO:teuthology.orchestra.run.smithi032.stdout:60129542156 2023-06-20T13:32:52.884 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.859+0000 7f00297fa700 1 -- 172.21.15.32:0/1087181040 <== osd.7 v2:172.21.15.115:6823/2723705964 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0020011630 con 0x7f0018074a80 2023-06-20T13:32:52.885 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-06-20T13:32:52.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.859+0000 7f0032bff700 1 -- 172.21.15.32:0/1087181040 >> [v2:172.21.15.115:6823/2723705964,v1:172.21.15.115:6825/2723705964] conn(0x7f0018074a80 msgr2=0x7f0018076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.859+0000 7f0032bff700 1 --2- 172.21.15.32:0/1087181040 >> [v2:172.21.15.115:6823/2723705964,v1:172.21.15.115:6825/2723705964] conn(0x7f0018074a80 0x7f0018076eb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:52.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.860+0000 7f0032bff700 1 -- 172.21.15.32:0/1087181040 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f001806adb0 msgr2=0x7f001806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.860+0000 7f0032bff700 1 --2- 172.21.15.32:0/1087181040 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f001806adb0 0x7f001806d260 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f001c00b9b0 tx=0x7f001c008040 comp rx=0 tx=0).stop 2023-06-20T13:32:52.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.860+0000 7f0032bff700 1 -- 172.21.15.32:0/1087181040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f002c16c7e0 msgr2=0x7f002c0c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:52.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.860+0000 7f0032bff700 1 --2- 172.21.15.32:0/1087181040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f002c16c7e0 0x7f002c0c7bb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f002400caa0 tx=0x7f002400ce60 comp rx=0 tx=0).stop 2023-06-20T13:32:52.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.860+0000 7f003119c700 1 -- 172.21.15.32:0/1087181040 reap_dead start 2023-06-20T13:32:52.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.860+0000 7f0032bff700 1 -- 172.21.15.32:0/1087181040 shutdown_connections 2023-06-20T13:32:52.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.860+0000 7f0032bff700 1 -- 172.21.15.32:0/1087181040 >> 172.21.15.32:0/1087181040 conn(0x7f002c06abc0 msgr2=0x7f002c0c5890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:52.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.860+0000 7f0032bff700 1 -- 172.21.15.32:0/1087181040 shutdown_connections 2023-06-20T13:32:52.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:52.860+0000 7f0032bff700 1 -- 172.21.15.32:0/1087181040 wait complete. 2023-06-20T13:32:52.888 INFO:teuthology.orchestra.run.smithi032.stdout:55834574860 2023-06-20T13:32:52.888 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-06-20T13:32:52.889 INFO:teuthology.orchestra.run.smithi032.stdout:60129542156 2023-06-20T13:32:52.889 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-06-20T13:32:52.890 INFO:teuthology.orchestra.run.smithi032.stdout:55834574860 2023-06-20T13:32:52.891 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-20T13:32:52.892 INFO:teuthology.orchestra.run.smithi032.stdout:60129542156 2023-06-20T13:32:52.892 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-06-20T13:32:52.893 INFO:teuthology.orchestra.run.smithi032.stdout:60129542156 2023-06-20T13:32:52.894 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-06-20T13:32:53.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.292+0000 7fe017dff700 1 Processor -- start 2023-06-20T13:32:53.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.293+0000 7fe017dff700 1 -- start start 2023-06-20T13:32:53.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.295+0000 7fe017dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe010160930 0x7fe010070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.295+0000 7fe017dff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0100ccb70 con 0x7fe0100adeb0 2023-06-20T13:32:53.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.295+0000 7fe017dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe010165400 con 0x7fe0100cc390 2023-06-20T13:32:53.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.295+0000 7fe017dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe010164640 con 0x7fe010160930 2023-06-20T13:32:53.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.296+0000 7fe015b9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe010160930 0x7fe010070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.296+0000 7fe01539a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fe0100cc390 0x7fe0100ad7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.32:34236/0 (socket says 172.21.15.32:34236) 2023-06-20T13:32:53.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.296+0000 7fe01539a700 1 -- 172.21.15.32:0/2122981646 learned_addr learned my addr 172.21.15.32:0/2122981646 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:53.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.297+0000 7fe014b99700 1 -- 172.21.15.32:0/2122981646 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3736913611 0 0) 0x7fe010165400 con 0x7fe0100cc390 2023-06-20T13:32:53.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.297+0000 7fe014b99700 1 -- 172.21.15.32:0/2122981646 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdffc0035b0 con 0x7fe0100cc390 2023-06-20T13:32:53.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.297+0000 7fe015b9b700 1 -- 172.21.15.32:0/2122981646 >> v1:172.21.15.115:6789/0 conn(0x7fe0100cc390 legacy=0x7fe0100ad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.297+0000 7fe015b9b700 1 -- 172.21.15.32:0/2122981646 >> v1:172.21.15.32:6789/0 conn(0x7fe0100adeb0 legacy=0x7fe01006c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:53.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.297+0000 7fe015b9b700 1 -- 172.21.15.32:0/2122981646 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe010164920 con 0x7fe010160930 2023-06-20T13:32:53.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.298+0000 7fe015b9b700 1 --2- 172.21.15.32:0/2122981646 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe010160930 0x7fe010070a80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe000009840 tx=0x7fe000009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b32006c9aabdd7ac server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:53.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.298+0000 7fe014b99700 1 -- 172.21.15.32:0/2122981646 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe000004230 con 0x7fe010160930 2023-06-20T13:32:53.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.298+0000 7fe014b99700 1 -- 172.21.15.32:0/2122981646 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe000004390 con 0x7fe010160930 2023-06-20T13:32:53.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.298+0000 7fe014b99700 1 -- 172.21.15.32:0/2122981646 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0000036c0 con 0x7fe010160930 2023-06-20T13:32:53.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.299+0000 7fe017dff700 1 -- 172.21.15.32:0/2122981646 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe010160930 msgr2=0x7fe010070a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.299+0000 7fe017dff700 1 --2- 172.21.15.32:0/2122981646 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe010160930 0x7fe010070a80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe000009840 tx=0x7fe000009b50 comp rx=0 tx=0).stop 2023-06-20T13:32:53.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.299+0000 7fe017dff700 1 -- 172.21.15.32:0/2122981646 shutdown_connections 2023-06-20T13:32:53.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.299+0000 7fe017dff700 1 --2- 172.21.15.32:0/2122981646 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe010160930 0x7fe010070a80 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe000009840 tx=0x7fe000009b50 comp rx=0 tx=0).stop 2023-06-20T13:32:53.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.299+0000 7fe017dff700 1 -- 172.21.15.32:0/2122981646 >> 172.21.15.32:0/2122981646 conn(0x7fe0100b0390 msgr2=0x7fe0100b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:53.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.299+0000 7fa2609ff700 1 Processor -- start 2023-06-20T13:32:53.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.300+0000 7fe017dff700 1 -- 172.21.15.32:0/2122981646 shutdown_connections 2023-06-20T13:32:53.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.300+0000 7fe017dff700 1 -- 172.21.15.32:0/2122981646 wait complete. 2023-06-20T13:32:53.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.299+0000 7fa2609ff700 1 -- start start 2023-06-20T13:32:53.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.302+0000 7fa2609ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa25c0c98e0 0x7fa25c0cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.302+0000 7fa2609ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa25c0c9d80 0x7fa25c0cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.302+0000 7fa2609ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa25c0cbc20 con 0x7fa25c0b0aa0 2023-06-20T13:32:53.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.302+0000 7fa2609ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa25c0ce5d0 con 0x7fa25c0c98e0 2023-06-20T13:32:53.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.302+0000 7fa2609ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa25c0cce20 con 0x7fa25c0c9d80 2023-06-20T13:32:53.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.304+0000 7fa25a59c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa25c0b0aa0 0x7fa25c0cdec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:52864/0 (socket says 172.21.15.32:52864) 2023-06-20T13:32:53.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.304+0000 7fa25a59c700 1 -- 172.21.15.32:0/2512223959 learned_addr learned my addr 172.21.15.32:0/2512223959 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:53.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.304+0000 7fa259d9b700 1 --2- 172.21.15.32:0/2512223959 >> v2:172.21.15.32:3300/0 conn(0x7fa25c0c98e0 0x7fa25c0cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.303+0000 7fe017dff700 1 Processor -- start 2023-06-20T13:32:53.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.303+0000 7fe017dff700 1 -- start start 2023-06-20T13:32:53.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.304+0000 7fa259d9b700 1 -- 172.21.15.32:0/2512223959 >> v2:172.21.15.115:3300/0 conn(0x7fa25c0c9d80 msgr2=0x7fa25c0cb6e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-20T13:32:53.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.304+0000 7fa259d9b700 1 --2- 172.21.15.32:0/2512223959 >> v2:172.21.15.115:3300/0 conn(0x7fa25c0c9d80 0x7fa25c0cb6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.304+0000 7fa259d9b700 1 -- 172.21.15.32:0/2512223959 >> v1:172.21.15.32:6789/0 conn(0x7fa25c0b0aa0 legacy=0x7fa25c0cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.304+0000 7fa259d9b700 1 -- 172.21.15.32:0/2512223959 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25c0cd100 con 0x7fa25c0c98e0 2023-06-20T13:32:53.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.305+0000 7fa259d9b700 1 --2- 172.21.15.32:0/2512223959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa25c0c98e0 0x7fa25c0cb1a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa25c0caca0 tx=0x7fa250009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1663052224403a71 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:53.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.305+0000 7fe017dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0100adeb0 0x7fe0100c2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.306+0000 7fe017dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0100cc390 0x7fe0100c22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.306+0000 7fe017dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0100c4a00 0x7fe0101eab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.306+0000 7fe017dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0100c2810 con 0x7fe0100c4a00 2023-06-20T13:32:53.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.306+0000 7fe017dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe010158c10 con 0x7fe0100cc390 2023-06-20T13:32:53.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.306+0000 7fe017dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe010158ed0 con 0x7fe0100adeb0 2023-06-20T13:32:53.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.305+0000 7fa25959a700 1 -- 172.21.15.32:0/2512223959 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa250011830 con 0x7fa25c0c98e0 2023-06-20T13:32:53.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.305+0000 7fa25959a700 1 -- 172.21.15.32:0/2512223959 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa250011990 con 0x7fa25c0c98e0 2023-06-20T13:32:53.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.305+0000 7fa25959a700 1 -- 172.21.15.32:0/2512223959 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa250011d00 con 0x7fa25c0c98e0 2023-06-20T13:32:53.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.306+0000 7f0d10fff700 1 Processor -- start 2023-06-20T13:32:53.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.306+0000 7fa2609ff700 1 -- 172.21.15.32:0/2512223959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa25c0c98e0 msgr2=0x7fa25c0cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.306+0000 7fa2609ff700 1 --2- 172.21.15.32:0/2512223959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa25c0c98e0 0x7fa25c0cb1a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa25c0caca0 tx=0x7fa250009b20 comp rx=0 tx=0).stop 2023-06-20T13:32:53.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.307+0000 7fe01639c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0100c4a00 0x7fe0101eab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.307+0000 7fe01639c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0100c4a00 0x7fe0101eab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59156/0 (socket says 172.21.15.32:59156) 2023-06-20T13:32:53.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.307+0000 7fe01639c700 1 -- 172.21.15.32:0/3048474089 learned_addr learned my addr 172.21.15.32:0/3048474089 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:53.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.307+0000 7fa2609ff700 1 -- 172.21.15.32:0/2512223959 shutdown_connections 2023-06-20T13:32:53.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.307+0000 7fa2609ff700 1 --2- 172.21.15.32:0/2512223959 >> v2:172.21.15.115:3300/0 conn(0x7fa25c0c9d80 0x7fa25c0cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.307+0000 7fa2609ff700 1 --2- 172.21.15.32:0/2512223959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa25c0c98e0 0x7fa25c0cb1a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.307+0000 7fa2609ff700 1 -- 172.21.15.32:0/2512223959 >> 172.21.15.32:0/2512223959 conn(0x7fa25c06abc0 msgr2=0x7fa25c0b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:53.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.307+0000 7fe015b9b700 1 --2- 172.21.15.32:0/3048474089 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0100adeb0 0x7fe0100c2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.308+0000 7fe01639c700 1 -- 172.21.15.32:0/3048474089 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0100adeb0 msgr2=0x7fe0100c2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.308+0000 7fe01639c700 1 --2- 172.21.15.32:0/3048474089 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0100adeb0 0x7fe0100c2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.308+0000 7fe01639c700 1 -- 172.21.15.32:0/3048474089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0100cc390 msgr2=0x7fe0100c22d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-20T13:32:53.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.308+0000 7fe01639c700 1 --2- 172.21.15.32:0/3048474089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0100cc390 0x7fe0100c22d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.308+0000 7fe01639c700 1 -- 172.21.15.32:0/3048474089 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0000094a0 con 0x7fe0100c4a00 2023-06-20T13:32:53.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.307+0000 7fa2609ff700 1 -- 172.21.15.32:0/2512223959 shutdown_connections 2023-06-20T13:32:53.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.307+0000 7fa2609ff700 1 -- 172.21.15.32:0/2512223959 wait complete. 2023-06-20T13:32:53.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.308+0000 7fe01639c700 1 --2- 172.21.15.32:0/3048474089 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0100c4a00 0x7fe0101eab70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00b410 tx=0x7fe00c00b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:53.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.309+0000 7fe0067fc700 1 -- 172.21.15.32:0/3048474089 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c011830 con 0x7fe0100c4a00 2023-06-20T13:32:53.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.309+0000 7fe0067fc700 1 -- 172.21.15.32:0/3048474089 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00c011990 con 0x7fe0100c4a00 2023-06-20T13:32:53.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.309+0000 7fe0067fc700 1 -- 172.21.15.32:0/3048474089 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c011d40 con 0x7fe0100c4a00 2023-06-20T13:32:53.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.309+0000 7fe017dff700 1 -- 172.21.15.32:0/3048474089 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0101591b0 con 0x7fe0100c4a00 2023-06-20T13:32:53.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.309+0000 7fe017dff700 1 -- 172.21.15.32:0/3048474089 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe010159770 con 0x7fe0100c4a00 2023-06-20T13:32:53.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.310+0000 7fa2609ff700 1 Processor -- start 2023-06-20T13:32:53.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.310+0000 7fa2609ff700 1 -- start start 2023-06-20T13:32:53.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.311+0000 7fe017dff700 1 -- 172.21.15.32:0/3048474089 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff80052f0 con 0x7fe0100c4a00 2023-06-20T13:32:53.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.311+0000 7f06e2fff700 1 Processor -- start 2023-06-20T13:32:53.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.307+0000 7f0d10fff700 1 -- start start 2023-06-20T13:32:53.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.309+0000 7f0d10fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d0c0c9970 0x7f0d0c0cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.309+0000 7f0d10fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0d0c0c9d40 0x7f0d0c0cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.310+0000 7f0d10fff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d0c0cce20 con 0x7f0d0c0cb6e0 2023-06-20T13:32:53.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.310+0000 7f0d10fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d0c0cd100 con 0x7f0d0c0c9d40 2023-06-20T13:32:53.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.310+0000 7f0d10fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c0cd3e0 con 0x7f0d0c0c9970 2023-06-20T13:32:53.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.311+0000 7f0d0ad9d700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f0d0c0cb6e0 0x7f0d0c157d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:52866/0 (socket says 172.21.15.32:52866) 2023-06-20T13:32:53.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.311+0000 7f0d0ad9d700 1 -- 172.21.15.32:0/3931455542 learned_addr learned my addr 172.21.15.32:0/3931455542 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:53.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.312+0000 7f0d0a59c700 1 --2- 172.21.15.32:0/3931455542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d0c0c9970 0x7f0d0c0cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.312+0000 7f0d09d9b700 1 --2- 172.21.15.32:0/3931455542 >> v2:172.21.15.115:3300/0 conn(0x7f0d0c0c9d40 0x7f0d0c0cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.313+0000 7f0d09d9b700 1 -- 172.21.15.32:0/3931455542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d0c0c9970 msgr2=0x7f0d0c0cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:53.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.313+0000 7f0d09d9b700 1 --2- 172.21.15.32:0/3931455542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d0c0c9970 0x7f0d0c0cdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.313+0000 7f0d09d9b700 1 -- 172.21.15.32:0/3931455542 >> v1:172.21.15.32:6789/0 conn(0x7f0d0c0cb6e0 legacy=0x7f0d0c157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.313+0000 7f0d09d9b700 1 -- 172.21.15.32:0/3931455542 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0c0cd6c0 con 0x7f0d0c0c9d40 2023-06-20T13:32:53.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.312+0000 7f06e2fff700 1 -- start start 2023-06-20T13:32:53.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.313+0000 7fa2609ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa25c0b0aa0 0x7fa25c14bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.313+0000 7fa2609ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa25c0c98e0 0x7fa25c1525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.313+0000 7fa2609ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa25c0c9d80 0x7fa25c152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.313+0000 7fa2609ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c0c87b0 con 0x7fa25c0c98e0 2023-06-20T13:32:53.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.313+0000 7fa2609ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c06d4b0 con 0x7fa25c0c9d80 2023-06-20T13:32:53.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.313+0000 7fa2609ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c06cbc0 con 0x7fa25c0b0aa0 2023-06-20T13:32:53.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.314+0000 7f0d09d9b700 1 --2- 172.21.15.32:0/3931455542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d0c0c9d40 0x7f0d0c0cb1a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0d000091b0 tx=0x7f0d000094c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4935f451c5da5f4 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:53.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.314+0000 7f06e2fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f06dc0c9970 0x7f06dc0cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.314+0000 7f06e2fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06dc0c9d40 0x7f06dc158470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.314+0000 7f06e2fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06dc0cce20 con 0x7f06dc0b0aa0 2023-06-20T13:32:53.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.314+0000 7f06e2fff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06dc0cd100 con 0x7f06dc0c9970 2023-06-20T13:32:53.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.314+0000 7f06e2fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc0cd3e0 con 0x7f06dc0c9d40 2023-06-20T13:32:53.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.314+0000 7f06dbfff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f06dc0b0aa0 0x7f06dc157d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.32:34242/0 (socket says 172.21.15.32:34242) 2023-06-20T13:32:53.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.314+0000 7f06dbfff700 1 -- 172.21.15.32:0/1361521078 learned_addr learned my addr 172.21.15.32:0/1361521078 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:53.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.314+0000 7f06e159c700 1 --2- 172.21.15.32:0/1361521078 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06dc0c9d40 0x7f06dc158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.315+0000 7f06db7fe700 1 -- 172.21.15.32:0/1361521078 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 276884121 0 0) 0x7f06dc0cce20 con 0x7f06dc0b0aa0 2023-06-20T13:32:53.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.315+0000 7f06db7fe700 1 -- 172.21.15.32:0/1361521078 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06c40035b0 con 0x7f06dc0b0aa0 2023-06-20T13:32:53.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.315+0000 7f06e159c700 1 -- 172.21.15.32:0/1361521078 >> v2:172.21.15.32:3300/0 conn(0x7f06dc0c9970 msgr2=0x7f06dc0cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:53.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.315+0000 7f06e159c700 1 --2- 172.21.15.32:0/1361521078 >> v2:172.21.15.32:3300/0 conn(0x7f06dc0c9970 0x7f06dc0cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.315+0000 7f06e159c700 1 -- 172.21.15.32:0/1361521078 >> v1:172.21.15.115:6789/0 conn(0x7f06dc0b0aa0 legacy=0x7f06dc157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.315+0000 7f06db7fe700 1 -- 172.21.15.32:0/1361521078 <== mon.1 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3008888823 0 0) 0x7f06c40035b0 con 0x7f06dc0b0aa0 2023-06-20T13:32:53.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.315+0000 7f06e159c700 1 -- 172.21.15.32:0/1361521078 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc0cd6c0 con 0x7f06dc0c9d40 2023-06-20T13:32:53.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.316+0000 7f06e159c700 1 --2- 172.21.15.32:0/1361521078 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06dc0c9d40 0x7f06dc158470 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009840 tx=0x7f06d0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9af3ec4b9c6f9c75 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:53.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.316+0000 7f7f439ff700 1 Processor -- start 2023-06-20T13:32:53.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.316+0000 7f06db7fe700 1 -- 172.21.15.32:0/1361521078 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc001670 con 0x7f06dc0c9d40 2023-06-20T13:32:53.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.316+0000 7f06db7fe700 1 -- 172.21.15.32:0/1361521078 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d0004030 con 0x7f06dc0c9d40 2023-06-20T13:32:53.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.316+0000 7f06db7fe700 1 -- 172.21.15.32:0/1361521078 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d00043c0 con 0x7f06dc0c9d40 2023-06-20T13:32:53.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.317+0000 7f06e2fff700 1 -- 172.21.15.32:0/1361521078 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06dc0c9d40 msgr2=0x7f06dc158470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.317+0000 7f06e2fff700 1 --2- 172.21.15.32:0/1361521078 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06dc0c9d40 0x7f06dc158470 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009840 tx=0x7f06d0009b50 comp rx=0 tx=0).stop 2023-06-20T13:32:53.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.317+0000 7f06e2fff700 1 -- 172.21.15.32:0/1361521078 shutdown_connections 2023-06-20T13:32:53.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.317+0000 7f06e2fff700 1 --2- 172.21.15.32:0/1361521078 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06dc0c9d40 0x7f06dc158470 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.317+0000 7f06e2fff700 1 --2- 172.21.15.32:0/1361521078 >> v2:172.21.15.32:3300/0 conn(0x7f06dc0c9970 0x7f06dc0cdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.317+0000 7f06e2fff700 1 -- 172.21.15.32:0/1361521078 >> 172.21.15.32:0/1361521078 conn(0x7f06dc06abc0 msgr2=0x7f06dc0b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:53.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.318+0000 7f06e2fff700 1 -- 172.21.15.32:0/1361521078 shutdown_connections 2023-06-20T13:32:53.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.318+0000 7f06e2fff700 1 -- 172.21.15.32:0/1361521078 wait complete. 2023-06-20T13:32:53.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.318+0000 7f0d0959a700 1 -- 172.21.15.32:0/3931455542 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0000c900 con 0x7f0d0c0c9d40 2023-06-20T13:32:53.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.318+0000 7f0d0959a700 1 -- 172.21.15.32:0/3931455542 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0000ca60 con 0x7f0d0c0c9d40 2023-06-20T13:32:53.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.318+0000 7f0d0959a700 1 -- 172.21.15.32:0/3931455542 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0000cdf0 con 0x7f0d0c0c9d40 2023-06-20T13:32:53.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.317+0000 7fa25a59c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa25c0b0aa0 0x7fa25c14bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.317+0000 7fa25a59c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa25c0b0aa0 0x7fa25c14bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.32:35464/0 (socket says 172.21.15.32:35464) 2023-06-20T13:32:53.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.317+0000 7fa25a59c700 1 -- 172.21.15.32:0/3553265959 learned_addr learned my addr 172.21.15.32:0/3553265959 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:53.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.318+0000 7fa259d9b700 1 --2- 172.21.15.32:0/3553265959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa25c0c98e0 0x7fa25c1525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.320+0000 7fa25ad9d700 1 --2- 172.21.15.32:0/3553265959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa25c0c9d80 0x7fa25c152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.319+0000 7f0d10fff700 1 -- 172.21.15.32:0/3931455542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d0c0c9d40 msgr2=0x7f0d0c0cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.319+0000 7f0d10fff700 1 --2- 172.21.15.32:0/3931455542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d0c0c9d40 0x7f0d0c0cb1a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0d000091b0 tx=0x7f0d000094c0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.316+0000 7f7f439ff700 1 -- start start 2023-06-20T13:32:53.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.318+0000 7f7f439ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7f3c070a80 0x7f7f3c0ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.318+0000 7f7f439ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7f3c0adce0 0x7f7f3c06c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.318+0000 7f7f439ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f3c0ccb70 con 0x7f7f3c160930 2023-06-20T13:32:53.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.318+0000 7f7f439ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f3c0ae160 con 0x7f7f3c0adce0 2023-06-20T13:32:53.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.319+0000 7f7f439ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f3c165400 con 0x7f7f3c070a80 2023-06-20T13:32:53.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.319+0000 7f7f41f9c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7f3c0adce0 0x7f7f3c06c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.320+0000 7f7f41f9c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f7f3c0adce0 0x7f7f3c06c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59170/0 (socket says 172.21.15.32:59170) 2023-06-20T13:32:53.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.320+0000 7f7f41f9c700 1 -- 172.21.15.32:0/2216300085 learned_addr learned my addr 172.21.15.32:0/2216300085 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:53.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.320+0000 7fa259d9b700 1 -- 172.21.15.32:0/3553265959 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa25c0b0aa0 msgr2=0x7fa25c14bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.320+0000 7fa259d9b700 1 --2- 172.21.15.32:0/3553265959 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa25c0b0aa0 0x7fa25c14bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.320+0000 7fa259d9b700 1 -- 172.21.15.32:0/3553265959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa25c0c9d80 msgr2=0x7fa25c152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.320+0000 7fa259d9b700 1 --2- 172.21.15.32:0/3553265959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa25c0c9d80 0x7fa25c152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.320+0000 7fa259d9b700 1 -- 172.21.15.32:0/3553265959 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2500094a0 con 0x7fa25c0c98e0 2023-06-20T13:32:53.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.320+0000 7f0d10fff700 1 -- 172.21.15.32:0/3931455542 shutdown_connections 2023-06-20T13:32:53.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.320+0000 7f0d10fff700 1 --2- 172.21.15.32:0/3931455542 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d0c0c9970 0x7f0d0c0cdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.320+0000 7f0d10fff700 1 --2- 172.21.15.32:0/3931455542 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d0c0c9d40 0x7f0d0c0cb1a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.320+0000 7f0d10fff700 1 -- 172.21.15.32:0/3931455542 >> 172.21.15.32:0/3931455542 conn(0x7f0d0c06abc0 msgr2=0x7f0d0c0b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:53.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.321+0000 7f06e2fff700 1 Processor -- start 2023-06-20T13:32:53.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.320+0000 7f7f40f9a700 1 --2- 172.21.15.32:0/2216300085 >> v2:172.21.15.115:3300/0 conn(0x7f7f3c070a80 0x7f7f3c0ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.320+0000 7f7f41f9c700 1 -- 172.21.15.32:0/2216300085 >> v2:172.21.15.115:3300/0 conn(0x7f7f3c070a80 msgr2=0x7f7f3c0ad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:53.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.320+0000 7f7f41f9c700 1 --2- 172.21.15.32:0/2216300085 >> v2:172.21.15.115:3300/0 conn(0x7f7f3c070a80 0x7f7f3c0ad7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.320+0000 7f7f2ffff700 1 -- 172.21.15.32:0/2216300085 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3337195005 0 0) 0x7f7f3c0ccb70 con 0x7f7f3c160930 2023-06-20T13:32:53.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.320+0000 7f7f41f9c700 1 -- 172.21.15.32:0/2216300085 >> v1:172.21.15.115:6789/0 conn(0x7f7f3c160930 legacy=0x7f7f3c0cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.320+0000 7f7f41f9c700 1 -- 172.21.15.32:0/2216300085 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3c164640 con 0x7f7f3c0adce0 2023-06-20T13:32:53.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.321+0000 7f7f40f9a700 1 --2- 172.21.15.32:0/2216300085 >> v2:172.21.15.115:3300/0 conn(0x7f7f3c070a80 0x7f7f3c0ad7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:32:53.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.321+0000 7f06e2fff700 1 -- start start 2023-06-20T13:32:53.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.321+0000 7f0d10fff700 1 -- 172.21.15.32:0/3931455542 shutdown_connections 2023-06-20T13:32:53.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.321+0000 7f7f41f9c700 1 --2- 172.21.15.32:0/2216300085 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f3c0adce0 0x7f7f3c06c340 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c06fd50 tx=0x7f7f3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9adec9dac98833 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:53.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.321+0000 7fa259d9b700 1 --2- 172.21.15.32:0/3553265959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa25c0c98e0 0x7fa25c1525f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa25c0cc560 tx=0x7fa250004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:53.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.318+0000 7fe0067fc700 1 -- 172.21.15.32:0/3048474089 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe00c01a400 con 0x7fe0100c4a00 2023-06-20T13:32:53.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.321+0000 7f0d10fff700 1 -- 172.21.15.32:0/3931455542 wait complete. 2023-06-20T13:32:53.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.322+0000 7f06e2fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06dc0b0aa0 0x7f06dc156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.322+0000 7f06e2fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06dc0c9970 0x7f06dc167530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.323+0000 7f06e2fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06dc0c9d40 0x7f06dc0c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.323+0000 7f06e2fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc1573d0 con 0x7f06dc0b0aa0 2023-06-20T13:32:53.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.323+0000 7f06e2fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc0b1aa0 con 0x7f06dc0c9970 2023-06-20T13:32:53.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.323+0000 7f06e2fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc0b3f80 con 0x7f06dc0c9d40 2023-06-20T13:32:53.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.323+0000 7f06dbfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06dc0c9970 0x7f06dc167530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.323+0000 7f06dbfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06dc0c9970 0x7f06dc167530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:46038/0 (socket says 172.21.15.32:46038) 2023-06-20T13:32:53.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.323+0000 7f06dbfff700 1 -- 172.21.15.32:0/2660827708 learned_addr learned my addr 172.21.15.32:0/2660827708 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:53.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.322+0000 7f7f2ffff700 1 -- 172.21.15.32:0/2216300085 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3400e070 con 0x7f7f3c0adce0 2023-06-20T13:32:53.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.322+0000 7f7f2ffff700 1 -- 172.21.15.32:0/2216300085 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3400b9c0 con 0x7f7f3c0adce0 2023-06-20T13:32:53.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.322+0000 7f7f2ffff700 1 -- 172.21.15.32:0/2216300085 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3400bd70 con 0x7f7f3c0adce0 2023-06-20T13:32:53.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.321+0000 7f9d337ff700 1 Processor -- start 2023-06-20T13:32:53.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.322+0000 7f9d337ff700 1 -- start start 2023-06-20T13:32:53.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.324+0000 7f06e159c700 1 --2- 172.21.15.32:0/2660827708 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06dc0c9d40 0x7f06dc0c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.324+0000 7f06dbfff700 1 -- 172.21.15.32:0/2660827708 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06dc0c9d40 msgr2=0x7f06dc0c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.324+0000 7f06dbfff700 1 --2- 172.21.15.32:0/2660827708 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06dc0c9d40 0x7f06dc0c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.324+0000 7f06dbfff700 1 -- 172.21.15.32:0/2660827708 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06dc0b0aa0 msgr2=0x7f06dc156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.324+0000 7f06dbfff700 1 --2- 172.21.15.32:0/2660827708 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06dc0b0aa0 0x7f06dc156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.324+0000 7f06dbfff700 1 -- 172.21.15.32:0/2660827708 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d00094a0 con 0x7f06dc0c9970 2023-06-20T13:32:53.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.323+0000 7fa24affd700 1 -- 172.21.15.32:0/3553265959 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2500036a0 con 0x7fa25c0c98e0 2023-06-20T13:32:53.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.323+0000 7fa24affd700 1 -- 172.21.15.32:0/3553265959 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25001f070 con 0x7fa25c0c98e0 2023-06-20T13:32:53.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.323+0000 7fa24affd700 1 -- 172.21.15.32:0/3553265959 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa250003a60 con 0x7fa25c0c98e0 2023-06-20T13:32:53.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.323+0000 7fa2609ff700 1 -- 172.21.15.32:0/3553265959 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa25c06ce60 con 0x7fa25c0c98e0 2023-06-20T13:32:53.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.323+0000 7fa2609ff700 1 -- 172.21.15.32:0/3553265959 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25c0c2f20 con 0x7fa25c0c98e0 2023-06-20T13:32:53.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.324+0000 7f0d10fff700 1 Processor -- start 2023-06-20T13:32:53.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.324+0000 7f7f439ff700 1 -- 172.21.15.32:0/2216300085 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f3c0adce0 msgr2=0x7f7f3c06c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.324+0000 7f7f439ff700 1 --2- 172.21.15.32:0/2216300085 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f3c0adce0 0x7f7f3c06c340 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c06fd50 tx=0x7f7f3400b330 comp rx=0 tx=0).stop 2023-06-20T13:32:53.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.325+0000 7f06dbfff700 1 --2- 172.21.15.32:0/2660827708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06dc0c9970 0x7f06dc167530 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f06cc00c750 tx=0x7f06cc00cb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:53.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.324+0000 7f7f439ff700 1 -- 172.21.15.32:0/2216300085 shutdown_connections 2023-06-20T13:32:53.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.324+0000 7f7f439ff700 1 --2- 172.21.15.32:0/2216300085 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f3c0adce0 0x7f7f3c06c340 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.324+0000 7f7f439ff700 1 --2- 172.21.15.32:0/2216300085 >> v2:172.21.15.115:3300/0 conn(0x7f7f3c070a80 0x7f7f3c0ad7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.325+0000 7f7f439ff700 1 -- 172.21.15.32:0/2216300085 >> 172.21.15.32:0/2216300085 conn(0x7f7f3c0b0390 msgr2=0x7f7f3c0b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:53.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.325+0000 7f06d97fa700 1 -- 172.21.15.32:0/2660827708 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc004c80 con 0x7f06dc0c9970 2023-06-20T13:32:53.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.325+0000 7f06d97fa700 1 -- 172.21.15.32:0/2660827708 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06cc004de0 con 0x7f06dc0c9970 2023-06-20T13:32:53.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.325+0000 7f06d97fa700 1 -- 172.21.15.32:0/2660827708 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc007310 con 0x7f06dc0c9970 2023-06-20T13:32:53.342 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.325+0000 7f0d10fff700 1 -- start start 2023-06-20T13:32:53.342 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.326+0000 7fa2609ff700 1 -- 172.21.15.32:0/3553265959 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2400052f0 con 0x7fa25c0c98e0 2023-06-20T13:32:53.342 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.323+0000 7fe0067fc700 1 --2- 172.21.15.32:0/3048474089 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdff406adb0 0x7fdff406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.342 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.323+0000 7fe0067fc700 1 -- 172.21.15.32:0/3048474089 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe00c089c20 con 0x7fe0100c4a00 2023-06-20T13:32:53.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.326+0000 7f0d10fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d0c0c9970 0x7f0d0c1e4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.326+0000 7f0d10fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d0c0c9d40 0x7f0d0c14f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.326+0000 7f0d10fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d0c0cb6e0 0x7f0d0c14f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.326+0000 7f0d10fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c0c8240 con 0x7f0d0c0cb6e0 2023-06-20T13:32:53.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.326+0000 7f0d10fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c0c76c0 con 0x7f0d0c0c9970 2023-06-20T13:32:53.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.326+0000 7f0d10fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c0c79a0 con 0x7f0d0c0c9d40 2023-06-20T13:32:53.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.326+0000 7f9d337ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9d2c0d1cd0 0x7f9d2c0cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.326+0000 7f9d337ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d2c0cf3b0 con 0x7f9d2c0b8320 2023-06-20T13:32:53.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.326+0000 7f9d337ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d2c0b86f0 con 0x7f9d2c0b4cc0 2023-06-20T13:32:53.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.326+0000 7f9d337ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d2c0cf0d0 con 0x7f9d2c0d1cd0 2023-06-20T13:32:53.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.327+0000 7f0d09d9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d0c0c9d40 0x7f0d0c14f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.327+0000 7f0d09d9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d0c0c9d40 0x7f0d0c14f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.32:35480/0 (socket says 172.21.15.32:35480) 2023-06-20T13:32:53.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.327+0000 7f0d09d9b700 1 -- 172.21.15.32:0/2423636869 learned_addr learned my addr 172.21.15.32:0/2423636869 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:53.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.327+0000 7f7f439ff700 1 -- 172.21.15.32:0/2216300085 shutdown_connections 2023-06-20T13:32:53.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.327+0000 7f9d30d9a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f9d2c0b4cc0 0x7f9d2c0d0700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.32:34262/0 (socket says 172.21.15.32:34262) 2023-06-20T13:32:53.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.327+0000 7f9d30d9a700 1 -- 172.21.15.32:0/173511370 learned_addr learned my addr 172.21.15.32:0/173511370 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:53.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.326+0000 7fe0067fc700 1 -- 172.21.15.32:0/3048474089 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe00c054b00 con 0x7fe0100c4a00 2023-06-20T13:32:53.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.327+0000 7f0d09d9b700 1 -- 172.21.15.32:0/2423636869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d0c0c9970 msgr2=0x7f0d0c1e4250 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-20T13:32:53.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.327+0000 7f0d09d9b700 1 --2- 172.21.15.32:0/2423636869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d0c0c9970 0x7f0d0c1e4250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.327+0000 7f0d09d9b700 1 -- 172.21.15.32:0/2423636869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d0c0cb6e0 msgr2=0x7f0d0c14f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.327+0000 7f0d09d9b700 1 --2- 172.21.15.32:0/2423636869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d0c0cb6e0 0x7f0d0c14f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.327+0000 7f0d09d9b700 1 -- 172.21.15.32:0/2423636869 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d00009d30 con 0x7f0d0c0c9d40 2023-06-20T13:32:53.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.327+0000 7f7f439ff700 1 -- 172.21.15.32:0/2216300085 wait complete. 2023-06-20T13:32:53.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.327+0000 7f9d31d9c700 1 --2- 172.21.15.32:0/173511370 >> v2:172.21.15.115:3300/0 conn(0x7f9d2c0d1cd0 0x7f9d2c0cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.328+0000 7fe015b9b700 1 --2- 172.21.15.32:0/3048474089 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdff406adb0 0x7fdff406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.328+0000 7f06e2fff700 1 -- 172.21.15.32:0/2660827708 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06dc0b4260 con 0x7f06dc0c9970 2023-06-20T13:32:53.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.328+0000 7f06e2fff700 1 -- 172.21.15.32:0/2660827708 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06dc0b4540 con 0x7f06dc0c9970 2023-06-20T13:32:53.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.328+0000 7f9d31d9c700 1 -- 172.21.15.32:0/173511370 >> v1:172.21.15.115:6789/0 conn(0x7f9d2c0b4cc0 legacy=0x7f9d2c0d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.328+0000 7f9d23fff700 1 -- 172.21.15.32:0/173511370 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2894213762 0 0) 0x7f9d2c0cf3b0 con 0x7f9d2c0b8320 2023-06-20T13:32:53.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.329+0000 7f0d09d9b700 1 --2- 172.21.15.32:0/2423636869 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d0c0c9d40 0x7f0d0c14f380 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0d00009500 tx=0x7f0d00004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:53.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.328+0000 7f9d31d9c700 1 -- 172.21.15.32:0/173511370 >> v1:172.21.15.32:6789/0 conn(0x7f9d2c0b8320 legacy=0x7f9d2c0b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.328+0000 7f9d31d9c700 1 -- 172.21.15.32:0/173511370 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2c0d22c0 con 0x7f9d2c0d1cd0 2023-06-20T13:32:53.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.329+0000 7f0cfaffd700 1 -- 172.21.15.32:0/2423636869 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0001c070 con 0x7f0d0c0c9d40 2023-06-20T13:32:53.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.329+0000 7f0cfaffd700 1 -- 172.21.15.32:0/2423636869 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0000c040 con 0x7f0d0c0c9d40 2023-06-20T13:32:53.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.329+0000 7f0cfaffd700 1 -- 172.21.15.32:0/2423636869 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d00018bd0 con 0x7f0d0c0c9d40 2023-06-20T13:32:53.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.330+0000 7f7f439ff700 1 Processor -- start 2023-06-20T13:32:53.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.332+0000 7fe015b9b700 1 --2- 172.21.15.32:0/3048474089 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdff406adb0 0x7fdff406d260 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe0100ae2d0 tx=0x7fe000010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:53.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.331+0000 7f9d31d9c700 1 --2- 172.21.15.32:0/173511370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d2c0d1cd0 0x7f9d2c0cd4f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0097c0 tx=0x7f9d1c009ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47e3a9e647c11ed2 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:53.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.332+0000 7f0d10fff700 1 -- 172.21.15.32:0/2423636869 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d0c0c7c80 con 0x7f0d0c0c9d40 2023-06-20T13:32:53.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.332+0000 7f9d23fff700 1 -- 172.21.15.32:0/173511370 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c004230 con 0x7f9d2c0d1cd0 2023-06-20T13:32:53.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.332+0000 7f9d23fff700 1 -- 172.21.15.32:0/173511370 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c004390 con 0x7f9d2c0d1cd0 2023-06-20T13:32:53.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.332+0000 7f9d23fff700 1 -- 172.21.15.32:0/173511370 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c0036a0 con 0x7f9d2c0d1cd0 2023-06-20T13:32:53.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.329+0000 7fa24affd700 1 -- 172.21.15.32:0/3553265959 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa250003bc0 con 0x7fa25c0c98e0 2023-06-20T13:32:53.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.331+0000 7fa24affd700 1 --2- 172.21.15.32:0/3553265959 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa23c06ad30 0x7fa23c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.331+0000 7fa24affd700 1 -- 172.21.15.32:0/3553265959 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa250021070 con 0x7fa25c0c98e0 2023-06-20T13:32:53.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.332+0000 7fa25a59c700 1 --2- 172.21.15.32:0/3553265959 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa23c06ad30 0x7fa23c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.332+0000 7f0d10fff700 1 -- 172.21.15.32:0/2423636869 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d0c1e4790 con 0x7f0d0c0c9d40 2023-06-20T13:32:53.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.333+0000 7f9d337ff700 1 -- 172.21.15.32:0/173511370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d2c0d1cd0 msgr2=0x7f9d2c0cd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.333+0000 7f9d337ff700 1 --2- 172.21.15.32:0/173511370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d2c0d1cd0 0x7f9d2c0cd4f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0097c0 tx=0x7f9d1c009ad0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.334+0000 7f7ca4fff700 1 Processor -- start 2023-06-20T13:32:53.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.334+0000 7fa25a59c700 1 --2- 172.21.15.32:0/3553265959 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa23c06ad30 0x7fa23c06d1e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa24c005c90 tx=0x7fa24c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:53.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.332+0000 7f7f439ff700 1 -- start start 2023-06-20T13:32:53.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.333+0000 7f7f439ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f3c070a80 0x7f7f3c143910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.333+0000 7f7f439ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f3c0adce0 0x7f7f3c151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.333+0000 7f7f439ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f3c160930 0x7f7f3c14cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.333+0000 7f7f439ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c0c39a0 con 0x7f7f3c0adce0 2023-06-20T13:32:53.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.333+0000 7f7f439ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c161e80 con 0x7f7f3c070a80 2023-06-20T13:32:53.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.333+0000 7f7f439ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c162160 con 0x7f7f3c160930 2023-06-20T13:32:53.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.334+0000 7f7f4179b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f3c070a80 0x7f7f3c143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.334+0000 7f7f4179b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f3c070a80 0x7f7f3c143910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:46052/0 (socket says 172.21.15.32:46052) 2023-06-20T13:32:53.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.334+0000 7f7f4179b700 1 -- 172.21.15.32:0/491408726 learned_addr learned my addr 172.21.15.32:0/491408726 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:53.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.334+0000 7f7f41f9c700 1 --2- 172.21.15.32:0/491408726 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f3c160930 0x7f7f3c14cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.335+0000 7f9d337ff700 1 -- 172.21.15.32:0/173511370 shutdown_connections 2023-06-20T13:32:53.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.335+0000 7f9d337ff700 1 --2- 172.21.15.32:0/173511370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d2c0d1cd0 0x7f9d2c0cd4f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.335+0000 7f9d337ff700 1 -- 172.21.15.32:0/173511370 >> 172.21.15.32:0/173511370 conn(0x7f9d2c0722b0 msgr2=0x7f9d2c0cf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:53.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.335+0000 7f7f4179b700 1 -- 172.21.15.32:0/491408726 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f3c160930 msgr2=0x7f7f3c14cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.335+0000 7f7f4179b700 1 --2- 172.21.15.32:0/491408726 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f3c160930 0x7f7f3c14cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.335+0000 7f7f4179b700 1 -- 172.21.15.32:0/491408726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f3c0adce0 msgr2=0x7f7f3c151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.335+0000 7f7f4179b700 1 --2- 172.21.15.32:0/491408726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f3c0adce0 0x7f7f3c151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.335+0000 7f7f4179b700 1 -- 172.21.15.32:0/491408726 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f34009b30 con 0x7f7f3c070a80 2023-06-20T13:32:53.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.335+0000 7f7f4179b700 1 --2- 172.21.15.32:0/491408726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f3c070a80 0x7f7f3c143910 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7f38001eb0 tx=0x7f7f3800c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:53.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.333+0000 7f06e2fff700 1 -- 172.21.15.32:0/2660827708 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06dc04ea60 con 0x7f06dc0c9970 2023-06-20T13:32:53.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.334+0000 7f06d97fa700 1 -- 172.21.15.32:0/2660827708 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f06cc007470 con 0x7f06dc0c9970 2023-06-20T13:32:53.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.334+0000 7f7ca4fff700 1 -- start start 2023-06-20T13:32:53.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.336+0000 7f0d10fff700 1 -- 172.21.15.32:0/2423636869 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d0c0b1720 con 0x7f0d0c0c9d40 2023-06-20T13:32:53.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.336+0000 7f06d97fa700 1 --2- 172.21.15.32:0/2660827708 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f06c806adb0 0x7f06c806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.336+0000 7f06d97fa700 1 -- 172.21.15.32:0/2660827708 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f06cc089610 con 0x7f06dc0c9970 2023-06-20T13:32:53.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.337+0000 7f9d337ff700 1 -- 172.21.15.32:0/173511370 shutdown_connections 2023-06-20T13:32:53.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.337+0000 7f7ca4fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7ca00c9d80 0x7f7ca00cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.337+0000 7f7ca4fff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca00ce5d0 con 0x7f7ca00b0aa0 2023-06-20T13:32:53.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.337+0000 7f7ca4fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca00cce20 con 0x7f7ca00c98e0 2023-06-20T13:32:53.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.337+0000 7f7ca4fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca00cd100 con 0x7f7ca00c9d80 2023-06-20T13:32:53.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.337+0000 7f7c9e59c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f7ca00b0aa0 0x7f7ca00cdec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:52874/0 (socket says 172.21.15.32:52874) 2023-06-20T13:32:53.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.337+0000 7f7c9e59c700 1 -- 172.21.15.32:0/2401513878 learned_addr learned my addr 172.21.15.32:0/2401513878 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:53.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.337+0000 7f7c9dd9b700 1 --1- 172.21.15.32:0/2401513878 >> v1:172.21.15.115:6789/0 conn(0x7f7ca00c98e0 0x7f7ca00cb1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.32:34276/0 (socket says 172.21.15.32:34276) 2023-06-20T13:32:53.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.338+0000 7f7c9ed9d700 1 --2- 172.21.15.32:0/2401513878 >> v2:172.21.15.115:3300/0 conn(0x7f7ca00c9d80 0x7f7ca00cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.338+0000 7fa24affd700 1 -- 172.21.15.32:0/3553265959 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa250055e00 con 0x7fa25c0c98e0 2023-06-20T13:32:53.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.337+0000 7f9d337ff700 1 -- 172.21.15.32:0/173511370 wait complete. 2023-06-20T13:32:53.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.338+0000 7f06e0d9b700 1 --2- 172.21.15.32:0/2660827708 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f06c806adb0 0x7f06c806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.338+0000 7f0cfaffd700 1 -- 172.21.15.32:0/2423636869 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0d00018d30 con 0x7f0d0c0c9d40 2023-06-20T13:32:53.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.338+0000 7f7c9ed9d700 1 -- 172.21.15.32:0/2401513878 >> v1:172.21.15.115:6789/0 conn(0x7f7ca00c98e0 legacy=0x7f7ca00cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.338+0000 7f7c9ed9d700 1 -- 172.21.15.32:0/2401513878 >> v1:172.21.15.32:6789/0 conn(0x7f7ca00b0aa0 legacy=0x7f7ca00cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.338+0000 7f7c9ed9d700 1 -- 172.21.15.32:0/2401513878 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca00cd3e0 con 0x7f7ca00c9d80 2023-06-20T13:32:53.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.338+0000 7f7c9d59a700 1 -- 172.21.15.32:0/2401513878 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3607387034 0 0) 0x7f7ca00ce5d0 con 0x7f7ca00b0aa0 2023-06-20T13:32:53.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.339+0000 7f7c9ed9d700 1 --2- 172.21.15.32:0/2401513878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ca00c9d80 0x7f7ca00cb8b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7c98009d90 tx=0x7f7c9800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75bc7f06fd7f0e09 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:53.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.339+0000 7f06e0d9b700 1 --2- 172.21.15.32:0/2660827708 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f06c806adb0 0x7f06c806d260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f06d400ab90 tx=0x7f06d4009250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:53.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.339+0000 7f0cfaffd700 1 --2- 172.21.15.32:0/2423636869 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f0cec06ad80 0x7f0cec06d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.340+0000 7f0cfaffd700 1 -- 172.21.15.32:0/2423636869 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0d0008a9b0 con 0x7f0d0c0c9d40 2023-06-20T13:32:53.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.340+0000 7f9d337ff700 1 Processor -- start 2023-06-20T13:32:53.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.340+0000 7f0d0a59c700 1 --2- 172.21.15.32:0/2423636869 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f0cec06ad80 0x7f0cec06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.340+0000 7f9d337ff700 1 -- start start 2023-06-20T13:32:53.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.341+0000 7f0d0a59c700 1 --2- 172.21.15.32:0/2423636869 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f0cec06ad80 0x7f0cec06d230 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc009770 tx=0x7f0cfc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:53.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.341+0000 7f06d97fa700 1 -- 172.21.15.32:0/2660827708 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f06cc0543b0 con 0x7f06dc0c9970 2023-06-20T13:32:53.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.341+0000 7f9d337ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d2c0b8320 0x7f9d2c1599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.341+0000 7f9d337ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d2c0d1cd0 0x7f9d2c1e8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.342+0000 7f9d337ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d2c0d06c0 0x7f9d2c0d0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.342+0000 7f9d337ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c0d1080 con 0x7f9d2c0d1cd0 2023-06-20T13:32:53.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.342+0000 7f9d337ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c1e7360 con 0x7f9d2c0d06c0 2023-06-20T13:32:53.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.342+0000 7f9d337ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c1e7640 con 0x7f9d2c0b8320 2023-06-20T13:32:53.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.340+0000 7f7c9d59a700 1 -- 172.21.15.32:0/2401513878 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9800e070 con 0x7f7ca00c9d80 2023-06-20T13:32:53.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.340+0000 7f7c9d59a700 1 -- 172.21.15.32:0/2401513878 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9800bbd0 con 0x7f7ca00c9d80 2023-06-20T13:32:53.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.340+0000 7f7c9d59a700 1 -- 172.21.15.32:0/2401513878 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c98012430 con 0x7f7ca00c9d80 2023-06-20T13:32:53.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.341+0000 7f7ca4fff700 1 -- 172.21.15.32:0/2401513878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ca00c9d80 msgr2=0x7f7ca00cb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.341+0000 7f7ca4fff700 1 --2- 172.21.15.32:0/2401513878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ca00c9d80 0x7f7ca00cb8b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7c98009d90 tx=0x7f7c9800b330 comp rx=0 tx=0).stop 2023-06-20T13:32:53.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.342+0000 7f7ca4fff700 1 -- 172.21.15.32:0/2401513878 shutdown_connections 2023-06-20T13:32:53.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.342+0000 7f7ca4fff700 1 --2- 172.21.15.32:0/2401513878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ca00c9d80 0x7f7ca00cb8b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.342+0000 7f7ca4fff700 1 -- 172.21.15.32:0/2401513878 >> 172.21.15.32:0/2401513878 conn(0x7f7ca006abc0 msgr2=0x7f7ca00b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:53.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.342+0000 7f9d31d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d2c0d06c0 0x7f9d2c0d0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.342+0000 7f9d31d9c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d2c0d06c0 0x7f9d2c0d0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:46076/0 (socket says 172.21.15.32:46076) 2023-06-20T13:32:53.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.342+0000 7f9d31d9c700 1 -- 172.21.15.32:0/262295763 learned_addr learned my addr 172.21.15.32:0/262295763 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:53.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.343+0000 7f9d3159b700 1 --2- 172.21.15.32:0/262295763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d2c0b8320 0x7f9d2c1599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.341+0000 7f7f2dffb700 1 -- 172.21.15.32:0/491408726 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f380054e0 con 0x7f7f3c070a80 2023-06-20T13:32:53.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.341+0000 7f7f2dffb700 1 -- 172.21.15.32:0/491408726 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f38003680 con 0x7f7f3c070a80 2023-06-20T13:32:53.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.341+0000 7f7f2dffb700 1 -- 172.21.15.32:0/491408726 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f380039f0 con 0x7f7f3c070a80 2023-06-20T13:32:53.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.341+0000 7f7f439ff700 1 -- 172.21.15.32:0/491408726 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f3c162440 con 0x7f7f3c070a80 2023-06-20T13:32:53.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.342+0000 7f7f439ff700 1 -- 172.21.15.32:0/491408726 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f3c143e50 con 0x7f7f3c070a80 2023-06-20T13:32:53.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.343+0000 7f9d31d9c700 1 -- 172.21.15.32:0/262295763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d2c0b8320 msgr2=0x7f9d2c1599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.343+0000 7f9d31d9c700 1 --2- 172.21.15.32:0/262295763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d2c0b8320 0x7f9d2c1599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.343+0000 7f9d31d9c700 1 -- 172.21.15.32:0/262295763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d2c0d1cd0 msgr2=0x7f9d2c1e8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.343+0000 7f9d31d9c700 1 --2- 172.21.15.32:0/262295763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d2c0d1cd0 0x7f9d2c1e8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.343+0000 7f9d31d9c700 1 -- 172.21.15.32:0/262295763 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c0094a0 con 0x7f9d2c0d06c0 2023-06-20T13:32:53.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.343+0000 7f7f439ff700 1 -- 172.21.15.32:0/491408726 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f3c162960 con 0x7f7f3c070a80 2023-06-20T13:32:53.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.344+0000 7f9d31d9c700 1 --2- 172.21.15.32:0/262295763 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d2c0d06c0 0x7f9d2c0d0b40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c08ba00 tx=0x7f9d1c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:53.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.344+0000 7f7ca4fff700 1 -- 172.21.15.32:0/2401513878 shutdown_connections 2023-06-20T13:32:53.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.344+0000 7f7ca4fff700 1 -- 172.21.15.32:0/2401513878 wait complete. 2023-06-20T13:32:53.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.344+0000 7f9d21ffb700 1 -- 172.21.15.32:0/262295763 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c003d70 con 0x7f9d2c0d06c0 2023-06-20T13:32:53.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.344+0000 7f9d21ffb700 1 -- 172.21.15.32:0/262295763 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c01f070 con 0x7f9d2c0d06c0 2023-06-20T13:32:53.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.344+0000 7f9d21ffb700 1 -- 172.21.15.32:0/262295763 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c011870 con 0x7f9d2c0d06c0 2023-06-20T13:32:53.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.344+0000 7f9d337ff700 1 -- 172.21.15.32:0/262295763 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d2c1e7920 con 0x7f9d2c0d06c0 2023-06-20T13:32:53.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.346+0000 7f0cfaffd700 1 -- 172.21.15.32:0/2423636869 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0d0c0b1720 con 0x7f0d0c0c9d40 2023-06-20T13:32:53.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.346+0000 7f7f2dffb700 1 -- 172.21.15.32:0/491408726 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7f38003b50 con 0x7f7f3c070a80 2023-06-20T13:32:53.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.347+0000 7f7f2dffb700 1 --2- 172.21.15.32:0/491408726 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f7f2006adb0 0x7f7f2006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.347+0000 7f7f2dffb700 1 -- 172.21.15.32:0/491408726 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7f38088ad0 con 0x7f7f3c070a80 2023-06-20T13:32:53.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.348+0000 7f7f40f9a700 1 --2- 172.21.15.32:0/491408726 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f7f2006adb0 0x7f7f2006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.350+0000 7f7f40f9a700 1 --2- 172.21.15.32:0/491408726 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f7f2006adb0 0x7f7f2006d260 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7f30006fd0 tx=0x7f7f30008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:53.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.352+0000 7f7f2dffb700 1 -- 172.21.15.32:0/491408726 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7f3c162960 con 0x7f7f3c070a80 2023-06-20T13:32:53.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.344+0000 7f9d337ff700 1 -- 172.21.15.32:0/262295763 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2c1e7ee0 con 0x7f9d2c0d06c0 2023-06-20T13:32:53.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.348+0000 7f9d21ffb700 1 -- 172.21.15.32:0/262295763 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9d1c021030 con 0x7f9d2c0d06c0 2023-06-20T13:32:53.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.350+0000 7f9d21ffb700 1 --2- 172.21.15.32:0/262295763 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f9d1006adb0 0x7f9d1006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.350+0000 7f9d21ffb700 1 -- 172.21.15.32:0/262295763 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9d1c08aba0 con 0x7f9d2c0d06c0 2023-06-20T13:32:53.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.351+0000 7f9d3159b700 1 --2- 172.21.15.32:0/262295763 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f9d1006adb0 0x7f9d1006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.352+0000 7f9d3159b700 1 --2- 172.21.15.32:0/262295763 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f9d1006adb0 0x7f9d1006d260 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9d28000f60 tx=0x7f9d28009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:53.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.347+0000 7f7ca4fff700 1 Processor -- start 2023-06-20T13:32:53.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.347+0000 7f7ca4fff700 1 -- start start 2023-06-20T13:32:53.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.349+0000 7f7ca4fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ca00b0aa0 0x7f7ca0158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.349+0000 7f7ca4fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ca00c98e0 0x7f7ca00b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.349+0000 7f7ca4fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ca00c9d80 0x7f7ca00b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.349+0000 7f7ca4fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00ae9c0 con 0x7f7ca00b0aa0 2023-06-20T13:32:53.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.349+0000 7f7ca4fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00aeca0 con 0x7f7ca00c9d80 2023-06-20T13:32:53.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.349+0000 7f7ca4fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00aef80 con 0x7f7ca00c98e0 2023-06-20T13:32:53.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.350+0000 7f7c9ed9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ca00c9d80 0x7f7ca00b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.350+0000 7f7c9ed9d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ca00c9d80 0x7f7ca00b3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:46078/0 (socket says 172.21.15.32:46078) 2023-06-20T13:32:53.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.350+0000 7f7c9ed9d700 1 -- 172.21.15.32:0/2594061225 learned_addr learned my addr 172.21.15.32:0/2594061225 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:53.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.350+0000 7f7c9dd9b700 1 --2- 172.21.15.32:0/2594061225 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ca00c98e0 0x7f7ca00b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.350+0000 7f7c9e59c700 1 --2- 172.21.15.32:0/2594061225 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ca00b0aa0 0x7f7ca0158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.351+0000 7f7c9dd9b700 1 -- 172.21.15.32:0/2594061225 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ca00c9d80 msgr2=0x7f7ca00b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.351+0000 7f7c9dd9b700 1 --2- 172.21.15.32:0/2594061225 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ca00c9d80 0x7f7ca00b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.351+0000 7f7c9dd9b700 1 -- 172.21.15.32:0/2594061225 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ca00b0aa0 msgr2=0x7f7ca0158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.351+0000 7f7c9dd9b700 1 --2- 172.21.15.32:0/2594061225 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ca00b0aa0 0x7f7ca0158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.351+0000 7f7c9dd9b700 1 -- 172.21.15.32:0/2594061225 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c98009a70 con 0x7f7ca00c98e0 2023-06-20T13:32:53.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.352+0000 7f7c9dd9b700 1 --2- 172.21.15.32:0/2594061225 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ca00c98e0 0x7f7ca00b1fa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400c450 tx=0x7f7c9400c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:53.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.353+0000 7ff166fff700 1 Processor -- start 2023-06-20T13:32:53.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.353+0000 7ff166fff700 1 -- start start 2023-06-20T13:32:53.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.353+0000 7f7c8effd700 1 -- 172.21.15.32:0/2594061225 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c94005cb0 con 0x7f7ca00c98e0 2023-06-20T13:32:53.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.353+0000 7f7c8effd700 1 -- 172.21.15.32:0/2594061225 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c94005e10 con 0x7f7ca00c98e0 2023-06-20T13:32:53.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.353+0000 7f7c8effd700 1 -- 172.21.15.32:0/2594061225 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c940072d0 con 0x7f7ca00c98e0 2023-06-20T13:32:53.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.353+0000 7f7ca4fff700 1 -- 172.21.15.32:0/2594061225 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca0149ed0 con 0x7f7ca00c98e0 2023-06-20T13:32:53.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.353+0000 7f7ca4fff700 1 -- 172.21.15.32:0/2594061225 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca00ae5e0 con 0x7f7ca00c98e0 2023-06-20T13:32:53.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.355+0000 7f9d337ff700 1 -- 172.21.15.32:0/262295763 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d0c0052f0 con 0x7f9d2c0d06c0 2023-06-20T13:32:53.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.355+0000 7f7ca4fff700 1 -- 172.21.15.32:0/2594061225 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca004ea60 con 0x7f7ca00c98e0 2023-06-20T13:32:53.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.355+0000 7ff166fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff1600c9970 0x7ff1600cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.355+0000 7ff166fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1600c9d40 0x7ff1600cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.355+0000 7ff166fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1600cce20 con 0x7ff1600cb6e0 2023-06-20T13:32:53.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.355+0000 7ff166fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1600cd100 con 0x7ff1600c9970 2023-06-20T13:32:53.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.355+0000 7ff166fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1600cd3e0 con 0x7ff1600c9d40 2023-06-20T13:32:53.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.356+0000 7ff16559c700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7ff1600cb6e0 0x7ff160157d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.32:34290/0 (socket says 172.21.15.32:34290) 2023-06-20T13:32:53.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.356+0000 7ff16559c700 1 -- 172.21.15.32:0/3413061761 learned_addr learned my addr 172.21.15.32:0/3413061761 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:53.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.356+0000 7ff164d9b700 1 --2- 172.21.15.32:0/3413061761 >> v2:172.21.15.115:3300/0 conn(0x7ff1600c9970 0x7ff1600cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.356+0000 7ff15ffff700 1 --2- 172.21.15.32:0/3413061761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1600c9d40 0x7ff1600cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.357+0000 7ff164d9b700 1 -- 172.21.15.32:0/3413061761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1600c9d40 msgr2=0x7ff1600cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:53.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.357+0000 7ff164d9b700 1 --2- 172.21.15.32:0/3413061761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1600c9d40 0x7ff1600cb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.357+0000 7ff164d9b700 1 -- 172.21.15.32:0/3413061761 >> v1:172.21.15.115:6789/0 conn(0x7ff1600cb6e0 legacy=0x7ff160157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.357+0000 7ff164d9b700 1 -- 172.21.15.32:0/3413061761 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1600cd6c0 con 0x7ff1600c9970 2023-06-20T13:32:53.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.357+0000 7ff164d9b700 1 --2- 172.21.15.32:0/3413061761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1600c9970 0x7ff1600cdec0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff15000a9e0 tx=0x7ff15000acf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ec24e19d2244fe8 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:53.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.358+0000 7f7c8effd700 1 -- 172.21.15.32:0/2594061225 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7c94007430 con 0x7f7ca00c98e0 2023-06-20T13:32:53.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.360+0000 7f7c8effd700 1 --2- 172.21.15.32:0/2594061225 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f7c8006adb0 0x7f7c8006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.360+0000 7f7c8effd700 1 -- 172.21.15.32:0/2594061225 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7c94088ec0 con 0x7f7ca00c98e0 2023-06-20T13:32:53.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.361+0000 7f9d21ffb700 1 -- 172.21.15.32:0/262295763 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9d1c0559d0 con 0x7f9d2c0d06c0 2023-06-20T13:32:53.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.361+0000 7ff15f7fe700 1 -- 172.21.15.32:0/3413061761 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15000cb70 con 0x7ff1600c9970 2023-06-20T13:32:53.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.361+0000 7ff15f7fe700 1 -- 172.21.15.32:0/3413061761 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15000ccd0 con 0x7ff1600c9970 2023-06-20T13:32:53.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.361+0000 7ff15f7fe700 1 -- 172.21.15.32:0/3413061761 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff150018620 con 0x7ff1600c9970 2023-06-20T13:32:53.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.362+0000 7ff166fff700 1 -- 172.21.15.32:0/3413061761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1600c9970 msgr2=0x7ff1600cdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.362+0000 7ff166fff700 1 --2- 172.21.15.32:0/3413061761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1600c9970 0x7ff1600cdec0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff15000a9e0 tx=0x7ff15000acf0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.361+0000 7f7c9e59c700 1 --2- 172.21.15.32:0/2594061225 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f7c8006adb0 0x7f7c8006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.362+0000 7f7c8effd700 1 -- 172.21.15.32:0/2594061225 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7c94053da0 con 0x7f7ca00c98e0 2023-06-20T13:32:53.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.362+0000 7ff166fff700 1 -- 172.21.15.32:0/3413061761 shutdown_connections 2023-06-20T13:32:53.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.362+0000 7ff166fff700 1 --2- 172.21.15.32:0/3413061761 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1600c9970 0x7ff1600cdec0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.362+0000 7ff166fff700 1 --2- 172.21.15.32:0/3413061761 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1600c9d40 0x7ff1600cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.362+0000 7ff166fff700 1 -- 172.21.15.32:0/3413061761 >> 172.21.15.32:0/3413061761 conn(0x7ff16006abc0 msgr2=0x7ff1600b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:53.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.363+0000 7f7c9e59c700 1 --2- 172.21.15.32:0/2594061225 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f7c8006adb0 0x7f7c8006d260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7c90001110 tx=0x7f7c90001080 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:53.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.364+0000 7ff166fff700 1 -- 172.21.15.32:0/3413061761 shutdown_connections 2023-06-20T13:32:53.389 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.364+0000 7ff166fff700 1 -- 172.21.15.32:0/3413061761 wait complete. 2023-06-20T13:32:53.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.367+0000 7ff166fff700 1 Processor -- start 2023-06-20T13:32:53.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.367+0000 7ff166fff700 1 -- start start 2023-06-20T13:32:53.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.369+0000 7ff166fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1600c9970 0x7ff1600b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.369+0000 7ff166fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1600c9d40 0x7ff1600b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.369+0000 7ff166fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff1600cb6e0 0x7ff1600b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.369+0000 7ff166fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1600b1bd0 con 0x7ff1600cb6e0 2023-06-20T13:32:53.390 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.369+0000 7ff166fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1600b1e50 con 0x7ff1600c9970 2023-06-20T13:32:53.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.369+0000 7ff166fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1600b2130 con 0x7ff1600c9d40 2023-06-20T13:32:53.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.372+0000 7ff164d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1600c9970 0x7ff1600b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.372+0000 7ff15ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1600c9d40 0x7ff1600b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.372+0000 7ff164d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1600c9970 0x7ff1600b1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:46090/0 (socket says 172.21.15.32:46090) 2023-06-20T13:32:53.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.372+0000 7ff164d9b700 1 -- 172.21.15.32:0/3274243905 learned_addr learned my addr 172.21.15.32:0/3274243905 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:53.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.373+0000 7ff16559c700 1 --2- 172.21.15.32:0/3274243905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff1600cb6e0 0x7ff1600b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.391 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.373+0000 7ff164d9b700 1 -- 172.21.15.32:0/3274243905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1600c9d40 msgr2=0x7ff1600b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.392 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.373+0000 7ff164d9b700 1 --2- 172.21.15.32:0/3274243905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1600c9d40 0x7ff1600b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.392 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.373+0000 7ff164d9b700 1 -- 172.21.15.32:0/3274243905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff1600cb6e0 msgr2=0x7ff1600b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.392 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.373+0000 7ff164d9b700 1 --2- 172.21.15.32:0/3274243905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff1600cb6e0 0x7ff1600b40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.392 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.373+0000 7ff164d9b700 1 -- 172.21.15.32:0/3274243905 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff15000a640 con 0x7ff1600c9970 2023-06-20T13:32:53.392 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.374+0000 7ff164d9b700 1 --2- 172.21.15.32:0/3274243905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1600c9970 0x7ff1600b1690 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff15000a1c0 tx=0x7ff150004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:53.392 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.374+0000 7ff15d7fa700 1 -- 172.21.15.32:0/3274243905 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15001c040 con 0x7ff1600c9970 2023-06-20T13:32:53.392 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.374+0000 7ff15d7fa700 1 -- 172.21.15.32:0/3274243905 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff150003ab0 con 0x7ff1600c9970 2023-06-20T13:32:53.392 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.374+0000 7ff15d7fa700 1 -- 172.21.15.32:0/3274243905 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff150003e60 con 0x7ff1600c9970 2023-06-20T13:32:53.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.374+0000 7ff166fff700 1 -- 172.21.15.32:0/3274243905 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1600b2410 con 0x7ff1600c9970 2023-06-20T13:32:53.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.374+0000 7ff166fff700 1 -- 172.21.15.32:0/3274243905 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1600b29d0 con 0x7ff1600c9970 2023-06-20T13:32:53.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.378+0000 7ff166fff700 1 -- 172.21.15.32:0/3274243905 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1400052f0 con 0x7ff1600c9970 2023-06-20T13:32:53.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.381+0000 7ff15d7fa700 1 -- 172.21.15.32:0/3274243905 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff150018400 con 0x7ff1600c9970 2023-06-20T13:32:53.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.382+0000 7ff15d7fa700 1 --2- 172.21.15.32:0/3274243905 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff14806af10 0x7ff14806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:53.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.383+0000 7ff15d7fa700 1 -- 172.21.15.32:0/3274243905 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff15008b0f0 con 0x7ff1600c9970 2023-06-20T13:32:53.393 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.384+0000 7ff15ffff700 1 --2- 172.21.15.32:0/3274243905 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff14806af10 0x7ff14806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:53.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.385+0000 7ff15ffff700 1 --2- 172.21.15.32:0/3274243905 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff14806af10 0x7ff14806d3c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff1600b38f0 tx=0x7ff154009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:53.394 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.385+0000 7ff15d7fa700 1 -- 172.21.15.32:0/3274243905 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff150056040 con 0x7ff1600c9970 2023-06-20T13:32:53.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.793+0000 7fe017dff700 1 -- 172.21.15.32:0/3048474089 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdff8005870 con 0x7fe0100c4a00 2023-06-20T13:32:53.798 INFO:teuthology.orchestra.run.smithi032.stdout:55834574859 2023-06-20T13:32:53.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.793+0000 7fe0067fc700 1 -- 172.21.15.32:0/3048474089 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe00c058120 con 0x7fe0100c4a00 2023-06-20T13:32:53.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.797+0000 7fe017dff700 1 -- 172.21.15.32:0/3048474089 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdff406adb0 msgr2=0x7fdff406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.798+0000 7fe017dff700 1 --2- 172.21.15.32:0/3048474089 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdff406adb0 0x7fdff406d260 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe0100ae2d0 tx=0x7fe000010000 comp rx=0 tx=0).stop 2023-06-20T13:32:53.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.798+0000 7fe017dff700 1 -- 172.21.15.32:0/3048474089 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0100c4a00 msgr2=0x7fe0101eab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.798+0000 7fe017dff700 1 --2- 172.21.15.32:0/3048474089 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0100c4a00 0x7fe0101eab70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00b410 tx=0x7fe00c00b7d0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.798+0000 7fe017dff700 1 -- 172.21.15.32:0/3048474089 shutdown_connections 2023-06-20T13:32:53.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.798+0000 7fe017dff700 1 --2- 172.21.15.32:0/3048474089 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdff406adb0 0x7fdff406d260 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe0100ae2d0 tx=0x7fe000010000 comp rx=0 tx=0).stop 2023-06-20T13:32:53.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.798+0000 7fe017dff700 1 --2- 172.21.15.32:0/3048474089 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0100c4a00 0x7fe0101eab70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.798+0000 7fe017dff700 1 --2- 172.21.15.32:0/3048474089 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0100adeb0 0x7fe0100c2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.798+0000 7fe017dff700 1 --2- 172.21.15.32:0/3048474089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0100cc390 0x7fe0100c22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.798+0000 7fe017dff700 1 -- 172.21.15.32:0/3048474089 >> 172.21.15.32:0/3048474089 conn(0x7fe0100b0390 msgr2=0x7fe0100af190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:53.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.800+0000 7fe017dff700 1 -- 172.21.15.32:0/3048474089 shutdown_connections 2023-06-20T13:32:53.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.800+0000 7fe017dff700 1 -- 172.21.15.32:0/3048474089 wait complete. 2023-06-20T13:32:53.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.803+0000 7fa2609ff700 1 -- 172.21.15.32:0/3553265959 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa2400055a0 con 0x7fa25c0c98e0 2023-06-20T13:32:53.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.803+0000 7fa24affd700 1 -- 172.21.15.32:0/3553265959 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa250015090 con 0x7fa25c0c98e0 2023-06-20T13:32:53.808 INFO:teuthology.orchestra.run.smithi032.stdout:55834574859 2023-06-20T13:32:53.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.810+0000 7f0d10fff700 1 -- 172.21.15.32:0/2423636869 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0d0c0b1720 con 0x7f0d0c0c9d40 2023-06-20T13:32:53.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.811+0000 7f0cfaffd700 1 -- 172.21.15.32:0/2423636869 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0d0c0b1720 con 0x7f0d0c0c9d40 2023-06-20T13:32:53.812 INFO:teuthology.orchestra.run.smithi032.stdout:60129542154 2023-06-20T13:32:53.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.812+0000 7fa2609ff700 1 -- 172.21.15.32:0/3553265959 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa23c06ad30 msgr2=0x7fa23c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.812+0000 7fa2609ff700 1 --2- 172.21.15.32:0/3553265959 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa23c06ad30 0x7fa23c06d1e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa24c005c90 tx=0x7fa24c009040 comp rx=0 tx=0).stop 2023-06-20T13:32:53.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.812+0000 7fa2609ff700 1 -- 172.21.15.32:0/3553265959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa25c0c98e0 msgr2=0x7fa25c1525f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.812+0000 7fa2609ff700 1 --2- 172.21.15.32:0/3553265959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa25c0c98e0 0x7fa25c1525f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa25c0cc560 tx=0x7fa250004750 comp rx=0 tx=0).stop 2023-06-20T13:32:53.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.812+0000 7fa2609ff700 1 -- 172.21.15.32:0/3553265959 shutdown_connections 2023-06-20T13:32:53.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.812+0000 7fa2609ff700 1 --2- 172.21.15.32:0/3553265959 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa23c06ad30 0x7fa23c06d1e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.812+0000 7fa2609ff700 1 --2- 172.21.15.32:0/3553265959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa25c0c9d80 0x7fa25c152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.812+0000 7fa2609ff700 1 --2- 172.21.15.32:0/3553265959 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa25c0b0aa0 0x7fa25c14bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.812+0000 7fa2609ff700 1 --2- 172.21.15.32:0/3553265959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa25c0c98e0 0x7fa25c1525f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.812+0000 7fa2609ff700 1 -- 172.21.15.32:0/3553265959 >> 172.21.15.32:0/3553265959 conn(0x7fa25c06abc0 msgr2=0x7fa25c0ae300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:53.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.809+0000 7f06e2fff700 1 -- 172.21.15.32:0/2660827708 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f06dc0cc830 con 0x7f06dc0c9970 2023-06-20T13:32:53.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.813+0000 7fa2609ff700 1 -- 172.21.15.32:0/3553265959 shutdown_connections 2023-06-20T13:32:53.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.813+0000 7fa2609ff700 1 -- 172.21.15.32:0/3553265959 wait complete. 2023-06-20T13:32:53.816 INFO:teuthology.orchestra.run.smithi032.stdout:55834574859 2023-06-20T13:32:53.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.813+0000 7f06d97fa700 1 -- 172.21.15.32:0/2660827708 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f06cc0579d0 con 0x7f06dc0c9970 2023-06-20T13:32:53.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.817+0000 7f0d10fff700 1 -- 172.21.15.32:0/2423636869 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f0cec06ad80 msgr2=0x7f0cec06d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.817+0000 7f0d10fff700 1 --2- 172.21.15.32:0/2423636869 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f0cec06ad80 0x7f0cec06d230 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc009770 tx=0x7f0cfc008040 comp rx=0 tx=0).stop 2023-06-20T13:32:53.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.817+0000 7f0d10fff700 1 -- 172.21.15.32:0/2423636869 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d0c0c9d40 msgr2=0x7f0d0c14f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.817+0000 7f0d10fff700 1 --2- 172.21.15.32:0/2423636869 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d0c0c9d40 0x7f0d0c14f380 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0d00009500 tx=0x7f0d00004750 comp rx=0 tx=0).stop 2023-06-20T13:32:53.821 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.816+0000 7f7f439ff700 1 -- 172.21.15.32:0/491408726 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7f3c161fc0 con 0x7f7f3c070a80 2023-06-20T13:32:53.821 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.820+0000 7f06e2fff700 1 -- 172.21.15.32:0/2660827708 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f06c806adb0 msgr2=0x7f06c806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.821 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.820+0000 7f06e2fff700 1 --2- 172.21.15.32:0/2660827708 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f06c806adb0 0x7f06c806d260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f06d400ab90 tx=0x7f06d4009250 comp rx=0 tx=0).stop 2023-06-20T13:32:53.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.820+0000 7f06e2fff700 1 -- 172.21.15.32:0/2660827708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06dc0c9970 msgr2=0x7f06dc167530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.820+0000 7f06e2fff700 1 --2- 172.21.15.32:0/2660827708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06dc0c9970 0x7f06dc167530 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f06cc00c750 tx=0x7f06cc00cb10 comp rx=0 tx=0).stop 2023-06-20T13:32:53.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.820+0000 7f06e2fff700 1 -- 172.21.15.32:0/2660827708 shutdown_connections 2023-06-20T13:32:53.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.820+0000 7f06e2fff700 1 --2- 172.21.15.32:0/2660827708 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f06c806adb0 0x7f06c806d260 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f06d400ab90 tx=0x7f06d4009250 comp rx=0 tx=0).stop 2023-06-20T13:32:53.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.820+0000 7f06e2fff700 1 --2- 172.21.15.32:0/2660827708 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06dc0c9d40 0x7f06dc0c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.820+0000 7f06e2fff700 1 --2- 172.21.15.32:0/2660827708 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06dc0b0aa0 0x7f06dc156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.820+0000 7f06e2fff700 1 --2- 172.21.15.32:0/2660827708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06dc0c9970 0x7f06dc167530 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.820+0000 7f06e2fff700 1 -- 172.21.15.32:0/2660827708 >> 172.21.15.32:0/2660827708 conn(0x7f06dc06abc0 msgr2=0x7f06dc06e570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:53.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.820+0000 7f06e2fff700 1 -- 172.21.15.32:0/2660827708 shutdown_connections 2023-06-20T13:32:53.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.820+0000 7f06e2fff700 1 -- 172.21.15.32:0/2660827708 wait complete. 2023-06-20T13:32:53.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.821+0000 7f0d10fff700 1 -- 172.21.15.32:0/2423636869 shutdown_connections 2023-06-20T13:32:53.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.821+0000 7f0d10fff700 1 --2- 172.21.15.32:0/2423636869 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f0cec06ad80 0x7f0cec06d230 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.821+0000 7f0d10fff700 1 --2- 172.21.15.32:0/2423636869 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f0d0c0cb6e0 0x7f0d0c14f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.821+0000 7f0d10fff700 1 --2- 172.21.15.32:0/2423636869 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0d0c0c9970 0x7f0d0c1e4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.821+0000 7f0d10fff700 1 --2- 172.21.15.32:0/2423636869 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0d0c0c9d40 0x7f0d0c14f380 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.821+0000 7f0d10fff700 1 -- 172.21.15.32:0/2423636869 >> 172.21.15.32:0/2423636869 conn(0x7f0d0c06abc0 msgr2=0x7f0d0c0ad6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:53.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.821+0000 7f0d10fff700 1 -- 172.21.15.32:0/2423636869 shutdown_connections 2023-06-20T13:32:53.825 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.821+0000 7f0d10fff700 1 -- 172.21.15.32:0/2423636869 wait complete. 2023-06-20T13:32:53.825 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.822+0000 7f7f2dffb700 1 -- 172.21.15.32:0/491408726 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7f3c161fc0 con 0x7f7f3c070a80 2023-06-20T13:32:53.825 INFO:teuthology.orchestra.run.smithi032.stdout:60129542154 2023-06-20T13:32:53.826 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.825+0000 7f9d337ff700 1 -- 172.21.15.32:0/262295763 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9d0c0055a0 con 0x7f9d2c0d06c0 2023-06-20T13:32:53.827 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.825+0000 7f9d21ffb700 1 -- 172.21.15.32:0/262295763 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9d1c058ff0 con 0x7f9d2c0d06c0 2023-06-20T13:32:53.827 INFO:teuthology.orchestra.run.smithi032.stdout:55834574859 2023-06-20T13:32:53.829 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.828+0000 7f7ca4fff700 1 -- 172.21.15.32:0/2594061225 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f7ca00af0c0 con 0x7f7ca00c98e0 2023-06-20T13:32:53.832 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.829+0000 7f7c8effd700 1 -- 172.21.15.32:0/2594061225 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7ca00af0c0 con 0x7f7ca00c98e0 2023-06-20T13:32:53.832 INFO:teuthology.orchestra.run.smithi032.stdout:60129542154 2023-06-20T13:32:53.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.0 2023-06-20T13:32:53.833 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.830+0000 7f7f439ff700 1 -- 172.21.15.32:0/491408726 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f7f2006adb0 msgr2=0x7f7f2006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.834 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.830+0000 7f7f439ff700 1 --2- 172.21.15.32:0/491408726 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f7f2006adb0 0x7f7f2006d260 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7f30006fd0 tx=0x7f7f30008040 comp rx=0 tx=0).stop 2023-06-20T13:32:53.834 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.830+0000 7f7f439ff700 1 -- 172.21.15.32:0/491408726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f3c070a80 msgr2=0x7f7f3c143910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.834 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.830+0000 7f7f439ff700 1 --2- 172.21.15.32:0/491408726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f3c070a80 0x7f7f3c143910 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7f38001eb0 tx=0x7f7f3800c800 comp rx=0 tx=0).stop 2023-06-20T13:32:53.834 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.831+0000 7f9d337ff700 1 -- 172.21.15.32:0/262295763 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f9d1006adb0 msgr2=0x7f9d1006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.834 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.831+0000 7f9d337ff700 1 --2- 172.21.15.32:0/262295763 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f9d1006adb0 0x7f9d1006d260 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9d28000f60 tx=0x7f9d28009040 comp rx=0 tx=0).stop 2023-06-20T13:32:53.834 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.831+0000 7f9d337ff700 1 -- 172.21.15.32:0/262295763 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d2c0d06c0 msgr2=0x7f9d2c0d0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.835 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.831+0000 7f9d337ff700 1 --2- 172.21.15.32:0/262295763 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d2c0d06c0 0x7f9d2c0d0b40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c08ba00 tx=0x7f9d1c004750 comp rx=0 tx=0).stop 2023-06-20T13:32:53.835 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.831+0000 7f9d337ff700 1 -- 172.21.15.32:0/262295763 shutdown_connections 2023-06-20T13:32:53.835 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.831+0000 7f9d337ff700 1 --2- 172.21.15.32:0/262295763 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f9d1006adb0 0x7f9d1006d260 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.836 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.831+0000 7f9d337ff700 1 --2- 172.21.15.32:0/262295763 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d2c0d06c0 0x7f9d2c0d0b40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.836 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.831+0000 7f9d337ff700 1 --2- 172.21.15.32:0/262295763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9d2c0b8320 0x7f9d2c1599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.836 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.831+0000 7f9d337ff700 1 --2- 172.21.15.32:0/262295763 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9d2c0d1cd0 0x7f9d2c1e8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.836 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.831+0000 7f9d337ff700 1 -- 172.21.15.32:0/262295763 >> 172.21.15.32:0/262295763 conn(0x7f9d2c0b4cc0 msgr2=0x7f9d2c0b2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:53.836 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.831+0000 7f9d337ff700 1 -- 172.21.15.32:0/262295763 shutdown_connections 2023-06-20T13:32:53.836 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.832+0000 7f9d337ff700 1 -- 172.21.15.32:0/262295763 wait complete. 2023-06-20T13:32:53.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.833+0000 7f7ca4fff700 1 -- 172.21.15.32:0/2594061225 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f7c8006adb0 msgr2=0x7f7c8006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.833+0000 7f7ca4fff700 1 --2- 172.21.15.32:0/2594061225 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f7c8006adb0 0x7f7c8006d260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7c90001110 tx=0x7f7c90001080 comp rx=0 tx=0).stop 2023-06-20T13:32:53.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.833+0000 7f7ca4fff700 1 -- 172.21.15.32:0/2594061225 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ca00c98e0 msgr2=0x7f7ca00b1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.833+0000 7f7ca4fff700 1 --2- 172.21.15.32:0/2594061225 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ca00c98e0 0x7f7ca00b1fa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400c450 tx=0x7f7c9400c760 comp rx=0 tx=0).stop 2023-06-20T13:32:53.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.834+0000 7f7f439ff700 1 -- 172.21.15.32:0/491408726 shutdown_connections 2023-06-20T13:32:53.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.834+0000 7f7f439ff700 1 --2- 172.21.15.32:0/491408726 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f7f2006adb0 0x7f7f2006d260 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.834+0000 7f7f439ff700 1 --2- 172.21.15.32:0/491408726 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f3c160930 0x7f7f3c14cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.834+0000 7f7f439ff700 1 --2- 172.21.15.32:0/491408726 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f3c070a80 0x7f7f3c143910 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.834+0000 7f7f439ff700 1 --2- 172.21.15.32:0/491408726 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f3c0adce0 0x7f7f3c151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.838 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.834+0000 7f7f439ff700 1 -- 172.21.15.32:0/491408726 >> 172.21.15.32:0/491408726 conn(0x7f7f3c0b0390 msgr2=0x7f7f3c06cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:53.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.834+0000 7f7ca4fff700 1 -- 172.21.15.32:0/2594061225 shutdown_connections 2023-06-20T13:32:53.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.834+0000 7f7ca4fff700 1 --2- 172.21.15.32:0/2594061225 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f7c8006adb0 0x7f7c8006d260 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.834+0000 7f7ca4fff700 1 --2- 172.21.15.32:0/2594061225 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7ca00c9d80 0x7f7ca00b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.834+0000 7f7ca4fff700 1 --2- 172.21.15.32:0/2594061225 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7ca00b0aa0 0x7f7ca0158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.834+0000 7f7ca4fff700 1 --2- 172.21.15.32:0/2594061225 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7ca00c98e0 0x7f7ca00b1fa0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.834+0000 7f7ca4fff700 1 -- 172.21.15.32:0/2594061225 >> 172.21.15.32:0/2594061225 conn(0x7f7ca006abc0 msgr2=0x7f7ca015bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:53.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.834+0000 7f7ca4fff700 1 -- 172.21.15.32:0/2594061225 shutdown_connections 2023-06-20T13:32:53.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.834+0000 7f7ca4fff700 1 -- 172.21.15.32:0/2594061225 wait complete. 2023-06-20T13:32:53.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.834+0000 7f7f439ff700 1 -- 172.21.15.32:0/491408726 shutdown_connections 2023-06-20T13:32:53.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.835+0000 7f7f439ff700 1 -- 172.21.15.32:0/491408726 wait complete. 2023-06-20T13:32:53.843 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.1 2023-06-20T13:32:53.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.848+0000 7ff166fff700 1 -- 172.21.15.32:0/3274243905 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff140005870 con 0x7ff1600c9970 2023-06-20T13:32:53.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.849+0000 7ff15d7fa700 1 -- 172.21.15.32:0/3274243905 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff150026020 con 0x7ff1600c9970 2023-06-20T13:32:53.854 INFO:teuthology.orchestra.run.smithi032.stdout:60129542154 2023-06-20T13:32:53.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.853+0000 7ff166fff700 1 -- 172.21.15.32:0/3274243905 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff14806af10 msgr2=0x7ff14806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.853+0000 7ff166fff700 1 --2- 172.21.15.32:0/3274243905 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff14806af10 0x7ff14806d3c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff1600b38f0 tx=0x7ff154009210 comp rx=0 tx=0).stop 2023-06-20T13:32:53.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.853+0000 7ff166fff700 1 -- 172.21.15.32:0/3274243905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1600c9970 msgr2=0x7ff1600b1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:53.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.853+0000 7ff166fff700 1 --2- 172.21.15.32:0/3274243905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1600c9970 0x7ff1600b1690 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff15000a1c0 tx=0x7ff150004750 comp rx=0 tx=0).stop 2023-06-20T13:32:53.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.853+0000 7ff166fff700 1 -- 172.21.15.32:0/3274243905 shutdown_connections 2023-06-20T13:32:53.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.853+0000 7ff166fff700 1 --2- 172.21.15.32:0/3274243905 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff14806af10 0x7ff14806d3c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.853+0000 7ff166fff700 1 --2- 172.21.15.32:0/3274243905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff1600cb6e0 0x7ff1600b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.853+0000 7ff166fff700 1 --2- 172.21.15.32:0/3274243905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1600c9970 0x7ff1600b1690 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.853+0000 7ff166fff700 1 --2- 172.21.15.32:0/3274243905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff1600c9d40 0x7ff1600b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:53.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.853+0000 7ff166fff700 1 -- 172.21.15.32:0/3274243905 >> 172.21.15.32:0/3274243905 conn(0x7ff16006abc0 msgr2=0x7ff16006e860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:53.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.854+0000 7ff166fff700 1 -- 172.21.15.32:0/3274243905 shutdown_connections 2023-06-20T13:32:53.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:53.854+0000 7ff166fff700 1 -- 172.21.15.32:0/3274243905 wait complete. 2023-06-20T13:32:53.858 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542154 for osd.4 2023-06-20T13:32:53.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.2 2023-06-20T13:32:53.865 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.3 2023-06-20T13:32:53.870 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542154 for osd.5 2023-06-20T13:32:53.870 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542154 for osd.7 2023-06-20T13:32:53.878 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542154 for osd.6 2023-06-20T13:32:54.834 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-06-20T13:32:54.844 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-06-20T13:32:54.858 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-06-20T13:32:54.859 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-06-20T13:32:54.866 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-20T13:32:54.870 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-06-20T13:32:54.871 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-06-20T13:32:54.879 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-06-20T13:32:55.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.176+0000 7f7f39dff700 1 Processor -- start 2023-06-20T13:32:55.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.176+0000 7f7f39dff700 1 -- start start 2023-06-20T13:32:55.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.178+0000 7f7f39dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f34160ab0 0x7f7f340ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.178+0000 7f7f39dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7f340ad710 0x7f7f340cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.178+0000 7f7f39dff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f340c1d30 con 0x7f7f341606e0 2023-06-20T13:32:55.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.178+0000 7f7f39dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f340ce670 con 0x7f7f340ad710 2023-06-20T13:32:55.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.178+0000 7f7f39dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f340cc840 con 0x7f7f34160ab0 2023-06-20T13:32:55.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.180+0000 7f7f337fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f7f341606e0 0x7f7f3406c3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:52882/0 (socket says 172.21.15.32:52882) 2023-06-20T13:32:55.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.180+0000 7f7f337fe700 1 -- 172.21.15.32:0/2230956362 learned_addr learned my addr 172.21.15.32:0/2230956362 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:55.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.181+0000 7f7f33fff700 1 --2- 172.21.15.32:0/2230956362 >> v2:172.21.15.115:3300/0 conn(0x7f7f340ad710 0x7f7f340cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.182+0000 7f7f33fff700 1 -- 172.21.15.32:0/2230956362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f34160ab0 msgr2=0x7f7f340ce130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-20T13:32:55.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.182+0000 7f7f33fff700 1 --2- 172.21.15.32:0/2230956362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f34160ab0 0x7f7f340ce130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.182+0000 7f7f33fff700 1 -- 172.21.15.32:0/2230956362 >> v1:172.21.15.32:6789/0 conn(0x7f7f341606e0 legacy=0x7f7f3406c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.182+0000 7f7f33fff700 1 -- 172.21.15.32:0/2230956362 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f340adc60 con 0x7f7f340ad710 2023-06-20T13:32:55.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.182+0000 7f7f33fff700 1 --2- 172.21.15.32:0/2230956362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f340ad710 0x7f7f340cb1b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7f28009840 tx=0x7f7f28009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d952bb19a7abd2ed server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:55.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.183+0000 7f7f327fc700 1 -- 172.21.15.32:0/2230956362 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f28004230 con 0x7f7f340ad710 2023-06-20T13:32:55.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.183+0000 7f7f327fc700 1 -- 172.21.15.32:0/2230956362 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f28004390 con 0x7f7f340ad710 2023-06-20T13:32:55.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.184+0000 7f7f327fc700 1 -- 172.21.15.32:0/2230956362 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f280036a0 con 0x7f7f340ad710 2023-06-20T13:32:55.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.184+0000 7f7f39dff700 1 -- 172.21.15.32:0/2230956362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f340ad710 msgr2=0x7f7f340cb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.184+0000 7f7f39dff700 1 --2- 172.21.15.32:0/2230956362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f340ad710 0x7f7f340cb1b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7f28009840 tx=0x7f7f28009b50 comp rx=0 tx=0).stop 2023-06-20T13:32:55.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.185+0000 7f7f39dff700 1 -- 172.21.15.32:0/2230956362 shutdown_connections 2023-06-20T13:32:55.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.185+0000 7f7f39dff700 1 --2- 172.21.15.32:0/2230956362 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f340ad710 0x7f7f340cb1b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.185+0000 7f7f39dff700 1 --2- 172.21.15.32:0/2230956362 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f34160ab0 0x7f7f340ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.185+0000 7f7f39dff700 1 -- 172.21.15.32:0/2230956362 >> 172.21.15.32:0/2230956362 conn(0x7f7f3406abc0 msgr2=0x7f7f340b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:55.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.186+0000 7f7f39dff700 1 -- 172.21.15.32:0/2230956362 shutdown_connections 2023-06-20T13:32:55.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.186+0000 7f7f39dff700 1 -- 172.21.15.32:0/2230956362 wait complete. 2023-06-20T13:32:55.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.189+0000 7f7f39dff700 1 Processor -- start 2023-06-20T13:32:55.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.189+0000 7f7f39dff700 1 -- start start 2023-06-20T13:32:55.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.191+0000 7f7f39dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f340ad710 0x7f7f340c4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.195 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.191+0000 7f7f39dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f341606e0 0x7f7f340b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.191+0000 7f7f39dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f34160ab0 0x7f7f340b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.191+0000 7f7f39dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f340c51c0 con 0x7f7f34160ab0 2023-06-20T13:32:55.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.191+0000 7f7f39dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f340c4920 con 0x7f7f340ad710 2023-06-20T13:32:55.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.191+0000 7f7f39dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f340c4c00 con 0x7f7f341606e0 2023-06-20T13:32:55.196 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.194+0000 7f7f33fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f34160ab0 0x7f7f340b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.194+0000 7f7f33fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f34160ab0 0x7f7f340b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59240/0 (socket says 172.21.15.32:59240) 2023-06-20T13:32:55.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.194+0000 7f7f33fff700 1 -- 172.21.15.32:0/1056475648 learned_addr learned my addr 172.21.15.32:0/1056475648 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:55.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.195+0000 7f7f32ffd700 1 --2- 172.21.15.32:0/1056475648 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f341606e0 0x7f7f340b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.195+0000 7f7f33fff700 1 -- 172.21.15.32:0/1056475648 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f341606e0 msgr2=0x7f7f340b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.195+0000 7f7f337fe700 1 --2- 172.21.15.32:0/1056475648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f340ad710 0x7f7f340c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.195+0000 7f7f33fff700 1 --2- 172.21.15.32:0/1056475648 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f341606e0 0x7f7f340b3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.195+0000 7f7f33fff700 1 -- 172.21.15.32:0/1056475648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f340ad710 msgr2=0x7f7f340c4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.195+0000 7f7f33fff700 1 --2- 172.21.15.32:0/1056475648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f340ad710 0x7f7f340c4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.195+0000 7f7f33fff700 1 -- 172.21.15.32:0/1056475648 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f280094a0 con 0x7f7f34160ab0 2023-06-20T13:32:55.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.197+0000 7f7f33fff700 1 --2- 172.21.15.32:0/1056475648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f34160ab0 0x7f7f340b1e60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7f34071580 tx=0x7f7f28004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:55.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.198+0000 7f7f1bfff700 1 -- 172.21.15.32:0/1056475648 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f28003d30 con 0x7f7f34160ab0 2023-06-20T13:32:55.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.198+0000 7f7f1bfff700 1 -- 172.21.15.32:0/1056475648 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f28020070 con 0x7f7f34160ab0 2023-06-20T13:32:55.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.198+0000 7f7f1bfff700 1 -- 172.21.15.32:0/1056475648 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f28011870 con 0x7f7f34160ab0 2023-06-20T13:32:55.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.198+0000 7f7f39dff700 1 -- 172.21.15.32:0/1056475648 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f340c4ee0 con 0x7f7f34160ab0 2023-06-20T13:32:55.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.198+0000 7f7f39dff700 1 -- 172.21.15.32:0/1056475648 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f340b23a0 con 0x7f7f34160ab0 2023-06-20T13:32:55.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.203+0000 7f7f1bfff700 1 -- 172.21.15.32:0/1056475648 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7f28022030 con 0x7f7f34160ab0 2023-06-20T13:32:55.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.205+0000 7f7f1bfff700 1 --2- 172.21.15.32:0/1056475648 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f7f2006adb0 0x7f7f2006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.205+0000 7f7f1bfff700 1 -- 172.21.15.32:0/1056475648 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7f2808b0d0 con 0x7f7f34160ab0 2023-06-20T13:32:55.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.207+0000 7f7f337fe700 1 --2- 172.21.15.32:0/1056475648 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f7f2006adb0 0x7f7f2006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.208+0000 7f7f337fe700 1 --2- 172.21.15.32:0/1056475648 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f7f2006adb0 0x7f7f2006d260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c00d380 tx=0x7f7f2c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:55.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.210+0000 7f7f39dff700 1 -- 172.21.15.32:0/1056475648 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f140052f0 con 0x7f7f34160ab0 2023-06-20T13:32:55.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.220+0000 7f7f1bfff700 1 -- 172.21.15.32:0/1056475648 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7f28055f00 con 0x7f7f34160ab0 2023-06-20T13:32:55.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.256+0000 7f6e1e5ff700 1 Processor -- start 2023-06-20T13:32:55.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.257+0000 7f6e1e5ff700 1 -- start start 2023-06-20T13:32:55.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.257+0000 7f8fc8fff700 1 Processor -- start 2023-06-20T13:32:55.260 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.257+0000 7f8fc8fff700 1 -- start start 2023-06-20T13:32:55.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.259+0000 7f71fb5ff700 1 Processor -- start 2023-06-20T13:32:55.262 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.259+0000 7f6e1e5ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e180ad7c0 0x7f6e18160a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.262 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.259+0000 7f6e1e5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6e180c9820 0x7f6e180ab960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.262 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.259+0000 7f6e1e5ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e180ccb20 con 0x7f6e180abea0 2023-06-20T13:32:55.262 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.259+0000 7f6e1e5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e180cc550 con 0x7f6e180c9820 2023-06-20T13:32:55.262 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.259+0000 7f6e1e5ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e180ccd70 con 0x7f6e180ad7c0 2023-06-20T13:32:55.262 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.259+0000 7f6e177fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6e180c9820 0x7f6e180ab960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.260+0000 7f6e177fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6e180c9820 0x7f6e180ab960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:46114/0 (socket says 172.21.15.32:46114) 2023-06-20T13:32:55.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.260+0000 7f6e177fe700 1 -- 172.21.15.32:0/812478731 learned_addr learned my addr 172.21.15.32:0/812478731 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:55.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.260+0000 7f6e17fff700 1 --2- 172.21.15.32:0/812478731 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e180ad7c0 0x7f6e18160a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.260+0000 7f8fc8fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8fc40c9e10 0x7f8fc40cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.260+0000 7f8fc8fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8fc40cb6e0 0x7f8fc4157d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.260+0000 7f8fc8fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc40cd100 con 0x7f8fc40b0aa0 2023-06-20T13:32:55.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.260+0000 7f8fc8fff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc40cd3e0 con 0x7f8fc40c9e10 2023-06-20T13:32:55.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.260+0000 7f8fc8fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc40cd6c0 con 0x7f8fc40cb6e0 2023-06-20T13:32:55.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.260+0000 7f6e177fe700 1 -- 172.21.15.32:0/812478731 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e180ad7c0 msgr2=0x7f6e18160a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:55.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.260+0000 7f6e177fe700 1 --2- 172.21.15.32:0/812478731 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e180ad7c0 0x7f6e18160a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.260+0000 7f6e177fe700 1 -- 172.21.15.32:0/812478731 >> v1:172.21.15.115:6789/0 conn(0x7f6e180abea0 legacy=0x7f6e180cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.260+0000 7f8fc1d9b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8fc40c9e10 0x7f8fc40cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.260+0000 7f8fc1d9b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8fc40c9e10 0x7f8fc40cb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59248/0 (socket says 172.21.15.32:59248) 2023-06-20T13:32:55.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.260+0000 7f8fc1d9b700 1 -- 172.21.15.32:0/2946428539 learned_addr learned my addr 172.21.15.32:0/2946428539 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:55.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.261+0000 7f8fc2d9d700 1 --2- 172.21.15.32:0/2946428539 >> v2:172.21.15.115:3300/0 conn(0x7f8fc40cb6e0 0x7f8fc4157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.260+0000 7f6e177fe700 1 -- 172.21.15.32:0/812478731 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e180cd050 con 0x7f6e180c9820 2023-06-20T13:32:55.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.261+0000 7f6e177fe700 1 --2- 172.21.15.32:0/812478731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e180c9820 0x7f6e180ab960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6e10009e50 tx=0x7f6e1000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cff9b17ee41e566 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:55.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.261+0000 7f8fc159a700 1 -- 172.21.15.32:0/2946428539 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3695633854 0 0) 0x7f8fc40cd100 con 0x7f8fc40b0aa0 2023-06-20T13:32:55.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.261+0000 7f8fc159a700 1 -- 172.21.15.32:0/2946428539 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fac0079c0 con 0x7f8fc40b0aa0 2023-06-20T13:32:55.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.261+0000 7f8fc1d9b700 1 -- 172.21.15.32:0/2946428539 >> v2:172.21.15.115:3300/0 conn(0x7f8fc40cb6e0 msgr2=0x7f8fc4157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:55.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.261+0000 7f8fc1d9b700 1 --2- 172.21.15.32:0/2946428539 >> v2:172.21.15.115:3300/0 conn(0x7f8fc40cb6e0 0x7f8fc4157d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.261+0000 7f8fc1d9b700 1 -- 172.21.15.32:0/2946428539 >> v1:172.21.15.115:6789/0 conn(0x7f8fc40b0aa0 legacy=0x7f8fc40c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.261+0000 7f8fc1d9b700 1 -- 172.21.15.32:0/2946428539 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc40cd9a0 con 0x7f8fc40c9e10 2023-06-20T13:32:55.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.262+0000 7f8fc1d9b700 1 --2- 172.21.15.32:0/2946428539 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fc40c9e10 0x7f8fc40cb1a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8fc40cac70 tx=0x7f8fb400d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bbec69344c34fa9 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:55.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.261+0000 7f6e16ffd700 1 -- 172.21.15.32:0/812478731 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1000e070 con 0x7f6e180c9820 2023-06-20T13:32:55.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.262+0000 7f6e16ffd700 1 -- 172.21.15.32:0/812478731 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1000b9c0 con 0x7f6e180c9820 2023-06-20T13:32:55.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.262+0000 7f6e16ffd700 1 -- 172.21.15.32:0/812478731 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1000bd70 con 0x7f6e180c9820 2023-06-20T13:32:55.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.262+0000 7f5b95dff700 1 Processor -- start 2023-06-20T13:32:55.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.260+0000 7f71fb5ff700 1 -- start start 2023-06-20T13:32:55.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.262+0000 7f71fb5ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71f40c9d40 0x7f71f40cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.262+0000 7f71fb5ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f71f40cb6e0 0x7f71f4157d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.262+0000 7f71fb5ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f40ce5d0 con 0x7f71f40c9970 2023-06-20T13:32:55.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.262+0000 7f71fb5ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f40cce20 con 0x7f71f40cb6e0 2023-06-20T13:32:55.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.262+0000 7f71fb5ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f40cd100 con 0x7f71f40c9d40 2023-06-20T13:32:55.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.263+0000 7f71f8b9a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71f40c9d40 0x7f71f40cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.263+0000 7f71f8b9a700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71f40c9d40 0x7f71f40cb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.32:35560/0 (socket says 172.21.15.32:35560) 2023-06-20T13:32:55.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.263+0000 7f71f8b9a700 1 -- 172.21.15.32:0/3186511211 learned_addr learned my addr 172.21.15.32:0/3186511211 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:55.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.263+0000 7f6e1e5ff700 1 -- 172.21.15.32:0/812478731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e180c9820 msgr2=0x7f6e180ab960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.263+0000 7f6e1e5ff700 1 --2- 172.21.15.32:0/812478731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e180c9820 0x7f6e180ab960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6e10009e50 tx=0x7f6e1000b330 comp rx=0 tx=0).stop 2023-06-20T13:32:55.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.263+0000 7f6e1e5ff700 1 -- 172.21.15.32:0/812478731 shutdown_connections 2023-06-20T13:32:55.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.263+0000 7f6e1e5ff700 1 --2- 172.21.15.32:0/812478731 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e180ad7c0 0x7f6e18160a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.263+0000 7f6e1e5ff700 1 --2- 172.21.15.32:0/812478731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e180c9820 0x7f6e180ab960 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.263+0000 7f6e1e5ff700 1 -- 172.21.15.32:0/812478731 >> 172.21.15.32:0/812478731 conn(0x7f6e1806abc0 msgr2=0x7f6e180b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:55.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.263+0000 7f5b95dff700 1 -- start start 2023-06-20T13:32:55.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.264+0000 7f6e1e5ff700 1 -- 172.21.15.32:0/812478731 shutdown_connections 2023-06-20T13:32:55.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.264+0000 7f71f8b9a700 1 -- 172.21.15.32:0/3186511211 >> v2:172.21.15.32:3300/0 conn(0x7f71f40cb6e0 msgr2=0x7f71f4157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:55.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.264+0000 7f71f8b9a700 1 --2- 172.21.15.32:0/3186511211 >> v2:172.21.15.32:3300/0 conn(0x7f71f40cb6e0 0x7f71f4157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.264+0000 7f71f8b9a700 1 -- 172.21.15.32:0/3186511211 >> v1:172.21.15.115:6789/0 conn(0x7f71f40c9970 legacy=0x7f71f40cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.264+0000 7f71f8b9a700 1 -- 172.21.15.32:0/3186511211 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f40cd3e0 con 0x7f71f40c9d40 2023-06-20T13:32:55.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.265+0000 7f71f8b9a700 1 --2- 172.21.15.32:0/3186511211 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71f40c9d40 0x7f71f40cb1a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f71e40088f0 tx=0x7f71e400d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=922c990c93380498 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:55.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.265+0000 7fe8cefff700 1 Processor -- start 2023-06-20T13:32:55.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.265+0000 7fe8cefff700 1 -- start start 2023-06-20T13:32:55.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.265+0000 7f5b95dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b900c3eb0 0x7f5b9016b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.265+0000 7f5b95dff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b900cd990 con 0x7f5b90160a10 2023-06-20T13:32:55.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.265+0000 7f5b95dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b900cde20 con 0x7f5b90160640 2023-06-20T13:32:55.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.265+0000 7f5b95dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b900cb6f0 con 0x7f5b900c3eb0 2023-06-20T13:32:55.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.266+0000 7f71ebfff700 1 -- 172.21.15.32:0/3186511211 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4010070 con 0x7f71f40c9d40 2023-06-20T13:32:55.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.266+0000 7f71ebfff700 1 -- 172.21.15.32:0/3186511211 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e400d980 con 0x7f71f40c9d40 2023-06-20T13:32:55.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.266+0000 7f71ebfff700 1 -- 172.21.15.32:0/3186511211 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e400dd10 con 0x7f71f40c9d40 2023-06-20T13:32:55.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.267+0000 7f71fb5ff700 1 -- 172.21.15.32:0/3186511211 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71f40c9d40 msgr2=0x7f71f40cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.267+0000 7f71fb5ff700 1 --2- 172.21.15.32:0/3186511211 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71f40c9d40 0x7f71f40cb1a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f71e40088f0 tx=0x7f71e400d330 comp rx=0 tx=0).stop 2023-06-20T13:32:55.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.265+0000 7f6e1e5ff700 1 -- 172.21.15.32:0/812478731 wait complete. 2023-06-20T13:32:55.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.266+0000 7f8fc159a700 1 -- 172.21.15.32:0/2946428539 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb400da10 con 0x7f8fc40c9e10 2023-06-20T13:32:55.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.266+0000 7f8fc159a700 1 -- 172.21.15.32:0/2946428539 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb400db70 con 0x7f8fc40c9e10 2023-06-20T13:32:55.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.266+0000 7f8fc159a700 1 -- 172.21.15.32:0/2946428539 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4017460 con 0x7f8fc40c9e10 2023-06-20T13:32:55.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.267+0000 7f8fc8fff700 1 -- 172.21.15.32:0/2946428539 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fc40c9e10 msgr2=0x7f8fc40cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.267+0000 7f8fc8fff700 1 --2- 172.21.15.32:0/2946428539 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fc40c9e10 0x7f8fc40cb1a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8fc40cac70 tx=0x7f8fb400d430 comp rx=0 tx=0).stop 2023-06-20T13:32:55.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.267+0000 7f8fc8fff700 1 -- 172.21.15.32:0/2946428539 shutdown_connections 2023-06-20T13:32:55.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.267+0000 7f8fc8fff700 1 --2- 172.21.15.32:0/2946428539 >> v2:172.21.15.115:3300/0 conn(0x7f8fc40cb6e0 0x7f8fc4157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.268+0000 7f8fc8fff700 1 --2- 172.21.15.32:0/2946428539 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fc40c9e10 0x7f8fc40cb1a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.268+0000 7f8fc8fff700 1 -- 172.21.15.32:0/2946428539 >> 172.21.15.32:0/2946428539 conn(0x7f8fc406abc0 msgr2=0x7f8fc40b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:55.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.269+0000 7f8fc8fff700 1 -- 172.21.15.32:0/2946428539 shutdown_connections 2023-06-20T13:32:55.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.269+0000 7f8fc8fff700 1 -- 172.21.15.32:0/2946428539 wait complete. 2023-06-20T13:32:55.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.272+0000 7f8fc8fff700 1 Processor -- start 2023-06-20T13:32:55.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.268+0000 7f5b8f7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f5b90160640 0x7f5b900cafe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.32:34324/0 (socket says 172.21.15.32:34324) 2023-06-20T13:32:55.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.268+0000 7f5b8f7fe700 1 -- 172.21.15.32:0/685464185 learned_addr learned my addr 172.21.15.32:0/685464185 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:55.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.268+0000 7f5b8ffff700 1 --2- 172.21.15.32:0/685464185 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b900c3eb0 0x7f5b9016b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.268+0000 7f5b8effd700 1 -- 172.21.15.32:0/685464185 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1040811683 0 0) 0x7f5b900cde20 con 0x7f5b90160640 2023-06-20T13:32:55.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.269+0000 7f5b8effd700 1 -- 172.21.15.32:0/685464185 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b7c0035b0 con 0x7f5b90160640 2023-06-20T13:32:55.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.269+0000 7f5b8effd700 1 -- 172.21.15.32:0/685464185 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2975851627 0 0) 0x7f5b900cd990 con 0x7f5b90160a10 2023-06-20T13:32:55.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.269+0000 7f5b8effd700 1 -- 172.21.15.32:0/685464185 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b900cde20 con 0x7f5b90160a10 2023-06-20T13:32:55.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.270+0000 7f5b8effd700 1 -- 172.21.15.32:0/685464185 <== mon.1 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2492803428 0 0) 0x7f5b7c0035b0 con 0x7f5b90160640 2023-06-20T13:32:55.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.270+0000 7f5b8effd700 1 -- 172.21.15.32:0/685464185 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b900c3eb0 msgr2=0x7f5b9016b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:55.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.270+0000 7f5b8effd700 1 --2- 172.21.15.32:0/685464185 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b900c3eb0 0x7f5b9016b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.270+0000 7f5b8effd700 1 -- 172.21.15.32:0/685464185 >> v1:172.21.15.32:6789/0 conn(0x7f5b90160a10 legacy=0x7f5b900c37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.270+0000 7f5b8effd700 1 -- 172.21.15.32:0/685464185 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b900cf570 con 0x7f5b90160640 2023-06-20T13:32:55.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.270+0000 7f5b8effd700 1 -- 172.21.15.32:0/685464185 <== mon.1 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3380058562 0 0) 0x7f5b80001a30 con 0x7f5b90160640 2023-06-20T13:32:55.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.270+0000 7f5b8effd700 1 -- 172.21.15.32:0/685464185 >> v1:172.21.15.115:6789/0 conn(0x7f5b90160640 legacy=0x7f5b900cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.270+0000 7f5b8effd700 1 --2- 172.21.15.32:0/685464185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b7c003b90 0x7f5b7c003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.270+0000 7f5b8effd700 1 --2- 172.21.15.32:0/685464185 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b7c004850 0x7f5b7c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.270+0000 7f5b8effd700 1 --2- 172.21.15.32:0/685464185 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b7c005200 0x7f5b7c01ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.270+0000 7f5b8effd700 1 -- 172.21.15.32:0/685464185 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c01cf90 con 0x7f5b7c004850 2023-06-20T13:32:55.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.270+0000 7f5b8effd700 1 -- 172.21.15.32:0/685464185 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c01d100 con 0x7f5b7c003b90 2023-06-20T13:32:55.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.270+0000 7f5b8effd700 1 -- 172.21.15.32:0/685464185 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c01d2c0 con 0x7f5b7c005200 2023-06-20T13:32:55.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.271+0000 7f5b8f7fe700 1 --2- 172.21.15.32:0/685464185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b7c003b90 0x7f5b7c003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.271+0000 7f5b86ffd700 1 --2- 172.21.15.32:0/685464185 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b7c004850 0x7f5b7c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.269+0000 7f71fb5ff700 1 -- 172.21.15.32:0/3186511211 shutdown_connections 2023-06-20T13:32:55.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.269+0000 7f71fb5ff700 1 --2- 172.21.15.32:0/3186511211 >> v2:172.21.15.32:3300/0 conn(0x7f71f40cb6e0 0x7f71f4157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.269+0000 7f71fb5ff700 1 --2- 172.21.15.32:0/3186511211 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71f40c9d40 0x7f71f40cb1a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.269+0000 7f71fb5ff700 1 -- 172.21.15.32:0/3186511211 >> 172.21.15.32:0/3186511211 conn(0x7f71f406abc0 msgr2=0x7f71f40b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:55.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.269+0000 7f71fb5ff700 1 -- 172.21.15.32:0/3186511211 shutdown_connections 2023-06-20T13:32:55.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.269+0000 7fe8cefff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe8c80c9820 0x7fe8c8160a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.269+0000 7fe8cefff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8c80cb190 0x7fe8c80cb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.269+0000 7fe8cefff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8c80ccb20 con 0x7fe8c80ad7c0 2023-06-20T13:32:55.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.269+0000 7fe8cefff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8c80cbb50 con 0x7fe8c80c9820 2023-06-20T13:32:55.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.269+0000 7fe8cefff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c80cc550 con 0x7fe8c80cb190 2023-06-20T13:32:55.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.270+0000 7fe8cd59c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8c80cb190 0x7fe8c80cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.270+0000 7fe8cd59c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8c80cb190 0x7fe8c80cb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.32:35590/0 (socket says 172.21.15.32:35590) 2023-06-20T13:32:55.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.270+0000 7fe8cd59c700 1 -- 172.21.15.32:0/1993115149 learned_addr learned my addr 172.21.15.32:0/1993115149 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:55.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.270+0000 7fe8c7fff700 1 --2- 172.21.15.32:0/1993115149 >> v2:172.21.15.115:3300/0 conn(0x7fe8c80c9820 0x7fe8c8160a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.268+0000 7f6e1e5ff700 1 Processor -- start 2023-06-20T13:32:55.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.268+0000 7f6e1e5ff700 1 -- start start 2023-06-20T13:32:55.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.270+0000 7f6e1e5ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e180abea0 0x7f6e181549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.270+0000 7f6e1e5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e180c9820 0x7f6e18150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.270+0000 7f6e1e5ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e181f7410 0x7f6e181f6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.270+0000 7f6e1e5ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e180ae5f0 con 0x7f6e181f7410 2023-06-20T13:32:55.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.270+0000 7f6e1e5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e18157500 con 0x7f6e180c9820 2023-06-20T13:32:55.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.270+0000 7f6e1e5ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e181577e0 con 0x7f6e180abea0 2023-06-20T13:32:55.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.271+0000 7f6e17fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e180abea0 0x7f6e181549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.271+0000 7f6e17fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e180abea0 0x7f6e181549b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.32:35604/0 (socket says 172.21.15.32:35604) 2023-06-20T13:32:55.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.271+0000 7f6e17fff700 1 -- 172.21.15.32:0/52891401 learned_addr learned my addr 172.21.15.32:0/52891401 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:55.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.271+0000 7f6e1cb9c700 1 --2- 172.21.15.32:0/52891401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e181f7410 0x7f6e181f6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.271+0000 7f6e177fe700 1 --2- 172.21.15.32:0/52891401 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e180c9820 0x7f6e18150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.271+0000 7f6e17fff700 1 -- 172.21.15.32:0/52891401 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e180c9820 msgr2=0x7f6e18150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.271+0000 7f6e17fff700 1 --2- 172.21.15.32:0/52891401 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e180c9820 0x7f6e18150b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.271+0000 7f6e17fff700 1 -- 172.21.15.32:0/52891401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e181f7410 msgr2=0x7f6e181f6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.271+0000 7f6e17fff700 1 --2- 172.21.15.32:0/52891401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e181f7410 0x7f6e181f6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.271+0000 7f6e17fff700 1 -- 172.21.15.32:0/52891401 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e10009b30 con 0x7f6e180abea0 2023-06-20T13:32:55.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.272+0000 7f5b8ffff700 1 --2- 172.21.15.32:0/685464185 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b7c005200 0x7f5b7c01ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.272+0000 7f5b86ffd700 1 -- 172.21.15.32:0/685464185 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b7c005200 msgr2=0x7f5b7c01ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:55.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.272+0000 7f5b86ffd700 1 --2- 172.21.15.32:0/685464185 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b7c005200 0x7f5b7c01ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.272+0000 7f5b86ffd700 1 -- 172.21.15.32:0/685464185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b7c003b90 msgr2=0x7f5b7c003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:55.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.272+0000 7f5b86ffd700 1 --2- 172.21.15.32:0/685464185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b7c003b90 0x7f5b7c003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.272+0000 7f5b86ffd700 1 -- 172.21.15.32:0/685464185 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b900cf570 con 0x7f5b7c004850 2023-06-20T13:32:55.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.273+0000 7f5b8ffff700 1 --2- 172.21.15.32:0/685464185 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b7c005200 0x7f5b7c01ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:32:55.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.273+0000 7f5b86ffd700 1 --2- 172.21.15.32:0/685464185 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b7c004850 0x7f5b7c004cc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5b78001910 tx=0x7f5b7c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a421007cd4cc8f08 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:55.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.272+0000 7fe8c7fff700 1 -- 172.21.15.32:0/1993115149 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8c80cb190 msgr2=0x7fe8c80cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:55.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.272+0000 7fe8c7fff700 1 --2- 172.21.15.32:0/1993115149 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8c80cb190 0x7fe8c80cb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.272+0000 7fe8c7fff700 1 -- 172.21.15.32:0/1993115149 >> v1:172.21.15.32:6789/0 conn(0x7fe8c80ad7c0 legacy=0x7fe8c80ab960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-20T13:32:55.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.272+0000 7fe8c7fff700 1 -- 172.21.15.32:0/1993115149 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c80ccd70 con 0x7fe8c80c9820 2023-06-20T13:32:55.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.273+0000 7f6e17fff700 1 --2- 172.21.15.32:0/52891401 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e180abea0 0x7f6e181549b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00e790 tx=0x7f6e0c00eaa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:55.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.273+0000 7f5b8effd700 1 -- 172.21.15.32:0/685464185 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b780050d0 con 0x7f5b7c004850 2023-06-20T13:32:55.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.273+0000 7f5b8effd700 1 -- 172.21.15.32:0/685464185 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b78005230 con 0x7f5b7c004850 2023-06-20T13:32:55.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.273+0000 7f5b8effd700 1 -- 172.21.15.32:0/685464185 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b78003680 con 0x7f5b7c004850 2023-06-20T13:32:55.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.273+0000 7fe8c7fff700 1 --2- 172.21.15.32:0/1993115149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8c80c9820 0x7fe8c8160a30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0009870 tx=0x7fe8c0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81fa6b5437515326 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:55.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.273+0000 7f8fc8fff700 1 -- start start 2023-06-20T13:32:55.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.269+0000 7f71fb5ff700 1 -- 172.21.15.32:0/3186511211 wait complete. 2023-06-20T13:32:55.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.273+0000 7f71fb5ff700 1 Processor -- start 2023-06-20T13:32:55.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.273+0000 7f71fb5ff700 1 -- start start 2023-06-20T13:32:55.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.274+0000 7fe8c77fe700 1 -- 172.21.15.32:0/1993115149 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0004230 con 0x7fe8c80c9820 2023-06-20T13:32:55.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.274+0000 7fe8c77fe700 1 -- 172.21.15.32:0/1993115149 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c0004390 con 0x7fe8c80c9820 2023-06-20T13:32:55.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.274+0000 7fe8c77fe700 1 -- 172.21.15.32:0/1993115149 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c00036a0 con 0x7fe8c80c9820 2023-06-20T13:32:55.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.274+0000 7fa52ebff700 1 Processor -- start 2023-06-20T13:32:55.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.274+0000 7f5b95dff700 1 -- 172.21.15.32:0/685464185 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b7c004850 msgr2=0x7f5b7c004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.274+0000 7f5b95dff700 1 --2- 172.21.15.32:0/685464185 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b7c004850 0x7f5b7c004cc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5b78001910 tx=0x7f5b7c005880 comp rx=0 tx=0).stop 2023-06-20T13:32:55.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.274+0000 7f5b8ffff700 1 -- 172.21.15.32:0/685464185 reap_dead start 2023-06-20T13:32:55.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.275+0000 7f5b95dff700 1 -- 172.21.15.32:0/685464185 shutdown_connections 2023-06-20T13:32:55.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.275+0000 7f5b95dff700 1 -- 172.21.15.32:0/685464185 >> 172.21.15.32:0/685464185 conn(0x7f5b9006ab60 msgr2=0x7f5b9006e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:55.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.275+0000 7fe8cefff700 1 -- 172.21.15.32:0/1993115149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8c80c9820 msgr2=0x7fe8c8160a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.275+0000 7fe8cefff700 1 --2- 172.21.15.32:0/1993115149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8c80c9820 0x7fe8c8160a30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0009870 tx=0x7fe8c0009b80 comp rx=0 tx=0).stop 2023-06-20T13:32:55.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.275+0000 7f8fc8fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fc40b0aa0 0x7f8fc4202d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.274+0000 7f71fb5ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71f40c9970 0x7f71f40c4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.274+0000 7f71fb5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71f40c9d40 0x7f71f4147a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.275+0000 7f71fb5ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71f40cb6e0 0x7f71f413c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.275+0000 7f71fb5ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f40b0b40 con 0x7f71f40cb6e0 2023-06-20T13:32:55.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.275+0000 7f71fb5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f414bce0 con 0x7f71f40c9d40 2023-06-20T13:32:55.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.275+0000 7f71fb5ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f41498f0 con 0x7f71f40c9970 2023-06-20T13:32:55.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.275+0000 7f8fc8fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fc40c9e10 0x7f8fc41fe6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.275+0000 7f8fc8fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fc40cb6e0 0x7f8fc40c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.275+0000 7f8fc8fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc40c79e0 con 0x7f8fc40b0aa0 2023-06-20T13:32:55.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.275+0000 7f8fc8fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc40c7c60 con 0x7f8fc40c9e10 2023-06-20T13:32:55.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.275+0000 7f8fc8fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc40c7f40 con 0x7f8fc40cb6e0 2023-06-20T13:32:55.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.275+0000 7fa52ebff700 1 -- start start 2023-06-20T13:32:55.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.276+0000 7f5b95dff700 1 -- 172.21.15.32:0/685464185 shutdown_connections 2023-06-20T13:32:55.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.276+0000 7f8fc2d9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fc40cb6e0 0x7f8fc40c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.276+0000 7f8fc2d9d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fc40cb6e0 0x7f8fc40c74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.32:35624/0 (socket says 172.21.15.32:35624) 2023-06-20T13:32:55.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.276+0000 7f8fc2d9d700 1 -- 172.21.15.32:0/2724985089 learned_addr learned my addr 172.21.15.32:0/2724985089 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:55.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.276+0000 7f71f9b9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71f40cb6e0 0x7f71f413c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.276+0000 7f71f8b9a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71f40c9d40 0x7f71f4147a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.276+0000 7f71f9b9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71f40cb6e0 0x7f71f413c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59292/0 (socket says 172.21.15.32:59292) 2023-06-20T13:32:55.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.276+0000 7f71f9b9c700 1 -- 172.21.15.32:0/3869424893 learned_addr learned my addr 172.21.15.32:0/3869424893 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:55.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.275+0000 7f6e14ff9700 1 -- 172.21.15.32:0/52891401 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c00c070 con 0x7f6e180abea0 2023-06-20T13:32:55.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.275+0000 7f6e14ff9700 1 -- 172.21.15.32:0/52891401 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e0c013630 con 0x7f6e180abea0 2023-06-20T13:32:55.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.275+0000 7f6e14ff9700 1 -- 172.21.15.32:0/52891401 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c0139e0 con 0x7f6e180abea0 2023-06-20T13:32:55.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.275+0000 7f6e1e5ff700 1 -- 172.21.15.32:0/52891401 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e180adfa0 con 0x7f6e180abea0 2023-06-20T13:32:55.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.276+0000 7f6e1e5ff700 1 -- 172.21.15.32:0/52891401 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e18154ef0 con 0x7f6e180abea0 2023-06-20T13:32:55.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.276+0000 7f8fc1d9b700 1 --2- 172.21.15.32:0/2724985089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fc40c9e10 0x7f8fc41fe6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.277+0000 7f8fc259c700 1 --2- 172.21.15.32:0/2724985089 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fc40b0aa0 0x7f8fc4202d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.277+0000 7f71f939b700 1 --2- 172.21.15.32:0/3869424893 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71f40c9970 0x7f71f40c4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.277+0000 7f71f9b9c700 1 -- 172.21.15.32:0/3869424893 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71f40c9970 msgr2=0x7f71f40c4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.277+0000 7f71f9b9c700 1 --2- 172.21.15.32:0/3869424893 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71f40c9970 0x7f71f40c4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.277+0000 7f71f9b9c700 1 -- 172.21.15.32:0/3869424893 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71f40c9d40 msgr2=0x7f71f4147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.277+0000 7f71f9b9c700 1 --2- 172.21.15.32:0/3869424893 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71f40c9d40 0x7f71f4147a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.277+0000 7f71f9b9c700 1 -- 172.21.15.32:0/3869424893 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e40085d0 con 0x7f71f40cb6e0 2023-06-20T13:32:55.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.277+0000 7f8fc1d9b700 1 -- 172.21.15.32:0/2724985089 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fc40cb6e0 msgr2=0x7f8fc40c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.277+0000 7f8fc1d9b700 1 --2- 172.21.15.32:0/2724985089 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fc40cb6e0 0x7f8fc40c74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.277+0000 7f8fc1d9b700 1 -- 172.21.15.32:0/2724985089 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fc40b0aa0 msgr2=0x7f8fc4202d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.277+0000 7f8fc1d9b700 1 --2- 172.21.15.32:0/2724985089 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fc40b0aa0 0x7f8fc4202d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.277+0000 7f8fc1d9b700 1 -- 172.21.15.32:0/2724985089 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb400bd40 con 0x7f8fc40c9e10 2023-06-20T13:32:55.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.278+0000 7f8fc1d9b700 1 --2- 172.21.15.32:0/2724985089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fc40c9e10 0x7f8fc41fe6f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4016000 tx=0x7f8fb4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:55.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.277+0000 7fa52ebff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5280c9970 0x7fa5280cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.301 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.278+0000 7fa52ebff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa5280b0aa0 0x7fa528157d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.278+0000 7fa52ebff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa5280c9d40 0x7fa5281582a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.278+0000 7fa52ebff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5281587e0 con 0x7fa5280c9d40 2023-06-20T13:32:55.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.278+0000 7fa52ebff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5280cce20 con 0x7fa5280b0aa0 2023-06-20T13:32:55.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.278+0000 7fa52ebff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5280cd100 con 0x7fa5280c9970 2023-06-20T13:32:55.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.278+0000 7fa52c99b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5280c9970 0x7fa5280cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.278+0000 7fa52c99b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5280c9970 0x7fa5280cdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.32:35634/0 (socket says 172.21.15.32:35634) 2023-06-20T13:32:55.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.278+0000 7fa52c99b700 1 -- 172.21.15.32:0/122718667 learned_addr learned my addr 172.21.15.32:0/122718667 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:55.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.276+0000 7f5b95dff700 1 -- 172.21.15.32:0/685464185 wait complete. 2023-06-20T13:32:55.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.278+0000 7fe8cefff700 1 -- 172.21.15.32:0/1993115149 shutdown_connections 2023-06-20T13:32:55.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.278+0000 7fe8cefff700 1 --2- 172.21.15.32:0/1993115149 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8c80cb190 0x7fe8c80cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.278+0000 7fe8cefff700 1 --2- 172.21.15.32:0/1993115149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8c80c9820 0x7fe8c8160a30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.278+0000 7fe8cefff700 1 -- 172.21.15.32:0/1993115149 >> 172.21.15.32:0/1993115149 conn(0x7fe8c806abc0 msgr2=0x7fe8c80b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:55.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.279+0000 7fe8cefff700 1 -- 172.21.15.32:0/1993115149 shutdown_connections 2023-06-20T13:32:55.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.279+0000 7fa52d19c700 1 --2- 172.21.15.32:0/122718667 >> v2:172.21.15.32:3300/0 conn(0x7fa5280c9d40 0x7fa5281582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.279+0000 7fa52c99b700 1 -- 172.21.15.32:0/122718667 >> v2:172.21.15.115:3300/0 conn(0x7fa5280b0aa0 msgr2=0x7fa528157d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-20T13:32:55.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.279+0000 7fa52c99b700 1 --2- 172.21.15.32:0/122718667 >> v2:172.21.15.115:3300/0 conn(0x7fa5280b0aa0 0x7fa528157d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.279+0000 7fa52c99b700 1 -- 172.21.15.32:0/122718667 >> v2:172.21.15.32:3300/0 conn(0x7fa5280c9d40 msgr2=0x7fa5281582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:55.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.279+0000 7fa52c99b700 1 --2- 172.21.15.32:0/122718667 >> v2:172.21.15.32:3300/0 conn(0x7fa5280c9d40 0x7fa5281582a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.279+0000 7fa52c99b700 1 -- 172.21.15.32:0/122718667 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5280cd3e0 con 0x7fa5280c9970 2023-06-20T13:32:55.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.279+0000 7f5b95dff700 1 Processor -- start 2023-06-20T13:32:55.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.279+0000 7fe8cefff700 1 -- 172.21.15.32:0/1993115149 wait complete. 2023-06-20T13:32:55.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.279+0000 7f71f9b9c700 1 --2- 172.21.15.32:0/3869424893 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71f40cb6e0 0x7f71f413c250 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f71f000b410 tx=0x7f71f000b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:55.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.280+0000 7f71e9ffb700 1 -- 172.21.15.32:0/3869424893 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f0011830 con 0x7f71f40cb6e0 2023-06-20T13:32:55.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.280+0000 7f71e9ffb700 1 -- 172.21.15.32:0/3869424893 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f0011990 con 0x7f71f40cb6e0 2023-06-20T13:32:55.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.280+0000 7f71e9ffb700 1 -- 172.21.15.32:0/3869424893 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f0011d20 con 0x7f71f40cb6e0 2023-06-20T13:32:55.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.279+0000 7f5b95dff700 1 -- start start 2023-06-20T13:32:55.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.280+0000 7f8fb2ffd700 1 -- 172.21.15.32:0/2724985089 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb401b040 con 0x7f8fc40c9e10 2023-06-20T13:32:55.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.280+0000 7f8fb2ffd700 1 -- 172.21.15.32:0/2724985089 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb4009d70 con 0x7f8fc40c9e10 2023-06-20T13:32:55.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.280+0000 7f8fb2ffd700 1 -- 172.21.15.32:0/2724985089 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb40176a0 con 0x7f8fc40c9e10 2023-06-20T13:32:55.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.280+0000 7f8fc8fff700 1 -- 172.21.15.32:0/2724985089 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc40c8220 con 0x7f8fc40c9e10 2023-06-20T13:32:55.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.280+0000 7f8fc8fff700 1 -- 172.21.15.32:0/2724985089 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc40af350 con 0x7f8fc40c9e10 2023-06-20T13:32:55.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.281+0000 7f6e1e5ff700 1 -- 172.21.15.32:0/52891401 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df80052f0 con 0x7f6e180abea0 2023-06-20T13:32:55.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.281+0000 7f71fb5ff700 1 -- 172.21.15.32:0/3869424893 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f414b3b0 con 0x7f71f40cb6e0 2023-06-20T13:32:55.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.282+0000 7f71fb5ff700 1 -- 172.21.15.32:0/3869424893 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f414b970 con 0x7f71f40cb6e0 2023-06-20T13:32:55.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.282+0000 7f8fc8fff700 1 -- 172.21.15.32:0/2724985089 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc404ea60 con 0x7f8fc40c9e10 2023-06-20T13:32:55.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.282+0000 7fe8cefff700 1 Processor -- start 2023-06-20T13:32:55.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.282+0000 7fe8cefff700 1 -- start start 2023-06-20T13:32:55.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.281+0000 7f6e14ff9700 1 -- 172.21.15.32:0/52891401 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6e0c013b40 con 0x7f6e180abea0 2023-06-20T13:32:55.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.283+0000 7f6e14ff9700 1 --2- 172.21.15.32:0/52891401 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6e0406adb0 0x7f6e0406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.283+0000 7f6e14ff9700 1 -- 172.21.15.32:0/52891401 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6e0c0891d0 con 0x7f6e180abea0 2023-06-20T13:32:55.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.281+0000 7f5b95dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b7c004850 0x7f5b90150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.281+0000 7f5b95dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b900c6c30 0x7f5b90163370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.281+0000 7f5b95dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b9014fc20 0x7f5b90150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.281+0000 7f5b95dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b900c74d0 con 0x7f5b7c004850 2023-06-20T13:32:55.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.281+0000 7f5b95dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b90161600 con 0x7f5b900c6c30 2023-06-20T13:32:55.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.281+0000 7f5b95dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b901505d0 con 0x7f5b9014fc20 2023-06-20T13:32:55.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.282+0000 7f5b8f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b7c004850 0x7f5b90150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.282+0000 7f5b8f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b7c004850 0x7f5b90150900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59324/0 (socket says 172.21.15.32:59324) 2023-06-20T13:32:55.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.282+0000 7f5b8f7fe700 1 -- 172.21.15.32:0/3712339444 learned_addr learned my addr 172.21.15.32:0/3712339444 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:55.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.283+0000 7f5b8f7fe700 1 -- 172.21.15.32:0/3712339444 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b9014fc20 msgr2=0x7f5b90150090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-20T13:32:55.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.283+0000 7f5b8f7fe700 1 --2- 172.21.15.32:0/3712339444 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b9014fc20 0x7f5b90150090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.283+0000 7f5b8f7fe700 1 -- 172.21.15.32:0/3712339444 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b900c6c30 msgr2=0x7f5b90163370 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-20T13:32:55.311 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.283+0000 7f5b8f7fe700 1 --2- 172.21.15.32:0/3712339444 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b900c6c30 0x7f5b90163370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.283+0000 7f5b8f7fe700 1 -- 172.21.15.32:0/3712339444 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b900c71f0 con 0x7f5b7c004850 2023-06-20T13:32:55.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.284+0000 7f5b8f7fe700 1 --2- 172.21.15.32:0/3712339444 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b7c004850 0x7f5b90150900 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5b80001980 tx=0x7f5b80007340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:55.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.284+0000 7f71fb5ff700 1 -- 172.21.15.32:0/3869424893 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f414be90 con 0x7f71f40cb6e0 2023-06-20T13:32:55.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.284+0000 7fa52c99b700 1 --2- 172.21.15.32:0/122718667 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5280c9970 0x7fa5280cdec0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa52806ff30 tx=0x7fa51c009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2bb46161f02dc98 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:55.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.285+0000 7f6e177fe700 1 --2- 172.21.15.32:0/52891401 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6e0406adb0 0x7f6e0406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.286+0000 7f71e9ffb700 1 -- 172.21.15.32:0/3869424893 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f71f001a400 con 0x7f71f40cb6e0 2023-06-20T13:32:55.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.286+0000 7f8fb2ffd700 1 -- 172.21.15.32:0/2724985089 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8fb4003a20 con 0x7f8fc40c9e10 2023-06-20T13:32:55.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.286+0000 7f6e177fe700 1 --2- 172.21.15.32:0/52891401 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6e0406adb0 0x7f6e0406d260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000b370 tx=0x7f6e10009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:55.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.286+0000 7f5b8cff9700 1 -- 172.21.15.32:0/3712339444 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b80035400 con 0x7f5b7c004850 2023-06-20T13:32:55.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.287+0000 7f5b95dff700 1 -- 172.21.15.32:0/3712339444 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b90160fb0 con 0x7f5b7c004850 2023-06-20T13:32:55.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.287+0000 7f5b95dff700 1 -- 172.21.15.32:0/3712339444 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b90150e40 con 0x7f5b7c004850 2023-06-20T13:32:55.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.284+0000 7fe8cefff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8c80ad7c0 0x7fe8c815ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.284+0000 7fe8cefff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8c80c9820 0x7fe8c80b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.284+0000 7fe8cefff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8c80cb190 0x7fe8c80b3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.284+0000 7fe8cefff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c80b1cc0 con 0x7fe8c80ad7c0 2023-06-20T13:32:55.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.284+0000 7fe8cefff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c80b1690 con 0x7fe8c80c9820 2023-06-20T13:32:55.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.284+0000 7fe8cefff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c80b3db0 con 0x7fe8c80cb190 2023-06-20T13:32:55.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.285+0000 7fe8ccd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8c80ad7c0 0x7fe8c815ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.285+0000 7fe8ccd9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8c80ad7c0 0x7fe8c815ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59330/0 (socket says 172.21.15.32:59330) 2023-06-20T13:32:55.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.285+0000 7fe8ccd9b700 1 -- 172.21.15.32:0/43568397 learned_addr learned my addr 172.21.15.32:0/43568397 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:55.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.285+0000 7fe8c7fff700 1 --2- 172.21.15.32:0/43568397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8c80c9820 0x7fe8c80b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.285+0000 7fe8cd59c700 1 --2- 172.21.15.32:0/43568397 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8c80cb190 0x7fe8c80b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.285+0000 7fe8c7fff700 1 -- 172.21.15.32:0/43568397 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8c80cb190 msgr2=0x7fe8c80b3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.285+0000 7fe8c7fff700 1 --2- 172.21.15.32:0/43568397 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8c80cb190 0x7fe8c80b3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.285+0000 7fe8c7fff700 1 -- 172.21.15.32:0/43568397 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8c80ad7c0 msgr2=0x7fe8c815ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.285+0000 7fe8c7fff700 1 --2- 172.21.15.32:0/43568397 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8c80ad7c0 0x7fe8c815ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.285+0000 7fe8c7fff700 1 -- 172.21.15.32:0/43568397 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c00094a0 con 0x7fe8c80c9820 2023-06-20T13:32:55.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.286+0000 7fe8c7fff700 1 --2- 172.21.15.32:0/43568397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8c80c9820 0x7fe8c80b20e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0015000 tx=0x7fe8c0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:55.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.287+0000 7f71e9ffb700 1 --2- 172.21.15.32:0/3869424893 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f71d806adb0 0x7f71d806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.287+0000 7f71e9ffb700 1 -- 172.21.15.32:0/3869424893 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f71f00897b0 con 0x7f71f40cb6e0 2023-06-20T13:32:55.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.288+0000 7f6e14ff9700 1 -- 172.21.15.32:0/52891401 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6e0c053f70 con 0x7f6e180abea0 2023-06-20T13:32:55.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.288+0000 7f8fb2ffd700 1 --2- 172.21.15.32:0/2724985089 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8fa406ad30 0x7f8fa406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.288+0000 7f8fb2ffd700 1 -- 172.21.15.32:0/2724985089 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8fb408b8d0 con 0x7f8fc40c9e10 2023-06-20T13:32:55.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.288+0000 7f8fc259c700 1 --2- 172.21.15.32:0/2724985089 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8fa406ad30 0x7f8fa406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.288+0000 7f71f939b700 1 --2- 172.21.15.32:0/3869424893 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f71d806adb0 0x7f71d806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.289+0000 7fa5277fe700 1 -- 172.21.15.32:0/122718667 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c00b870 con 0x7fa5280c9970 2023-06-20T13:32:55.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.289+0000 7fa5277fe700 1 -- 172.21.15.32:0/122718667 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51c00b9d0 con 0x7fa5280c9970 2023-06-20T13:32:55.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.289+0000 7fa5277fe700 1 -- 172.21.15.32:0/122718667 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c00bd60 con 0x7fa5280c9970 2023-06-20T13:32:55.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.289+0000 7fe8c57fa700 1 -- 172.21.15.32:0/43568397 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0003ea0 con 0x7fe8c80c9820 2023-06-20T13:32:55.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.289+0000 7fe8c57fa700 1 -- 172.21.15.32:0/43568397 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c001e070 con 0x7fe8c80c9820 2023-06-20T13:32:55.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.289+0000 7fe8c57fa700 1 -- 172.21.15.32:0/43568397 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0011830 con 0x7fe8c80c9820 2023-06-20T13:32:55.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.289+0000 7f8fc259c700 1 --2- 172.21.15.32:0/2724985089 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8fa406ad30 0x7f8fa406d1e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8007fd0 tx=0x7f8fb8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:55.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.289+0000 7f8fb2ffd700 1 -- 172.21.15.32:0/2724985089 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8fb405a2b0 con 0x7f8fc40c9e10 2023-06-20T13:32:55.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.290+0000 7f5b95dff700 1 -- 172.21.15.32:0/3712339444 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b90160e10 con 0x7f5b7c004850 2023-06-20T13:32:55.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.290+0000 7fa52ebff700 1 -- 172.21.15.32:0/122718667 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5280c9970 msgr2=0x7fa5280cdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.290+0000 7fa52ebff700 1 --2- 172.21.15.32:0/122718667 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5280c9970 0x7fa5280cdec0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa52806ff30 tx=0x7fa51c009bd0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.290+0000 7fe8cefff700 1 -- 172.21.15.32:0/43568397 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8c80b4090 con 0x7fe8c80c9820 2023-06-20T13:32:55.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.290+0000 7fe8cefff700 1 -- 172.21.15.32:0/43568397 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c815f690 con 0x7fe8c80c9820 2023-06-20T13:32:55.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.290+0000 7f71f939b700 1 --2- 172.21.15.32:0/3869424893 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f71d806adb0 0x7f71d806d260 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f71ec001f80 tx=0x7f71ec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:55.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.290+0000 7fa52ebff700 1 -- 172.21.15.32:0/122718667 shutdown_connections 2023-06-20T13:32:55.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.290+0000 7fa52ebff700 1 --2- 172.21.15.32:0/122718667 >> v2:172.21.15.32:3300/0 conn(0x7fa5280c9d40 0x7fa5281582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.290+0000 7fa52ebff700 1 --2- 172.21.15.32:0/122718667 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5280c9970 0x7fa5280cdec0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.290+0000 7fa52ebff700 1 --2- 172.21.15.32:0/122718667 >> v2:172.21.15.115:3300/0 conn(0x7fa5280b0aa0 0x7fa528157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.290+0000 7fa52ebff700 1 -- 172.21.15.32:0/122718667 >> 172.21.15.32:0/122718667 conn(0x7fa52806abc0 msgr2=0x7fa5280b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:55.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.290+0000 7fa52ebff700 1 -- 172.21.15.32:0/122718667 shutdown_connections 2023-06-20T13:32:55.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.291+0000 7fa52ebff700 1 -- 172.21.15.32:0/122718667 wait complete. 2023-06-20T13:32:55.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.293+0000 7fe8cefff700 1 -- 172.21.15.32:0/43568397 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a80052f0 con 0x7fe8c80c9820 2023-06-20T13:32:55.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.293+0000 7fdee41ff700 1 Processor -- start 2023-06-20T13:32:55.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.294+0000 7fdee41ff700 1 -- start start 2023-06-20T13:32:55.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.297+0000 7f5b8cff9700 1 -- 172.21.15.32:0/3712339444 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b80035560 con 0x7f5b7c004850 2023-06-20T13:32:55.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.297+0000 7f5b8cff9700 1 -- 172.21.15.32:0/3712339444 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b800358d0 con 0x7f5b7c004850 2023-06-20T13:32:55.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.295+0000 7fe8c57fa700 1 -- 172.21.15.32:0/43568397 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe8c0011990 con 0x7fe8c80c9820 2023-06-20T13:32:55.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.296+0000 7fe8c57fa700 1 --2- 172.21.15.32:0/43568397 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe8b406adb0 0x7fe8b406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.296+0000 7fe8c57fa700 1 -- 172.21.15.32:0/43568397 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe8c008a730 con 0x7fe8c80c9820 2023-06-20T13:32:55.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.294+0000 7fa52ebff700 1 Processor -- start 2023-06-20T13:32:55.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.295+0000 7fa52ebff700 1 -- start start 2023-06-20T13:32:55.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.296+0000 7fa52ebff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5280b0aa0 0x7fa52815a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.296+0000 7fa52ebff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5280c9970 0x7fa528202340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.296+0000 7fa52ebff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5280c9d40 0x7fa528202880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.296+0000 7fa52ebff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5281fec60 con 0x7fa5280b0aa0 2023-06-20T13:32:55.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.296+0000 7fa52ebff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5280adbd0 con 0x7fa5280c9d40 2023-06-20T13:32:55.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.296+0000 7fa52ebff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa52815aa70 con 0x7fa5280c9970 2023-06-20T13:32:55.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.297+0000 7fa52c99b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5280b0aa0 0x7fa52815a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.297+0000 7fa52c99b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5280b0aa0 0x7fa52815a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59348/0 (socket says 172.21.15.32:59348) 2023-06-20T13:32:55.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.297+0000 7fa52c99b700 1 -- 172.21.15.32:0/2972650084 learned_addr learned my addr 172.21.15.32:0/2972650084 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:55.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.295+0000 7fdee41ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdedc15c460 0x7fdedc0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.296+0000 7fdee41ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdedc0d2640 0x7fdedc0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.296+0000 7fdee41ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdedc0d1790 con 0x7fdedc0cf720 2023-06-20T13:32:55.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.296+0000 7fdee41ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdedc0cedd0 con 0x7fdedc0d2640 2023-06-20T13:32:55.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.296+0000 7fdee41ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdedc0cd950 con 0x7fdedc15c460 2023-06-20T13:32:55.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.298+0000 7fa527fff700 1 --2- 172.21.15.32:0/2972650084 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5280c9970 0x7fa528202340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.298+0000 7fa52d19c700 1 --2- 172.21.15.32:0/2972650084 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5280c9d40 0x7fa528202880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.297+0000 7fdee1f9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdedc15c460 0x7fdedc0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.297+0000 7fdee1f9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdedc15c460 0x7fdedc0b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:46226/0 (socket says 172.21.15.32:46226) 2023-06-20T13:32:55.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.297+0000 7fdee1f9b700 1 -- 172.21.15.32:0/2689765658 learned_addr learned my addr 172.21.15.32:0/2689765658 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:55.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.297+0000 7fdee179a700 1 --2- 172.21.15.32:0/2689765658 >> v2:172.21.15.32:3300/0 conn(0x7fdedc0d2640 0x7fdedc0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.298+0000 7fdee1f9b700 1 -- 172.21.15.32:0/2689765658 >> v2:172.21.15.32:3300/0 conn(0x7fdedc0d2640 msgr2=0x7fdedc0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:55.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.298+0000 7fdee1f9b700 1 --2- 172.21.15.32:0/2689765658 >> v2:172.21.15.32:3300/0 conn(0x7fdedc0d2640 0x7fdedc0cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.298+0000 7fdee1f9b700 1 -- 172.21.15.32:0/2689765658 >> v1:172.21.15.32:6789/0 conn(0x7fdedc0cf720 legacy=0x7fdedc0d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:55.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.298+0000 7fdee1f9b700 1 -- 172.21.15.32:0/2689765658 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdedc0d14b0 con 0x7fdedc15c460 2023-06-20T13:32:55.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.299+0000 7fe8ccd9b700 1 --2- 172.21.15.32:0/43568397 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe8b406adb0 0x7fe8b406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.300+0000 7fe8ccd9b700 1 --2- 172.21.15.32:0/43568397 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe8b406adb0 0x7fe8b406d260 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe8c80ce140 tx=0x7fe8b800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:55.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.300+0000 7f71e9ffb700 1 -- 172.21.15.32:0/3869424893 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f71f414be90 con 0x7f71f40cb6e0 2023-06-20T13:32:55.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.300+0000 7fe8c57fa700 1 -- 172.21.15.32:0/43568397 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe8c0055560 con 0x7fe8c80c9820 2023-06-20T13:32:55.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.298+0000 7fa52c99b700 1 -- 172.21.15.32:0/2972650084 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5280c9970 msgr2=0x7fa528202340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.298+0000 7fa52c99b700 1 --2- 172.21.15.32:0/2972650084 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5280c9970 0x7fa528202340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.298+0000 7fa52c99b700 1 -- 172.21.15.32:0/2972650084 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5280c9d40 msgr2=0x7fa528202880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.298+0000 7fa52c99b700 1 --2- 172.21.15.32:0/2972650084 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5280c9d40 0x7fa528202880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.298+0000 7fa52c99b700 1 -- 172.21.15.32:0/2972650084 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51c009550 con 0x7fa5280b0aa0 2023-06-20T13:32:55.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.299+0000 7fa52c99b700 1 --2- 172.21.15.32:0/2972650084 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5280b0aa0 0x7fa52815a530 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa5280cd240 tx=0x7fa51c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:55.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.299+0000 7f5b8cff9700 1 -- 172.21.15.32:0/3712339444 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5b80035a70 con 0x7f5b7c004850 2023-06-20T13:32:55.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.301+0000 7fdee1f9b700 1 --2- 172.21.15.32:0/2689765658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdedc15c460 0x7fdedc0b59d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdedc0b4f00 tx=0x7fded000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbe73e3d45b49646 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:55.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.301+0000 7f5b8cff9700 1 --2- 172.21.15.32:0/3712339444 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5b7006ace0 0x7f5b7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.301+0000 7f5b8cff9700 1 -- 172.21.15.32:0/3712339444 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5b800aca20 con 0x7f5b7c004850 2023-06-20T13:32:55.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.302+0000 7f5b86ffd700 1 --2- 172.21.15.32:0/3712339444 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5b7006ace0 0x7f5b7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.302+0000 7fdee0f99700 1 -- 172.21.15.32:0/2689765658 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded0003c20 con 0x7fdedc15c460 2023-06-20T13:32:55.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.302+0000 7fdee0f99700 1 -- 172.21.15.32:0/2689765658 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded0003d80 con 0x7fdedc15c460 2023-06-20T13:32:55.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.302+0000 7fdee0f99700 1 -- 172.21.15.32:0/2689765658 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded000bbc0 con 0x7fdedc15c460 2023-06-20T13:32:55.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.303+0000 7f5b86ffd700 1 --2- 172.21.15.32:0/3712339444 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5b7006ace0 0x7f5b7006d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5b900c3e80 tx=0x7f5b7800a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:55.335 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.303+0000 7fdee41ff700 1 -- 172.21.15.32:0/2689765658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdedc15c460 msgr2=0x7fdedc0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.303+0000 7fdee41ff700 1 --2- 172.21.15.32:0/2689765658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdedc15c460 0x7fdedc0b59d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdedc0b4f00 tx=0x7fded000b330 comp rx=0 tx=0).stop 2023-06-20T13:32:55.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.303+0000 7fdee41ff700 1 -- 172.21.15.32:0/2689765658 shutdown_connections 2023-06-20T13:32:55.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.303+0000 7fdee41ff700 1 --2- 172.21.15.32:0/2689765658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdedc15c460 0x7fdedc0b59d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.303+0000 7fdee41ff700 1 --2- 172.21.15.32:0/2689765658 >> v2:172.21.15.32:3300/0 conn(0x7fdedc0d2640 0x7fdedc0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.303+0000 7fdee41ff700 1 -- 172.21.15.32:0/2689765658 >> 172.21.15.32:0/2689765658 conn(0x7fdedc071660 msgr2=0x7fdedc071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:55.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.304+0000 7fdee41ff700 1 -- 172.21.15.32:0/2689765658 shutdown_connections 2023-06-20T13:32:55.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.304+0000 7fa5257fa700 1 -- 172.21.15.32:0/2972650084 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c004440 con 0x7fa5280b0aa0 2023-06-20T13:32:55.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.304+0000 7fa5257fa700 1 -- 172.21.15.32:0/2972650084 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51c0045a0 con 0x7fa5280b0aa0 2023-06-20T13:32:55.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.304+0000 7fa5257fa700 1 -- 172.21.15.32:0/2972650084 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c0038a0 con 0x7fa5280b0aa0 2023-06-20T13:32:55.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.304+0000 7f5b8cff9700 1 -- 172.21.15.32:0/3712339444 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5b80077750 con 0x7f5b7c004850 2023-06-20T13:32:55.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.305+0000 7fa52ebff700 1 -- 172.21.15.32:0/2972650084 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5280c5bc0 con 0x7fa5280b0aa0 2023-06-20T13:32:55.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.305+0000 7fa52ebff700 1 -- 172.21.15.32:0/2972650084 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa52815aff0 con 0x7fa5280b0aa0 2023-06-20T13:32:55.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.304+0000 7fdee41ff700 1 -- 172.21.15.32:0/2689765658 wait complete. 2023-06-20T13:32:55.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.307+0000 7fdee41ff700 1 Processor -- start 2023-06-20T13:32:55.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.307+0000 7fdee41ff700 1 -- start start 2023-06-20T13:32:55.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.310+0000 7fdee41ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdedc0cf720 0x7fdedc0c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.310+0000 7fdee41ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdedc0d2640 0x7fdedc152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.310+0000 7fdee41ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdedc15c460 0x7fdedc150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.310+0000 7fdee41ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc0c83d0 con 0x7fdedc0cf720 2023-06-20T13:32:55.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.310+0000 7fdee41ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc0c86b0 con 0x7fdedc0d2640 2023-06-20T13:32:55.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.310+0000 7fdee41ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc0c8990 con 0x7fdedc15c460 2023-06-20T13:32:55.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.309+0000 7fa5257fa700 1 -- 172.21.15.32:0/2972650084 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa51c003a00 con 0x7fa5280b0aa0 2023-06-20T13:32:55.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.312+0000 7fa52ebff700 1 -- 172.21.15.32:0/2972650084 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5280ad980 con 0x7fa5280b0aa0 2023-06-20T13:32:55.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.312+0000 7fa5257fa700 1 --2- 172.21.15.32:0/2972650084 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa51406adb0 0x7fa51406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.312+0000 7fa5257fa700 1 -- 172.21.15.32:0/2972650084 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa51c08ad60 con 0x7fa5280b0aa0 2023-06-20T13:32:55.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.312+0000 7fdee179a700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdedc0d2640 0x7fdedc152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.312+0000 7fdee279c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdedc15c460 0x7fdedc150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.312+0000 7fdee279c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdedc15c460 0x7fdedc150d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.32:35650/0 (socket says 172.21.15.32:35650) 2023-06-20T13:32:55.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.312+0000 7fdee279c700 1 -- 172.21.15.32:0/2428836034 learned_addr learned my addr 172.21.15.32:0/2428836034 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:55.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.313+0000 7fdee1f9b700 1 --2- 172.21.15.32:0/2428836034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdedc0cf720 0x7fdedc0c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.313+0000 7fa527fff700 1 --2- 172.21.15.32:0/2972650084 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa51406adb0 0x7fa51406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.342 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.314+0000 7fdee1f9b700 1 -- 172.21.15.32:0/2428836034 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdedc15c460 msgr2=0x7fdedc150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.342 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.314+0000 7fdee1f9b700 1 --2- 172.21.15.32:0/2428836034 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdedc15c460 0x7fdedc150d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.342 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.314+0000 7fdee1f9b700 1 -- 172.21.15.32:0/2428836034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdedc0d2640 msgr2=0x7fdedc152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.342 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.314+0000 7fdee1f9b700 1 --2- 172.21.15.32:0/2428836034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdedc0d2640 0x7fdedc152bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.342 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.314+0000 7fdee1f9b700 1 -- 172.21.15.32:0/2428836034 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded0009b30 con 0x7fdedc0cf720 2023-06-20T13:32:55.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.314+0000 7fa527fff700 1 --2- 172.21.15.32:0/2972650084 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa51406adb0 0x7fa51406d260 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa5280b0a70 tx=0x7fa518009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:55.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.314+0000 7fdee1f9b700 1 --2- 172.21.15.32:0/2428836034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdedc0cf720 0x7fdedc0c66b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fded001c000 tx=0x7fded0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:55.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.325+0000 7fa5257fa700 1 -- 172.21.15.32:0/2972650084 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa51c055b90 con 0x7fa5280b0aa0 2023-06-20T13:32:55.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.325+0000 7fdeda7fc700 1 -- 172.21.15.32:0/2428836034 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded00092e0 con 0x7fdedc0cf720 2023-06-20T13:32:55.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.325+0000 7fdeda7fc700 1 -- 172.21.15.32:0/2428836034 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded0014e60 con 0x7fdedc0cf720 2023-06-20T13:32:55.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.325+0000 7fdeda7fc700 1 -- 172.21.15.32:0/2428836034 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded000bdd0 con 0x7fdedc0cf720 2023-06-20T13:32:55.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.325+0000 7fdee41ff700 1 -- 172.21.15.32:0/2428836034 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdedc0c8c70 con 0x7fdedc0cf720 2023-06-20T13:32:55.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.325+0000 7fdee41ff700 1 -- 172.21.15.32:0/2428836034 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdedc153100 con 0x7fdedc0cf720 2023-06-20T13:32:55.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.328+0000 7fdee41ff700 1 -- 172.21.15.32:0/2428836034 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec40052f0 con 0x7fdedc0cf720 2023-06-20T13:32:55.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.343+0000 7fdeda7fc700 1 -- 172.21.15.32:0/2428836034 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fded0004030 con 0x7fdedc0cf720 2023-06-20T13:32:55.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.344+0000 7fdeda7fc700 1 --2- 172.21.15.32:0/2428836034 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdec006adb0 0x7fdec006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:55.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.344+0000 7fdeda7fc700 1 -- 172.21.15.32:0/2428836034 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fded00935a0 con 0x7fdedc0cf720 2023-06-20T13:32:55.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.345+0000 7fdeda7fc700 1 -- 172.21.15.32:0/2428836034 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fded0093a20 con 0x7fdedc0cf720 2023-06-20T13:32:55.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.354+0000 7fdee179a700 1 --2- 172.21.15.32:0/2428836034 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdec006adb0 0x7fdec006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:55.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.355+0000 7fdee179a700 1 --2- 172.21.15.32:0/2428836034 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdec006adb0 0x7fdec006d260 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdedc1f1190 tx=0x7fdec8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:55.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.679+0000 7f7f39dff700 1 -- 172.21.15.32:0/1056475648 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7f140055a0 con 0x7f7f34160ab0 2023-06-20T13:32:55.685 INFO:teuthology.orchestra.run.smithi032.stdout:55834574860 2023-06-20T13:32:55.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.680+0000 7f7f1bfff700 1 -- 172.21.15.32:0/1056475648 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7f28059520 con 0x7f7f34160ab0 2023-06-20T13:32:55.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.684+0000 7f7f39dff700 1 -- 172.21.15.32:0/1056475648 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f7f2006adb0 msgr2=0x7f7f2006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.684+0000 7f7f39dff700 1 --2- 172.21.15.32:0/1056475648 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f7f2006adb0 0x7f7f2006d260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c00d380 tx=0x7f7f2c009040 comp rx=0 tx=0).stop 2023-06-20T13:32:55.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.684+0000 7f7f39dff700 1 -- 172.21.15.32:0/1056475648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f34160ab0 msgr2=0x7f7f340b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.684+0000 7f7f39dff700 1 --2- 172.21.15.32:0/1056475648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f34160ab0 0x7f7f340b1e60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7f34071580 tx=0x7f7f28004750 comp rx=0 tx=0).stop 2023-06-20T13:32:55.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.685+0000 7f7f39dff700 1 -- 172.21.15.32:0/1056475648 shutdown_connections 2023-06-20T13:32:55.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.685+0000 7f7f39dff700 1 --2- 172.21.15.32:0/1056475648 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f7f2006adb0 0x7f7f2006d260 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.685+0000 7f7f39dff700 1 --2- 172.21.15.32:0/1056475648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f7f34160ab0 0x7f7f340b1e60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.685+0000 7f7f39dff700 1 --2- 172.21.15.32:0/1056475648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7f340ad710 0x7f7f340c4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.685+0000 7f7f39dff700 1 --2- 172.21.15.32:0/1056475648 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7f341606e0 0x7f7f340b3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.685+0000 7f7f39dff700 1 -- 172.21.15.32:0/1056475648 >> 172.21.15.32:0/1056475648 conn(0x7f7f3406abc0 msgr2=0x7f7f340703f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:55.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.686+0000 7f7f39dff700 1 -- 172.21.15.32:0/1056475648 shutdown_connections 2023-06-20T13:32:55.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.686+0000 7f7f39dff700 1 -- 172.21.15.32:0/1056475648 wait complete. 2023-06-20T13:32:55.720 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.0 2023-06-20T13:32:55.721 DEBUG:teuthology.parallel:result is None 2023-06-20T13:32:55.734 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.732+0000 7f6e1e5ff700 1 -- 172.21.15.32:0/52891401 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f6df80055a0 con 0x7f6e180abea0 2023-06-20T13:32:55.735 INFO:teuthology.orchestra.run.smithi032.stdout:60129542156 2023-06-20T13:32:55.735 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.732+0000 7f6e14ff9700 1 -- 172.21.15.32:0/52891401 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6e0c057590 con 0x7f6e180abea0 2023-06-20T13:32:55.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.735+0000 7f6e1e5ff700 1 -- 172.21.15.32:0/52891401 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6e0406adb0 msgr2=0x7f6e0406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.735+0000 7f6e1e5ff700 1 --2- 172.21.15.32:0/52891401 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6e0406adb0 0x7f6e0406d260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000b370 tx=0x7f6e10009000 comp rx=0 tx=0).stop 2023-06-20T13:32:55.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.735+0000 7f6e1e5ff700 1 -- 172.21.15.32:0/52891401 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e180abea0 msgr2=0x7f6e181549b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.735+0000 7f6e1e5ff700 1 --2- 172.21.15.32:0/52891401 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e180abea0 0x7f6e181549b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00e790 tx=0x7f6e0c00eaa0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.735+0000 7f6e1e5ff700 1 -- 172.21.15.32:0/52891401 shutdown_connections 2023-06-20T13:32:55.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.735+0000 7f6e1e5ff700 1 --2- 172.21.15.32:0/52891401 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6e0406adb0 0x7f6e0406d260 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.735+0000 7f6e1e5ff700 1 --2- 172.21.15.32:0/52891401 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6e181f7410 0x7f6e181f6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.735+0000 7f6e1e5ff700 1 --2- 172.21.15.32:0/52891401 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6e180abea0 0x7f6e181549b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.735+0000 7f6e1e5ff700 1 --2- 172.21.15.32:0/52891401 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6e180c9820 0x7f6e18150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.735+0000 7f6e1e5ff700 1 -- 172.21.15.32:0/52891401 >> 172.21.15.32:0/52891401 conn(0x7f6e1806abc0 msgr2=0x7f6e180cda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:55.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.736+0000 7f6e1e5ff700 1 -- 172.21.15.32:0/52891401 shutdown_connections 2023-06-20T13:32:55.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.736+0000 7f6e1e5ff700 1 -- 172.21.15.32:0/52891401 wait complete. 2023-06-20T13:32:55.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.749+0000 7f8fc8fff700 1 -- 172.21.15.32:0/2724985089 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8fc40c8080 con 0x7f8fc40c9e10 2023-06-20T13:32:55.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.750+0000 7f8fb2ffd700 1 -- 172.21.15.32:0/2724985089 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8fc40c8080 con 0x7f8fc40c9e10 2023-06-20T13:32:55.752 INFO:teuthology.orchestra.run.smithi032.stdout:55834574860 2023-06-20T13:32:55.756 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.754+0000 7f8fc8fff700 1 -- 172.21.15.32:0/2724985089 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8fa406ad30 msgr2=0x7f8fa406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.757 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.754+0000 7f8fc8fff700 1 --2- 172.21.15.32:0/2724985089 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8fa406ad30 0x7f8fa406d1e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8007fd0 tx=0x7f8fb8009040 comp rx=0 tx=0).stop 2023-06-20T13:32:55.757 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.754+0000 7f8fc8fff700 1 -- 172.21.15.32:0/2724985089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fc40c9e10 msgr2=0x7f8fc41fe6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.757 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.754+0000 7f8fc8fff700 1 --2- 172.21.15.32:0/2724985089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fc40c9e10 0x7f8fc41fe6f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4016000 tx=0x7f8fb4004ad0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.757 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.754+0000 7f8fc8fff700 1 -- 172.21.15.32:0/2724985089 shutdown_connections 2023-06-20T13:32:55.758 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.754+0000 7f8fc8fff700 1 --2- 172.21.15.32:0/2724985089 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8fa406ad30 0x7f8fa406d1e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.758 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.754+0000 7f8fc8fff700 1 --2- 172.21.15.32:0/2724985089 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fc40cb6e0 0x7f8fc40c74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.758 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.754+0000 7f8fc8fff700 1 --2- 172.21.15.32:0/2724985089 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8fc40b0aa0 0x7f8fc4202d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.758 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.754+0000 7f8fc8fff700 1 --2- 172.21.15.32:0/2724985089 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fc40c9e10 0x7f8fc41fe6f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.754+0000 7f8fc8fff700 1 -- 172.21.15.32:0/2724985089 >> 172.21.15.32:0/2724985089 conn(0x7f8fc406abc0 msgr2=0x7f8fc41e2300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:55.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.754+0000 7f8fc8fff700 1 -- 172.21.15.32:0/2724985089 shutdown_connections 2023-06-20T13:32:55.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.755+0000 7f8fc8fff700 1 -- 172.21.15.32:0/2724985089 wait complete. 2023-06-20T13:32:55.760 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.5 2023-06-20T13:32:55.761 DEBUG:teuthology.parallel:result is None 2023-06-20T13:32:55.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.767+0000 7fe8cefff700 1 -- 172.21.15.32:0/43568397 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe8a80055a0 con 0x7fe8c80c9820 2023-06-20T13:32:55.769 INFO:teuthology.orchestra.run.smithi032.stdout:55834574860 2023-06-20T13:32:55.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.767+0000 7fe8c57fa700 1 -- 172.21.15.32:0/43568397 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe8c0006cc0 con 0x7fe8c80c9820 2023-06-20T13:32:55.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.771+0000 7fe8cefff700 1 -- 172.21.15.32:0/43568397 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe8b406adb0 msgr2=0x7fe8b406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.771+0000 7fe8cefff700 1 --2- 172.21.15.32:0/43568397 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe8b406adb0 0x7fe8b406d260 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe8c80ce140 tx=0x7fe8b800b040 comp rx=0 tx=0).stop 2023-06-20T13:32:55.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.771+0000 7fe8cefff700 1 -- 172.21.15.32:0/43568397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8c80c9820 msgr2=0x7fe8c80b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.771+0000 7fe8cefff700 1 --2- 172.21.15.32:0/43568397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8c80c9820 0x7fe8c80b20e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0015000 tx=0x7fe8c0004750 comp rx=0 tx=0).stop 2023-06-20T13:32:55.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.771+0000 7f71fb5ff700 1 -- 172.21.15.32:0/3869424893 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f71f414be90 con 0x7f71f40cb6e0 2023-06-20T13:32:55.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.771+0000 7fe8cefff700 1 -- 172.21.15.32:0/43568397 shutdown_connections 2023-06-20T13:32:55.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.771+0000 7fe8cefff700 1 --2- 172.21.15.32:0/43568397 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe8b406adb0 0x7fe8b406d260 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.771+0000 7fe8cefff700 1 --2- 172.21.15.32:0/43568397 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe8c80cb190 0x7fe8c80b3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.771+0000 7fe8cefff700 1 --2- 172.21.15.32:0/43568397 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe8c80ad7c0 0x7fe8c815ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.771+0000 7fe8cefff700 1 --2- 172.21.15.32:0/43568397 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8c80c9820 0x7fe8c80b20e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.771+0000 7fe8cefff700 1 -- 172.21.15.32:0/43568397 >> 172.21.15.32:0/43568397 conn(0x7fe8c806abc0 msgr2=0x7fe8c80acb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:55.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.771+0000 7fe8cefff700 1 -- 172.21.15.32:0/43568397 shutdown_connections 2023-06-20T13:32:55.776 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.772+0000 7fe8cefff700 1 -- 172.21.15.32:0/43568397 wait complete. 2023-06-20T13:32:55.776 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.772+0000 7f71e9ffb700 1 -- 172.21.15.32:0/3869424893 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f71f414be90 con 0x7f71f40cb6e0 2023-06-20T13:32:55.776 INFO:teuthology.orchestra.run.smithi032.stdout:55834574860 2023-06-20T13:32:55.777 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.775+0000 7f71fb5ff700 1 -- 172.21.15.32:0/3869424893 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f71d806adb0 msgr2=0x7f71d806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.777 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.775+0000 7f71fb5ff700 1 --2- 172.21.15.32:0/3869424893 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f71d806adb0 0x7f71d806d260 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f71ec001f80 tx=0x7f71ec009040 comp rx=0 tx=0).stop 2023-06-20T13:32:55.777 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.775+0000 7f71fb5ff700 1 -- 172.21.15.32:0/3869424893 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71f40cb6e0 msgr2=0x7f71f413c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.777 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.775+0000 7f71fb5ff700 1 --2- 172.21.15.32:0/3869424893 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71f40cb6e0 0x7f71f413c250 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f71f000b410 tx=0x7f71f000b7d0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.1 2023-06-20T13:32:55.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.775+0000 7f71fb5ff700 1 -- 172.21.15.32:0/3869424893 shutdown_connections 2023-06-20T13:32:55.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.775+0000 7f71fb5ff700 1 --2- 172.21.15.32:0/3869424893 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f71d806adb0 0x7f71d806d260 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.775+0000 7f71fb5ff700 1 --2- 172.21.15.32:0/3869424893 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71f40cb6e0 0x7f71f413c250 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.775+0000 7f71fb5ff700 1 --2- 172.21.15.32:0/3869424893 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71f40c9970 0x7f71f40c4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.775+0000 7f71fb5ff700 1 --2- 172.21.15.32:0/3869424893 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71f40c9d40 0x7f71f4147a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.779 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.775+0000 7f71fb5ff700 1 -- 172.21.15.32:0/3869424893 >> 172.21.15.32:0/3869424893 conn(0x7f71f406abc0 msgr2=0x7f71f406e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:55.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.776+0000 7f71fb5ff700 1 -- 172.21.15.32:0/3869424893 shutdown_connections 2023-06-20T13:32:55.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.776+0000 7f71fb5ff700 1 -- 172.21.15.32:0/3869424893 wait complete. 2023-06-20T13:32:55.780 DEBUG:teuthology.parallel:result is None 2023-06-20T13:32:55.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.776+0000 7f5b95dff700 1 -- 172.21.15.32:0/3712339444 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5b90160e10 con 0x7f5b7c004850 2023-06-20T13:32:55.781 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.777+0000 7f5b8cff9700 1 -- 172.21.15.32:0/3712339444 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5b90160e10 con 0x7f5b7c004850 2023-06-20T13:32:55.781 INFO:teuthology.orchestra.run.smithi032.stdout:60129542156 2023-06-20T13:32:55.781 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.777+0000 7fa52ebff700 1 -- 172.21.15.32:0/2972650084 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa52804ea60 con 0x7fa5280b0aa0 2023-06-20T13:32:55.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.778+0000 7fa5257fa700 1 -- 172.21.15.32:0/2972650084 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa51c0093b0 con 0x7fa5280b0aa0 2023-06-20T13:32:55.782 INFO:teuthology.orchestra.run.smithi032.stdout:60129542156 2023-06-20T13:32:55.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.781+0000 7f5b95dff700 1 -- 172.21.15.32:0/3712339444 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5b7006ace0 msgr2=0x7f5b7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.781+0000 7f5b95dff700 1 --2- 172.21.15.32:0/3712339444 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5b7006ace0 0x7f5b7006d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5b900c3e80 tx=0x7f5b7800a000 comp rx=0 tx=0).stop 2023-06-20T13:32:55.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.781+0000 7f5b95dff700 1 -- 172.21.15.32:0/3712339444 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b7c004850 msgr2=0x7f5b90150900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.781+0000 7f5b95dff700 1 --2- 172.21.15.32:0/3712339444 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b7c004850 0x7f5b90150900 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5b80001980 tx=0x7f5b80007340 comp rx=0 tx=0).stop 2023-06-20T13:32:55.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.781+0000 7f5b95dff700 1 -- 172.21.15.32:0/3712339444 shutdown_connections 2023-06-20T13:32:55.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.781+0000 7f5b95dff700 1 --2- 172.21.15.32:0/3712339444 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5b7006ace0 0x7f5b7006d190 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.781+0000 7f5b95dff700 1 --2- 172.21.15.32:0/3712339444 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5b9014fc20 0x7f5b90150090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.781+0000 7f5b95dff700 1 --2- 172.21.15.32:0/3712339444 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5b7c004850 0x7f5b90150900 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.781+0000 7f5b95dff700 1 --2- 172.21.15.32:0/3712339444 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5b900c6c30 0x7f5b90163370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.781+0000 7f5b95dff700 1 -- 172.21.15.32:0/3712339444 >> 172.21.15.32:0/3712339444 conn(0x7f5b9006ab60 msgr2=0x7f5b90157040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:55.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.781+0000 7f5b95dff700 1 -- 172.21.15.32:0/3712339444 shutdown_connections 2023-06-20T13:32:55.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.781+0000 7f5b95dff700 1 -- 172.21.15.32:0/3712339444 wait complete. 2023-06-20T13:32:55.785 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.782+0000 7fa52ebff700 1 -- 172.21.15.32:0/2972650084 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa51406adb0 msgr2=0x7fa51406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.782+0000 7fa52ebff700 1 --2- 172.21.15.32:0/2972650084 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa51406adb0 0x7fa51406d260 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa5280b0a70 tx=0x7fa518009190 comp rx=0 tx=0).stop 2023-06-20T13:32:55.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.782+0000 7fa52ebff700 1 -- 172.21.15.32:0/2972650084 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5280b0aa0 msgr2=0x7fa52815a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.782+0000 7fa52ebff700 1 --2- 172.21.15.32:0/2972650084 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5280b0aa0 0x7fa52815a530 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa5280cd240 tx=0x7fa51c004750 comp rx=0 tx=0).stop 2023-06-20T13:32:55.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.782+0000 7fa52ebff700 1 -- 172.21.15.32:0/2972650084 shutdown_connections 2023-06-20T13:32:55.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.782+0000 7fa52ebff700 1 --2- 172.21.15.32:0/2972650084 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa51406adb0 0x7fa51406d260 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.782+0000 7fa52ebff700 1 --2- 172.21.15.32:0/2972650084 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5280c9d40 0x7fa528202880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.782+0000 7fa52ebff700 1 --2- 172.21.15.32:0/2972650084 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa5280b0aa0 0x7fa52815a530 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.782+0000 7fa52ebff700 1 --2- 172.21.15.32:0/2972650084 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5280c9970 0x7fa528202340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.782+0000 7fa52ebff700 1 -- 172.21.15.32:0/2972650084 >> 172.21.15.32:0/2972650084 conn(0x7fa52806abc0 msgr2=0x7fa52815c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:55.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.782+0000 7fa52ebff700 1 -- 172.21.15.32:0/2972650084 shutdown_connections 2023-06-20T13:32:55.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.782+0000 7fa52ebff700 1 -- 172.21.15.32:0/2972650084 wait complete. 2023-06-20T13:32:55.802 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.2 2023-06-20T13:32:55.802 DEBUG:teuthology.parallel:result is None 2023-06-20T13:32:55.807 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.3 2023-06-20T13:32:55.807 DEBUG:teuthology.parallel:result is None 2023-06-20T13:32:55.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.7 2023-06-20T13:32:55.813 DEBUG:teuthology.parallel:result is None 2023-06-20T13:32:55.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.812+0000 7fdee41ff700 1 -- 172.21.15.32:0/2428836034 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fdec4005870 con 0x7fdedc0cf720 2023-06-20T13:32:55.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.813+0000 7fdeda7fc700 1 -- 172.21.15.32:0/2428836034 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fded0029090 con 0x7fdedc0cf720 2023-06-20T13:32:55.815 INFO:teuthology.orchestra.run.smithi032.stdout:60129542156 2023-06-20T13:32:55.816 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.4 2023-06-20T13:32:55.816 DEBUG:teuthology.parallel:result is None 2023-06-20T13:32:55.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.815+0000 7fdee41ff700 1 -- 172.21.15.32:0/2428836034 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdec006adb0 msgr2=0x7fdec006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.815+0000 7fdee41ff700 1 --2- 172.21.15.32:0/2428836034 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdec006adb0 0x7fdec006d260 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdedc1f1190 tx=0x7fdec8008040 comp rx=0 tx=0).stop 2023-06-20T13:32:55.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.815+0000 7fdee41ff700 1 -- 172.21.15.32:0/2428836034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdedc0cf720 msgr2=0x7fdedc0c66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:55.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.815+0000 7fdee41ff700 1 --2- 172.21.15.32:0/2428836034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdedc0cf720 0x7fdedc0c66b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fded001c000 tx=0x7fded0004ad0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.815+0000 7fdee41ff700 1 -- 172.21.15.32:0/2428836034 shutdown_connections 2023-06-20T13:32:55.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.815+0000 7fdee41ff700 1 --2- 172.21.15.32:0/2428836034 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdec006adb0 0x7fdec006d260 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.815+0000 7fdee41ff700 1 --2- 172.21.15.32:0/2428836034 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdedc15c460 0x7fdedc150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.815+0000 7fdee41ff700 1 --2- 172.21.15.32:0/2428836034 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdedc0cf720 0x7fdedc0c66b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.815+0000 7fdee41ff700 1 --2- 172.21.15.32:0/2428836034 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdedc0d2640 0x7fdedc152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:55.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.815+0000 7fdee41ff700 1 -- 172.21.15.32:0/2428836034 >> 172.21.15.32:0/2428836034 conn(0x7fdedc071660 msgr2=0x7fdedc155cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:55.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.815+0000 7fdee41ff700 1 -- 172.21.15.32:0/2428836034 shutdown_connections 2023-06-20T13:32:55.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:55.815+0000 7fdee41ff700 1 -- 172.21.15.32:0/2428836034 wait complete. 2023-06-20T13:32:55.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.6 2023-06-20T13:32:55.836 DEBUG:teuthology.parallel:result is None 2023-06-20T13:32:55.836 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-06-20T13:32:55.837 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-20T13:32:56.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.075+0000 7fcc49dff700 1 Processor -- start 2023-06-20T13:32:56.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.075+0000 7fcc49dff700 1 -- start start 2023-06-20T13:32:56.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.076+0000 7fcc49dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc440d2640 0x7fcc440b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:56.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.076+0000 7fcc49dff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc440d1790 con 0x7fcc4415c460 2023-06-20T13:32:56.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.076+0000 7fcc49dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc440cd950 con 0x7fcc440cf8f0 2023-06-20T13:32:56.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.076+0000 7fcc49dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc440cedd0 con 0x7fcc440d2640 2023-06-20T13:32:56.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.076+0000 7fcc437fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fcc4415c460 0x7fcc440cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:52904/0 (socket says 172.21.15.32:52904) 2023-06-20T13:32:56.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.076+0000 7fcc437fe700 1 -- 172.21.15.32:0/4191182950 learned_addr learned my addr 172.21.15.32:0/4191182950 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:56.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.077+0000 7fcc427fc700 1 -- 172.21.15.32:0/4191182950 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279873016 0 0) 0x7fcc440d1790 con 0x7fcc4415c460 2023-06-20T13:32:56.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.077+0000 7fcc427fc700 1 -- 172.21.15.32:0/4191182950 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc2c0035b0 con 0x7fcc4415c460 2023-06-20T13:32:56.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.077+0000 7fcc42ffd700 1 --2- 172.21.15.32:0/4191182950 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc440d2640 0x7fcc440b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:56.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.077+0000 7fcc427fc700 1 -- 172.21.15.32:0/4191182950 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4206013530 0 0) 0x7fcc2c0035b0 con 0x7fcc4415c460 2023-06-20T13:32:56.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.077+0000 7fcc427fc700 1 -- 172.21.15.32:0/4191182950 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc440d2640 msgr2=0x7fcc440b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:56.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.077+0000 7fcc427fc700 1 --2- 172.21.15.32:0/4191182950 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc440d2640 0x7fcc440b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:56.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.077+0000 7fcc427fc700 1 -- 172.21.15.32:0/4191182950 >> v1:172.21.15.115:6789/0 conn(0x7fcc440cf8f0 legacy=0x7fcc4415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:56.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.077+0000 7fcc427fc700 1 -- 172.21.15.32:0/4191182950 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc440d14b0 con 0x7fcc4415c460 2023-06-20T13:32:56.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.077+0000 7fcc427fc700 1 -- 172.21.15.32:0/4191182950 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3380058562 0 0) 0x7fcc34001670 con 0x7fcc4415c460 2023-06-20T13:32:56.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.077+0000 7fcc427fc700 1 -- 172.21.15.32:0/4191182950 >> v1:172.21.15.32:6789/0 conn(0x7fcc4415c460 legacy=0x7fcc440cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:56.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.077+0000 7fcc427fc700 1 --2- 172.21.15.32:0/4191182950 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc2c003a30 0x7fcc2c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:56.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.077+0000 7fcc427fc700 1 --2- 172.21.15.32:0/4191182950 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc2c004850 0x7fcc2c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:56.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.077+0000 7fcc427fc700 1 --2- 172.21.15.32:0/4191182950 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc440d2640 0x7fcc2c005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:56.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.078+0000 7fcc427fc700 1 -- 172.21.15.32:0/4191182950 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc440cedd0 con 0x7fcc2c003a30 2023-06-20T13:32:56.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.078+0000 7fcc427fc700 1 -- 172.21.15.32:0/4191182950 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c00bb40 con 0x7fcc2c004850 2023-06-20T13:32:56.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.078+0000 7fcc427fc700 1 -- 172.21.15.32:0/4191182950 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c00bd00 con 0x7fcc440d2640 2023-06-20T13:32:56.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.078+0000 7fcc437fe700 1 --2- 172.21.15.32:0/4191182950 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc2c003a30 0x7fcc2c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:56.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.078+0000 7fcc42ffd700 1 --2- 172.21.15.32:0/4191182950 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc2c004850 0x7fcc2c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:56.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.078+0000 7fcc43fff700 1 --2- 172.21.15.32:0/4191182950 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc440d2640 0x7fcc2c005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:56.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.078+0000 7fcc437fe700 1 -- 172.21.15.32:0/4191182950 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc440d2640 msgr2=0x7fcc2c005240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:56.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.078+0000 7fcc437fe700 1 --2- 172.21.15.32:0/4191182950 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc440d2640 0x7fcc2c005240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:56.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.078+0000 7fcc437fe700 1 -- 172.21.15.32:0/4191182950 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc2c004850 msgr2=0x7fcc2c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:56.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.078+0000 7fcc437fe700 1 --2- 172.21.15.32:0/4191182950 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc2c004850 0x7fcc2c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:56.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.078+0000 7fcc437fe700 1 -- 172.21.15.32:0/4191182950 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2c0035b0 con 0x7fcc2c003a30 2023-06-20T13:32:56.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.079+0000 7fcc437fe700 1 --2- 172.21.15.32:0/4191182950 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc2c003a30 0x7fcc2c003e00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcc3400c240 tx=0x7fcc2c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=466546aeac7308bf server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:56.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.079+0000 7fcc427fc700 1 -- 172.21.15.32:0/4191182950 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3400ccc0 con 0x7fcc2c003a30 2023-06-20T13:32:56.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.079+0000 7fcc427fc700 1 -- 172.21.15.32:0/4191182950 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3400ce20 con 0x7fcc2c003a30 2023-06-20T13:32:56.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.079+0000 7fcc427fc700 1 -- 172.21.15.32:0/4191182950 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc34005ba0 con 0x7fcc2c003a30 2023-06-20T13:32:56.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.079+0000 7fcc49dff700 1 -- 172.21.15.32:0/4191182950 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc2c003a30 msgr2=0x7fcc2c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:56.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.079+0000 7fcc49dff700 1 --2- 172.21.15.32:0/4191182950 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc2c003a30 0x7fcc2c003e00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcc3400c240 tx=0x7fcc2c005880 comp rx=0 tx=0).stop 2023-06-20T13:32:56.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.079+0000 7fcc43fff700 1 -- 172.21.15.32:0/4191182950 reap_dead start 2023-06-20T13:32:56.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.079+0000 7fcc49dff700 1 -- 172.21.15.32:0/4191182950 shutdown_connections 2023-06-20T13:32:56.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.079+0000 7fcc49dff700 1 -- 172.21.15.32:0/4191182950 >> 172.21.15.32:0/4191182950 conn(0x7fcc44071660 msgr2=0x7fcc44071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:56.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.079+0000 7fcc49dff700 1 -- 172.21.15.32:0/4191182950 shutdown_connections 2023-06-20T13:32:56.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.079+0000 7fcc49dff700 1 -- 172.21.15.32:0/4191182950 wait complete. 2023-06-20T13:32:56.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.081+0000 7fcc49dff700 1 Processor -- start 2023-06-20T13:32:56.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.081+0000 7fcc49dff700 1 -- start start 2023-06-20T13:32:56.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.082+0000 7fcc49dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc2c003a30 0x7fcc4414d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:56.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.082+0000 7fcc49dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc4414dee0 0x7fcc440cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:56.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.082+0000 7fcc49dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc440cc320 0x7fcc4414f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:56.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.082+0000 7fcc49dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc440cb9c0 con 0x7fcc440cc320 2023-06-20T13:32:56.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.082+0000 7fcc49dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc440cad40 con 0x7fcc2c003a30 2023-06-20T13:32:56.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.082+0000 7fcc49dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc440cb020 con 0x7fcc4414dee0 2023-06-20T13:32:56.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.083+0000 7fcc43fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc440cc320 0x7fcc4414f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:56.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.083+0000 7fcc43fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc440cc320 0x7fcc4414f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59374/0 (socket says 172.21.15.32:59374) 2023-06-20T13:32:56.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.083+0000 7fcc43fff700 1 -- 172.21.15.32:0/2198685211 learned_addr learned my addr 172.21.15.32:0/2198685211 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:56.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.083+0000 7fcc42ffd700 1 --2- 172.21.15.32:0/2198685211 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc4414dee0 0x7fcc440cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:56.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.083+0000 7fcc437fe700 1 --2- 172.21.15.32:0/2198685211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc2c003a30 0x7fcc4414d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:56.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.083+0000 7fcc43fff700 1 -- 172.21.15.32:0/2198685211 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc4414dee0 msgr2=0x7fcc440cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:56.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.083+0000 7fcc43fff700 1 --2- 172.21.15.32:0/2198685211 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc4414dee0 0x7fcc440cbde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:56.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.083+0000 7fcc43fff700 1 -- 172.21.15.32:0/2198685211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc2c003a30 msgr2=0x7fcc4414d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:56.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.083+0000 7fcc43fff700 1 --2- 172.21.15.32:0/2198685211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc2c003a30 0x7fcc4414d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:56.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.083+0000 7fcc43fff700 1 -- 172.21.15.32:0/2198685211 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc440cb300 con 0x7fcc440cc320 2023-06-20T13:32:56.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.083+0000 7fcc43fff700 1 --2- 172.21.15.32:0/2198685211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc440cc320 0x7fcc4414f310 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcc4408bf90 tx=0x7fcc3c00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:56.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.083+0000 7fcc2bfff700 1 -- 172.21.15.32:0/2198685211 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c003c10 con 0x7fcc440cc320 2023-06-20T13:32:56.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.084+0000 7fcc2bfff700 1 -- 172.21.15.32:0/2198685211 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3c003d70 con 0x7fcc440cc320 2023-06-20T13:32:56.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.084+0000 7fcc49dff700 1 -- 172.21.15.32:0/2198685211 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc440cb5e0 con 0x7fcc440cc320 2023-06-20T13:32:56.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.084+0000 7fcc2bfff700 1 -- 172.21.15.32:0/2198685211 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c00dbd0 con 0x7fcc440cc320 2023-06-20T13:32:56.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.084+0000 7fcc49dff700 1 -- 172.21.15.32:0/2198685211 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc4414fa30 con 0x7fcc440cc320 2023-06-20T13:32:56.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.085+0000 7fcc49dff700 1 -- 172.21.15.32:0/2198685211 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc44066a00 con 0x7fcc440cc320 2023-06-20T13:32:56.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.086+0000 7fcc2bfff700 1 -- 172.21.15.32:0/2198685211 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcc3c00dd30 con 0x7fcc440cc320 2023-06-20T13:32:56.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.087+0000 7fcc2bfff700 1 --2- 172.21.15.32:0/2198685211 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcc3006ace0 0x7fcc3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:56.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.087+0000 7fcc2bfff700 1 -- 172.21.15.32:0/2198685211 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcc3c089a00 con 0x7fcc440cc320 2023-06-20T13:32:56.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.087+0000 7fcc437fe700 1 --2- 172.21.15.32:0/2198685211 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcc3006ace0 0x7fcc3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:56.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.088+0000 7fcc437fe700 1 --2- 172.21.15.32:0/2198685211 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcc3006ace0 0x7fcc3006d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcc34015040 tx=0x7fcc3400a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:56.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.091+0000 7fcc2bfff700 1 -- 172.21.15.32:0/2198685211 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcc44066a00 con 0x7fcc440cc320 2023-06-20T13:32:56.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.293+0000 7fcc49dff700 1 -- 172.21.15.32:0/2198685211 --> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcc440cd5e0 con 0x7fcc3006ace0 2023-06-20T13:32:56.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.304+0000 7fcc2bfff700 1 -- 172.21.15.32:0/2198685211 <== mgr.4101 v2:172.21.15.32:6832/1136488437 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367314 (secure 0 0 0) 0x7fcc34023070 con 0x7fcc3006ace0 2023-06-20T13:32:56.310 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:32:56.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.309+0000 7fcc49dff700 1 -- 172.21.15.32:0/2198685211 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcc3006ace0 msgr2=0x7fcc3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:56.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.309+0000 7fcc49dff700 1 --2- 172.21.15.32:0/2198685211 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcc3006ace0 0x7fcc3006d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcc34015040 tx=0x7fcc3400a000 comp rx=0 tx=0).stop 2023-06-20T13:32:56.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.309+0000 7fcc49dff700 1 -- 172.21.15.32:0/2198685211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc440cc320 msgr2=0x7fcc4414f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:56.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.309+0000 7fcc49dff700 1 --2- 172.21.15.32:0/2198685211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc440cc320 0x7fcc4414f310 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcc4408bf90 tx=0x7fcc3c00d430 comp rx=0 tx=0).stop 2023-06-20T13:32:56.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.309+0000 7fcc49dff700 1 -- 172.21.15.32:0/2198685211 shutdown_connections 2023-06-20T13:32:56.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.309+0000 7fcc49dff700 1 --2- 172.21.15.32:0/2198685211 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcc3006ace0 0x7fcc3006d190 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:56.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.309+0000 7fcc49dff700 1 --2- 172.21.15.32:0/2198685211 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc440cc320 0x7fcc4414f310 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:56.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.309+0000 7fcc49dff700 1 --2- 172.21.15.32:0/2198685211 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc2c003a30 0x7fcc4414d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:56.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.309+0000 7fcc49dff700 1 --2- 172.21.15.32:0/2198685211 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc4414dee0 0x7fcc440cbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:56.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.309+0000 7fcc49dff700 1 -- 172.21.15.32:0/2198685211 >> 172.21.15.32:0/2198685211 conn(0x7fcc44071660 msgr2=0x7fcc4415f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:56.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.310+0000 7fcc49dff700 1 -- 172.21.15.32:0/2198685211 shutdown_connections 2023-06-20T13:32:56.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.310+0000 7fcc49dff700 1 -- 172.21.15.32:0/2198685211 wait complete. 2023-06-20T13:32:56.314 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-06-20T13:32:56.330 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2023-06-20T13:32:55.268802+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219080,"kb_used_data":3464,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755640,"statfs":{"total":773094113280,"available":772869775360,"internally_reserved":0,"allocated":3547136,"data_stored":2140168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.010155"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.048185+0000","last_change":"2023-06-20T13:32:21.033030+0000","last_active":"2023-06-20T13:32:26.048185+0000","last_peered":"2023-06-20T13:32:26.048185+0000","last_clean":"2023-06-20T13:32:26.048185+0000","last_became_active":"2023-06-20T13:32:21.032583+0000","last_became_peered":"2023-06-20T13:32:21.032583+0000","last_unstale":"2023-06-20T13:32:26.048185+0000","last_undegraded":"2023-06-20T13:32:26.048185+0000","last_fullsized":"2023-06-20T13:32:26.048185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:43:58.636715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225801+0000","last_change":"2023-06-20T13:32:21.028815+0000","last_active":"2023-06-20T13:32:27.225801+0000","last_peered":"2023-06-20T13:32:27.225801+0000","last_clean":"2023-06-20T13:32:27.225801+0000","last_became_active":"2023-06-20T13:32:21.026146+0000","last_became_peered":"2023-06-20T13:32:21.026146+0000","last_unstale":"2023-06-20T13:32:27.225801+0000","last_undegraded":"2023-06-20T13:32:27.225801+0000","last_fullsized":"2023-06-20T13:32:27.225801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:22:54.374851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288495+0000","last_change":"2023-06-20T13:32:21.031230+0000","last_active":"2023-06-20T13:32:26.288495+0000","last_peered":"2023-06-20T13:32:26.288495+0000","last_clean":"2023-06-20T13:32:26.288495+0000","last_became_active":"2023-06-20T13:32:21.030270+0000","last_became_peered":"2023-06-20T13:32:21.030270+0000","last_unstale":"2023-06-20T13:32:26.288495+0000","last_undegraded":"2023-06-20T13:32:26.288495+0000","last_fullsized":"2023-06-20T13:32:26.288495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:32:45.231640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225268+0000","last_change":"2023-06-20T13:32:21.033833+0000","last_active":"2023-06-20T13:32:27.225268+0000","last_peered":"2023-06-20T13:32:27.225268+0000","last_clean":"2023-06-20T13:32:27.225268+0000","last_became_active":"2023-06-20T13:32:21.033516+0000","last_became_peered":"2023-06-20T13:32:21.033516+0000","last_unstale":"2023-06-20T13:32:27.225268+0000","last_undegraded":"2023-06-20T13:32:27.225268+0000","last_fullsized":"2023-06-20T13:32:27.225268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:46:34.316386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050622+0000","last_change":"2023-06-20T13:32:21.033655+0000","last_active":"2023-06-20T13:32:26.050622+0000","last_peered":"2023-06-20T13:32:26.050622+0000","last_clean":"2023-06-20T13:32:26.050622+0000","last_became_active":"2023-06-20T13:32:21.033357+0000","last_became_peered":"2023-06-20T13:32:21.033357+0000","last_unstale":"2023-06-20T13:32:26.050622+0000","last_undegraded":"2023-06-20T13:32:26.050622+0000","last_fullsized":"2023-06-20T13:32:26.050622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:39:14.274571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288173+0000","last_change":"2023-06-20T13:32:21.032497+0000","last_active":"2023-06-20T13:32:26.288173+0000","last_peered":"2023-06-20T13:32:26.288173+0000","last_clean":"2023-06-20T13:32:26.288173+0000","last_became_active":"2023-06-20T13:32:21.032222+0000","last_became_peered":"2023-06-20T13:32:21.032222+0000","last_unstale":"2023-06-20T13:32:26.288173+0000","last_undegraded":"2023-06-20T13:32:26.288173+0000","last_fullsized":"2023-06-20T13:32:26.288173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:29:48.507048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049899+0000","last_change":"2023-06-20T13:32:21.022372+0000","last_active":"2023-06-20T13:32:26.049899+0000","last_peered":"2023-06-20T13:32:26.049899+0000","last_clean":"2023-06-20T13:32:26.049899+0000","last_became_active":"2023-06-20T13:32:21.021763+0000","last_became_peered":"2023-06-20T13:32:21.021763+0000","last_unstale":"2023-06-20T13:32:26.049899+0000","last_undegraded":"2023-06-20T13:32:26.049899+0000","last_fullsized":"2023-06-20T13:32:26.049899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:22:54.374851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224785+0000","last_change":"2023-06-20T13:32:21.040883+0000","last_active":"2023-06-20T13:32:27.224785+0000","last_peered":"2023-06-20T13:32:27.224785+0000","last_clean":"2023-06-20T13:32:27.224785+0000","last_became_active":"2023-06-20T13:32:21.040645+0000","last_became_peered":"2023-06-20T13:32:21.040645+0000","last_unstale":"2023-06-20T13:32:27.224785+0000","last_undegraded":"2023-06-20T13:32:27.224785+0000","last_fullsized":"2023-06-20T13:32:27.224785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:10:11.011524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049846+0000","last_change":"2023-06-20T13:32:21.032741+0000","last_active":"2023-06-20T13:32:26.049846+0000","last_peered":"2023-06-20T13:32:26.049846+0000","last_clean":"2023-06-20T13:32:26.049846+0000","last_became_active":"2023-06-20T13:32:21.031965+0000","last_became_peered":"2023-06-20T13:32:21.031965+0000","last_unstale":"2023-06-20T13:32:26.049846+0000","last_undegraded":"2023-06-20T13:32:26.049846+0000","last_fullsized":"2023-06-20T13:32:26.049846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:10:11.011524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.226123+0000","last_change":"2023-06-20T13:32:21.029077+0000","last_active":"2023-06-20T13:32:27.226123+0000","last_peered":"2023-06-20T13:32:27.226123+0000","last_clean":"2023-06-20T13:32:27.226123+0000","last_became_active":"2023-06-20T13:32:21.025779+0000","last_became_peered":"2023-06-20T13:32:21.025779+0000","last_unstale":"2023-06-20T13:32:27.226123+0000","last_undegraded":"2023-06-20T13:32:27.226123+0000","last_fullsized":"2023-06-20T13:32:27.226123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:12:08.369795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288693+0000","last_change":"2023-06-20T13:32:21.031418+0000","last_active":"2023-06-20T13:32:26.288693+0000","last_peered":"2023-06-20T13:32:26.288693+0000","last_clean":"2023-06-20T13:32:26.288693+0000","last_became_active":"2023-06-20T13:32:21.030652+0000","last_became_peered":"2023-06-20T13:32:21.030652+0000","last_unstale":"2023-06-20T13:32:26.288693+0000","last_undegraded":"2023-06-20T13:32:26.288693+0000","last_fullsized":"2023-06-20T13:32:26.288693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:34:05.805819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.048364+0000","last_change":"2023-06-20T13:32:21.038615+0000","last_active":"2023-06-20T13:32:26.048364+0000","last_peered":"2023-06-20T13:32:26.048364+0000","last_clean":"2023-06-20T13:32:26.048364+0000","last_became_active":"2023-06-20T13:32:21.038282+0000","last_became_peered":"2023-06-20T13:32:21.038282+0000","last_unstale":"2023-06-20T13:32:26.048364+0000","last_undegraded":"2023-06-20T13:32:26.048364+0000","last_fullsized":"2023-06-20T13:32:26.048364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:59:33.841139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.047994+0000","last_change":"2023-06-20T13:32:21.031597+0000","last_active":"2023-06-20T13:32:26.047994+0000","last_peered":"2023-06-20T13:32:26.047994+0000","last_clean":"2023-06-20T13:32:26.047994+0000","last_became_active":"2023-06-20T13:32:21.031271+0000","last_became_peered":"2023-06-20T13:32:21.031271+0000","last_unstale":"2023-06-20T13:32:26.047994+0000","last_undegraded":"2023-06-20T13:32:26.047994+0000","last_fullsized":"2023-06-20T13:32:26.047994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:44:15.228781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225403+0000","last_change":"2023-06-20T13:32:21.025613+0000","last_active":"2023-06-20T13:32:27.225403+0000","last_peered":"2023-06-20T13:32:27.225403+0000","last_clean":"2023-06-20T13:32:27.225403+0000","last_became_active":"2023-06-20T13:32:21.025299+0000","last_became_peered":"2023-06-20T13:32:21.025299+0000","last_unstale":"2023-06-20T13:32:27.225403+0000","last_undegraded":"2023-06-20T13:32:27.225403+0000","last_fullsized":"2023-06-20T13:32:27.225403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:02:59.622021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049134+0000","last_change":"2023-06-20T13:32:21.022539+0000","last_active":"2023-06-20T13:32:26.049134+0000","last_peered":"2023-06-20T13:32:26.049134+0000","last_clean":"2023-06-20T13:32:26.049134+0000","last_became_active":"2023-06-20T13:32:21.022066+0000","last_became_peered":"2023-06-20T13:32:21.022066+0000","last_unstale":"2023-06-20T13:32:26.049134+0000","last_undegraded":"2023-06-20T13:32:26.049134+0000","last_fullsized":"2023-06-20T13:32:26.049134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:41:51.423544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287835+0000","last_change":"2023-06-20T13:32:21.029934+0000","last_active":"2023-06-20T13:32:26.287835+0000","last_peered":"2023-06-20T13:32:26.287835+0000","last_clean":"2023-06-20T13:32:26.287835+0000","last_became_active":"2023-06-20T13:32:21.029620+0000","last_became_peered":"2023-06-20T13:32:21.029620+0000","last_unstale":"2023-06-20T13:32:26.287835+0000","last_undegraded":"2023-06-20T13:32:26.287835+0000","last_fullsized":"2023-06-20T13:32:26.287835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:24:59.969867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049998+0000","last_change":"2023-06-20T13:32:21.032911+0000","last_active":"2023-06-20T13:32:26.049998+0000","last_peered":"2023-06-20T13:32:26.049998+0000","last_clean":"2023-06-20T13:32:26.049998+0000","last_became_active":"2023-06-20T13:32:21.032330+0000","last_became_peered":"2023-06-20T13:32:21.032330+0000","last_unstale":"2023-06-20T13:32:26.049998+0000","last_undegraded":"2023-06-20T13:32:26.049998+0000","last_fullsized":"2023-06-20T13:32:26.049998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:25:29.097559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288480+0000","last_change":"2023-06-20T13:32:21.032286+0000","last_active":"2023-06-20T13:32:26.288480+0000","last_peered":"2023-06-20T13:32:26.288480+0000","last_clean":"2023-06-20T13:32:26.288480+0000","last_became_active":"2023-06-20T13:32:21.032026+0000","last_became_peered":"2023-06-20T13:32:21.032026+0000","last_unstale":"2023-06-20T13:32:26.288480+0000","last_undegraded":"2023-06-20T13:32:26.288480+0000","last_fullsized":"2023-06-20T13:32:26.288480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:20:54.027209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.047620+0000","last_change":"2023-06-20T13:32:21.038729+0000","last_active":"2023-06-20T13:32:26.047620+0000","last_peered":"2023-06-20T13:32:26.047620+0000","last_clean":"2023-06-20T13:32:26.047620+0000","last_became_active":"2023-06-20T13:32:21.038349+0000","last_became_peered":"2023-06-20T13:32:21.038349+0000","last_unstale":"2023-06-20T13:32:26.047620+0000","last_undegraded":"2023-06-20T13:32:26.047620+0000","last_fullsized":"2023-06-20T13:32:26.047620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:52:33.238643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288055+0000","last_change":"2023-06-20T13:32:21.038223+0000","last_active":"2023-06-20T13:32:26.288055+0000","last_peered":"2023-06-20T13:32:26.288055+0000","last_clean":"2023-06-20T13:32:26.288055+0000","last_became_active":"2023-06-20T13:32:21.037898+0000","last_became_peered":"2023-06-20T13:32:21.037898+0000","last_unstale":"2023-06-20T13:32:26.288055+0000","last_undegraded":"2023-06-20T13:32:26.288055+0000","last_fullsized":"2023-06-20T13:32:26.288055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:22:57.611066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049472+0000","last_change":"2023-06-20T13:32:21.031301+0000","last_active":"2023-06-20T13:32:26.049472+0000","last_peered":"2023-06-20T13:32:26.049472+0000","last_clean":"2023-06-20T13:32:26.049472+0000","last_became_active":"2023-06-20T13:32:21.031013+0000","last_became_peered":"2023-06-20T13:32:21.031013+0000","last_unstale":"2023-06-20T13:32:26.049472+0000","last_undegraded":"2023-06-20T13:32:26.049472+0000","last_fullsized":"2023-06-20T13:32:26.049472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:29:48.333437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049583+0000","last_change":"2023-06-20T13:32:21.025148+0000","last_active":"2023-06-20T13:32:26.049583+0000","last_peered":"2023-06-20T13:32:26.049583+0000","last_clean":"2023-06-20T13:32:26.049583+0000","last_became_active":"2023-06-20T13:32:21.024903+0000","last_became_peered":"2023-06-20T13:32:21.024903+0000","last_unstale":"2023-06-20T13:32:26.049583+0000","last_undegraded":"2023-06-20T13:32:26.049583+0000","last_fullsized":"2023-06-20T13:32:26.049583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:41:51.423544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224396+0000","last_change":"2023-06-20T13:32:21.028704+0000","last_active":"2023-06-20T13:32:27.224396+0000","last_peered":"2023-06-20T13:32:27.224396+0000","last_clean":"2023-06-20T13:32:27.224396+0000","last_became_active":"2023-06-20T13:32:21.028340+0000","last_became_peered":"2023-06-20T13:32:21.028340+0000","last_unstale":"2023-06-20T13:32:27.224396+0000","last_undegraded":"2023-06-20T13:32:27.224396+0000","last_fullsized":"2023-06-20T13:32:27.224396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:48:09.417634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049186+0000","last_change":"2023-06-20T13:32:21.034406+0000","last_active":"2023-06-20T13:32:26.049186+0000","last_peered":"2023-06-20T13:32:26.049186+0000","last_clean":"2023-06-20T13:32:26.049186+0000","last_became_active":"2023-06-20T13:32:21.034097+0000","last_became_peered":"2023-06-20T13:32:21.034097+0000","last_unstale":"2023-06-20T13:32:26.049186+0000","last_undegraded":"2023-06-20T13:32:26.049186+0000","last_fullsized":"2023-06-20T13:32:26.049186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:10:11.011524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998821+0000","last_change":"2023-06-20T13:32:21.038778+0000","last_active":"2023-06-20T13:32:26.998821+0000","last_peered":"2023-06-20T13:32:26.998821+0000","last_clean":"2023-06-20T13:32:26.998821+0000","last_became_active":"2023-06-20T13:32:21.038456+0000","last_became_peered":"2023-06-20T13:32:21.038456+0000","last_unstale":"2023-06-20T13:32:26.998821+0000","last_undegraded":"2023-06-20T13:32:26.998821+0000","last_fullsized":"2023-06-20T13:32:26.998821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:29:48.333437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998629+0000","last_change":"2023-06-20T13:32:21.023655+0000","last_active":"2023-06-20T13:32:26.998629+0000","last_peered":"2023-06-20T13:32:26.998629+0000","last_clean":"2023-06-20T13:32:26.998629+0000","last_became_active":"2023-06-20T13:32:21.023366+0000","last_became_peered":"2023-06-20T13:32:21.023366+0000","last_unstale":"2023-06-20T13:32:26.998629+0000","last_undegraded":"2023-06-20T13:32:26.998629+0000","last_fullsized":"2023-06-20T13:32:26.998629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:02:59.622021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225931+0000","last_change":"2023-06-20T13:32:21.040132+0000","last_active":"2023-06-20T13:32:27.225931+0000","last_peered":"2023-06-20T13:32:27.225931+0000","last_clean":"2023-06-20T13:32:27.225931+0000","last_became_active":"2023-06-20T13:32:21.039482+0000","last_became_peered":"2023-06-20T13:32:21.039482+0000","last_unstale":"2023-06-20T13:32:27.225931+0000","last_undegraded":"2023-06-20T13:32:27.225931+0000","last_fullsized":"2023-06-20T13:32:27.225931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:01:24.597870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288708+0000","last_change":"2023-06-20T13:32:25.083629+0000","last_active":"2023-06-20T13:32:26.288708+0000","last_peered":"2023-06-20T13:32:26.288708+0000","last_clean":"2023-06-20T13:32:26.288708+0000","last_became_active":"2023-06-20T13:32:25.083205+0000","last_became_peered":"2023-06-20T13:32:25.083205+0000","last_unstale":"2023-06-20T13:32:26.288708+0000","last_undegraded":"2023-06-20T13:32:26.288708+0000","last_fullsized":"2023-06-20T13:32:26.288708+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:05:12.289018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287897+0000","last_change":"2023-06-20T13:32:20.023586+0000","last_active":"2023-06-20T13:32:26.287897+0000","last_peered":"2023-06-20T13:32:26.287897+0000","last_clean":"2023-06-20T13:32:26.287897+0000","last_became_active":"2023-06-20T13:32:20.023257+0000","last_became_peered":"2023-06-20T13:32:20.023257+0000","last_unstale":"2023-06-20T13:32:26.287897+0000","last_undegraded":"2023-06-20T13:32:26.287897+0000","last_fullsized":"2023-06-20T13:32:26.287897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:28:06.073451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225087+0000","last_change":"2023-06-20T13:32:21.024146+0000","last_active":"2023-06-20T13:32:27.225087+0000","last_peered":"2023-06-20T13:32:27.225087+0000","last_clean":"2023-06-20T13:32:27.225087+0000","last_became_active":"2023-06-20T13:32:21.023861+0000","last_became_peered":"2023-06-20T13:32:21.023861+0000","last_unstale":"2023-06-20T13:32:27.225087+0000","last_undegraded":"2023-06-20T13:32:27.225087+0000","last_fullsized":"2023-06-20T13:32:27.225087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:19:16.766615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224818+0000","last_change":"2023-06-20T13:32:25.070665+0000","last_active":"2023-06-20T13:32:27.224818+0000","last_peered":"2023-06-20T13:32:27.224818+0000","last_clean":"2023-06-20T13:32:27.224818+0000","last_became_active":"2023-06-20T13:32:25.070238+0000","last_became_peered":"2023-06-20T13:32:25.070238+0000","last_unstale":"2023-06-20T13:32:27.224818+0000","last_undegraded":"2023-06-20T13:32:27.224818+0000","last_fullsized":"2023-06-20T13:32:27.224818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:49:58.213633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998000+0000","last_change":"2023-06-20T13:32:20.022478+0000","last_active":"2023-06-20T13:32:26.998000+0000","last_peered":"2023-06-20T13:32:26.998000+0000","last_clean":"2023-06-20T13:32:26.998000+0000","last_became_active":"2023-06-20T13:32:20.022166+0000","last_became_peered":"2023-06-20T13:32:20.022166+0000","last_unstale":"2023-06-20T13:32:26.998000+0000","last_undegraded":"2023-06-20T13:32:26.998000+0000","last_fullsized":"2023-06-20T13:32:26.998000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:19:18.352136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050275+0000","last_change":"2023-06-20T13:32:21.037532+0000","last_active":"2023-06-20T13:32:26.050275+0000","last_peered":"2023-06-20T13:32:26.050275+0000","last_clean":"2023-06-20T13:32:26.050275+0000","last_became_active":"2023-06-20T13:32:21.037127+0000","last_became_peered":"2023-06-20T13:32:21.037127+0000","last_unstale":"2023-06-20T13:32:26.050275+0000","last_undegraded":"2023-06-20T13:32:26.050275+0000","last_fullsized":"2023-06-20T13:32:26.050275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:26:47.720233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050558+0000","last_change":"2023-06-20T13:32:25.085925+0000","last_active":"2023-06-20T13:32:26.050558+0000","last_peered":"2023-06-20T13:32:26.050558+0000","last_clean":"2023-06-20T13:32:26.050558+0000","last_became_active":"2023-06-20T13:32:25.085537+0000","last_became_peered":"2023-06-20T13:32:25.085537+0000","last_unstale":"2023-06-20T13:32:26.050558+0000","last_undegraded":"2023-06-20T13:32:26.050558+0000","last_fullsized":"2023-06-20T13:32:26.050558+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:01:28.635985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224478+0000","last_change":"2023-06-20T13:32:20.028414+0000","last_active":"2023-06-20T13:32:27.224478+0000","last_peered":"2023-06-20T13:32:27.224478+0000","last_clean":"2023-06-20T13:32:27.224478+0000","last_became_active":"2023-06-20T13:32:20.028129+0000","last_became_peered":"2023-06-20T13:32:20.028129+0000","last_unstale":"2023-06-20T13:32:27.224478+0000","last_undegraded":"2023-06-20T13:32:27.224478+0000","last_fullsized":"2023-06-20T13:32:27.224478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:16:57.717945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225375+0000","last_change":"2023-06-20T13:32:21.036814+0000","last_active":"2023-06-20T13:32:27.225375+0000","last_peered":"2023-06-20T13:32:27.225375+0000","last_clean":"2023-06-20T13:32:27.225375+0000","last_became_active":"2023-06-20T13:32:21.036540+0000","last_became_peered":"2023-06-20T13:32:21.036540+0000","last_unstale":"2023-06-20T13:32:27.225375+0000","last_undegraded":"2023-06-20T13:32:27.225375+0000","last_fullsized":"2023-06-20T13:32:27.225375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:39:45.434194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224434+0000","last_change":"2023-06-20T13:32:25.070673+0000","last_active":"2023-06-20T13:32:27.224434+0000","last_peered":"2023-06-20T13:32:27.224434+0000","last_clean":"2023-06-20T13:32:27.224434+0000","last_became_active":"2023-06-20T13:32:25.070136+0000","last_became_peered":"2023-06-20T13:32:25.070136+0000","last_unstale":"2023-06-20T13:32:27.224434+0000","last_undegraded":"2023-06-20T13:32:27.224434+0000","last_fullsized":"2023-06-20T13:32:27.224434+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:57:00.983846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050185+0000","last_change":"2023-06-20T13:32:20.030153+0000","last_active":"2023-06-20T13:32:26.050185+0000","last_peered":"2023-06-20T13:32:26.050185+0000","last_clean":"2023-06-20T13:32:26.050185+0000","last_became_active":"2023-06-20T13:32:20.029794+0000","last_became_peered":"2023-06-20T13:32:20.029794+0000","last_unstale":"2023-06-20T13:32:26.050185+0000","last_undegraded":"2023-06-20T13:32:26.050185+0000","last_fullsized":"2023-06-20T13:32:26.050185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:04:42.004091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224386+0000","last_change":"2023-06-20T13:32:21.028713+0000","last_active":"2023-06-20T13:32:27.224386+0000","last_peered":"2023-06-20T13:32:27.224386+0000","last_clean":"2023-06-20T13:32:27.224386+0000","last_became_active":"2023-06-20T13:32:21.027969+0000","last_became_peered":"2023-06-20T13:32:21.027969+0000","last_unstale":"2023-06-20T13:32:27.224386+0000","last_undegraded":"2023-06-20T13:32:27.224386+0000","last_fullsized":"2023-06-20T13:32:27.224386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:26:47.720233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.048978+0000","last_change":"2023-06-20T13:32:25.072571+0000","last_active":"2023-06-20T13:32:26.048978+0000","last_peered":"2023-06-20T13:32:26.048978+0000","last_clean":"2023-06-20T13:32:26.048978+0000","last_became_active":"2023-06-20T13:32:25.072166+0000","last_became_peered":"2023-06-20T13:32:25.072166+0000","last_unstale":"2023-06-20T13:32:26.048978+0000","last_undegraded":"2023-06-20T13:32:26.048978+0000","last_fullsized":"2023-06-20T13:32:26.048978+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:02:49.608947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225983+0000","last_change":"2023-06-20T13:32:20.022108+0000","last_active":"2023-06-20T13:32:27.225983+0000","last_peered":"2023-06-20T13:32:27.225983+0000","last_clean":"2023-06-20T13:32:27.225983+0000","last_became_active":"2023-06-20T13:32:20.021836+0000","last_became_peered":"2023-06-20T13:32:20.021836+0000","last_unstale":"2023-06-20T13:32:27.225983+0000","last_undegraded":"2023-06-20T13:32:27.225983+0000","last_fullsized":"2023-06-20T13:32:27.225983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:32:35.608967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224530+0000","last_change":"2023-06-20T13:32:21.027141+0000","last_active":"2023-06-20T13:32:27.224530+0000","last_peered":"2023-06-20T13:32:27.224530+0000","last_clean":"2023-06-20T13:32:27.224530+0000","last_became_active":"2023-06-20T13:32:21.026831+0000","last_became_peered":"2023-06-20T13:32:21.026831+0000","last_unstale":"2023-06-20T13:32:27.224530+0000","last_undegraded":"2023-06-20T13:32:27.224530+0000","last_fullsized":"2023-06-20T13:32:27.224530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:01:24.597870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225358+0000","last_change":"2023-06-20T13:32:25.074657+0000","last_active":"2023-06-20T13:32:27.225358+0000","last_peered":"2023-06-20T13:32:27.225358+0000","last_clean":"2023-06-20T13:32:27.225358+0000","last_became_active":"2023-06-20T13:32:25.074234+0000","last_became_peered":"2023-06-20T13:32:25.074234+0000","last_unstale":"2023-06-20T13:32:27.225358+0000","last_undegraded":"2023-06-20T13:32:27.225358+0000","last_fullsized":"2023-06-20T13:32:27.225358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:34:34.823010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049629+0000","last_change":"2023-06-20T13:32:20.023105+0000","last_active":"2023-06-20T13:32:26.049629+0000","last_peered":"2023-06-20T13:32:26.049629+0000","last_clean":"2023-06-20T13:32:26.049629+0000","last_became_active":"2023-06-20T13:32:20.022845+0000","last_became_peered":"2023-06-20T13:32:20.022845+0000","last_unstale":"2023-06-20T13:32:26.049629+0000","last_undegraded":"2023-06-20T13:32:26.049629+0000","last_fullsized":"2023-06-20T13:32:26.049629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:04:42.004091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998524+0000","last_change":"2023-06-20T13:32:21.035337+0000","last_active":"2023-06-20T13:32:26.998524+0000","last_peered":"2023-06-20T13:32:26.998524+0000","last_clean":"2023-06-20T13:32:26.998524+0000","last_became_active":"2023-06-20T13:32:21.035026+0000","last_became_peered":"2023-06-20T13:32:21.035026+0000","last_unstale":"2023-06-20T13:32:26.998524+0000","last_undegraded":"2023-06-20T13:32:26.998524+0000","last_fullsized":"2023-06-20T13:32:26.998524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:08:50.174602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998117+0000","last_change":"2023-06-20T13:32:25.077778+0000","last_active":"2023-06-20T13:32:26.998117+0000","last_peered":"2023-06-20T13:32:26.998117+0000","last_clean":"2023-06-20T13:32:26.998117+0000","last_became_active":"2023-06-20T13:32:25.076300+0000","last_became_peered":"2023-06-20T13:32:25.076300+0000","last_unstale":"2023-06-20T13:32:26.998117+0000","last_undegraded":"2023-06-20T13:32:26.998117+0000","last_fullsized":"2023-06-20T13:32:26.998117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:38:55.235383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:39.667215+0000","last_change":"2023-06-20T13:32:20.020923+0000","last_active":"2023-06-20T13:32:39.667215+0000","last_peered":"2023-06-20T13:32:39.667215+0000","last_clean":"2023-06-20T13:32:39.667215+0000","last_became_active":"2023-06-20T13:32:20.020435+0000","last_became_peered":"2023-06-20T13:32:20.020435+0000","last_unstale":"2023-06-20T13:32:39.667215+0000","last_undegraded":"2023-06-20T13:32:39.667215+0000","last_fullsized":"2023-06-20T13:32:39.667215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:04:23.085234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288184+0000","last_change":"2023-06-20T13:32:21.035014+0000","last_active":"2023-06-20T13:32:26.288184+0000","last_peered":"2023-06-20T13:32:26.288184+0000","last_clean":"2023-06-20T13:32:26.288184+0000","last_became_active":"2023-06-20T13:32:21.034760+0000","last_became_peered":"2023-06-20T13:32:21.034760+0000","last_unstale":"2023-06-20T13:32:26.288184+0000","last_undegraded":"2023-06-20T13:32:26.288184+0000","last_fullsized":"2023-06-20T13:32:26.288184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:35:16.891724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.226159+0000","last_change":"2023-06-20T13:32:25.082529+0000","last_active":"2023-06-20T13:32:27.226159+0000","last_peered":"2023-06-20T13:32:27.226159+0000","last_clean":"2023-06-20T13:32:27.226159+0000","last_became_active":"2023-06-20T13:32:25.082205+0000","last_became_peered":"2023-06-20T13:32:25.082205+0000","last_unstale":"2023-06-20T13:32:27.226159+0000","last_undegraded":"2023-06-20T13:32:27.226159+0000","last_fullsized":"2023-06-20T13:32:27.226159+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:18:17.174644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049387+0000","last_change":"2023-06-20T13:32:20.022027+0000","last_active":"2023-06-20T13:32:26.049387+0000","last_peered":"2023-06-20T13:32:26.049387+0000","last_clean":"2023-06-20T13:32:26.049387+0000","last_became_active":"2023-06-20T13:32:20.021696+0000","last_became_peered":"2023-06-20T13:32:20.021696+0000","last_unstale":"2023-06-20T13:32:26.049387+0000","last_undegraded":"2023-06-20T13:32:26.049387+0000","last_fullsized":"2023-06-20T13:32:26.049387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:21:22.959916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224795+0000","last_change":"2023-06-20T13:32:21.035314+0000","last_active":"2023-06-20T13:32:27.224795+0000","last_peered":"2023-06-20T13:32:27.224795+0000","last_clean":"2023-06-20T13:32:27.224795+0000","last_became_active":"2023-06-20T13:32:21.035000+0000","last_became_peered":"2023-06-20T13:32:21.035000+0000","last_unstale":"2023-06-20T13:32:27.224795+0000","last_undegraded":"2023-06-20T13:32:27.224795+0000","last_fullsized":"2023-06-20T13:32:27.224795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:32:36.617660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224640+0000","last_change":"2023-06-20T13:32:25.067229+0000","last_active":"2023-06-20T13:32:27.224640+0000","last_peered":"2023-06-20T13:32:27.224640+0000","last_clean":"2023-06-20T13:32:27.224640+0000","last_became_active":"2023-06-20T13:32:25.066768+0000","last_became_peered":"2023-06-20T13:32:25.066768+0000","last_unstale":"2023-06-20T13:32:27.224640+0000","last_undegraded":"2023-06-20T13:32:27.224640+0000","last_fullsized":"2023-06-20T13:32:27.224640+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:53:30.164168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049398+0000","last_change":"2023-06-20T13:32:20.025271+0000","last_active":"2023-06-20T13:32:26.049398+0000","last_peered":"2023-06-20T13:32:26.049398+0000","last_clean":"2023-06-20T13:32:26.049398+0000","last_became_active":"2023-06-20T13:32:20.024881+0000","last_became_peered":"2023-06-20T13:32:20.024881+0000","last_unstale":"2023-06-20T13:32:26.049398+0000","last_undegraded":"2023-06-20T13:32:26.049398+0000","last_fullsized":"2023-06-20T13:32:26.049398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:08:49.165909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225931+0000","last_change":"2023-06-20T13:32:21.040302+0000","last_active":"2023-06-20T13:32:27.225931+0000","last_peered":"2023-06-20T13:32:27.225931+0000","last_clean":"2023-06-20T13:32:27.225931+0000","last_became_active":"2023-06-20T13:32:21.039807+0000","last_became_peered":"2023-06-20T13:32:21.039807+0000","last_unstale":"2023-06-20T13:32:27.225931+0000","last_undegraded":"2023-06-20T13:32:27.225931+0000","last_fullsized":"2023-06-20T13:32:27.225931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:39:14.274571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225542+0000","last_change":"2023-06-20T13:32:25.074563+0000","last_active":"2023-06-20T13:32:27.225542+0000","last_peered":"2023-06-20T13:32:27.225542+0000","last_clean":"2023-06-20T13:32:27.225542+0000","last_became_active":"2023-06-20T13:32:25.074142+0000","last_became_peered":"2023-06-20T13:32:25.074142+0000","last_unstale":"2023-06-20T13:32:27.225542+0000","last_undegraded":"2023-06-20T13:32:27.225542+0000","last_fullsized":"2023-06-20T13:32:27.225542+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:21:34.190318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049875+0000","last_change":"2023-06-20T13:32:20.022385+0000","last_active":"2023-06-20T13:32:26.049875+0000","last_peered":"2023-06-20T13:32:26.049875+0000","last_clean":"2023-06-20T13:32:26.049875+0000","last_became_active":"2023-06-20T13:32:20.022046+0000","last_became_peered":"2023-06-20T13:32:20.022046+0000","last_unstale":"2023-06-20T13:32:26.049875+0000","last_undegraded":"2023-06-20T13:32:26.049875+0000","last_fullsized":"2023-06-20T13:32:26.049875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:16:57.717945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050412+0000","last_change":"2023-06-20T13:32:21.037368+0000","last_active":"2023-06-20T13:32:26.050412+0000","last_peered":"2023-06-20T13:32:26.050412+0000","last_clean":"2023-06-20T13:32:26.050412+0000","last_became_active":"2023-06-20T13:32:21.036706+0000","last_became_peered":"2023-06-20T13:32:21.036706+0000","last_unstale":"2023-06-20T13:32:26.050412+0000","last_undegraded":"2023-06-20T13:32:26.050412+0000","last_fullsized":"2023-06-20T13:32:26.050412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:16:58.726638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225769+0000","last_change":"2023-06-20T13:32:25.081687+0000","last_active":"2023-06-20T13:32:27.225769+0000","last_peered":"2023-06-20T13:32:27.225769+0000","last_clean":"2023-06-20T13:32:27.225769+0000","last_became_active":"2023-06-20T13:32:25.081227+0000","last_became_peered":"2023-06-20T13:32:25.081227+0000","last_unstale":"2023-06-20T13:32:27.225769+0000","last_undegraded":"2023-06-20T13:32:27.225769+0000","last_fullsized":"2023-06-20T13:32:27.225769+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:17:02.764753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224793+0000","last_change":"2023-06-20T13:32:20.028572+0000","last_active":"2023-06-20T13:32:27.224793+0000","last_peered":"2023-06-20T13:32:27.224793+0000","last_clean":"2023-06-20T13:32:27.224793+0000","last_became_active":"2023-06-20T13:32:20.028266+0000","last_became_peered":"2023-06-20T13:32:20.028266+0000","last_unstale":"2023-06-20T13:32:27.224793+0000","last_undegraded":"2023-06-20T13:32:27.224793+0000","last_fullsized":"2023-06-20T13:32:27.224793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:28:13.559245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225547+0000","last_change":"2023-06-20T13:32:21.036385+0000","last_active":"2023-06-20T13:32:27.225547+0000","last_peered":"2023-06-20T13:32:27.225547+0000","last_clean":"2023-06-20T13:32:27.225547+0000","last_became_active":"2023-06-20T13:32:21.036013+0000","last_became_peered":"2023-06-20T13:32:21.036013+0000","last_unstale":"2023-06-20T13:32:27.225547+0000","last_undegraded":"2023-06-20T13:32:27.225547+0000","last_fullsized":"2023-06-20T13:32:27.225547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:04:01.696402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050107+0000","last_change":"2023-06-20T13:32:25.071698+0000","last_active":"2023-06-20T13:32:26.050107+0000","last_peered":"2023-06-20T13:32:26.050107+0000","last_clean":"2023-06-20T13:32:26.050107+0000","last_became_active":"2023-06-20T13:32:25.070889+0000","last_became_peered":"2023-06-20T13:32:25.070889+0000","last_unstale":"2023-06-20T13:32:26.050107+0000","last_undegraded":"2023-06-20T13:32:26.050107+0000","last_fullsized":"2023-06-20T13:32:26.050107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:53:30.164168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050078+0000","last_change":"2023-06-20T13:32:20.027675+0000","last_active":"2023-06-20T13:32:26.050078+0000","last_peered":"2023-06-20T13:32:26.050078+0000","last_clean":"2023-06-20T13:32:26.050078+0000","last_became_active":"2023-06-20T13:32:20.027273+0000","last_became_peered":"2023-06-20T13:32:20.027273+0000","last_unstale":"2023-06-20T13:32:26.050078+0000","last_undegraded":"2023-06-20T13:32:26.050078+0000","last_fullsized":"2023-06-20T13:32:26.050078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:01:23.589176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224638+0000","last_change":"2023-06-20T13:32:21.025518+0000","last_active":"2023-06-20T13:32:27.224638+0000","last_peered":"2023-06-20T13:32:27.224638+0000","last_clean":"2023-06-20T13:32:27.224638+0000","last_became_active":"2023-06-20T13:32:21.025151+0000","last_became_peered":"2023-06-20T13:32:21.025151+0000","last_unstale":"2023-06-20T13:32:27.224638+0000","last_undegraded":"2023-06-20T13:32:27.224638+0000","last_fullsized":"2023-06-20T13:32:27.224638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:41:51.423544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.047440+0000","last_change":"2023-06-20T13:32:25.078296+0000","last_active":"2023-06-20T13:32:26.047440+0000","last_peered":"2023-06-20T13:32:26.047440+0000","last_clean":"2023-06-20T13:32:26.047440+0000","last_became_active":"2023-06-20T13:32:25.076656+0000","last_became_peered":"2023-06-20T13:32:25.076656+0000","last_unstale":"2023-06-20T13:32:26.047440+0000","last_undegraded":"2023-06-20T13:32:26.047440+0000","last_fullsized":"2023-06-20T13:32:26.047440+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:04:34.188995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049640+0000","last_change":"2023-06-20T13:32:20.022015+0000","last_active":"2023-06-20T13:32:26.049640+0000","last_peered":"2023-06-20T13:32:26.049640+0000","last_clean":"2023-06-20T13:32:26.049640+0000","last_became_active":"2023-06-20T13:32:20.021716+0000","last_became_peered":"2023-06-20T13:32:20.021716+0000","last_unstale":"2023-06-20T13:32:26.049640+0000","last_undegraded":"2023-06-20T13:32:26.049640+0000","last_fullsized":"2023-06-20T13:32:26.049640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:48:59.452870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288000+0000","last_change":"2023-06-20T13:32:21.022058+0000","last_active":"2023-06-20T13:32:26.288000+0000","last_peered":"2023-06-20T13:32:26.288000+0000","last_clean":"2023-06-20T13:32:26.288000+0000","last_became_active":"2023-06-20T13:32:21.021798+0000","last_became_peered":"2023-06-20T13:32:21.021798+0000","last_unstale":"2023-06-20T13:32:26.288000+0000","last_undegraded":"2023-06-20T13:32:26.288000+0000","last_fullsized":"2023-06-20T13:32:26.288000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:20:17.077026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.047790+0000","last_change":"2023-06-20T13:32:25.077838+0000","last_active":"2023-06-20T13:32:26.047790+0000","last_peered":"2023-06-20T13:32:26.047790+0000","last_clean":"2023-06-20T13:32:26.047790+0000","last_became_active":"2023-06-20T13:32:25.077296+0000","last_became_peered":"2023-06-20T13:32:25.077296+0000","last_unstale":"2023-06-20T13:32:26.047790+0000","last_undegraded":"2023-06-20T13:32:26.047790+0000","last_fullsized":"2023-06-20T13:32:26.047790+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T01:06:17.814845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049856+0000","last_change":"2023-06-20T13:32:20.027368+0000","last_active":"2023-06-20T13:32:26.049856+0000","last_peered":"2023-06-20T13:32:26.049856+0000","last_clean":"2023-06-20T13:32:26.049856+0000","last_became_active":"2023-06-20T13:32:20.027052+0000","last_became_peered":"2023-06-20T13:32:20.027052+0000","last_unstale":"2023-06-20T13:32:26.049856+0000","last_undegraded":"2023-06-20T13:32:26.049856+0000","last_fullsized":"2023-06-20T13:32:26.049856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:48:08.408940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224398+0000","last_change":"2023-06-20T13:32:21.034964+0000","last_active":"2023-06-20T13:32:27.224398+0000","last_peered":"2023-06-20T13:32:27.224398+0000","last_clean":"2023-06-20T13:32:27.224398+0000","last_became_active":"2023-06-20T13:32:21.034681+0000","last_became_peered":"2023-06-20T13:32:21.034681+0000","last_unstale":"2023-06-20T13:32:27.224398+0000","last_undegraded":"2023-06-20T13:32:27.224398+0000","last_fullsized":"2023-06-20T13:32:27.224398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:36:48.688763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.048245+0000","last_change":"2023-06-20T13:32:25.070289+0000","last_active":"2023-06-20T13:32:26.048245+0000","last_peered":"2023-06-20T13:32:26.048245+0000","last_clean":"2023-06-20T13:32:26.048245+0000","last_became_active":"2023-06-20T13:32:25.069805+0000","last_became_peered":"2023-06-20T13:32:25.069805+0000","last_unstale":"2023-06-20T13:32:26.048245+0000","last_undegraded":"2023-06-20T13:32:26.048245+0000","last_fullsized":"2023-06-20T13:32:26.048245+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:36:52.726879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225702+0000","last_change":"2023-06-20T13:32:20.024117+0000","last_active":"2023-06-20T13:32:27.225702+0000","last_peered":"2023-06-20T13:32:27.225702+0000","last_clean":"2023-06-20T13:32:27.225702+0000","last_became_active":"2023-06-20T13:32:20.023863+0000","last_became_peered":"2023-06-20T13:32:20.023863+0000","last_unstale":"2023-06-20T13:32:27.225702+0000","last_undegraded":"2023-06-20T13:32:27.225702+0000","last_fullsized":"2023-06-20T13:32:27.225702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:48:08.408940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050083+0000","last_change":"2023-06-20T13:32:21.033767+0000","last_active":"2023-06-20T13:32:26.050083+0000","last_peered":"2023-06-20T13:32:26.050083+0000","last_clean":"2023-06-20T13:32:26.050083+0000","last_became_active":"2023-06-20T13:32:21.033502+0000","last_became_peered":"2023-06-20T13:32:21.033502+0000","last_unstale":"2023-06-20T13:32:26.050083+0000","last_undegraded":"2023-06-20T13:32:26.050083+0000","last_fullsized":"2023-06-20T13:32:26.050083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:49:00.461563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.047814+0000","last_change":"2023-06-20T13:32:25.077964+0000","last_active":"2023-06-20T13:32:26.047814+0000","last_peered":"2023-06-20T13:32:26.047814+0000","last_clean":"2023-06-20T13:32:26.047814+0000","last_became_active":"2023-06-20T13:32:25.077026+0000","last_became_peered":"2023-06-20T13:32:25.077026+0000","last_unstale":"2023-06-20T13:32:26.047814+0000","last_undegraded":"2023-06-20T13:32:26.047814+0000","last_fullsized":"2023-06-20T13:32:26.047814+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:58:41.932351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224687+0000","last_change":"2023-06-20T13:32:20.028575+0000","last_active":"2023-06-20T13:32:27.224687+0000","last_peered":"2023-06-20T13:32:27.224687+0000","last_clean":"2023-06-20T13:32:27.224687+0000","last_became_active":"2023-06-20T13:32:20.028182+0000","last_became_peered":"2023-06-20T13:32:20.028182+0000","last_unstale":"2023-06-20T13:32:27.224687+0000","last_undegraded":"2023-06-20T13:32:27.224687+0000","last_fullsized":"2023-06-20T13:32:27.224687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:39:13.265878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287817+0000","last_change":"2023-06-20T13:32:21.032963+0000","last_active":"2023-06-20T13:32:26.287817+0000","last_peered":"2023-06-20T13:32:26.287817+0000","last_clean":"2023-06-20T13:32:26.287817+0000","last_became_active":"2023-06-20T13:32:21.032688+0000","last_became_peered":"2023-06-20T13:32:21.032688+0000","last_unstale":"2023-06-20T13:32:26.287817+0000","last_undegraded":"2023-06-20T13:32:26.287817+0000","last_fullsized":"2023-06-20T13:32:26.287817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:04:01.696402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998304+0000","last_change":"2023-06-20T13:32:25.077326+0000","last_active":"2023-06-20T13:32:26.998304+0000","last_peered":"2023-06-20T13:32:26.998304+0000","last_clean":"2023-06-20T13:32:26.998304+0000","last_became_active":"2023-06-20T13:32:25.076929+0000","last_became_peered":"2023-06-20T13:32:25.076929+0000","last_unstale":"2023-06-20T13:32:26.998304+0000","last_undegraded":"2023-06-20T13:32:26.998304+0000","last_fullsized":"2023-06-20T13:32:26.998304+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:56:29.417379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224597+0000","last_change":"2023-06-20T13:32:20.030260+0000","last_active":"2023-06-20T13:32:27.224597+0000","last_peered":"2023-06-20T13:32:27.224597+0000","last_clean":"2023-06-20T13:32:27.224597+0000","last_became_active":"2023-06-20T13:32:20.029938+0000","last_became_peered":"2023-06-20T13:32:20.029938+0000","last_unstale":"2023-06-20T13:32:27.224597+0000","last_undegraded":"2023-06-20T13:32:27.224597+0000","last_fullsized":"2023-06-20T13:32:27.224597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:59:32.832446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288271+0000","last_change":"2023-06-20T13:32:21.030989+0000","last_active":"2023-06-20T13:32:26.288271+0000","last_peered":"2023-06-20T13:32:26.288271+0000","last_clean":"2023-06-20T13:32:26.288271+0000","last_became_active":"2023-06-20T13:32:21.029954+0000","last_became_peered":"2023-06-20T13:32:21.029954+0000","last_unstale":"2023-06-20T13:32:26.288271+0000","last_undegraded":"2023-06-20T13:32:26.288271+0000","last_fullsized":"2023-06-20T13:32:26.288271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:12:40.689219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225889+0000","last_change":"2023-06-20T13:32:25.087926+0000","last_active":"2023-06-20T13:32:27.225889+0000","last_peered":"2023-06-20T13:32:27.225889+0000","last_clean":"2023-06-20T13:32:27.225889+0000","last_became_active":"2023-06-20T13:32:25.087469+0000","last_became_peered":"2023-06-20T13:32:25.087469+0000","last_unstale":"2023-06-20T13:32:27.225889+0000","last_undegraded":"2023-06-20T13:32:27.225889+0000","last_fullsized":"2023-06-20T13:32:27.225889+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:53:30.164168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287510+0000","last_change":"2023-06-20T13:32:20.028180+0000","last_active":"2023-06-20T13:32:26.287510+0000","last_peered":"2023-06-20T13:32:26.287510+0000","last_clean":"2023-06-20T13:32:26.287510+0000","last_became_active":"2023-06-20T13:32:20.027835+0000","last_became_peered":"2023-06-20T13:32:20.027835+0000","last_unstale":"2023-06-20T13:32:26.287510+0000","last_undegraded":"2023-06-20T13:32:26.287510+0000","last_fullsized":"2023-06-20T13:32:26.287510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:34:29.776201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288742+0000","last_change":"2023-06-20T13:32:21.039550+0000","last_active":"2023-06-20T13:32:26.288742+0000","last_peered":"2023-06-20T13:32:26.288742+0000","last_clean":"2023-06-20T13:32:26.288742+0000","last_became_active":"2023-06-20T13:32:21.039297+0000","last_became_peered":"2023-06-20T13:32:21.039297+0000","last_unstale":"2023-06-20T13:32:26.288742+0000","last_undegraded":"2023-06-20T13:32:26.288742+0000","last_fullsized":"2023-06-20T13:32:26.288742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:36:43.451301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288495+0000","last_change":"2023-06-20T13:32:25.084491+0000","last_active":"2023-06-20T13:32:26.288495+0000","last_peered":"2023-06-20T13:32:26.288495+0000","last_clean":"2023-06-20T13:32:26.288495+0000","last_became_active":"2023-06-20T13:32:25.084072+0000","last_became_peered":"2023-06-20T13:32:25.084072+0000","last_unstale":"2023-06-20T13:32:26.288495+0000","last_undegraded":"2023-06-20T13:32:26.288495+0000","last_fullsized":"2023-06-20T13:32:26.288495+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:01:48.702402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224341+0000","last_change":"2023-06-20T13:32:20.022743+0000","last_active":"2023-06-20T13:32:27.224341+0000","last_peered":"2023-06-20T13:32:27.224341+0000","last_clean":"2023-06-20T13:32:27.224341+0000","last_became_active":"2023-06-20T13:32:20.022384+0000","last_became_peered":"2023-06-20T13:32:20.022384+0000","last_unstale":"2023-06-20T13:32:27.224341+0000","last_undegraded":"2023-06-20T13:32:27.224341+0000","last_fullsized":"2023-06-20T13:32:27.224341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:04:42.004091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998918+0000","last_change":"2023-06-20T13:32:21.032771+0000","last_active":"2023-06-20T13:32:26.998918+0000","last_peered":"2023-06-20T13:32:26.998918+0000","last_clean":"2023-06-20T13:32:26.998918+0000","last_became_active":"2023-06-20T13:32:21.032459+0000","last_became_peered":"2023-06-20T13:32:21.032459+0000","last_unstale":"2023-06-20T13:32:26.998918+0000","last_undegraded":"2023-06-20T13:32:26.998918+0000","last_fullsized":"2023-06-20T13:32:26.998918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:51:29.356444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049993+0000","last_change":"2023-06-20T13:32:25.080253+0000","last_active":"2023-06-20T13:32:26.049993+0000","last_peered":"2023-06-20T13:32:26.049993+0000","last_clean":"2023-06-20T13:32:26.049993+0000","last_became_active":"2023-06-20T13:32:25.079626+0000","last_became_peered":"2023-06-20T13:32:25.079626+0000","last_unstale":"2023-06-20T13:32:26.049993+0000","last_undegraded":"2023-06-20T13:32:26.049993+0000","last_fullsized":"2023-06-20T13:32:26.049993+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:21:28.006725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998581+0000","last_change":"2023-06-20T13:32:14.847834+0000","last_active":"2023-06-20T13:32:26.998581+0000","last_peered":"2023-06-20T13:32:26.998581+0000","last_clean":"2023-06-20T13:32:26.998581+0000","last_became_active":"2023-06-20T13:32:14.847518+0000","last_became_peered":"2023-06-20T13:32:14.847518+0000","last_unstale":"2023-06-20T13:32:26.998581+0000","last_undegraded":"2023-06-20T13:32:26.998581+0000","last_fullsized":"2023-06-20T13:32:26.998581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:10:03.973904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225597+0000","last_change":"2023-06-20T13:32:20.025034+0000","last_active":"2023-06-20T13:32:27.225597+0000","last_peered":"2023-06-20T13:32:27.225597+0000","last_clean":"2023-06-20T13:32:27.225597+0000","last_became_active":"2023-06-20T13:32:20.024436+0000","last_became_peered":"2023-06-20T13:32:20.024436+0000","last_unstale":"2023-06-20T13:32:27.225597+0000","last_undegraded":"2023-06-20T13:32:27.225597+0000","last_fullsized":"2023-06-20T13:32:27.225597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:21:22.959916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998113+0000","last_change":"2023-06-20T13:32:21.031761+0000","last_active":"2023-06-20T13:32:26.998113+0000","last_peered":"2023-06-20T13:32:26.998113+0000","last_clean":"2023-06-20T13:32:26.998113+0000","last_became_active":"2023-06-20T13:32:21.031474+0000","last_became_peered":"2023-06-20T13:32:21.031474+0000","last_unstale":"2023-06-20T13:32:26.998113+0000","last_undegraded":"2023-06-20T13:32:26.998113+0000","last_fullsized":"2023-06-20T13:32:26.998113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:38:03.196793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049886+0000","last_change":"2023-06-20T13:32:25.081982+0000","last_active":"2023-06-20T13:32:26.049886+0000","last_peered":"2023-06-20T13:32:26.049886+0000","last_clean":"2023-06-20T13:32:26.049886+0000","last_became_active":"2023-06-20T13:32:25.081414+0000","last_became_peered":"2023-06-20T13:32:25.081414+0000","last_unstale":"2023-06-20T13:32:26.049886+0000","last_undegraded":"2023-06-20T13:32:26.049886+0000","last_fullsized":"2023-06-20T13:32:26.049886+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:03:03.660136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225550+0000","last_change":"2023-06-20T13:32:13.979189+0000","last_active":"2023-06-20T13:32:27.225550+0000","last_peered":"2023-06-20T13:32:27.225550+0000","last_clean":"2023-06-20T13:32:27.225550+0000","last_became_active":"2023-06-20T13:32:13.978675+0000","last_became_peered":"2023-06-20T13:32:13.978675+0000","last_unstale":"2023-06-20T13:32:27.225550+0000","last_undegraded":"2023-06-20T13:32:27.225550+0000","last_fullsized":"2023-06-20T13:32:27.225550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:25:22.059939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288140+0000","last_change":"2023-06-20T13:32:20.029884+0000","last_active":"2023-06-20T13:32:26.288140+0000","last_peered":"2023-06-20T13:32:26.288140+0000","last_clean":"2023-06-20T13:32:26.288140+0000","last_became_active":"2023-06-20T13:32:20.029589+0000","last_became_peered":"2023-06-20T13:32:20.029589+0000","last_unstale":"2023-06-20T13:32:26.288140+0000","last_undegraded":"2023-06-20T13:32:26.288140+0000","last_fullsized":"2023-06-20T13:32:26.288140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:04:36.254532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998444+0000","last_change":"2023-06-20T13:32:21.024248+0000","last_active":"2023-06-20T13:32:26.998444+0000","last_peered":"2023-06-20T13:32:26.998444+0000","last_clean":"2023-06-20T13:32:26.998444+0000","last_became_active":"2023-06-20T13:32:21.023949+0000","last_became_peered":"2023-06-20T13:32:21.023949+0000","last_unstale":"2023-06-20T13:32:26.998444+0000","last_undegraded":"2023-06-20T13:32:26.998444+0000","last_fullsized":"2023-06-20T13:32:26.998444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:27:37.100680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.048226+0000","last_change":"2023-06-20T13:32:25.076311+0000","last_active":"2023-06-20T13:32:26.048226+0000","last_peered":"2023-06-20T13:32:26.048226+0000","last_clean":"2023-06-20T13:32:26.048226+0000","last_became_active":"2023-06-20T13:32:25.075855+0000","last_became_peered":"2023-06-20T13:32:25.075855+0000","last_unstale":"2023-06-20T13:32:26.048226+0000","last_undegraded":"2023-06-20T13:32:26.048226+0000","last_fullsized":"2023-06-20T13:32:26.048226+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:32:42.525847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.047620+0000","last_change":"2023-06-20T13:32:14.567022+0000","last_active":"2023-06-20T13:32:26.047620+0000","last_peered":"2023-06-20T13:32:26.047620+0000","last_clean":"2023-06-20T13:32:26.047620+0000","last_became_active":"2023-06-20T13:32:14.566671+0000","last_became_peered":"2023-06-20T13:32:14.566671+0000","last_unstale":"2023-06-20T13:32:26.047620+0000","last_undegraded":"2023-06-20T13:32:26.047620+0000","last_fullsized":"2023-06-20T13:32:26.047620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:56:49.908110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998274+0000","last_change":"2023-06-20T13:32:20.028715+0000","last_active":"2023-06-20T13:32:26.998274+0000","last_peered":"2023-06-20T13:32:26.998274+0000","last_clean":"2023-06-20T13:32:26.998274+0000","last_became_active":"2023-06-20T13:32:20.028414+0000","last_became_peered":"2023-06-20T13:32:20.028414+0000","last_unstale":"2023-06-20T13:32:26.998274+0000","last_undegraded":"2023-06-20T13:32:26.998274+0000","last_fullsized":"2023-06-20T13:32:26.998274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:15:12.926553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998963+0000","last_change":"2023-06-20T13:32:21.030732+0000","last_active":"2023-06-20T13:32:26.998963+0000","last_peered":"2023-06-20T13:32:26.998963+0000","last_clean":"2023-06-20T13:32:26.998963+0000","last_became_active":"2023-06-20T13:32:21.030452+0000","last_became_peered":"2023-06-20T13:32:21.030452+0000","last_unstale":"2023-06-20T13:32:26.998963+0000","last_undegraded":"2023-06-20T13:32:26.998963+0000","last_fullsized":"2023-06-20T13:32:26.998963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:04:43.012785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049792+0000","last_change":"2023-06-20T13:32:25.078650+0000","last_active":"2023-06-20T13:32:26.049792+0000","last_peered":"2023-06-20T13:32:26.049792+0000","last_clean":"2023-06-20T13:32:26.049792+0000","last_became_active":"2023-06-20T13:32:25.078187+0000","last_became_peered":"2023-06-20T13:32:25.078187+0000","last_unstale":"2023-06-20T13:32:26.049792+0000","last_undegraded":"2023-06-20T13:32:26.049792+0000","last_fullsized":"2023-06-20T13:32:26.049792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:26:51.758348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225609+0000","last_change":"2023-06-20T13:32:13.978856+0000","last_active":"2023-06-20T13:32:27.225609+0000","last_peered":"2023-06-20T13:32:27.225609+0000","last_clean":"2023-06-20T13:32:27.225609+0000","last_became_active":"2023-06-20T13:32:13.978454+0000","last_became_peered":"2023-06-20T13:32:13.978454+0000","last_unstale":"2023-06-20T13:32:27.225609+0000","last_undegraded":"2023-06-20T13:32:27.225609+0000","last_fullsized":"2023-06-20T13:32:27.225609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:29:41.295818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049111+0000","last_change":"2023-06-20T13:32:06.907663+0000","last_active":"2023-06-20T13:32:26.049111+0000","last_peered":"2023-06-20T13:32:26.049111+0000","last_clean":"2023-06-20T13:32:26.049111+0000","last_became_active":"2023-06-20T13:32:06.906687+0000","last_became_peered":"2023-06-20T13:32:06.906687+0000","last_unstale":"2023-06-20T13:32:26.049111+0000","last_undegraded":"2023-06-20T13:32:26.049111+0000","last_fullsized":"2023-06-20T13:32:26.049111+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:05.521263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:05.521263+0000","last_clean_scrub_stamp":"2023-06-20T13:32:05.521263+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:08:35.702344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224861+0000","last_change":"2023-06-20T13:32:20.019895+0000","last_active":"2023-06-20T13:32:27.224861+0000","last_peered":"2023-06-20T13:32:27.224861+0000","last_clean":"2023-06-20T13:32:27.224861+0000","last_became_active":"2023-06-20T13:32:20.019522+0000","last_became_peered":"2023-06-20T13:32:20.019522+0000","last_unstale":"2023-06-20T13:32:27.224861+0000","last_undegraded":"2023-06-20T13:32:27.224861+0000","last_fullsized":"2023-06-20T13:32:27.224861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:18:12.127836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225154+0000","last_change":"2023-06-20T13:32:21.036376+0000","last_active":"2023-06-20T13:32:27.225154+0000","last_peered":"2023-06-20T13:32:27.225154+0000","last_clean":"2023-06-20T13:32:27.225154+0000","last_became_active":"2023-06-20T13:32:21.036065+0000","last_became_peered":"2023-06-20T13:32:21.036065+0000","last_unstale":"2023-06-20T13:32:27.225154+0000","last_undegraded":"2023-06-20T13:32:27.225154+0000","last_fullsized":"2023-06-20T13:32:27.225154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:44:44.788880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225647+0000","last_change":"2023-06-20T13:32:25.087122+0000","last_active":"2023-06-20T13:32:27.225647+0000","last_peered":"2023-06-20T13:32:27.225647+0000","last_clean":"2023-06-20T13:32:27.225647+0000","last_became_active":"2023-06-20T13:32:25.086746+0000","last_became_peered":"2023-06-20T13:32:25.086746+0000","last_unstale":"2023-06-20T13:32:27.225647+0000","last_undegraded":"2023-06-20T13:32:27.225647+0000","last_fullsized":"2023-06-20T13:32:27.225647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:51:33.394559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049273+0000","last_change":"2023-06-20T13:32:13.977027+0000","last_active":"2023-06-20T13:32:26.049273+0000","last_peered":"2023-06-20T13:32:26.049273+0000","last_clean":"2023-06-20T13:32:26.049273+0000","last_became_active":"2023-06-20T13:32:13.975895+0000","last_became_peered":"2023-06-20T13:32:13.975895+0000","last_unstale":"2023-06-20T13:32:26.049273+0000","last_undegraded":"2023-06-20T13:32:26.049273+0000","last_fullsized":"2023-06-20T13:32:26.049273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:25:22.059939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049300+0000","last_change":"2023-06-20T13:32:20.024292+0000","last_active":"2023-06-20T13:32:26.049300+0000","last_peered":"2023-06-20T13:32:26.049300+0000","last_clean":"2023-06-20T13:32:26.049300+0000","last_became_active":"2023-06-20T13:32:20.023931+0000","last_became_peered":"2023-06-20T13:32:20.023931+0000","last_unstale":"2023-06-20T13:32:26.049300+0000","last_undegraded":"2023-06-20T13:32:26.049300+0000","last_fullsized":"2023-06-20T13:32:26.049300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:02:44.562138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050028+0000","last_change":"2023-06-20T13:32:21.024724+0000","last_active":"2023-06-20T13:32:26.050028+0000","last_peered":"2023-06-20T13:32:26.050028+0000","last_clean":"2023-06-20T13:32:26.050028+0000","last_became_active":"2023-06-20T13:32:21.024485+0000","last_became_peered":"2023-06-20T13:32:21.024485+0000","last_unstale":"2023-06-20T13:32:26.050028+0000","last_undegraded":"2023-06-20T13:32:26.050028+0000","last_fullsized":"2023-06-20T13:32:26.050028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:51:29.356444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225119+0000","last_change":"2023-06-20T13:32:25.076508+0000","last_active":"2023-06-20T13:32:27.225119+0000","last_peered":"2023-06-20T13:32:27.225119+0000","last_clean":"2023-06-20T13:32:27.225119+0000","last_became_active":"2023-06-20T13:32:25.076181+0000","last_became_peered":"2023-06-20T13:32:25.076181+0000","last_unstale":"2023-06-20T13:32:27.225119+0000","last_undegraded":"2023-06-20T13:32:27.225119+0000","last_fullsized":"2023-06-20T13:32:27.225119+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:19:55.667242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049673+0000","last_change":"2023-06-20T13:32:14.848215+0000","last_active":"2023-06-20T13:32:26.049673+0000","last_peered":"2023-06-20T13:32:26.049673+0000","last_clean":"2023-06-20T13:32:26.049673+0000","last_became_active":"2023-06-20T13:32:14.847950+0000","last_became_peered":"2023-06-20T13:32:14.847950+0000","last_unstale":"2023-06-20T13:32:26.049673+0000","last_undegraded":"2023-06-20T13:32:26.049673+0000","last_fullsized":"2023-06-20T13:32:26.049673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:51:22.318824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998709+0000","last_change":"2023-06-20T13:32:20.032594+0000","last_active":"2023-06-20T13:32:26.998709+0000","last_peered":"2023-06-20T13:32:26.998709+0000","last_clean":"2023-06-20T13:32:26.998709+0000","last_became_active":"2023-06-20T13:32:20.032291+0000","last_became_peered":"2023-06-20T13:32:20.032291+0000","last_unstale":"2023-06-20T13:32:26.998709+0000","last_undegraded":"2023-06-20T13:32:26.998709+0000","last_fullsized":"2023-06-20T13:32:26.998709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:21:22.959916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050508+0000","last_change":"2023-06-20T13:32:21.040885+0000","last_active":"2023-06-20T13:32:26.050508+0000","last_peered":"2023-06-20T13:32:26.050508+0000","last_clean":"2023-06-20T13:32:26.050508+0000","last_became_active":"2023-06-20T13:32:21.040606+0000","last_became_peered":"2023-06-20T13:32:21.040606+0000","last_unstale":"2023-06-20T13:32:26.050508+0000","last_undegraded":"2023-06-20T13:32:26.050508+0000","last_fullsized":"2023-06-20T13:32:26.050508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:53:26.126053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288157+0000","last_change":"2023-06-20T13:32:25.074482+0000","last_active":"2023-06-20T13:32:26.288157+0000","last_peered":"2023-06-20T13:32:26.288157+0000","last_clean":"2023-06-20T13:32:26.288157+0000","last_became_active":"2023-06-20T13:32:25.071535+0000","last_became_peered":"2023-06-20T13:32:25.071535+0000","last_unstale":"2023-06-20T13:32:26.288157+0000","last_undegraded":"2023-06-20T13:32:26.288157+0000","last_fullsized":"2023-06-20T13:32:26.288157+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:34:53.709352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225674+0000","last_change":"2023-06-20T13:32:20.023465+0000","last_active":"2023-06-20T13:32:27.225674+0000","last_peered":"2023-06-20T13:32:27.225674+0000","last_clean":"2023-06-20T13:32:27.225674+0000","last_became_active":"2023-06-20T13:32:20.023069+0000","last_became_peered":"2023-06-20T13:32:20.023069+0000","last_unstale":"2023-06-20T13:32:27.225674+0000","last_undegraded":"2023-06-20T13:32:27.225674+0000","last_fullsized":"2023-06-20T13:32:27.225674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:24:58.961174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998839+0000","last_change":"2023-06-20T13:32:13.978089+0000","last_active":"2023-06-20T13:32:26.998839+0000","last_peered":"2023-06-20T13:32:26.998839+0000","last_clean":"2023-06-20T13:32:26.998839+0000","last_became_active":"2023-06-20T13:32:13.977748+0000","last_became_peered":"2023-06-20T13:32:13.977748+0000","last_unstale":"2023-06-20T13:32:26.998839+0000","last_undegraded":"2023-06-20T13:32:26.998839+0000","last_fullsized":"2023-06-20T13:32:26.998839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:48:53.423943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224252+0000","last_change":"2023-06-20T13:32:21.028939+0000","last_active":"2023-06-20T13:32:27.224252+0000","last_peered":"2023-06-20T13:32:27.224252+0000","last_clean":"2023-06-20T13:32:27.224252+0000","last_became_active":"2023-06-20T13:32:21.028355+0000","last_became_peered":"2023-06-20T13:32:21.028355+0000","last_unstale":"2023-06-20T13:32:27.224252+0000","last_undegraded":"2023-06-20T13:32:27.224252+0000","last_fullsized":"2023-06-20T13:32:27.224252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:51:29.356444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224186+0000","last_change":"2023-06-20T13:32:25.076159+0000","last_active":"2023-06-20T13:32:27.224186+0000","last_peered":"2023-06-20T13:32:27.224186+0000","last_clean":"2023-06-20T13:32:27.224186+0000","last_became_active":"2023-06-20T13:32:25.074781+0000","last_became_peered":"2023-06-20T13:32:25.074781+0000","last_unstale":"2023-06-20T13:32:27.224186+0000","last_undegraded":"2023-06-20T13:32:27.224186+0000","last_fullsized":"2023-06-20T13:32:27.224186+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:49:04.499679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224965+0000","last_change":"2023-06-20T13:32:13.977875+0000","last_active":"2023-06-20T13:32:27.224965+0000","last_peered":"2023-06-20T13:32:27.224965+0000","last_clean":"2023-06-20T13:32:27.224965+0000","last_became_active":"2023-06-20T13:32:13.977589+0000","last_became_peered":"2023-06-20T13:32:13.977589+0000","last_unstale":"2023-06-20T13:32:27.224965+0000","last_undegraded":"2023-06-20T13:32:27.224965+0000","last_fullsized":"2023-06-20T13:32:27.224965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:21:46.859788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050052+0000","last_change":"2023-06-20T13:32:20.026066+0000","last_active":"2023-06-20T13:32:26.050052+0000","last_peered":"2023-06-20T13:32:26.050052+0000","last_clean":"2023-06-20T13:32:26.050052+0000","last_became_active":"2023-06-20T13:32:20.025801+0000","last_became_peered":"2023-06-20T13:32:20.025801+0000","last_unstale":"2023-06-20T13:32:26.050052+0000","last_undegraded":"2023-06-20T13:32:26.050052+0000","last_fullsized":"2023-06-20T13:32:26.050052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:29:47.324744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287504+0000","last_change":"2023-06-20T13:32:21.030547+0000","last_active":"2023-06-20T13:32:26.287504+0000","last_peered":"2023-06-20T13:32:26.287504+0000","last_clean":"2023-06-20T13:32:26.287504+0000","last_became_active":"2023-06-20T13:32:21.030257+0000","last_became_peered":"2023-06-20T13:32:21.030257+0000","last_unstale":"2023-06-20T13:32:26.287504+0000","last_undegraded":"2023-06-20T13:32:26.287504+0000","last_fullsized":"2023-06-20T13:32:26.287504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:23:42.344527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998540+0000","last_change":"2023-06-20T13:32:25.078236+0000","last_active":"2023-06-20T13:32:26.998540+0000","last_peered":"2023-06-20T13:32:26.998540+0000","last_clean":"2023-06-20T13:32:26.998540+0000","last_became_active":"2023-06-20T13:32:25.077747+0000","last_became_peered":"2023-06-20T13:32:25.077747+0000","last_unstale":"2023-06-20T13:32:26.998540+0000","last_undegraded":"2023-06-20T13:32:26.998540+0000","last_fullsized":"2023-06-20T13:32:26.998540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:41:55.461660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050484+0000","last_change":"2023-06-20T13:32:20.027046+0000","last_active":"2023-06-20T13:32:26.050484+0000","last_peered":"2023-06-20T13:32:26.050484+0000","last_clean":"2023-06-20T13:32:26.050484+0000","last_became_active":"2023-06-20T13:32:20.026741+0000","last_became_peered":"2023-06-20T13:32:20.026741+0000","last_unstale":"2023-06-20T13:32:26.050484+0000","last_undegraded":"2023-06-20T13:32:26.050484+0000","last_fullsized":"2023-06-20T13:32:26.050484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:22:53.366158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.047799+0000","last_change":"2023-06-20T13:32:21.015867+0000","last_active":"2023-06-20T13:32:26.047799+0000","last_peered":"2023-06-20T13:32:26.047799+0000","last_clean":"2023-06-20T13:32:26.047799+0000","last_became_active":"2023-06-20T13:32:21.015563+0000","last_became_peered":"2023-06-20T13:32:21.015563+0000","last_unstale":"2023-06-20T13:32:26.047799+0000","last_undegraded":"2023-06-20T13:32:26.047799+0000","last_fullsized":"2023-06-20T13:32:26.047799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:54:58.955740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049263+0000","last_change":"2023-06-20T13:32:25.069092+0000","last_active":"2023-06-20T13:32:26.049263+0000","last_peered":"2023-06-20T13:32:26.049263+0000","last_clean":"2023-06-20T13:32:26.049263+0000","last_became_active":"2023-06-20T13:32:25.068638+0000","last_became_peered":"2023-06-20T13:32:25.068638+0000","last_unstale":"2023-06-20T13:32:26.049263+0000","last_undegraded":"2023-06-20T13:32:26.049263+0000","last_fullsized":"2023-06-20T13:32:26.049263+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:03:03.660136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225596+0000","last_change":"2023-06-20T13:32:20.025796+0000","last_active":"2023-06-20T13:32:27.225596+0000","last_peered":"2023-06-20T13:32:27.225596+0000","last_clean":"2023-06-20T13:32:27.225596+0000","last_became_active":"2023-06-20T13:32:20.025522+0000","last_became_peered":"2023-06-20T13:32:20.025522+0000","last_unstale":"2023-06-20T13:32:27.225596+0000","last_undegraded":"2023-06-20T13:32:27.225596+0000","last_fullsized":"2023-06-20T13:32:27.225596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:04:42.004091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287773+0000","last_change":"2023-06-20T13:32:21.033490+0000","last_active":"2023-06-20T13:32:26.287773+0000","last_peered":"2023-06-20T13:32:26.287773+0000","last_clean":"2023-06-20T13:32:26.287773+0000","last_became_active":"2023-06-20T13:32:21.033237+0000","last_became_peered":"2023-06-20T13:32:21.033237+0000","last_unstale":"2023-06-20T13:32:26.287773+0000","last_undegraded":"2023-06-20T13:32:26.287773+0000","last_fullsized":"2023-06-20T13:32:26.287773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:19:16.766615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225649+0000","last_change":"2023-06-20T13:32:25.081885+0000","last_active":"2023-06-20T13:32:27.225649+0000","last_peered":"2023-06-20T13:32:27.225649+0000","last_clean":"2023-06-20T13:32:27.225649+0000","last_became_active":"2023-06-20T13:32:25.081228+0000","last_became_peered":"2023-06-20T13:32:25.081228+0000","last_unstale":"2023-06-20T13:32:27.225649+0000","last_undegraded":"2023-06-20T13:32:27.225649+0000","last_fullsized":"2023-06-20T13:32:27.225649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:49:04.499679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225509+0000","last_change":"2023-06-20T13:32:20.025197+0000","last_active":"2023-06-20T13:32:27.225509+0000","last_peered":"2023-06-20T13:32:27.225509+0000","last_clean":"2023-06-20T13:32:27.225509+0000","last_became_active":"2023-06-20T13:32:20.024758+0000","last_became_peered":"2023-06-20T13:32:20.024758+0000","last_unstale":"2023-06-20T13:32:27.225509+0000","last_undegraded":"2023-06-20T13:32:27.225509+0000","last_fullsized":"2023-06-20T13:32:27.225509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:26:46.711540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287663+0000","last_change":"2023-06-20T13:32:21.031954+0000","last_active":"2023-06-20T13:32:26.287663+0000","last_peered":"2023-06-20T13:32:26.287663+0000","last_clean":"2023-06-20T13:32:26.287663+0000","last_became_active":"2023-06-20T13:32:21.031666+0000","last_became_peered":"2023-06-20T13:32:21.031666+0000","last_unstale":"2023-06-20T13:32:26.287663+0000","last_undegraded":"2023-06-20T13:32:26.287663+0000","last_fullsized":"2023-06-20T13:32:26.287663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:57:30.492657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287583+0000","last_change":"2023-06-20T13:32:25.084390+0000","last_active":"2023-06-20T13:32:26.287583+0000","last_peered":"2023-06-20T13:32:26.287583+0000","last_clean":"2023-06-20T13:32:26.287583+0000","last_became_active":"2023-06-20T13:32:25.083962+0000","last_became_peered":"2023-06-20T13:32:25.083962+0000","last_unstale":"2023-06-20T13:32:26.287583+0000","last_undegraded":"2023-06-20T13:32:26.287583+0000","last_fullsized":"2023-06-20T13:32:26.287583+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:18:17.174644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225215+0000","last_change":"2023-06-20T13:32:20.023402+0000","last_active":"2023-06-20T13:32:27.225215+0000","last_peered":"2023-06-20T13:32:27.225215+0000","last_clean":"2023-06-20T13:32:27.225215+0000","last_became_active":"2023-06-20T13:32:20.021613+0000","last_became_peered":"2023-06-20T13:32:20.021613+0000","last_unstale":"2023-06-20T13:32:27.225215+0000","last_undegraded":"2023-06-20T13:32:27.225215+0000","last_fullsized":"2023-06-20T13:32:27.225215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:23:41.335834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224909+0000","last_change":"2023-06-20T13:32:21.022492+0000","last_active":"2023-06-20T13:32:27.224909+0000","last_peered":"2023-06-20T13:32:27.224909+0000","last_clean":"2023-06-20T13:32:27.224909+0000","last_became_active":"2023-06-20T13:32:21.022206+0000","last_became_peered":"2023-06-20T13:32:21.022206+0000","last_unstale":"2023-06-20T13:32:27.224909+0000","last_undegraded":"2023-06-20T13:32:27.224909+0000","last_fullsized":"2023-06-20T13:32:27.224909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:12:08.369795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998506+0000","last_change":"2023-06-20T13:32:25.076299+0000","last_active":"2023-06-20T13:32:26.998506+0000","last_peered":"2023-06-20T13:32:26.998506+0000","last_clean":"2023-06-20T13:32:26.998506+0000","last_became_active":"2023-06-20T13:32:25.075767+0000","last_became_peered":"2023-06-20T13:32:25.075767+0000","last_unstale":"2023-06-20T13:32:26.998506+0000","last_undegraded":"2023-06-20T13:32:26.998506+0000","last_fullsized":"2023-06-20T13:32:26.998506+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:02:49.608947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050335+0000","last_change":"2023-06-20T13:32:20.030050+0000","last_active":"2023-06-20T13:32:26.050335+0000","last_peered":"2023-06-20T13:32:26.050335+0000","last_clean":"2023-06-20T13:32:26.050335+0000","last_became_active":"2023-06-20T13:32:20.029733+0000","last_became_peered":"2023-06-20T13:32:20.029733+0000","last_unstale":"2023-06-20T13:32:26.050335+0000","last_undegraded":"2023-06-20T13:32:26.050335+0000","last_fullsized":"2023-06-20T13:32:26.050335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:48:08.408940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287814+0000","last_change":"2023-06-20T13:32:21.038936+0000","last_active":"2023-06-20T13:32:26.287814+0000","last_peered":"2023-06-20T13:32:26.287814+0000","last_clean":"2023-06-20T13:32:26.287814+0000","last_became_active":"2023-06-20T13:32:21.038680+0000","last_became_peered":"2023-06-20T13:32:21.038680+0000","last_unstale":"2023-06-20T13:32:26.287814+0000","last_undegraded":"2023-06-20T13:32:26.287814+0000","last_fullsized":"2023-06-20T13:32:26.287814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:21:30.152203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224604+0000","last_change":"2023-06-20T13:32:21.033221+0000","last_active":"2023-06-20T13:32:27.224604+0000","last_peered":"2023-06-20T13:32:27.224604+0000","last_clean":"2023-06-20T13:32:27.224604+0000","last_became_active":"2023-06-20T13:32:21.032926+0000","last_became_peered":"2023-06-20T13:32:21.032926+0000","last_unstale":"2023-06-20T13:32:27.224604+0000","last_undegraded":"2023-06-20T13:32:27.224604+0000","last_fullsized":"2023-06-20T13:32:27.224604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:42:28.774705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225379+0000","last_change":"2023-06-20T13:32:21.024688+0000","last_active":"2023-06-20T13:32:27.225379+0000","last_peered":"2023-06-20T13:32:27.225379+0000","last_clean":"2023-06-20T13:32:27.225379+0000","last_became_active":"2023-06-20T13:32:21.024425+0000","last_became_peered":"2023-06-20T13:32:21.024425+0000","last_unstale":"2023-06-20T13:32:27.225379+0000","last_undegraded":"2023-06-20T13:32:27.225379+0000","last_fullsized":"2023-06-20T13:32:27.225379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:57:30.492657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288448+0000","last_change":"2023-06-20T13:32:21.038363+0000","last_active":"2023-06-20T13:32:26.288448+0000","last_peered":"2023-06-20T13:32:26.288448+0000","last_clean":"2023-06-20T13:32:26.288448+0000","last_became_active":"2023-06-20T13:32:21.038067+0000","last_became_peered":"2023-06-20T13:32:21.038067+0000","last_unstale":"2023-06-20T13:32:26.288448+0000","last_undegraded":"2023-06-20T13:32:26.288448+0000","last_fullsized":"2023-06-20T13:32:26.288448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:39:38.079107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224630+0000","last_change":"2023-06-20T13:32:21.027425+0000","last_active":"2023-06-20T13:32:27.224630+0000","last_peered":"2023-06-20T13:32:27.224630+0000","last_clean":"2023-06-20T13:32:27.224630+0000","last_became_active":"2023-06-20T13:32:21.026535+0000","last_became_peered":"2023-06-20T13:32:21.026535+0000","last_unstale":"2023-06-20T13:32:27.224630+0000","last_undegraded":"2023-06-20T13:32:27.224630+0000","last_fullsized":"2023-06-20T13:32:27.224630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:22:54.374851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998680+0000","last_change":"2023-06-20T13:32:21.027385+0000","last_active":"2023-06-20T13:32:26.998680+0000","last_peered":"2023-06-20T13:32:26.998680+0000","last_clean":"2023-06-20T13:32:26.998680+0000","last_became_active":"2023-06-20T13:32:21.027089+0000","last_became_peered":"2023-06-20T13:32:21.027089+0000","last_unstale":"2023-06-20T13:32:26.998680+0000","last_undegraded":"2023-06-20T13:32:26.998680+0000","last_fullsized":"2023-06-20T13:32:26.998680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:25:29.097559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":909312,"data_stored":713159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542156,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":286720,"data_stored":118781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":286720,"data_stored":118781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":884736,"data_stored":709731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":286720,"data_stored":118781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4950000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.9630000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.8310000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":118871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542156,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":122631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":119433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-20T13:32:56.338 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-20T13:32:56.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.567+0000 7f2975dff700 1 Processor -- start 2023-06-20T13:32:56.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.568+0000 7f2975dff700 1 -- start start 2023-06-20T13:32:56.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.569+0000 7f2975dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f297015c1e0 0x7f29700caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:56.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.569+0000 7f2975dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f297006c450 0x7f29700b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:56.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.569+0000 7f2975dff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29700ce6e0 con 0x7f29700cb470 2023-06-20T13:32:56.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.569+0000 7f2975dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29700d06d0 con 0x7f297006c450 2023-06-20T13:32:56.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.569+0000 7f2975dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29700ceb70 con 0x7f297015c1e0 2023-06-20T13:32:56.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.569+0000 7f296effd700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f29700cb470 0x7f297006ba50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:52918/0 (socket says 172.21.15.32:52918) 2023-06-20T13:32:56.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.569+0000 7f296effd700 1 -- 172.21.15.32:0/37110418 learned_addr learned my addr 172.21.15.32:0/37110418 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:56.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.569+0000 7f296ffff700 1 --2- 172.21.15.32:0/37110418 >> v2:172.21.15.115:3300/0 conn(0x7f297006c450 0x7f29700b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:56.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.569+0000 7f296f7fe700 1 --2- 172.21.15.32:0/37110418 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f297015c1e0 0x7f29700caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:56.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.569+0000 7f296e7fc700 1 -- 172.21.15.32:0/37110418 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166393180 0 0) 0x7f29700ce6e0 con 0x7f29700cb470 2023-06-20T13:32:56.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.570+0000 7f296e7fc700 1 -- 172.21.15.32:0/37110418 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29580035b0 con 0x7f29700cb470 2023-06-20T13:32:56.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.570+0000 7f296e7fc700 1 -- 172.21.15.32:0/37110418 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2825135340 0 0) 0x7f29580035b0 con 0x7f29700cb470 2023-06-20T13:32:56.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.570+0000 7f296e7fc700 1 -- 172.21.15.32:0/37110418 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f297015c1e0 msgr2=0x7f29700caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:56.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.570+0000 7f296e7fc700 1 --2- 172.21.15.32:0/37110418 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f297015c1e0 0x7f29700caf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:56.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.570+0000 7f296e7fc700 1 -- 172.21.15.32:0/37110418 >> v2:172.21.15.115:3300/0 conn(0x7f297006c450 msgr2=0x7f29700b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:56.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.570+0000 7f296e7fc700 1 --2- 172.21.15.32:0/37110418 >> v2:172.21.15.115:3300/0 conn(0x7f297006c450 0x7f29700b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:56.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.570+0000 7f296e7fc700 1 -- 172.21.15.32:0/37110418 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2970070b60 con 0x7f29700cb470 2023-06-20T13:32:56.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.570+0000 7f296e7fc700 1 -- 172.21.15.32:0/37110418 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3380058562 0 0) 0x7f2964001670 con 0x7f29700cb470 2023-06-20T13:32:56.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.570+0000 7f296e7fc700 1 -- 172.21.15.32:0/37110418 >> v1:172.21.15.32:6789/0 conn(0x7f29700cb470 legacy=0x7f297006ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:56.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.570+0000 7f296e7fc700 1 --2- 172.21.15.32:0/37110418 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2958003a00 0x7f2958003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:56.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.570+0000 7f296e7fc700 1 --2- 172.21.15.32:0/37110418 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f297015c1e0 0x7f2958004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:56.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.570+0000 7f296e7fc700 1 --2- 172.21.15.32:0/37110418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2958004d90 0x7f2958005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:56.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.570+0000 7f296e7fc700 1 -- 172.21.15.32:0/37110418 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29700d06d0 con 0x7f2958004d90 2023-06-20T13:32:56.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.570+0000 7f296e7fc700 1 -- 172.21.15.32:0/37110418 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29700ceb70 con 0x7f2958003a00 2023-06-20T13:32:56.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.570+0000 7f296e7fc700 1 -- 172.21.15.32:0/37110418 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f295800ba10 con 0x7f297015c1e0 2023-06-20T13:32:56.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.570+0000 7f296ffff700 1 --2- 172.21.15.32:0/37110418 >> v2:172.21.15.115:3300/0 conn(0x7f297006c450 0x7f29700b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:32:56.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.570+0000 7f296ffff700 1 --2- 172.21.15.32:0/37110418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2958004d90 0x7f2958005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:56.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.570+0000 7f296effd700 1 --2- 172.21.15.32:0/37110418 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f297015c1e0 0x7f2958004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:56.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.570+0000 7f296f7fe700 1 --2- 172.21.15.32:0/37110418 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2958003a00 0x7f2958003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:56.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.571+0000 7f296ffff700 1 -- 172.21.15.32:0/37110418 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f297015c1e0 msgr2=0x7f2958004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:56.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.571+0000 7f296ffff700 1 --2- 172.21.15.32:0/37110418 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f297015c1e0 0x7f2958004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:56.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.571+0000 7f296ffff700 1 -- 172.21.15.32:0/37110418 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2958003a00 msgr2=0x7f2958003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:56.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.571+0000 7f296ffff700 1 --2- 172.21.15.32:0/37110418 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2958003a00 0x7f2958003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:56.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.571+0000 7f296ffff700 1 -- 172.21.15.32:0/37110418 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29580035b0 con 0x7f2958004d90 2023-06-20T13:32:56.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.571+0000 7f296ffff700 1 --2- 172.21.15.32:0/37110418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2958004d90 0x7f2958005200 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f296800e350 tx=0x7f2958005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10840615d54756f4 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:56.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.571+0000 7f296e7fc700 1 -- 172.21.15.32:0/37110418 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296800edb0 con 0x7f2958004d90 2023-06-20T13:32:56.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.571+0000 7f296e7fc700 1 -- 172.21.15.32:0/37110418 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296800f040 con 0x7f2958004d90 2023-06-20T13:32:56.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.571+0000 7f296e7fc700 1 -- 172.21.15.32:0/37110418 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2968003c40 con 0x7f2958004d90 2023-06-20T13:32:56.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.572+0000 7f2975dff700 1 -- 172.21.15.32:0/37110418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2958004d90 msgr2=0x7f2958005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:56.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.572+0000 7f2975dff700 1 --2- 172.21.15.32:0/37110418 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2958004d90 0x7f2958005200 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f296800e350 tx=0x7f2958005880 comp rx=0 tx=0).stop 2023-06-20T13:32:56.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.572+0000 7f296ffff700 1 -- 172.21.15.32:0/37110418 reap_dead start 2023-06-20T13:32:56.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.572+0000 7f2975dff700 1 -- 172.21.15.32:0/37110418 shutdown_connections 2023-06-20T13:32:56.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.572+0000 7f2975dff700 1 -- 172.21.15.32:0/37110418 >> 172.21.15.32:0/37110418 conn(0x7f297006e550 msgr2=0x7f297006e920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:56.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.572+0000 7f2975dff700 1 -- 172.21.15.32:0/37110418 shutdown_connections 2023-06-20T13:32:56.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.572+0000 7f2975dff700 1 -- 172.21.15.32:0/37110418 wait complete. 2023-06-20T13:32:56.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.574+0000 7f2975dff700 1 Processor -- start 2023-06-20T13:32:56.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.574+0000 7f2975dff700 1 -- start start 2023-06-20T13:32:56.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.575+0000 7f2975dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2958004d90 0x7f297014d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:56.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.575+0000 7f2975dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29700ccac0 0x7f29700ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:56.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.575+0000 7f2975dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29700c5440 0x7f29700c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:56.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.575+0000 7f2975dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29700cd470 con 0x7f29700c5440 2023-06-20T13:32:56.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.575+0000 7f2975dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2970147c80 con 0x7f29700ccac0 2023-06-20T13:32:56.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.575+0000 7f2975dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29700c6450 con 0x7f2958004d90 2023-06-20T13:32:56.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.575+0000 7f296ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29700c5440 0x7f29700c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:56.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.575+0000 7f296ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29700c5440 0x7f29700c58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59398/0 (socket says 172.21.15.32:59398) 2023-06-20T13:32:56.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.575+0000 7f296ffff700 1 -- 172.21.15.32:0/1179472025 learned_addr learned my addr 172.21.15.32:0/1179472025 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:56.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.575+0000 7f296ffff700 1 -- 172.21.15.32:0/1179472025 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2958004d90 msgr2=0x7f297014d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:56.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.575+0000 7f296ffff700 1 --2- 172.21.15.32:0/1179472025 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2958004d90 0x7f297014d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:56.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.575+0000 7f296ffff700 1 -- 172.21.15.32:0/1179472025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29700ccac0 msgr2=0x7f29700ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:56.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.575+0000 7f296ffff700 1 --2- 172.21.15.32:0/1179472025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29700ccac0 0x7f29700ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:56.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.575+0000 7f296ffff700 1 -- 172.21.15.32:0/1179472025 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29700c6170 con 0x7f29700c5440 2023-06-20T13:32:56.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.576+0000 7f296ffff700 1 --2- 172.21.15.32:0/1179472025 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29700c5440 0x7f29700c58e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2968004000 tx=0x7f2968009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:56.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.576+0000 7f2957fff700 1 -- 172.21.15.32:0/1179472025 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2968004030 con 0x7f29700c5440 2023-06-20T13:32:56.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.576+0000 7f2957fff700 1 -- 172.21.15.32:0/1179472025 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2968022070 con 0x7f29700c5440 2023-06-20T13:32:56.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.576+0000 7f2957fff700 1 -- 172.21.15.32:0/1179472025 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29680043d0 con 0x7f29700c5440 2023-06-20T13:32:56.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.576+0000 7f2975dff700 1 -- 172.21.15.32:0/1179472025 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2970147630 con 0x7f29700c5440 2023-06-20T13:32:56.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.576+0000 7f2975dff700 1 -- 172.21.15.32:0/1179472025 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29700c5e20 con 0x7f29700c5440 2023-06-20T13:32:56.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.577+0000 7f2975dff700 1 -- 172.21.15.32:0/1179472025 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f297006c120 con 0x7f29700c5440 2023-06-20T13:32:56.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.578+0000 7f2957fff700 1 -- 172.21.15.32:0/1179472025 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2968024070 con 0x7f29700c5440 2023-06-20T13:32:56.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.579+0000 7f2957fff700 1 --2- 172.21.15.32:0/1179472025 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f295c06ace0 0x7f295c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:56.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.579+0000 7f2957fff700 1 -- 172.21.15.32:0/1179472025 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f296808b190 con 0x7f29700c5440 2023-06-20T13:32:56.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.579+0000 7f296f7fe700 1 --2- 172.21.15.32:0/1179472025 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f295c06ace0 0x7f295c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:56.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.580+0000 7f296f7fe700 1 --2- 172.21.15.32:0/1179472025 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f295c06ace0 0x7f295c06d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2960009ae0 tx=0x7f29600093c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:56.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.583+0000 7f2957fff700 1 -- 172.21.15.32:0/1179472025 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2968055f40 con 0x7f29700c5440 2023-06-20T13:32:56.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.787+0000 7f2975dff700 1 -- 172.21.15.32:0/1179472025 --> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f29700d03f0 con 0x7f295c06ace0 2023-06-20T13:32:56.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.797+0000 7f2957fff700 1 -- 172.21.15.32:0/1179472025 <== mgr.4101 v2:172.21.15.32:6832/1136488437 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367314 (secure 0 0 0) 0x7f29600116b0 con 0x7f295c06ace0 2023-06-20T13:32:56.803 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:32:56.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.802+0000 7f2975dff700 1 -- 172.21.15.32:0/1179472025 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f295c06ace0 msgr2=0x7f295c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:56.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.802+0000 7f2975dff700 1 --2- 172.21.15.32:0/1179472025 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f295c06ace0 0x7f295c06d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2960009ae0 tx=0x7f29600093c0 comp rx=0 tx=0).stop 2023-06-20T13:32:56.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.802+0000 7f2975dff700 1 -- 172.21.15.32:0/1179472025 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29700c5440 msgr2=0x7f29700c58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:56.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.802+0000 7f2975dff700 1 --2- 172.21.15.32:0/1179472025 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29700c5440 0x7f29700c58e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2968004000 tx=0x7f2968009750 comp rx=0 tx=0).stop 2023-06-20T13:32:56.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.802+0000 7f2975dff700 1 -- 172.21.15.32:0/1179472025 shutdown_connections 2023-06-20T13:32:56.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.802+0000 7f2975dff700 1 --2- 172.21.15.32:0/1179472025 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f295c06ace0 0x7f295c06d190 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:56.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.802+0000 7f2975dff700 1 --2- 172.21.15.32:0/1179472025 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f29700c5440 0x7f29700c58e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:56.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.802+0000 7f2975dff700 1 --2- 172.21.15.32:0/1179472025 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2958004d90 0x7f297014d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:56.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.802+0000 7f2975dff700 1 --2- 172.21.15.32:0/1179472025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29700ccac0 0x7f29700ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:56.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.802+0000 7f2975dff700 1 -- 172.21.15.32:0/1179472025 >> 172.21.15.32:0/1179472025 conn(0x7f297006e550 msgr2=0x7f297015b500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:56.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.802+0000 7f2975dff700 1 -- 172.21.15.32:0/1179472025 shutdown_connections 2023-06-20T13:32:56.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:56.802+0000 7f2975dff700 1 -- 172.21.15.32:0/1179472025 wait complete. 2023-06-20T13:32:56.807 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-06-20T13:32:56.823 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2023-06-20T13:32:55.268802+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219080,"kb_used_data":3464,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755640,"statfs":{"total":773094113280,"available":772869775360,"internally_reserved":0,"allocated":3547136,"data_stored":2140168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.010155"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.048185+0000","last_change":"2023-06-20T13:32:21.033030+0000","last_active":"2023-06-20T13:32:26.048185+0000","last_peered":"2023-06-20T13:32:26.048185+0000","last_clean":"2023-06-20T13:32:26.048185+0000","last_became_active":"2023-06-20T13:32:21.032583+0000","last_became_peered":"2023-06-20T13:32:21.032583+0000","last_unstale":"2023-06-20T13:32:26.048185+0000","last_undegraded":"2023-06-20T13:32:26.048185+0000","last_fullsized":"2023-06-20T13:32:26.048185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:43:58.636715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225801+0000","last_change":"2023-06-20T13:32:21.028815+0000","last_active":"2023-06-20T13:32:27.225801+0000","last_peered":"2023-06-20T13:32:27.225801+0000","last_clean":"2023-06-20T13:32:27.225801+0000","last_became_active":"2023-06-20T13:32:21.026146+0000","last_became_peered":"2023-06-20T13:32:21.026146+0000","last_unstale":"2023-06-20T13:32:27.225801+0000","last_undegraded":"2023-06-20T13:32:27.225801+0000","last_fullsized":"2023-06-20T13:32:27.225801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:22:54.374851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288495+0000","last_change":"2023-06-20T13:32:21.031230+0000","last_active":"2023-06-20T13:32:26.288495+0000","last_peered":"2023-06-20T13:32:26.288495+0000","last_clean":"2023-06-20T13:32:26.288495+0000","last_became_active":"2023-06-20T13:32:21.030270+0000","last_became_peered":"2023-06-20T13:32:21.030270+0000","last_unstale":"2023-06-20T13:32:26.288495+0000","last_undegraded":"2023-06-20T13:32:26.288495+0000","last_fullsized":"2023-06-20T13:32:26.288495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:32:45.231640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225268+0000","last_change":"2023-06-20T13:32:21.033833+0000","last_active":"2023-06-20T13:32:27.225268+0000","last_peered":"2023-06-20T13:32:27.225268+0000","last_clean":"2023-06-20T13:32:27.225268+0000","last_became_active":"2023-06-20T13:32:21.033516+0000","last_became_peered":"2023-06-20T13:32:21.033516+0000","last_unstale":"2023-06-20T13:32:27.225268+0000","last_undegraded":"2023-06-20T13:32:27.225268+0000","last_fullsized":"2023-06-20T13:32:27.225268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:46:34.316386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050622+0000","last_change":"2023-06-20T13:32:21.033655+0000","last_active":"2023-06-20T13:32:26.050622+0000","last_peered":"2023-06-20T13:32:26.050622+0000","last_clean":"2023-06-20T13:32:26.050622+0000","last_became_active":"2023-06-20T13:32:21.033357+0000","last_became_peered":"2023-06-20T13:32:21.033357+0000","last_unstale":"2023-06-20T13:32:26.050622+0000","last_undegraded":"2023-06-20T13:32:26.050622+0000","last_fullsized":"2023-06-20T13:32:26.050622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:39:14.274571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288173+0000","last_change":"2023-06-20T13:32:21.032497+0000","last_active":"2023-06-20T13:32:26.288173+0000","last_peered":"2023-06-20T13:32:26.288173+0000","last_clean":"2023-06-20T13:32:26.288173+0000","last_became_active":"2023-06-20T13:32:21.032222+0000","last_became_peered":"2023-06-20T13:32:21.032222+0000","last_unstale":"2023-06-20T13:32:26.288173+0000","last_undegraded":"2023-06-20T13:32:26.288173+0000","last_fullsized":"2023-06-20T13:32:26.288173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:29:48.507048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049899+0000","last_change":"2023-06-20T13:32:21.022372+0000","last_active":"2023-06-20T13:32:26.049899+0000","last_peered":"2023-06-20T13:32:26.049899+0000","last_clean":"2023-06-20T13:32:26.049899+0000","last_became_active":"2023-06-20T13:32:21.021763+0000","last_became_peered":"2023-06-20T13:32:21.021763+0000","last_unstale":"2023-06-20T13:32:26.049899+0000","last_undegraded":"2023-06-20T13:32:26.049899+0000","last_fullsized":"2023-06-20T13:32:26.049899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:22:54.374851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224785+0000","last_change":"2023-06-20T13:32:21.040883+0000","last_active":"2023-06-20T13:32:27.224785+0000","last_peered":"2023-06-20T13:32:27.224785+0000","last_clean":"2023-06-20T13:32:27.224785+0000","last_became_active":"2023-06-20T13:32:21.040645+0000","last_became_peered":"2023-06-20T13:32:21.040645+0000","last_unstale":"2023-06-20T13:32:27.224785+0000","last_undegraded":"2023-06-20T13:32:27.224785+0000","last_fullsized":"2023-06-20T13:32:27.224785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:10:11.011524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049846+0000","last_change":"2023-06-20T13:32:21.032741+0000","last_active":"2023-06-20T13:32:26.049846+0000","last_peered":"2023-06-20T13:32:26.049846+0000","last_clean":"2023-06-20T13:32:26.049846+0000","last_became_active":"2023-06-20T13:32:21.031965+0000","last_became_peered":"2023-06-20T13:32:21.031965+0000","last_unstale":"2023-06-20T13:32:26.049846+0000","last_undegraded":"2023-06-20T13:32:26.049846+0000","last_fullsized":"2023-06-20T13:32:26.049846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:10:11.011524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.226123+0000","last_change":"2023-06-20T13:32:21.029077+0000","last_active":"2023-06-20T13:32:27.226123+0000","last_peered":"2023-06-20T13:32:27.226123+0000","last_clean":"2023-06-20T13:32:27.226123+0000","last_became_active":"2023-06-20T13:32:21.025779+0000","last_became_peered":"2023-06-20T13:32:21.025779+0000","last_unstale":"2023-06-20T13:32:27.226123+0000","last_undegraded":"2023-06-20T13:32:27.226123+0000","last_fullsized":"2023-06-20T13:32:27.226123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:12:08.369795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288693+0000","last_change":"2023-06-20T13:32:21.031418+0000","last_active":"2023-06-20T13:32:26.288693+0000","last_peered":"2023-06-20T13:32:26.288693+0000","last_clean":"2023-06-20T13:32:26.288693+0000","last_became_active":"2023-06-20T13:32:21.030652+0000","last_became_peered":"2023-06-20T13:32:21.030652+0000","last_unstale":"2023-06-20T13:32:26.288693+0000","last_undegraded":"2023-06-20T13:32:26.288693+0000","last_fullsized":"2023-06-20T13:32:26.288693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:34:05.805819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.048364+0000","last_change":"2023-06-20T13:32:21.038615+0000","last_active":"2023-06-20T13:32:26.048364+0000","last_peered":"2023-06-20T13:32:26.048364+0000","last_clean":"2023-06-20T13:32:26.048364+0000","last_became_active":"2023-06-20T13:32:21.038282+0000","last_became_peered":"2023-06-20T13:32:21.038282+0000","last_unstale":"2023-06-20T13:32:26.048364+0000","last_undegraded":"2023-06-20T13:32:26.048364+0000","last_fullsized":"2023-06-20T13:32:26.048364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:59:33.841139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.047994+0000","last_change":"2023-06-20T13:32:21.031597+0000","last_active":"2023-06-20T13:32:26.047994+0000","last_peered":"2023-06-20T13:32:26.047994+0000","last_clean":"2023-06-20T13:32:26.047994+0000","last_became_active":"2023-06-20T13:32:21.031271+0000","last_became_peered":"2023-06-20T13:32:21.031271+0000","last_unstale":"2023-06-20T13:32:26.047994+0000","last_undegraded":"2023-06-20T13:32:26.047994+0000","last_fullsized":"2023-06-20T13:32:26.047994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:44:15.228781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225403+0000","last_change":"2023-06-20T13:32:21.025613+0000","last_active":"2023-06-20T13:32:27.225403+0000","last_peered":"2023-06-20T13:32:27.225403+0000","last_clean":"2023-06-20T13:32:27.225403+0000","last_became_active":"2023-06-20T13:32:21.025299+0000","last_became_peered":"2023-06-20T13:32:21.025299+0000","last_unstale":"2023-06-20T13:32:27.225403+0000","last_undegraded":"2023-06-20T13:32:27.225403+0000","last_fullsized":"2023-06-20T13:32:27.225403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:02:59.622021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049134+0000","last_change":"2023-06-20T13:32:21.022539+0000","last_active":"2023-06-20T13:32:26.049134+0000","last_peered":"2023-06-20T13:32:26.049134+0000","last_clean":"2023-06-20T13:32:26.049134+0000","last_became_active":"2023-06-20T13:32:21.022066+0000","last_became_peered":"2023-06-20T13:32:21.022066+0000","last_unstale":"2023-06-20T13:32:26.049134+0000","last_undegraded":"2023-06-20T13:32:26.049134+0000","last_fullsized":"2023-06-20T13:32:26.049134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:41:51.423544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287835+0000","last_change":"2023-06-20T13:32:21.029934+0000","last_active":"2023-06-20T13:32:26.287835+0000","last_peered":"2023-06-20T13:32:26.287835+0000","last_clean":"2023-06-20T13:32:26.287835+0000","last_became_active":"2023-06-20T13:32:21.029620+0000","last_became_peered":"2023-06-20T13:32:21.029620+0000","last_unstale":"2023-06-20T13:32:26.287835+0000","last_undegraded":"2023-06-20T13:32:26.287835+0000","last_fullsized":"2023-06-20T13:32:26.287835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:24:59.969867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049998+0000","last_change":"2023-06-20T13:32:21.032911+0000","last_active":"2023-06-20T13:32:26.049998+0000","last_peered":"2023-06-20T13:32:26.049998+0000","last_clean":"2023-06-20T13:32:26.049998+0000","last_became_active":"2023-06-20T13:32:21.032330+0000","last_became_peered":"2023-06-20T13:32:21.032330+0000","last_unstale":"2023-06-20T13:32:26.049998+0000","last_undegraded":"2023-06-20T13:32:26.049998+0000","last_fullsized":"2023-06-20T13:32:26.049998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:25:29.097559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288480+0000","last_change":"2023-06-20T13:32:21.032286+0000","last_active":"2023-06-20T13:32:26.288480+0000","last_peered":"2023-06-20T13:32:26.288480+0000","last_clean":"2023-06-20T13:32:26.288480+0000","last_became_active":"2023-06-20T13:32:21.032026+0000","last_became_peered":"2023-06-20T13:32:21.032026+0000","last_unstale":"2023-06-20T13:32:26.288480+0000","last_undegraded":"2023-06-20T13:32:26.288480+0000","last_fullsized":"2023-06-20T13:32:26.288480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:20:54.027209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.047620+0000","last_change":"2023-06-20T13:32:21.038729+0000","last_active":"2023-06-20T13:32:26.047620+0000","last_peered":"2023-06-20T13:32:26.047620+0000","last_clean":"2023-06-20T13:32:26.047620+0000","last_became_active":"2023-06-20T13:32:21.038349+0000","last_became_peered":"2023-06-20T13:32:21.038349+0000","last_unstale":"2023-06-20T13:32:26.047620+0000","last_undegraded":"2023-06-20T13:32:26.047620+0000","last_fullsized":"2023-06-20T13:32:26.047620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:52:33.238643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288055+0000","last_change":"2023-06-20T13:32:21.038223+0000","last_active":"2023-06-20T13:32:26.288055+0000","last_peered":"2023-06-20T13:32:26.288055+0000","last_clean":"2023-06-20T13:32:26.288055+0000","last_became_active":"2023-06-20T13:32:21.037898+0000","last_became_peered":"2023-06-20T13:32:21.037898+0000","last_unstale":"2023-06-20T13:32:26.288055+0000","last_undegraded":"2023-06-20T13:32:26.288055+0000","last_fullsized":"2023-06-20T13:32:26.288055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:22:57.611066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049472+0000","last_change":"2023-06-20T13:32:21.031301+0000","last_active":"2023-06-20T13:32:26.049472+0000","last_peered":"2023-06-20T13:32:26.049472+0000","last_clean":"2023-06-20T13:32:26.049472+0000","last_became_active":"2023-06-20T13:32:21.031013+0000","last_became_peered":"2023-06-20T13:32:21.031013+0000","last_unstale":"2023-06-20T13:32:26.049472+0000","last_undegraded":"2023-06-20T13:32:26.049472+0000","last_fullsized":"2023-06-20T13:32:26.049472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:29:48.333437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049583+0000","last_change":"2023-06-20T13:32:21.025148+0000","last_active":"2023-06-20T13:32:26.049583+0000","last_peered":"2023-06-20T13:32:26.049583+0000","last_clean":"2023-06-20T13:32:26.049583+0000","last_became_active":"2023-06-20T13:32:21.024903+0000","last_became_peered":"2023-06-20T13:32:21.024903+0000","last_unstale":"2023-06-20T13:32:26.049583+0000","last_undegraded":"2023-06-20T13:32:26.049583+0000","last_fullsized":"2023-06-20T13:32:26.049583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:41:51.423544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224396+0000","last_change":"2023-06-20T13:32:21.028704+0000","last_active":"2023-06-20T13:32:27.224396+0000","last_peered":"2023-06-20T13:32:27.224396+0000","last_clean":"2023-06-20T13:32:27.224396+0000","last_became_active":"2023-06-20T13:32:21.028340+0000","last_became_peered":"2023-06-20T13:32:21.028340+0000","last_unstale":"2023-06-20T13:32:27.224396+0000","last_undegraded":"2023-06-20T13:32:27.224396+0000","last_fullsized":"2023-06-20T13:32:27.224396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:48:09.417634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049186+0000","last_change":"2023-06-20T13:32:21.034406+0000","last_active":"2023-06-20T13:32:26.049186+0000","last_peered":"2023-06-20T13:32:26.049186+0000","last_clean":"2023-06-20T13:32:26.049186+0000","last_became_active":"2023-06-20T13:32:21.034097+0000","last_became_peered":"2023-06-20T13:32:21.034097+0000","last_unstale":"2023-06-20T13:32:26.049186+0000","last_undegraded":"2023-06-20T13:32:26.049186+0000","last_fullsized":"2023-06-20T13:32:26.049186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:10:11.011524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998821+0000","last_change":"2023-06-20T13:32:21.038778+0000","last_active":"2023-06-20T13:32:26.998821+0000","last_peered":"2023-06-20T13:32:26.998821+0000","last_clean":"2023-06-20T13:32:26.998821+0000","last_became_active":"2023-06-20T13:32:21.038456+0000","last_became_peered":"2023-06-20T13:32:21.038456+0000","last_unstale":"2023-06-20T13:32:26.998821+0000","last_undegraded":"2023-06-20T13:32:26.998821+0000","last_fullsized":"2023-06-20T13:32:26.998821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:29:48.333437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998629+0000","last_change":"2023-06-20T13:32:21.023655+0000","last_active":"2023-06-20T13:32:26.998629+0000","last_peered":"2023-06-20T13:32:26.998629+0000","last_clean":"2023-06-20T13:32:26.998629+0000","last_became_active":"2023-06-20T13:32:21.023366+0000","last_became_peered":"2023-06-20T13:32:21.023366+0000","last_unstale":"2023-06-20T13:32:26.998629+0000","last_undegraded":"2023-06-20T13:32:26.998629+0000","last_fullsized":"2023-06-20T13:32:26.998629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:02:59.622021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225931+0000","last_change":"2023-06-20T13:32:21.040132+0000","last_active":"2023-06-20T13:32:27.225931+0000","last_peered":"2023-06-20T13:32:27.225931+0000","last_clean":"2023-06-20T13:32:27.225931+0000","last_became_active":"2023-06-20T13:32:21.039482+0000","last_became_peered":"2023-06-20T13:32:21.039482+0000","last_unstale":"2023-06-20T13:32:27.225931+0000","last_undegraded":"2023-06-20T13:32:27.225931+0000","last_fullsized":"2023-06-20T13:32:27.225931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:01:24.597870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288708+0000","last_change":"2023-06-20T13:32:25.083629+0000","last_active":"2023-06-20T13:32:26.288708+0000","last_peered":"2023-06-20T13:32:26.288708+0000","last_clean":"2023-06-20T13:32:26.288708+0000","last_became_active":"2023-06-20T13:32:25.083205+0000","last_became_peered":"2023-06-20T13:32:25.083205+0000","last_unstale":"2023-06-20T13:32:26.288708+0000","last_undegraded":"2023-06-20T13:32:26.288708+0000","last_fullsized":"2023-06-20T13:32:26.288708+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:05:12.289018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287897+0000","last_change":"2023-06-20T13:32:20.023586+0000","last_active":"2023-06-20T13:32:26.287897+0000","last_peered":"2023-06-20T13:32:26.287897+0000","last_clean":"2023-06-20T13:32:26.287897+0000","last_became_active":"2023-06-20T13:32:20.023257+0000","last_became_peered":"2023-06-20T13:32:20.023257+0000","last_unstale":"2023-06-20T13:32:26.287897+0000","last_undegraded":"2023-06-20T13:32:26.287897+0000","last_fullsized":"2023-06-20T13:32:26.287897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:28:06.073451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225087+0000","last_change":"2023-06-20T13:32:21.024146+0000","last_active":"2023-06-20T13:32:27.225087+0000","last_peered":"2023-06-20T13:32:27.225087+0000","last_clean":"2023-06-20T13:32:27.225087+0000","last_became_active":"2023-06-20T13:32:21.023861+0000","last_became_peered":"2023-06-20T13:32:21.023861+0000","last_unstale":"2023-06-20T13:32:27.225087+0000","last_undegraded":"2023-06-20T13:32:27.225087+0000","last_fullsized":"2023-06-20T13:32:27.225087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:19:16.766615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224818+0000","last_change":"2023-06-20T13:32:25.070665+0000","last_active":"2023-06-20T13:32:27.224818+0000","last_peered":"2023-06-20T13:32:27.224818+0000","last_clean":"2023-06-20T13:32:27.224818+0000","last_became_active":"2023-06-20T13:32:25.070238+0000","last_became_peered":"2023-06-20T13:32:25.070238+0000","last_unstale":"2023-06-20T13:32:27.224818+0000","last_undegraded":"2023-06-20T13:32:27.224818+0000","last_fullsized":"2023-06-20T13:32:27.224818+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:49:58.213633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998000+0000","last_change":"2023-06-20T13:32:20.022478+0000","last_active":"2023-06-20T13:32:26.998000+0000","last_peered":"2023-06-20T13:32:26.998000+0000","last_clean":"2023-06-20T13:32:26.998000+0000","last_became_active":"2023-06-20T13:32:20.022166+0000","last_became_peered":"2023-06-20T13:32:20.022166+0000","last_unstale":"2023-06-20T13:32:26.998000+0000","last_undegraded":"2023-06-20T13:32:26.998000+0000","last_fullsized":"2023-06-20T13:32:26.998000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:19:18.352136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050275+0000","last_change":"2023-06-20T13:32:21.037532+0000","last_active":"2023-06-20T13:32:26.050275+0000","last_peered":"2023-06-20T13:32:26.050275+0000","last_clean":"2023-06-20T13:32:26.050275+0000","last_became_active":"2023-06-20T13:32:21.037127+0000","last_became_peered":"2023-06-20T13:32:21.037127+0000","last_unstale":"2023-06-20T13:32:26.050275+0000","last_undegraded":"2023-06-20T13:32:26.050275+0000","last_fullsized":"2023-06-20T13:32:26.050275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:26:47.720233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050558+0000","last_change":"2023-06-20T13:32:25.085925+0000","last_active":"2023-06-20T13:32:26.050558+0000","last_peered":"2023-06-20T13:32:26.050558+0000","last_clean":"2023-06-20T13:32:26.050558+0000","last_became_active":"2023-06-20T13:32:25.085537+0000","last_became_peered":"2023-06-20T13:32:25.085537+0000","last_unstale":"2023-06-20T13:32:26.050558+0000","last_undegraded":"2023-06-20T13:32:26.050558+0000","last_fullsized":"2023-06-20T13:32:26.050558+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:01:28.635985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224478+0000","last_change":"2023-06-20T13:32:20.028414+0000","last_active":"2023-06-20T13:32:27.224478+0000","last_peered":"2023-06-20T13:32:27.224478+0000","last_clean":"2023-06-20T13:32:27.224478+0000","last_became_active":"2023-06-20T13:32:20.028129+0000","last_became_peered":"2023-06-20T13:32:20.028129+0000","last_unstale":"2023-06-20T13:32:27.224478+0000","last_undegraded":"2023-06-20T13:32:27.224478+0000","last_fullsized":"2023-06-20T13:32:27.224478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:16:57.717945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225375+0000","last_change":"2023-06-20T13:32:21.036814+0000","last_active":"2023-06-20T13:32:27.225375+0000","last_peered":"2023-06-20T13:32:27.225375+0000","last_clean":"2023-06-20T13:32:27.225375+0000","last_became_active":"2023-06-20T13:32:21.036540+0000","last_became_peered":"2023-06-20T13:32:21.036540+0000","last_unstale":"2023-06-20T13:32:27.225375+0000","last_undegraded":"2023-06-20T13:32:27.225375+0000","last_fullsized":"2023-06-20T13:32:27.225375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:39:45.434194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224434+0000","last_change":"2023-06-20T13:32:25.070673+0000","last_active":"2023-06-20T13:32:27.224434+0000","last_peered":"2023-06-20T13:32:27.224434+0000","last_clean":"2023-06-20T13:32:27.224434+0000","last_became_active":"2023-06-20T13:32:25.070136+0000","last_became_peered":"2023-06-20T13:32:25.070136+0000","last_unstale":"2023-06-20T13:32:27.224434+0000","last_undegraded":"2023-06-20T13:32:27.224434+0000","last_fullsized":"2023-06-20T13:32:27.224434+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:57:00.983846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050185+0000","last_change":"2023-06-20T13:32:20.030153+0000","last_active":"2023-06-20T13:32:26.050185+0000","last_peered":"2023-06-20T13:32:26.050185+0000","last_clean":"2023-06-20T13:32:26.050185+0000","last_became_active":"2023-06-20T13:32:20.029794+0000","last_became_peered":"2023-06-20T13:32:20.029794+0000","last_unstale":"2023-06-20T13:32:26.050185+0000","last_undegraded":"2023-06-20T13:32:26.050185+0000","last_fullsized":"2023-06-20T13:32:26.050185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:04:42.004091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224386+0000","last_change":"2023-06-20T13:32:21.028713+0000","last_active":"2023-06-20T13:32:27.224386+0000","last_peered":"2023-06-20T13:32:27.224386+0000","last_clean":"2023-06-20T13:32:27.224386+0000","last_became_active":"2023-06-20T13:32:21.027969+0000","last_became_peered":"2023-06-20T13:32:21.027969+0000","last_unstale":"2023-06-20T13:32:27.224386+0000","last_undegraded":"2023-06-20T13:32:27.224386+0000","last_fullsized":"2023-06-20T13:32:27.224386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:26:47.720233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.048978+0000","last_change":"2023-06-20T13:32:25.072571+0000","last_active":"2023-06-20T13:32:26.048978+0000","last_peered":"2023-06-20T13:32:26.048978+0000","last_clean":"2023-06-20T13:32:26.048978+0000","last_became_active":"2023-06-20T13:32:25.072166+0000","last_became_peered":"2023-06-20T13:32:25.072166+0000","last_unstale":"2023-06-20T13:32:26.048978+0000","last_undegraded":"2023-06-20T13:32:26.048978+0000","last_fullsized":"2023-06-20T13:32:26.048978+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:02:49.608947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225983+0000","last_change":"2023-06-20T13:32:20.022108+0000","last_active":"2023-06-20T13:32:27.225983+0000","last_peered":"2023-06-20T13:32:27.225983+0000","last_clean":"2023-06-20T13:32:27.225983+0000","last_became_active":"2023-06-20T13:32:20.021836+0000","last_became_peered":"2023-06-20T13:32:20.021836+0000","last_unstale":"2023-06-20T13:32:27.225983+0000","last_undegraded":"2023-06-20T13:32:27.225983+0000","last_fullsized":"2023-06-20T13:32:27.225983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:32:35.608967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224530+0000","last_change":"2023-06-20T13:32:21.027141+0000","last_active":"2023-06-20T13:32:27.224530+0000","last_peered":"2023-06-20T13:32:27.224530+0000","last_clean":"2023-06-20T13:32:27.224530+0000","last_became_active":"2023-06-20T13:32:21.026831+0000","last_became_peered":"2023-06-20T13:32:21.026831+0000","last_unstale":"2023-06-20T13:32:27.224530+0000","last_undegraded":"2023-06-20T13:32:27.224530+0000","last_fullsized":"2023-06-20T13:32:27.224530+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:01:24.597870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225358+0000","last_change":"2023-06-20T13:32:25.074657+0000","last_active":"2023-06-20T13:32:27.225358+0000","last_peered":"2023-06-20T13:32:27.225358+0000","last_clean":"2023-06-20T13:32:27.225358+0000","last_became_active":"2023-06-20T13:32:25.074234+0000","last_became_peered":"2023-06-20T13:32:25.074234+0000","last_unstale":"2023-06-20T13:32:27.225358+0000","last_undegraded":"2023-06-20T13:32:27.225358+0000","last_fullsized":"2023-06-20T13:32:27.225358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:34:34.823010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049629+0000","last_change":"2023-06-20T13:32:20.023105+0000","last_active":"2023-06-20T13:32:26.049629+0000","last_peered":"2023-06-20T13:32:26.049629+0000","last_clean":"2023-06-20T13:32:26.049629+0000","last_became_active":"2023-06-20T13:32:20.022845+0000","last_became_peered":"2023-06-20T13:32:20.022845+0000","last_unstale":"2023-06-20T13:32:26.049629+0000","last_undegraded":"2023-06-20T13:32:26.049629+0000","last_fullsized":"2023-06-20T13:32:26.049629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:04:42.004091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998524+0000","last_change":"2023-06-20T13:32:21.035337+0000","last_active":"2023-06-20T13:32:26.998524+0000","last_peered":"2023-06-20T13:32:26.998524+0000","last_clean":"2023-06-20T13:32:26.998524+0000","last_became_active":"2023-06-20T13:32:21.035026+0000","last_became_peered":"2023-06-20T13:32:21.035026+0000","last_unstale":"2023-06-20T13:32:26.998524+0000","last_undegraded":"2023-06-20T13:32:26.998524+0000","last_fullsized":"2023-06-20T13:32:26.998524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:08:50.174602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998117+0000","last_change":"2023-06-20T13:32:25.077778+0000","last_active":"2023-06-20T13:32:26.998117+0000","last_peered":"2023-06-20T13:32:26.998117+0000","last_clean":"2023-06-20T13:32:26.998117+0000","last_became_active":"2023-06-20T13:32:25.076300+0000","last_became_peered":"2023-06-20T13:32:25.076300+0000","last_unstale":"2023-06-20T13:32:26.998117+0000","last_undegraded":"2023-06-20T13:32:26.998117+0000","last_fullsized":"2023-06-20T13:32:26.998117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:38:55.235383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:39.667215+0000","last_change":"2023-06-20T13:32:20.020923+0000","last_active":"2023-06-20T13:32:39.667215+0000","last_peered":"2023-06-20T13:32:39.667215+0000","last_clean":"2023-06-20T13:32:39.667215+0000","last_became_active":"2023-06-20T13:32:20.020435+0000","last_became_peered":"2023-06-20T13:32:20.020435+0000","last_unstale":"2023-06-20T13:32:39.667215+0000","last_undegraded":"2023-06-20T13:32:39.667215+0000","last_fullsized":"2023-06-20T13:32:39.667215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:04:23.085234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288184+0000","last_change":"2023-06-20T13:32:21.035014+0000","last_active":"2023-06-20T13:32:26.288184+0000","last_peered":"2023-06-20T13:32:26.288184+0000","last_clean":"2023-06-20T13:32:26.288184+0000","last_became_active":"2023-06-20T13:32:21.034760+0000","last_became_peered":"2023-06-20T13:32:21.034760+0000","last_unstale":"2023-06-20T13:32:26.288184+0000","last_undegraded":"2023-06-20T13:32:26.288184+0000","last_fullsized":"2023-06-20T13:32:26.288184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:35:16.891724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.226159+0000","last_change":"2023-06-20T13:32:25.082529+0000","last_active":"2023-06-20T13:32:27.226159+0000","last_peered":"2023-06-20T13:32:27.226159+0000","last_clean":"2023-06-20T13:32:27.226159+0000","last_became_active":"2023-06-20T13:32:25.082205+0000","last_became_peered":"2023-06-20T13:32:25.082205+0000","last_unstale":"2023-06-20T13:32:27.226159+0000","last_undegraded":"2023-06-20T13:32:27.226159+0000","last_fullsized":"2023-06-20T13:32:27.226159+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:18:17.174644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049387+0000","last_change":"2023-06-20T13:32:20.022027+0000","last_active":"2023-06-20T13:32:26.049387+0000","last_peered":"2023-06-20T13:32:26.049387+0000","last_clean":"2023-06-20T13:32:26.049387+0000","last_became_active":"2023-06-20T13:32:20.021696+0000","last_became_peered":"2023-06-20T13:32:20.021696+0000","last_unstale":"2023-06-20T13:32:26.049387+0000","last_undegraded":"2023-06-20T13:32:26.049387+0000","last_fullsized":"2023-06-20T13:32:26.049387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:21:22.959916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224795+0000","last_change":"2023-06-20T13:32:21.035314+0000","last_active":"2023-06-20T13:32:27.224795+0000","last_peered":"2023-06-20T13:32:27.224795+0000","last_clean":"2023-06-20T13:32:27.224795+0000","last_became_active":"2023-06-20T13:32:21.035000+0000","last_became_peered":"2023-06-20T13:32:21.035000+0000","last_unstale":"2023-06-20T13:32:27.224795+0000","last_undegraded":"2023-06-20T13:32:27.224795+0000","last_fullsized":"2023-06-20T13:32:27.224795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:32:36.617660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224640+0000","last_change":"2023-06-20T13:32:25.067229+0000","last_active":"2023-06-20T13:32:27.224640+0000","last_peered":"2023-06-20T13:32:27.224640+0000","last_clean":"2023-06-20T13:32:27.224640+0000","last_became_active":"2023-06-20T13:32:25.066768+0000","last_became_peered":"2023-06-20T13:32:25.066768+0000","last_unstale":"2023-06-20T13:32:27.224640+0000","last_undegraded":"2023-06-20T13:32:27.224640+0000","last_fullsized":"2023-06-20T13:32:27.224640+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:53:30.164168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049398+0000","last_change":"2023-06-20T13:32:20.025271+0000","last_active":"2023-06-20T13:32:26.049398+0000","last_peered":"2023-06-20T13:32:26.049398+0000","last_clean":"2023-06-20T13:32:26.049398+0000","last_became_active":"2023-06-20T13:32:20.024881+0000","last_became_peered":"2023-06-20T13:32:20.024881+0000","last_unstale":"2023-06-20T13:32:26.049398+0000","last_undegraded":"2023-06-20T13:32:26.049398+0000","last_fullsized":"2023-06-20T13:32:26.049398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:08:49.165909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225931+0000","last_change":"2023-06-20T13:32:21.040302+0000","last_active":"2023-06-20T13:32:27.225931+0000","last_peered":"2023-06-20T13:32:27.225931+0000","last_clean":"2023-06-20T13:32:27.225931+0000","last_became_active":"2023-06-20T13:32:21.039807+0000","last_became_peered":"2023-06-20T13:32:21.039807+0000","last_unstale":"2023-06-20T13:32:27.225931+0000","last_undegraded":"2023-06-20T13:32:27.225931+0000","last_fullsized":"2023-06-20T13:32:27.225931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:39:14.274571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225542+0000","last_change":"2023-06-20T13:32:25.074563+0000","last_active":"2023-06-20T13:32:27.225542+0000","last_peered":"2023-06-20T13:32:27.225542+0000","last_clean":"2023-06-20T13:32:27.225542+0000","last_became_active":"2023-06-20T13:32:25.074142+0000","last_became_peered":"2023-06-20T13:32:25.074142+0000","last_unstale":"2023-06-20T13:32:27.225542+0000","last_undegraded":"2023-06-20T13:32:27.225542+0000","last_fullsized":"2023-06-20T13:32:27.225542+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:21:34.190318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049875+0000","last_change":"2023-06-20T13:32:20.022385+0000","last_active":"2023-06-20T13:32:26.049875+0000","last_peered":"2023-06-20T13:32:26.049875+0000","last_clean":"2023-06-20T13:32:26.049875+0000","last_became_active":"2023-06-20T13:32:20.022046+0000","last_became_peered":"2023-06-20T13:32:20.022046+0000","last_unstale":"2023-06-20T13:32:26.049875+0000","last_undegraded":"2023-06-20T13:32:26.049875+0000","last_fullsized":"2023-06-20T13:32:26.049875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:16:57.717945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050412+0000","last_change":"2023-06-20T13:32:21.037368+0000","last_active":"2023-06-20T13:32:26.050412+0000","last_peered":"2023-06-20T13:32:26.050412+0000","last_clean":"2023-06-20T13:32:26.050412+0000","last_became_active":"2023-06-20T13:32:21.036706+0000","last_became_peered":"2023-06-20T13:32:21.036706+0000","last_unstale":"2023-06-20T13:32:26.050412+0000","last_undegraded":"2023-06-20T13:32:26.050412+0000","last_fullsized":"2023-06-20T13:32:26.050412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:16:58.726638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225769+0000","last_change":"2023-06-20T13:32:25.081687+0000","last_active":"2023-06-20T13:32:27.225769+0000","last_peered":"2023-06-20T13:32:27.225769+0000","last_clean":"2023-06-20T13:32:27.225769+0000","last_became_active":"2023-06-20T13:32:25.081227+0000","last_became_peered":"2023-06-20T13:32:25.081227+0000","last_unstale":"2023-06-20T13:32:27.225769+0000","last_undegraded":"2023-06-20T13:32:27.225769+0000","last_fullsized":"2023-06-20T13:32:27.225769+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:17:02.764753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224793+0000","last_change":"2023-06-20T13:32:20.028572+0000","last_active":"2023-06-20T13:32:27.224793+0000","last_peered":"2023-06-20T13:32:27.224793+0000","last_clean":"2023-06-20T13:32:27.224793+0000","last_became_active":"2023-06-20T13:32:20.028266+0000","last_became_peered":"2023-06-20T13:32:20.028266+0000","last_unstale":"2023-06-20T13:32:27.224793+0000","last_undegraded":"2023-06-20T13:32:27.224793+0000","last_fullsized":"2023-06-20T13:32:27.224793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:28:13.559245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225547+0000","last_change":"2023-06-20T13:32:21.036385+0000","last_active":"2023-06-20T13:32:27.225547+0000","last_peered":"2023-06-20T13:32:27.225547+0000","last_clean":"2023-06-20T13:32:27.225547+0000","last_became_active":"2023-06-20T13:32:21.036013+0000","last_became_peered":"2023-06-20T13:32:21.036013+0000","last_unstale":"2023-06-20T13:32:27.225547+0000","last_undegraded":"2023-06-20T13:32:27.225547+0000","last_fullsized":"2023-06-20T13:32:27.225547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:04:01.696402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050107+0000","last_change":"2023-06-20T13:32:25.071698+0000","last_active":"2023-06-20T13:32:26.050107+0000","last_peered":"2023-06-20T13:32:26.050107+0000","last_clean":"2023-06-20T13:32:26.050107+0000","last_became_active":"2023-06-20T13:32:25.070889+0000","last_became_peered":"2023-06-20T13:32:25.070889+0000","last_unstale":"2023-06-20T13:32:26.050107+0000","last_undegraded":"2023-06-20T13:32:26.050107+0000","last_fullsized":"2023-06-20T13:32:26.050107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:53:30.164168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050078+0000","last_change":"2023-06-20T13:32:20.027675+0000","last_active":"2023-06-20T13:32:26.050078+0000","last_peered":"2023-06-20T13:32:26.050078+0000","last_clean":"2023-06-20T13:32:26.050078+0000","last_became_active":"2023-06-20T13:32:20.027273+0000","last_became_peered":"2023-06-20T13:32:20.027273+0000","last_unstale":"2023-06-20T13:32:26.050078+0000","last_undegraded":"2023-06-20T13:32:26.050078+0000","last_fullsized":"2023-06-20T13:32:26.050078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:01:23.589176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224638+0000","last_change":"2023-06-20T13:32:21.025518+0000","last_active":"2023-06-20T13:32:27.224638+0000","last_peered":"2023-06-20T13:32:27.224638+0000","last_clean":"2023-06-20T13:32:27.224638+0000","last_became_active":"2023-06-20T13:32:21.025151+0000","last_became_peered":"2023-06-20T13:32:21.025151+0000","last_unstale":"2023-06-20T13:32:27.224638+0000","last_undegraded":"2023-06-20T13:32:27.224638+0000","last_fullsized":"2023-06-20T13:32:27.224638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:41:51.423544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.047440+0000","last_change":"2023-06-20T13:32:25.078296+0000","last_active":"2023-06-20T13:32:26.047440+0000","last_peered":"2023-06-20T13:32:26.047440+0000","last_clean":"2023-06-20T13:32:26.047440+0000","last_became_active":"2023-06-20T13:32:25.076656+0000","last_became_peered":"2023-06-20T13:32:25.076656+0000","last_unstale":"2023-06-20T13:32:26.047440+0000","last_undegraded":"2023-06-20T13:32:26.047440+0000","last_fullsized":"2023-06-20T13:32:26.047440+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:04:34.188995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049640+0000","last_change":"2023-06-20T13:32:20.022015+0000","last_active":"2023-06-20T13:32:26.049640+0000","last_peered":"2023-06-20T13:32:26.049640+0000","last_clean":"2023-06-20T13:32:26.049640+0000","last_became_active":"2023-06-20T13:32:20.021716+0000","last_became_peered":"2023-06-20T13:32:20.021716+0000","last_unstale":"2023-06-20T13:32:26.049640+0000","last_undegraded":"2023-06-20T13:32:26.049640+0000","last_fullsized":"2023-06-20T13:32:26.049640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:48:59.452870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288000+0000","last_change":"2023-06-20T13:32:21.022058+0000","last_active":"2023-06-20T13:32:26.288000+0000","last_peered":"2023-06-20T13:32:26.288000+0000","last_clean":"2023-06-20T13:32:26.288000+0000","last_became_active":"2023-06-20T13:32:21.021798+0000","last_became_peered":"2023-06-20T13:32:21.021798+0000","last_unstale":"2023-06-20T13:32:26.288000+0000","last_undegraded":"2023-06-20T13:32:26.288000+0000","last_fullsized":"2023-06-20T13:32:26.288000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:20:17.077026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.047790+0000","last_change":"2023-06-20T13:32:25.077838+0000","last_active":"2023-06-20T13:32:26.047790+0000","last_peered":"2023-06-20T13:32:26.047790+0000","last_clean":"2023-06-20T13:32:26.047790+0000","last_became_active":"2023-06-20T13:32:25.077296+0000","last_became_peered":"2023-06-20T13:32:25.077296+0000","last_unstale":"2023-06-20T13:32:26.047790+0000","last_undegraded":"2023-06-20T13:32:26.047790+0000","last_fullsized":"2023-06-20T13:32:26.047790+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T01:06:17.814845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049856+0000","last_change":"2023-06-20T13:32:20.027368+0000","last_active":"2023-06-20T13:32:26.049856+0000","last_peered":"2023-06-20T13:32:26.049856+0000","last_clean":"2023-06-20T13:32:26.049856+0000","last_became_active":"2023-06-20T13:32:20.027052+0000","last_became_peered":"2023-06-20T13:32:20.027052+0000","last_unstale":"2023-06-20T13:32:26.049856+0000","last_undegraded":"2023-06-20T13:32:26.049856+0000","last_fullsized":"2023-06-20T13:32:26.049856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:48:08.408940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224398+0000","last_change":"2023-06-20T13:32:21.034964+0000","last_active":"2023-06-20T13:32:27.224398+0000","last_peered":"2023-06-20T13:32:27.224398+0000","last_clean":"2023-06-20T13:32:27.224398+0000","last_became_active":"2023-06-20T13:32:21.034681+0000","last_became_peered":"2023-06-20T13:32:21.034681+0000","last_unstale":"2023-06-20T13:32:27.224398+0000","last_undegraded":"2023-06-20T13:32:27.224398+0000","last_fullsized":"2023-06-20T13:32:27.224398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:36:48.688763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.048245+0000","last_change":"2023-06-20T13:32:25.070289+0000","last_active":"2023-06-20T13:32:26.048245+0000","last_peered":"2023-06-20T13:32:26.048245+0000","last_clean":"2023-06-20T13:32:26.048245+0000","last_became_active":"2023-06-20T13:32:25.069805+0000","last_became_peered":"2023-06-20T13:32:25.069805+0000","last_unstale":"2023-06-20T13:32:26.048245+0000","last_undegraded":"2023-06-20T13:32:26.048245+0000","last_fullsized":"2023-06-20T13:32:26.048245+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:36:52.726879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225702+0000","last_change":"2023-06-20T13:32:20.024117+0000","last_active":"2023-06-20T13:32:27.225702+0000","last_peered":"2023-06-20T13:32:27.225702+0000","last_clean":"2023-06-20T13:32:27.225702+0000","last_became_active":"2023-06-20T13:32:20.023863+0000","last_became_peered":"2023-06-20T13:32:20.023863+0000","last_unstale":"2023-06-20T13:32:27.225702+0000","last_undegraded":"2023-06-20T13:32:27.225702+0000","last_fullsized":"2023-06-20T13:32:27.225702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:48:08.408940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050083+0000","last_change":"2023-06-20T13:32:21.033767+0000","last_active":"2023-06-20T13:32:26.050083+0000","last_peered":"2023-06-20T13:32:26.050083+0000","last_clean":"2023-06-20T13:32:26.050083+0000","last_became_active":"2023-06-20T13:32:21.033502+0000","last_became_peered":"2023-06-20T13:32:21.033502+0000","last_unstale":"2023-06-20T13:32:26.050083+0000","last_undegraded":"2023-06-20T13:32:26.050083+0000","last_fullsized":"2023-06-20T13:32:26.050083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:49:00.461563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.047814+0000","last_change":"2023-06-20T13:32:25.077964+0000","last_active":"2023-06-20T13:32:26.047814+0000","last_peered":"2023-06-20T13:32:26.047814+0000","last_clean":"2023-06-20T13:32:26.047814+0000","last_became_active":"2023-06-20T13:32:25.077026+0000","last_became_peered":"2023-06-20T13:32:25.077026+0000","last_unstale":"2023-06-20T13:32:26.047814+0000","last_undegraded":"2023-06-20T13:32:26.047814+0000","last_fullsized":"2023-06-20T13:32:26.047814+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:58:41.932351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224687+0000","last_change":"2023-06-20T13:32:20.028575+0000","last_active":"2023-06-20T13:32:27.224687+0000","last_peered":"2023-06-20T13:32:27.224687+0000","last_clean":"2023-06-20T13:32:27.224687+0000","last_became_active":"2023-06-20T13:32:20.028182+0000","last_became_peered":"2023-06-20T13:32:20.028182+0000","last_unstale":"2023-06-20T13:32:27.224687+0000","last_undegraded":"2023-06-20T13:32:27.224687+0000","last_fullsized":"2023-06-20T13:32:27.224687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:39:13.265878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287817+0000","last_change":"2023-06-20T13:32:21.032963+0000","last_active":"2023-06-20T13:32:26.287817+0000","last_peered":"2023-06-20T13:32:26.287817+0000","last_clean":"2023-06-20T13:32:26.287817+0000","last_became_active":"2023-06-20T13:32:21.032688+0000","last_became_peered":"2023-06-20T13:32:21.032688+0000","last_unstale":"2023-06-20T13:32:26.287817+0000","last_undegraded":"2023-06-20T13:32:26.287817+0000","last_fullsized":"2023-06-20T13:32:26.287817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:04:01.696402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998304+0000","last_change":"2023-06-20T13:32:25.077326+0000","last_active":"2023-06-20T13:32:26.998304+0000","last_peered":"2023-06-20T13:32:26.998304+0000","last_clean":"2023-06-20T13:32:26.998304+0000","last_became_active":"2023-06-20T13:32:25.076929+0000","last_became_peered":"2023-06-20T13:32:25.076929+0000","last_unstale":"2023-06-20T13:32:26.998304+0000","last_undegraded":"2023-06-20T13:32:26.998304+0000","last_fullsized":"2023-06-20T13:32:26.998304+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:56:29.417379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224597+0000","last_change":"2023-06-20T13:32:20.030260+0000","last_active":"2023-06-20T13:32:27.224597+0000","last_peered":"2023-06-20T13:32:27.224597+0000","last_clean":"2023-06-20T13:32:27.224597+0000","last_became_active":"2023-06-20T13:32:20.029938+0000","last_became_peered":"2023-06-20T13:32:20.029938+0000","last_unstale":"2023-06-20T13:32:27.224597+0000","last_undegraded":"2023-06-20T13:32:27.224597+0000","last_fullsized":"2023-06-20T13:32:27.224597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:59:32.832446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288271+0000","last_change":"2023-06-20T13:32:21.030989+0000","last_active":"2023-06-20T13:32:26.288271+0000","last_peered":"2023-06-20T13:32:26.288271+0000","last_clean":"2023-06-20T13:32:26.288271+0000","last_became_active":"2023-06-20T13:32:21.029954+0000","last_became_peered":"2023-06-20T13:32:21.029954+0000","last_unstale":"2023-06-20T13:32:26.288271+0000","last_undegraded":"2023-06-20T13:32:26.288271+0000","last_fullsized":"2023-06-20T13:32:26.288271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:12:40.689219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225889+0000","last_change":"2023-06-20T13:32:25.087926+0000","last_active":"2023-06-20T13:32:27.225889+0000","last_peered":"2023-06-20T13:32:27.225889+0000","last_clean":"2023-06-20T13:32:27.225889+0000","last_became_active":"2023-06-20T13:32:25.087469+0000","last_became_peered":"2023-06-20T13:32:25.087469+0000","last_unstale":"2023-06-20T13:32:27.225889+0000","last_undegraded":"2023-06-20T13:32:27.225889+0000","last_fullsized":"2023-06-20T13:32:27.225889+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:53:30.164168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287510+0000","last_change":"2023-06-20T13:32:20.028180+0000","last_active":"2023-06-20T13:32:26.287510+0000","last_peered":"2023-06-20T13:32:26.287510+0000","last_clean":"2023-06-20T13:32:26.287510+0000","last_became_active":"2023-06-20T13:32:20.027835+0000","last_became_peered":"2023-06-20T13:32:20.027835+0000","last_unstale":"2023-06-20T13:32:26.287510+0000","last_undegraded":"2023-06-20T13:32:26.287510+0000","last_fullsized":"2023-06-20T13:32:26.287510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:34:29.776201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288742+0000","last_change":"2023-06-20T13:32:21.039550+0000","last_active":"2023-06-20T13:32:26.288742+0000","last_peered":"2023-06-20T13:32:26.288742+0000","last_clean":"2023-06-20T13:32:26.288742+0000","last_became_active":"2023-06-20T13:32:21.039297+0000","last_became_peered":"2023-06-20T13:32:21.039297+0000","last_unstale":"2023-06-20T13:32:26.288742+0000","last_undegraded":"2023-06-20T13:32:26.288742+0000","last_fullsized":"2023-06-20T13:32:26.288742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:36:43.451301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288495+0000","last_change":"2023-06-20T13:32:25.084491+0000","last_active":"2023-06-20T13:32:26.288495+0000","last_peered":"2023-06-20T13:32:26.288495+0000","last_clean":"2023-06-20T13:32:26.288495+0000","last_became_active":"2023-06-20T13:32:25.084072+0000","last_became_peered":"2023-06-20T13:32:25.084072+0000","last_unstale":"2023-06-20T13:32:26.288495+0000","last_undegraded":"2023-06-20T13:32:26.288495+0000","last_fullsized":"2023-06-20T13:32:26.288495+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:01:48.702402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224341+0000","last_change":"2023-06-20T13:32:20.022743+0000","last_active":"2023-06-20T13:32:27.224341+0000","last_peered":"2023-06-20T13:32:27.224341+0000","last_clean":"2023-06-20T13:32:27.224341+0000","last_became_active":"2023-06-20T13:32:20.022384+0000","last_became_peered":"2023-06-20T13:32:20.022384+0000","last_unstale":"2023-06-20T13:32:27.224341+0000","last_undegraded":"2023-06-20T13:32:27.224341+0000","last_fullsized":"2023-06-20T13:32:27.224341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:04:42.004091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998918+0000","last_change":"2023-06-20T13:32:21.032771+0000","last_active":"2023-06-20T13:32:26.998918+0000","last_peered":"2023-06-20T13:32:26.998918+0000","last_clean":"2023-06-20T13:32:26.998918+0000","last_became_active":"2023-06-20T13:32:21.032459+0000","last_became_peered":"2023-06-20T13:32:21.032459+0000","last_unstale":"2023-06-20T13:32:26.998918+0000","last_undegraded":"2023-06-20T13:32:26.998918+0000","last_fullsized":"2023-06-20T13:32:26.998918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:51:29.356444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049993+0000","last_change":"2023-06-20T13:32:25.080253+0000","last_active":"2023-06-20T13:32:26.049993+0000","last_peered":"2023-06-20T13:32:26.049993+0000","last_clean":"2023-06-20T13:32:26.049993+0000","last_became_active":"2023-06-20T13:32:25.079626+0000","last_became_peered":"2023-06-20T13:32:25.079626+0000","last_unstale":"2023-06-20T13:32:26.049993+0000","last_undegraded":"2023-06-20T13:32:26.049993+0000","last_fullsized":"2023-06-20T13:32:26.049993+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:21:28.006725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998581+0000","last_change":"2023-06-20T13:32:14.847834+0000","last_active":"2023-06-20T13:32:26.998581+0000","last_peered":"2023-06-20T13:32:26.998581+0000","last_clean":"2023-06-20T13:32:26.998581+0000","last_became_active":"2023-06-20T13:32:14.847518+0000","last_became_peered":"2023-06-20T13:32:14.847518+0000","last_unstale":"2023-06-20T13:32:26.998581+0000","last_undegraded":"2023-06-20T13:32:26.998581+0000","last_fullsized":"2023-06-20T13:32:26.998581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:10:03.973904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225597+0000","last_change":"2023-06-20T13:32:20.025034+0000","last_active":"2023-06-20T13:32:27.225597+0000","last_peered":"2023-06-20T13:32:27.225597+0000","last_clean":"2023-06-20T13:32:27.225597+0000","last_became_active":"2023-06-20T13:32:20.024436+0000","last_became_peered":"2023-06-20T13:32:20.024436+0000","last_unstale":"2023-06-20T13:32:27.225597+0000","last_undegraded":"2023-06-20T13:32:27.225597+0000","last_fullsized":"2023-06-20T13:32:27.225597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:21:22.959916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998113+0000","last_change":"2023-06-20T13:32:21.031761+0000","last_active":"2023-06-20T13:32:26.998113+0000","last_peered":"2023-06-20T13:32:26.998113+0000","last_clean":"2023-06-20T13:32:26.998113+0000","last_became_active":"2023-06-20T13:32:21.031474+0000","last_became_peered":"2023-06-20T13:32:21.031474+0000","last_unstale":"2023-06-20T13:32:26.998113+0000","last_undegraded":"2023-06-20T13:32:26.998113+0000","last_fullsized":"2023-06-20T13:32:26.998113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:38:03.196793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049886+0000","last_change":"2023-06-20T13:32:25.081982+0000","last_active":"2023-06-20T13:32:26.049886+0000","last_peered":"2023-06-20T13:32:26.049886+0000","last_clean":"2023-06-20T13:32:26.049886+0000","last_became_active":"2023-06-20T13:32:25.081414+0000","last_became_peered":"2023-06-20T13:32:25.081414+0000","last_unstale":"2023-06-20T13:32:26.049886+0000","last_undegraded":"2023-06-20T13:32:26.049886+0000","last_fullsized":"2023-06-20T13:32:26.049886+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:03:03.660136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225550+0000","last_change":"2023-06-20T13:32:13.979189+0000","last_active":"2023-06-20T13:32:27.225550+0000","last_peered":"2023-06-20T13:32:27.225550+0000","last_clean":"2023-06-20T13:32:27.225550+0000","last_became_active":"2023-06-20T13:32:13.978675+0000","last_became_peered":"2023-06-20T13:32:13.978675+0000","last_unstale":"2023-06-20T13:32:27.225550+0000","last_undegraded":"2023-06-20T13:32:27.225550+0000","last_fullsized":"2023-06-20T13:32:27.225550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:25:22.059939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288140+0000","last_change":"2023-06-20T13:32:20.029884+0000","last_active":"2023-06-20T13:32:26.288140+0000","last_peered":"2023-06-20T13:32:26.288140+0000","last_clean":"2023-06-20T13:32:26.288140+0000","last_became_active":"2023-06-20T13:32:20.029589+0000","last_became_peered":"2023-06-20T13:32:20.029589+0000","last_unstale":"2023-06-20T13:32:26.288140+0000","last_undegraded":"2023-06-20T13:32:26.288140+0000","last_fullsized":"2023-06-20T13:32:26.288140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:04:36.254532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998444+0000","last_change":"2023-06-20T13:32:21.024248+0000","last_active":"2023-06-20T13:32:26.998444+0000","last_peered":"2023-06-20T13:32:26.998444+0000","last_clean":"2023-06-20T13:32:26.998444+0000","last_became_active":"2023-06-20T13:32:21.023949+0000","last_became_peered":"2023-06-20T13:32:21.023949+0000","last_unstale":"2023-06-20T13:32:26.998444+0000","last_undegraded":"2023-06-20T13:32:26.998444+0000","last_fullsized":"2023-06-20T13:32:26.998444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:27:37.100680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.048226+0000","last_change":"2023-06-20T13:32:25.076311+0000","last_active":"2023-06-20T13:32:26.048226+0000","last_peered":"2023-06-20T13:32:26.048226+0000","last_clean":"2023-06-20T13:32:26.048226+0000","last_became_active":"2023-06-20T13:32:25.075855+0000","last_became_peered":"2023-06-20T13:32:25.075855+0000","last_unstale":"2023-06-20T13:32:26.048226+0000","last_undegraded":"2023-06-20T13:32:26.048226+0000","last_fullsized":"2023-06-20T13:32:26.048226+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:32:42.525847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.047620+0000","last_change":"2023-06-20T13:32:14.567022+0000","last_active":"2023-06-20T13:32:26.047620+0000","last_peered":"2023-06-20T13:32:26.047620+0000","last_clean":"2023-06-20T13:32:26.047620+0000","last_became_active":"2023-06-20T13:32:14.566671+0000","last_became_peered":"2023-06-20T13:32:14.566671+0000","last_unstale":"2023-06-20T13:32:26.047620+0000","last_undegraded":"2023-06-20T13:32:26.047620+0000","last_fullsized":"2023-06-20T13:32:26.047620+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:56:49.908110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998274+0000","last_change":"2023-06-20T13:32:20.028715+0000","last_active":"2023-06-20T13:32:26.998274+0000","last_peered":"2023-06-20T13:32:26.998274+0000","last_clean":"2023-06-20T13:32:26.998274+0000","last_became_active":"2023-06-20T13:32:20.028414+0000","last_became_peered":"2023-06-20T13:32:20.028414+0000","last_unstale":"2023-06-20T13:32:26.998274+0000","last_undegraded":"2023-06-20T13:32:26.998274+0000","last_fullsized":"2023-06-20T13:32:26.998274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:15:12.926553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998963+0000","last_change":"2023-06-20T13:32:21.030732+0000","last_active":"2023-06-20T13:32:26.998963+0000","last_peered":"2023-06-20T13:32:26.998963+0000","last_clean":"2023-06-20T13:32:26.998963+0000","last_became_active":"2023-06-20T13:32:21.030452+0000","last_became_peered":"2023-06-20T13:32:21.030452+0000","last_unstale":"2023-06-20T13:32:26.998963+0000","last_undegraded":"2023-06-20T13:32:26.998963+0000","last_fullsized":"2023-06-20T13:32:26.998963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:04:43.012785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049792+0000","last_change":"2023-06-20T13:32:25.078650+0000","last_active":"2023-06-20T13:32:26.049792+0000","last_peered":"2023-06-20T13:32:26.049792+0000","last_clean":"2023-06-20T13:32:26.049792+0000","last_became_active":"2023-06-20T13:32:25.078187+0000","last_became_peered":"2023-06-20T13:32:25.078187+0000","last_unstale":"2023-06-20T13:32:26.049792+0000","last_undegraded":"2023-06-20T13:32:26.049792+0000","last_fullsized":"2023-06-20T13:32:26.049792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:26:51.758348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225609+0000","last_change":"2023-06-20T13:32:13.978856+0000","last_active":"2023-06-20T13:32:27.225609+0000","last_peered":"2023-06-20T13:32:27.225609+0000","last_clean":"2023-06-20T13:32:27.225609+0000","last_became_active":"2023-06-20T13:32:13.978454+0000","last_became_peered":"2023-06-20T13:32:13.978454+0000","last_unstale":"2023-06-20T13:32:27.225609+0000","last_undegraded":"2023-06-20T13:32:27.225609+0000","last_fullsized":"2023-06-20T13:32:27.225609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:29:41.295818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049111+0000","last_change":"2023-06-20T13:32:06.907663+0000","last_active":"2023-06-20T13:32:26.049111+0000","last_peered":"2023-06-20T13:32:26.049111+0000","last_clean":"2023-06-20T13:32:26.049111+0000","last_became_active":"2023-06-20T13:32:06.906687+0000","last_became_peered":"2023-06-20T13:32:06.906687+0000","last_unstale":"2023-06-20T13:32:26.049111+0000","last_undegraded":"2023-06-20T13:32:26.049111+0000","last_fullsized":"2023-06-20T13:32:26.049111+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:05.521263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:05.521263+0000","last_clean_scrub_stamp":"2023-06-20T13:32:05.521263+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:08:35.702344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224861+0000","last_change":"2023-06-20T13:32:20.019895+0000","last_active":"2023-06-20T13:32:27.224861+0000","last_peered":"2023-06-20T13:32:27.224861+0000","last_clean":"2023-06-20T13:32:27.224861+0000","last_became_active":"2023-06-20T13:32:20.019522+0000","last_became_peered":"2023-06-20T13:32:20.019522+0000","last_unstale":"2023-06-20T13:32:27.224861+0000","last_undegraded":"2023-06-20T13:32:27.224861+0000","last_fullsized":"2023-06-20T13:32:27.224861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:18:12.127836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225154+0000","last_change":"2023-06-20T13:32:21.036376+0000","last_active":"2023-06-20T13:32:27.225154+0000","last_peered":"2023-06-20T13:32:27.225154+0000","last_clean":"2023-06-20T13:32:27.225154+0000","last_became_active":"2023-06-20T13:32:21.036065+0000","last_became_peered":"2023-06-20T13:32:21.036065+0000","last_unstale":"2023-06-20T13:32:27.225154+0000","last_undegraded":"2023-06-20T13:32:27.225154+0000","last_fullsized":"2023-06-20T13:32:27.225154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:44:44.788880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225647+0000","last_change":"2023-06-20T13:32:25.087122+0000","last_active":"2023-06-20T13:32:27.225647+0000","last_peered":"2023-06-20T13:32:27.225647+0000","last_clean":"2023-06-20T13:32:27.225647+0000","last_became_active":"2023-06-20T13:32:25.086746+0000","last_became_peered":"2023-06-20T13:32:25.086746+0000","last_unstale":"2023-06-20T13:32:27.225647+0000","last_undegraded":"2023-06-20T13:32:27.225647+0000","last_fullsized":"2023-06-20T13:32:27.225647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:51:33.394559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049273+0000","last_change":"2023-06-20T13:32:13.977027+0000","last_active":"2023-06-20T13:32:26.049273+0000","last_peered":"2023-06-20T13:32:26.049273+0000","last_clean":"2023-06-20T13:32:26.049273+0000","last_became_active":"2023-06-20T13:32:13.975895+0000","last_became_peered":"2023-06-20T13:32:13.975895+0000","last_unstale":"2023-06-20T13:32:26.049273+0000","last_undegraded":"2023-06-20T13:32:26.049273+0000","last_fullsized":"2023-06-20T13:32:26.049273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:25:22.059939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049300+0000","last_change":"2023-06-20T13:32:20.024292+0000","last_active":"2023-06-20T13:32:26.049300+0000","last_peered":"2023-06-20T13:32:26.049300+0000","last_clean":"2023-06-20T13:32:26.049300+0000","last_became_active":"2023-06-20T13:32:20.023931+0000","last_became_peered":"2023-06-20T13:32:20.023931+0000","last_unstale":"2023-06-20T13:32:26.049300+0000","last_undegraded":"2023-06-20T13:32:26.049300+0000","last_fullsized":"2023-06-20T13:32:26.049300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:02:44.562138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050028+0000","last_change":"2023-06-20T13:32:21.024724+0000","last_active":"2023-06-20T13:32:26.050028+0000","last_peered":"2023-06-20T13:32:26.050028+0000","last_clean":"2023-06-20T13:32:26.050028+0000","last_became_active":"2023-06-20T13:32:21.024485+0000","last_became_peered":"2023-06-20T13:32:21.024485+0000","last_unstale":"2023-06-20T13:32:26.050028+0000","last_undegraded":"2023-06-20T13:32:26.050028+0000","last_fullsized":"2023-06-20T13:32:26.050028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:51:29.356444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225119+0000","last_change":"2023-06-20T13:32:25.076508+0000","last_active":"2023-06-20T13:32:27.225119+0000","last_peered":"2023-06-20T13:32:27.225119+0000","last_clean":"2023-06-20T13:32:27.225119+0000","last_became_active":"2023-06-20T13:32:25.076181+0000","last_became_peered":"2023-06-20T13:32:25.076181+0000","last_unstale":"2023-06-20T13:32:27.225119+0000","last_undegraded":"2023-06-20T13:32:27.225119+0000","last_fullsized":"2023-06-20T13:32:27.225119+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:19:55.667242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049673+0000","last_change":"2023-06-20T13:32:14.848215+0000","last_active":"2023-06-20T13:32:26.049673+0000","last_peered":"2023-06-20T13:32:26.049673+0000","last_clean":"2023-06-20T13:32:26.049673+0000","last_became_active":"2023-06-20T13:32:14.847950+0000","last_became_peered":"2023-06-20T13:32:14.847950+0000","last_unstale":"2023-06-20T13:32:26.049673+0000","last_undegraded":"2023-06-20T13:32:26.049673+0000","last_fullsized":"2023-06-20T13:32:26.049673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:51:22.318824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998709+0000","last_change":"2023-06-20T13:32:20.032594+0000","last_active":"2023-06-20T13:32:26.998709+0000","last_peered":"2023-06-20T13:32:26.998709+0000","last_clean":"2023-06-20T13:32:26.998709+0000","last_became_active":"2023-06-20T13:32:20.032291+0000","last_became_peered":"2023-06-20T13:32:20.032291+0000","last_unstale":"2023-06-20T13:32:26.998709+0000","last_undegraded":"2023-06-20T13:32:26.998709+0000","last_fullsized":"2023-06-20T13:32:26.998709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:21:22.959916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050508+0000","last_change":"2023-06-20T13:32:21.040885+0000","last_active":"2023-06-20T13:32:26.050508+0000","last_peered":"2023-06-20T13:32:26.050508+0000","last_clean":"2023-06-20T13:32:26.050508+0000","last_became_active":"2023-06-20T13:32:21.040606+0000","last_became_peered":"2023-06-20T13:32:21.040606+0000","last_unstale":"2023-06-20T13:32:26.050508+0000","last_undegraded":"2023-06-20T13:32:26.050508+0000","last_fullsized":"2023-06-20T13:32:26.050508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:53:26.126053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288157+0000","last_change":"2023-06-20T13:32:25.074482+0000","last_active":"2023-06-20T13:32:26.288157+0000","last_peered":"2023-06-20T13:32:26.288157+0000","last_clean":"2023-06-20T13:32:26.288157+0000","last_became_active":"2023-06-20T13:32:25.071535+0000","last_became_peered":"2023-06-20T13:32:25.071535+0000","last_unstale":"2023-06-20T13:32:26.288157+0000","last_undegraded":"2023-06-20T13:32:26.288157+0000","last_fullsized":"2023-06-20T13:32:26.288157+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:34:53.709352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225674+0000","last_change":"2023-06-20T13:32:20.023465+0000","last_active":"2023-06-20T13:32:27.225674+0000","last_peered":"2023-06-20T13:32:27.225674+0000","last_clean":"2023-06-20T13:32:27.225674+0000","last_became_active":"2023-06-20T13:32:20.023069+0000","last_became_peered":"2023-06-20T13:32:20.023069+0000","last_unstale":"2023-06-20T13:32:27.225674+0000","last_undegraded":"2023-06-20T13:32:27.225674+0000","last_fullsized":"2023-06-20T13:32:27.225674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:24:58.961174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998839+0000","last_change":"2023-06-20T13:32:13.978089+0000","last_active":"2023-06-20T13:32:26.998839+0000","last_peered":"2023-06-20T13:32:26.998839+0000","last_clean":"2023-06-20T13:32:26.998839+0000","last_became_active":"2023-06-20T13:32:13.977748+0000","last_became_peered":"2023-06-20T13:32:13.977748+0000","last_unstale":"2023-06-20T13:32:26.998839+0000","last_undegraded":"2023-06-20T13:32:26.998839+0000","last_fullsized":"2023-06-20T13:32:26.998839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:48:53.423943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224252+0000","last_change":"2023-06-20T13:32:21.028939+0000","last_active":"2023-06-20T13:32:27.224252+0000","last_peered":"2023-06-20T13:32:27.224252+0000","last_clean":"2023-06-20T13:32:27.224252+0000","last_became_active":"2023-06-20T13:32:21.028355+0000","last_became_peered":"2023-06-20T13:32:21.028355+0000","last_unstale":"2023-06-20T13:32:27.224252+0000","last_undegraded":"2023-06-20T13:32:27.224252+0000","last_fullsized":"2023-06-20T13:32:27.224252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:51:29.356444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224186+0000","last_change":"2023-06-20T13:32:25.076159+0000","last_active":"2023-06-20T13:32:27.224186+0000","last_peered":"2023-06-20T13:32:27.224186+0000","last_clean":"2023-06-20T13:32:27.224186+0000","last_became_active":"2023-06-20T13:32:25.074781+0000","last_became_peered":"2023-06-20T13:32:25.074781+0000","last_unstale":"2023-06-20T13:32:27.224186+0000","last_undegraded":"2023-06-20T13:32:27.224186+0000","last_fullsized":"2023-06-20T13:32:27.224186+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:49:04.499679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224965+0000","last_change":"2023-06-20T13:32:13.977875+0000","last_active":"2023-06-20T13:32:27.224965+0000","last_peered":"2023-06-20T13:32:27.224965+0000","last_clean":"2023-06-20T13:32:27.224965+0000","last_became_active":"2023-06-20T13:32:13.977589+0000","last_became_peered":"2023-06-20T13:32:13.977589+0000","last_unstale":"2023-06-20T13:32:27.224965+0000","last_undegraded":"2023-06-20T13:32:27.224965+0000","last_fullsized":"2023-06-20T13:32:27.224965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:21:46.859788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050052+0000","last_change":"2023-06-20T13:32:20.026066+0000","last_active":"2023-06-20T13:32:26.050052+0000","last_peered":"2023-06-20T13:32:26.050052+0000","last_clean":"2023-06-20T13:32:26.050052+0000","last_became_active":"2023-06-20T13:32:20.025801+0000","last_became_peered":"2023-06-20T13:32:20.025801+0000","last_unstale":"2023-06-20T13:32:26.050052+0000","last_undegraded":"2023-06-20T13:32:26.050052+0000","last_fullsized":"2023-06-20T13:32:26.050052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:29:47.324744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287504+0000","last_change":"2023-06-20T13:32:21.030547+0000","last_active":"2023-06-20T13:32:26.287504+0000","last_peered":"2023-06-20T13:32:26.287504+0000","last_clean":"2023-06-20T13:32:26.287504+0000","last_became_active":"2023-06-20T13:32:21.030257+0000","last_became_peered":"2023-06-20T13:32:21.030257+0000","last_unstale":"2023-06-20T13:32:26.287504+0000","last_undegraded":"2023-06-20T13:32:26.287504+0000","last_fullsized":"2023-06-20T13:32:26.287504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:23:42.344527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998540+0000","last_change":"2023-06-20T13:32:25.078236+0000","last_active":"2023-06-20T13:32:26.998540+0000","last_peered":"2023-06-20T13:32:26.998540+0000","last_clean":"2023-06-20T13:32:26.998540+0000","last_became_active":"2023-06-20T13:32:25.077747+0000","last_became_peered":"2023-06-20T13:32:25.077747+0000","last_unstale":"2023-06-20T13:32:26.998540+0000","last_undegraded":"2023-06-20T13:32:26.998540+0000","last_fullsized":"2023-06-20T13:32:26.998540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:41:55.461660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050484+0000","last_change":"2023-06-20T13:32:20.027046+0000","last_active":"2023-06-20T13:32:26.050484+0000","last_peered":"2023-06-20T13:32:26.050484+0000","last_clean":"2023-06-20T13:32:26.050484+0000","last_became_active":"2023-06-20T13:32:20.026741+0000","last_became_peered":"2023-06-20T13:32:20.026741+0000","last_unstale":"2023-06-20T13:32:26.050484+0000","last_undegraded":"2023-06-20T13:32:26.050484+0000","last_fullsized":"2023-06-20T13:32:26.050484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:22:53.366158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.047799+0000","last_change":"2023-06-20T13:32:21.015867+0000","last_active":"2023-06-20T13:32:26.047799+0000","last_peered":"2023-06-20T13:32:26.047799+0000","last_clean":"2023-06-20T13:32:26.047799+0000","last_became_active":"2023-06-20T13:32:21.015563+0000","last_became_peered":"2023-06-20T13:32:21.015563+0000","last_unstale":"2023-06-20T13:32:26.047799+0000","last_undegraded":"2023-06-20T13:32:26.047799+0000","last_fullsized":"2023-06-20T13:32:26.047799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:54:58.955740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.049263+0000","last_change":"2023-06-20T13:32:25.069092+0000","last_active":"2023-06-20T13:32:26.049263+0000","last_peered":"2023-06-20T13:32:26.049263+0000","last_clean":"2023-06-20T13:32:26.049263+0000","last_became_active":"2023-06-20T13:32:25.068638+0000","last_became_peered":"2023-06-20T13:32:25.068638+0000","last_unstale":"2023-06-20T13:32:26.049263+0000","last_undegraded":"2023-06-20T13:32:26.049263+0000","last_fullsized":"2023-06-20T13:32:26.049263+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:03:03.660136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225596+0000","last_change":"2023-06-20T13:32:20.025796+0000","last_active":"2023-06-20T13:32:27.225596+0000","last_peered":"2023-06-20T13:32:27.225596+0000","last_clean":"2023-06-20T13:32:27.225596+0000","last_became_active":"2023-06-20T13:32:20.025522+0000","last_became_peered":"2023-06-20T13:32:20.025522+0000","last_unstale":"2023-06-20T13:32:27.225596+0000","last_undegraded":"2023-06-20T13:32:27.225596+0000","last_fullsized":"2023-06-20T13:32:27.225596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:04:42.004091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287773+0000","last_change":"2023-06-20T13:32:21.033490+0000","last_active":"2023-06-20T13:32:26.287773+0000","last_peered":"2023-06-20T13:32:26.287773+0000","last_clean":"2023-06-20T13:32:26.287773+0000","last_became_active":"2023-06-20T13:32:21.033237+0000","last_became_peered":"2023-06-20T13:32:21.033237+0000","last_unstale":"2023-06-20T13:32:26.287773+0000","last_undegraded":"2023-06-20T13:32:26.287773+0000","last_fullsized":"2023-06-20T13:32:26.287773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:19:16.766615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225649+0000","last_change":"2023-06-20T13:32:25.081885+0000","last_active":"2023-06-20T13:32:27.225649+0000","last_peered":"2023-06-20T13:32:27.225649+0000","last_clean":"2023-06-20T13:32:27.225649+0000","last_became_active":"2023-06-20T13:32:25.081228+0000","last_became_peered":"2023-06-20T13:32:25.081228+0000","last_unstale":"2023-06-20T13:32:27.225649+0000","last_undegraded":"2023-06-20T13:32:27.225649+0000","last_fullsized":"2023-06-20T13:32:27.225649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:49:04.499679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225509+0000","last_change":"2023-06-20T13:32:20.025197+0000","last_active":"2023-06-20T13:32:27.225509+0000","last_peered":"2023-06-20T13:32:27.225509+0000","last_clean":"2023-06-20T13:32:27.225509+0000","last_became_active":"2023-06-20T13:32:20.024758+0000","last_became_peered":"2023-06-20T13:32:20.024758+0000","last_unstale":"2023-06-20T13:32:27.225509+0000","last_undegraded":"2023-06-20T13:32:27.225509+0000","last_fullsized":"2023-06-20T13:32:27.225509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:26:46.711540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287663+0000","last_change":"2023-06-20T13:32:21.031954+0000","last_active":"2023-06-20T13:32:26.287663+0000","last_peered":"2023-06-20T13:32:26.287663+0000","last_clean":"2023-06-20T13:32:26.287663+0000","last_became_active":"2023-06-20T13:32:21.031666+0000","last_became_peered":"2023-06-20T13:32:21.031666+0000","last_unstale":"2023-06-20T13:32:26.287663+0000","last_undegraded":"2023-06-20T13:32:26.287663+0000","last_fullsized":"2023-06-20T13:32:26.287663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:57:30.492657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287583+0000","last_change":"2023-06-20T13:32:25.084390+0000","last_active":"2023-06-20T13:32:26.287583+0000","last_peered":"2023-06-20T13:32:26.287583+0000","last_clean":"2023-06-20T13:32:26.287583+0000","last_became_active":"2023-06-20T13:32:25.083962+0000","last_became_peered":"2023-06-20T13:32:25.083962+0000","last_unstale":"2023-06-20T13:32:26.287583+0000","last_undegraded":"2023-06-20T13:32:26.287583+0000","last_fullsized":"2023-06-20T13:32:26.287583+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:18:17.174644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225215+0000","last_change":"2023-06-20T13:32:20.023402+0000","last_active":"2023-06-20T13:32:27.225215+0000","last_peered":"2023-06-20T13:32:27.225215+0000","last_clean":"2023-06-20T13:32:27.225215+0000","last_became_active":"2023-06-20T13:32:20.021613+0000","last_became_peered":"2023-06-20T13:32:20.021613+0000","last_unstale":"2023-06-20T13:32:27.225215+0000","last_undegraded":"2023-06-20T13:32:27.225215+0000","last_fullsized":"2023-06-20T13:32:27.225215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:23:41.335834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224909+0000","last_change":"2023-06-20T13:32:21.022492+0000","last_active":"2023-06-20T13:32:27.224909+0000","last_peered":"2023-06-20T13:32:27.224909+0000","last_clean":"2023-06-20T13:32:27.224909+0000","last_became_active":"2023-06-20T13:32:21.022206+0000","last_became_peered":"2023-06-20T13:32:21.022206+0000","last_unstale":"2023-06-20T13:32:27.224909+0000","last_undegraded":"2023-06-20T13:32:27.224909+0000","last_fullsized":"2023-06-20T13:32:27.224909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:12:08.369795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998506+0000","last_change":"2023-06-20T13:32:25.076299+0000","last_active":"2023-06-20T13:32:26.998506+0000","last_peered":"2023-06-20T13:32:26.998506+0000","last_clean":"2023-06-20T13:32:26.998506+0000","last_became_active":"2023-06-20T13:32:25.075767+0000","last_became_peered":"2023-06-20T13:32:25.075767+0000","last_unstale":"2023-06-20T13:32:26.998506+0000","last_undegraded":"2023-06-20T13:32:26.998506+0000","last_fullsized":"2023-06-20T13:32:26.998506+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:24.031637+0000","last_clean_scrub_stamp":"2023-06-20T13:32:24.031637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:02:49.608947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.050335+0000","last_change":"2023-06-20T13:32:20.030050+0000","last_active":"2023-06-20T13:32:26.050335+0000","last_peered":"2023-06-20T13:32:26.050335+0000","last_clean":"2023-06-20T13:32:26.050335+0000","last_became_active":"2023-06-20T13:32:20.029733+0000","last_became_peered":"2023-06-20T13:32:20.029733+0000","last_unstale":"2023-06-20T13:32:26.050335+0000","last_undegraded":"2023-06-20T13:32:26.050335+0000","last_fullsized":"2023-06-20T13:32:26.050335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:18.984828+0000","last_clean_scrub_stamp":"2023-06-20T13:32:18.984828+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:48:08.408940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.287814+0000","last_change":"2023-06-20T13:32:21.038936+0000","last_active":"2023-06-20T13:32:26.287814+0000","last_peered":"2023-06-20T13:32:26.287814+0000","last_clean":"2023-06-20T13:32:26.287814+0000","last_became_active":"2023-06-20T13:32:21.038680+0000","last_became_peered":"2023-06-20T13:32:21.038680+0000","last_unstale":"2023-06-20T13:32:26.287814+0000","last_undegraded":"2023-06-20T13:32:26.287814+0000","last_fullsized":"2023-06-20T13:32:26.287814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:21:30.152203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224604+0000","last_change":"2023-06-20T13:32:21.033221+0000","last_active":"2023-06-20T13:32:27.224604+0000","last_peered":"2023-06-20T13:32:27.224604+0000","last_clean":"2023-06-20T13:32:27.224604+0000","last_became_active":"2023-06-20T13:32:21.032926+0000","last_became_peered":"2023-06-20T13:32:21.032926+0000","last_unstale":"2023-06-20T13:32:27.224604+0000","last_undegraded":"2023-06-20T13:32:27.224604+0000","last_fullsized":"2023-06-20T13:32:27.224604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:42:28.774705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.225379+0000","last_change":"2023-06-20T13:32:21.024688+0000","last_active":"2023-06-20T13:32:27.225379+0000","last_peered":"2023-06-20T13:32:27.225379+0000","last_clean":"2023-06-20T13:32:27.225379+0000","last_became_active":"2023-06-20T13:32:21.024425+0000","last_became_peered":"2023-06-20T13:32:21.024425+0000","last_unstale":"2023-06-20T13:32:27.225379+0000","last_undegraded":"2023-06-20T13:32:27.225379+0000","last_fullsized":"2023-06-20T13:32:27.225379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:57:30.492657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.288448+0000","last_change":"2023-06-20T13:32:21.038363+0000","last_active":"2023-06-20T13:32:26.288448+0000","last_peered":"2023-06-20T13:32:26.288448+0000","last_clean":"2023-06-20T13:32:26.288448+0000","last_became_active":"2023-06-20T13:32:21.038067+0000","last_became_peered":"2023-06-20T13:32:21.038067+0000","last_unstale":"2023-06-20T13:32:26.288448+0000","last_undegraded":"2023-06-20T13:32:26.288448+0000","last_fullsized":"2023-06-20T13:32:26.288448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:39:38.079107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:27.224630+0000","last_change":"2023-06-20T13:32:21.027425+0000","last_active":"2023-06-20T13:32:27.224630+0000","last_peered":"2023-06-20T13:32:27.224630+0000","last_clean":"2023-06-20T13:32:27.224630+0000","last_became_active":"2023-06-20T13:32:21.026535+0000","last_became_peered":"2023-06-20T13:32:21.026535+0000","last_unstale":"2023-06-20T13:32:27.224630+0000","last_undegraded":"2023-06-20T13:32:27.224630+0000","last_fullsized":"2023-06-20T13:32:27.224630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:22:54.374851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-20T13:32:26.998680+0000","last_change":"2023-06-20T13:32:21.027385+0000","last_active":"2023-06-20T13:32:26.998680+0000","last_peered":"2023-06-20T13:32:26.998680+0000","last_clean":"2023-06-20T13:32:26.998680+0000","last_became_active":"2023-06-20T13:32:21.027089+0000","last_became_peered":"2023-06-20T13:32:21.027089+0000","last_unstale":"2023-06-20T13:32:26.998680+0000","last_undegraded":"2023-06-20T13:32:26.998680+0000","last_fullsized":"2023-06-20T13:32:26.998680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:19.993522+0000","last_clean_scrub_stamp":"2023-06-20T13:32:19.993522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:25:29.097559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":909312,"data_stored":713159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542156,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":286720,"data_stored":118781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":286720,"data_stored":118781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":884736,"data_stored":709731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":286720,"data_stored":118781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4950000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.9630000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.8310000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":118871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542156,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":122631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":119433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-20T13:32:56.830 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-06-20T13:32:56.831 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-06-20T13:32:56.831 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-06-20T13:32:56.831 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-06-20T13:32:57.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.060+0000 7f06923ff700 1 Processor -- start 2023-06-20T13:32:57.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.060+0000 7f06923ff700 1 -- start start 2023-06-20T13:32:57.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.062+0000 7f06923ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f068c0d2640 0x7f068c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:57.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.062+0000 7f06923ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f068c0d1790 con 0x7f068c15c460 2023-06-20T13:32:57.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.062+0000 7f06923ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f068c0cd950 con 0x7f068c0cf8f0 2023-06-20T13:32:57.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.062+0000 7f06923ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f068c0cedd0 con 0x7f068c0d2640 2023-06-20T13:32:57.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.062+0000 7f068bfff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f068c15c460 0x7f068c0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:52928/0 (socket says 172.21.15.32:52928) 2023-06-20T13:32:57.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.062+0000 7f068bfff700 1 -- 172.21.15.32:0/2925108308 learned_addr learned my addr 172.21.15.32:0/2925108308 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:57.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.062+0000 7f0683fff700 1 --2- 172.21.15.32:0/2925108308 >> v2:172.21.15.115:3300/0 conn(0x7f068c0d2640 0x7f068c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:57.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.062+0000 7f068b7fe700 1 -- 172.21.15.32:0/2925108308 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3007183108 0 0) 0x7f068c0d1790 con 0x7f068c15c460 2023-06-20T13:32:57.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.062+0000 7f068b7fe700 1 -- 172.21.15.32:0/2925108308 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06780035b0 con 0x7f068c15c460 2023-06-20T13:32:57.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.063+0000 7f0683fff700 1 -- 172.21.15.32:0/2925108308 >> v1:172.21.15.115:6789/0 conn(0x7f068c0cf8f0 legacy=0x7f068c15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:57.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.063+0000 7f068b7fe700 1 -- 172.21.15.32:0/2925108308 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1234986863 0 0) 0x7f068c0cd950 con 0x7f068c0cf8f0 2023-06-20T13:32:57.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.063+0000 7f0683fff700 1 -- 172.21.15.32:0/2925108308 >> v1:172.21.15.32:6789/0 conn(0x7f068c15c460 legacy=0x7f068c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:57.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.063+0000 7f0683fff700 1 -- 172.21.15.32:0/2925108308 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f068c0d14b0 con 0x7f068c0d2640 2023-06-20T13:32:57.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.063+0000 7f0683fff700 1 --2- 172.21.15.32:0/2925108308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f068c0d2640 0x7f068c0b59d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0674009840 tx=0x7f0674009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fb7bad90fba6618 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:57.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.063+0000 7f068b7fe700 1 -- 172.21.15.32:0/2925108308 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0674011830 con 0x7f068c0d2640 2023-06-20T13:32:57.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.063+0000 7f068b7fe700 1 -- 172.21.15.32:0/2925108308 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0674011990 con 0x7f068c0d2640 2023-06-20T13:32:57.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.063+0000 7f068b7fe700 1 -- 172.21.15.32:0/2925108308 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0674011d20 con 0x7f068c0d2640 2023-06-20T13:32:57.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.064+0000 7f06923ff700 1 -- 172.21.15.32:0/2925108308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f068c0d2640 msgr2=0x7f068c0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:57.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.064+0000 7f06923ff700 1 --2- 172.21.15.32:0/2925108308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f068c0d2640 0x7f068c0b59d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0674009840 tx=0x7f0674009b50 comp rx=0 tx=0).stop 2023-06-20T13:32:57.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.064+0000 7f06923ff700 1 -- 172.21.15.32:0/2925108308 shutdown_connections 2023-06-20T13:32:57.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.064+0000 7f06923ff700 1 --2- 172.21.15.32:0/2925108308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f068c0d2640 0x7f068c0b59d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:57.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.064+0000 7f06923ff700 1 -- 172.21.15.32:0/2925108308 >> 172.21.15.32:0/2925108308 conn(0x7f068c071660 msgr2=0x7f068c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:57.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.064+0000 7f06923ff700 1 -- 172.21.15.32:0/2925108308 shutdown_connections 2023-06-20T13:32:57.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.064+0000 7f06923ff700 1 -- 172.21.15.32:0/2925108308 wait complete. 2023-06-20T13:32:57.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.066+0000 7f06923ff700 1 Processor -- start 2023-06-20T13:32:57.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.066+0000 7f06923ff700 1 -- start start 2023-06-20T13:32:57.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.067+0000 7f06923ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f068c0cf8f0 0x7f068c0b76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:57.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.067+0000 7f06923ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f068c0d2640 0x7f068c145d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:57.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.067+0000 7f06923ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f068c15c460 0x7f068c0c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:57.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.067+0000 7f06923ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068c0caa40 con 0x7f068c0d2640 2023-06-20T13:32:57.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.067+0000 7f06923ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068c15c830 con 0x7f068c15c460 2023-06-20T13:32:57.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.067+0000 7f06923ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f068c15d650 con 0x7f068c0cf8f0 2023-06-20T13:32:57.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.067+0000 7f0683fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f068c0d2640 0x7f068c145d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:57.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.067+0000 7f068bfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f068c0cf8f0 0x7f068c0b76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:57.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.067+0000 7f0683fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f068c0d2640 0x7f068c145d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59410/0 (socket says 172.21.15.32:59410) 2023-06-20T13:32:57.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.067+0000 7f0683fff700 1 -- 172.21.15.32:0/2551084278 learned_addr learned my addr 172.21.15.32:0/2551084278 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:57.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.067+0000 7f069099c700 1 --2- 172.21.15.32:0/2551084278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f068c15c460 0x7f068c0c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:57.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.068+0000 7f0683fff700 1 -- 172.21.15.32:0/2551084278 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f068c0cf8f0 msgr2=0x7f068c0b76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:57.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.068+0000 7f0683fff700 1 --2- 172.21.15.32:0/2551084278 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f068c0cf8f0 0x7f068c0b76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:57.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.068+0000 7f0683fff700 1 -- 172.21.15.32:0/2551084278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f068c15c460 msgr2=0x7f068c0c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:57.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.068+0000 7f0683fff700 1 --2- 172.21.15.32:0/2551084278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f068c15c460 0x7f068c0c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:57.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.068+0000 7f0683fff700 1 -- 172.21.15.32:0/2551084278 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06740094a0 con 0x7f068c0d2640 2023-06-20T13:32:57.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.068+0000 7f0683fff700 1 --2- 172.21.15.32:0/2551084278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f068c0d2640 0x7f068c145d90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f06740090b0 tx=0x7f0674004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:57.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.068+0000 7f06897fa700 1 -- 172.21.15.32:0/2551084278 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067401a7e0 con 0x7f068c0d2640 2023-06-20T13:32:57.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.068+0000 7f06897fa700 1 -- 172.21.15.32:0/2551084278 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067401a940 con 0x7f068c0d2640 2023-06-20T13:32:57.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.068+0000 7f06923ff700 1 -- 172.21.15.32:0/2551084278 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f068c15ca40 con 0x7f068c0d2640 2023-06-20T13:32:57.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.068+0000 7f06897fa700 1 -- 172.21.15.32:0/2551084278 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067401acd0 con 0x7f068c0d2640 2023-06-20T13:32:57.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.068+0000 7f06923ff700 1 -- 172.21.15.32:0/2551084278 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f068c15d000 con 0x7f068c0d2640 2023-06-20T13:32:57.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.070+0000 7f06923ff700 1 -- 172.21.15.32:0/2551084278 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f068c04ea60 con 0x7f068c0d2640 2023-06-20T13:32:57.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.071+0000 7f06897fa700 1 -- 172.21.15.32:0/2551084278 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0674022070 con 0x7f068c0d2640 2023-06-20T13:32:57.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.072+0000 7f06897fa700 1 --2- 172.21.15.32:0/2551084278 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f066c06ace0 0x7f066c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:57.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.072+0000 7f06897fa700 1 -- 172.21.15.32:0/2551084278 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f067408a770 con 0x7f068c0d2640 2023-06-20T13:32:57.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.072+0000 7f068bfff700 1 --2- 172.21.15.32:0/2551084278 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f066c06ace0 0x7f066c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:57.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.073+0000 7f068bfff700 1 --2- 172.21.15.32:0/2551084278 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f066c06ace0 0x7f066c06d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f067c007fd0 tx=0x7f067c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:57.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.078+0000 7f06897fa700 1 -- 172.21.15.32:0/2551084278 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0674055520 con 0x7f068c0d2640 2023-06-20T13:32:57.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.334+0000 7f06923ff700 1 -- 172.21.15.32:0/2551084278 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f068c0b4fa0 con 0x7f068c0d2640 2023-06-20T13:32:57.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.334+0000 7f06897fa700 1 -- 172.21.15.32:0/2551084278 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f0674058b40 con 0x7f068c0d2640 2023-06-20T13:32:57.337 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:32:57.337 INFO:teuthology.orchestra.run.smithi032.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-06-20T13:32:57.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.337+0000 7f06923ff700 1 -- 172.21.15.32:0/2551084278 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f066c06ace0 msgr2=0x7f066c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:57.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.337+0000 7f06923ff700 1 --2- 172.21.15.32:0/2551084278 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f066c06ace0 0x7f066c06d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f067c007fd0 tx=0x7f067c009040 comp rx=0 tx=0).stop 2023-06-20T13:32:57.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.337+0000 7f06923ff700 1 -- 172.21.15.32:0/2551084278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f068c0d2640 msgr2=0x7f068c145d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:57.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.337+0000 7f06923ff700 1 --2- 172.21.15.32:0/2551084278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f068c0d2640 0x7f068c145d90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f06740090b0 tx=0x7f0674004750 comp rx=0 tx=0).stop 2023-06-20T13:32:57.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.337+0000 7f06923ff700 1 -- 172.21.15.32:0/2551084278 shutdown_connections 2023-06-20T13:32:57.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.337+0000 7f06923ff700 1 --2- 172.21.15.32:0/2551084278 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f066c06ace0 0x7f066c06d190 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:57.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.337+0000 7f06923ff700 1 --2- 172.21.15.32:0/2551084278 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f068c15c460 0x7f068c0c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:57.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.337+0000 7f06923ff700 1 --2- 172.21.15.32:0/2551084278 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f068c0cf8f0 0x7f068c0b76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:57.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.337+0000 7f06923ff700 1 --2- 172.21.15.32:0/2551084278 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f068c0d2640 0x7f068c145d90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:57.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.337+0000 7f06923ff700 1 -- 172.21.15.32:0/2551084278 >> 172.21.15.32:0/2551084278 conn(0x7f068c071660 msgr2=0x7f068c0b7ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:57.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.337+0000 7f06923ff700 1 -- 172.21.15.32:0/2551084278 shutdown_connections 2023-06-20T13:32:57.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.337+0000 7f06923ff700 1 -- 172.21.15.32:0/2551084278 wait complete. 2023-06-20T13:32:57.357 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-06-20T13:32:57.358 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:32:57.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.556+0000 7f3abcfff700 1 Processor -- start 2023-06-20T13:32:57.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.556+0000 7f3abcfff700 1 -- start start 2023-06-20T13:32:57.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.557+0000 7f3abcfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3ab815c460 0x7f3ab80b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:57.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.557+0000 7f3abcfff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3ab80d2640 0x7f3ab80cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:57.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.557+0000 7f3abcfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ab80cf720 0x7f3ab80cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:57.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.557+0000 7f3abcfff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab80cedd0 con 0x7f3ab80d2640 2023-06-20T13:32:57.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.557+0000 7f3abcfff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab80d1790 con 0x7f3ab815c460 2023-06-20T13:32:57.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.557+0000 7f3abcfff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab80cd950 con 0x7f3ab80cf720 2023-06-20T13:32:57.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.558+0000 7f3ab5d9b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3ab80d2640 0x7f3ab80cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:57.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.558+0000 7f3ab5d9b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f3ab80d2640 0x7f3ab80cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59420/0 (socket says 172.21.15.32:59420) 2023-06-20T13:32:57.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.558+0000 7f3ab5d9b700 1 -- 172.21.15.32:0/408478441 learned_addr learned my addr 172.21.15.32:0/408478441 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:57.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.558+0000 7f3ab659c700 1 --2- 172.21.15.32:0/408478441 >> v2:172.21.15.115:3300/0 conn(0x7f3ab815c460 0x7f3ab80b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:57.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.558+0000 7f3ab6d9d700 1 --2- 172.21.15.32:0/408478441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ab80cf720 0x7f3ab80cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:57.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.558+0000 7f3ab5d9b700 1 -- 172.21.15.32:0/408478441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ab80cf720 msgr2=0x7f3ab80cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:57.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.558+0000 7f3ab5d9b700 1 --2- 172.21.15.32:0/408478441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ab80cf720 0x7f3ab80cfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:57.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.558+0000 7f3ab5d9b700 1 -- 172.21.15.32:0/408478441 >> v2:172.21.15.115:3300/0 conn(0x7f3ab815c460 msgr2=0x7f3ab80b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:57.563 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.558+0000 7f3ab5d9b700 1 --2- 172.21.15.32:0/408478441 >> v2:172.21.15.115:3300/0 conn(0x7f3ab815c460 0x7f3ab80b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:57.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.558+0000 7f3ab5d9b700 1 -- 172.21.15.32:0/408478441 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab80d14b0 con 0x7f3ab80d2640 2023-06-20T13:32:57.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.558+0000 7f3ab5d9b700 1 --2- 172.21.15.32:0/408478441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ab80d2640 0x7f3ab80cf1e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3ab80b4f00 tx=0x7f3aac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8afee8779ea6b329 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:57.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.559+0000 7f3ab559a700 1 -- 172.21.15.32:0/408478441 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac011830 con 0x7f3ab80d2640 2023-06-20T13:32:57.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.559+0000 7f3ab559a700 1 -- 172.21.15.32:0/408478441 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aac011990 con 0x7f3ab80d2640 2023-06-20T13:32:57.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.559+0000 7f3ab559a700 1 -- 172.21.15.32:0/408478441 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac011d20 con 0x7f3ab80d2640 2023-06-20T13:32:57.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.559+0000 7f3abcfff700 1 -- 172.21.15.32:0/408478441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ab80d2640 msgr2=0x7f3ab80cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:57.564 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.559+0000 7f3abcfff700 1 --2- 172.21.15.32:0/408478441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ab80d2640 0x7f3ab80cf1e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3ab80b4f00 tx=0x7f3aac009bd0 comp rx=0 tx=0).stop 2023-06-20T13:32:57.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.559+0000 7f3abcfff700 1 -- 172.21.15.32:0/408478441 shutdown_connections 2023-06-20T13:32:57.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.559+0000 7f3abcfff700 1 --2- 172.21.15.32:0/408478441 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ab80cf720 0x7f3ab80cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:57.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.559+0000 7f3abcfff700 1 --2- 172.21.15.32:0/408478441 >> v2:172.21.15.115:3300/0 conn(0x7f3ab815c460 0x7f3ab80b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:57.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.559+0000 7f3abcfff700 1 --2- 172.21.15.32:0/408478441 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ab80d2640 0x7f3ab80cf1e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:57.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.559+0000 7f3abcfff700 1 -- 172.21.15.32:0/408478441 >> 172.21.15.32:0/408478441 conn(0x7f3ab8071660 msgr2=0x7f3ab8071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:57.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.559+0000 7f3abcfff700 1 -- 172.21.15.32:0/408478441 shutdown_connections 2023-06-20T13:32:57.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.559+0000 7f3abcfff700 1 -- 172.21.15.32:0/408478441 wait complete. 2023-06-20T13:32:57.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.562+0000 7f3abcfff700 1 Processor -- start 2023-06-20T13:32:57.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.562+0000 7f3abcfff700 1 -- start start 2023-06-20T13:32:57.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.563+0000 7f3abcfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ab80cf720 0x7f3ab8157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:57.567 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.563+0000 7f3abcfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ab80d2640 0x7f3ab80c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:57.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.563+0000 7f3abcfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ab815c460 0x7f3ab81e7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:57.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.563+0000 7f3abcfff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab80ca2c0 con 0x7f3ab80cf720 2023-06-20T13:32:57.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.563+0000 7f3abcfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab80c7630 con 0x7f3ab815c460 2023-06-20T13:32:57.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.563+0000 7f3abcfff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab80c7910 con 0x7f3ab80d2640 2023-06-20T13:32:57.568 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.563+0000 7f3ab659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ab80cf720 0x7f3ab8157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:57.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.564+0000 7f3ab659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ab80cf720 0x7f3ab8157fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59428/0 (socket says 172.21.15.32:59428) 2023-06-20T13:32:57.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.564+0000 7f3ab659c700 1 -- 172.21.15.32:0/1095902203 learned_addr learned my addr 172.21.15.32:0/1095902203 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:57.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.564+0000 7f3ab6d9d700 1 --2- 172.21.15.32:0/1095902203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ab815c460 0x7f3ab81e7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:57.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.564+0000 7f3ab659c700 1 -- 172.21.15.32:0/1095902203 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ab80d2640 msgr2=0x7f3ab80c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:57.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.564+0000 7f3ab5d9b700 1 --2- 172.21.15.32:0/1095902203 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ab80d2640 0x7f3ab80c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:57.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.564+0000 7f3ab659c700 1 --2- 172.21.15.32:0/1095902203 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ab80d2640 0x7f3ab80c90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:57.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.564+0000 7f3ab659c700 1 -- 172.21.15.32:0/1095902203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ab815c460 msgr2=0x7f3ab81e7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:57.569 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.564+0000 7f3ab659c700 1 --2- 172.21.15.32:0/1095902203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ab815c460 0x7f3ab81e7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:57.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.564+0000 7f3ab659c700 1 -- 172.21.15.32:0/1095902203 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac009550 con 0x7f3ab80cf720 2023-06-20T13:32:57.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.564+0000 7f3ab6d9d700 1 --2- 172.21.15.32:0/1095902203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ab815c460 0x7f3ab81e7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:32:57.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.564+0000 7f3ab5d9b700 1 --2- 172.21.15.32:0/1095902203 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ab80d2640 0x7f3ab80c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:32:57.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.564+0000 7f3ab659c700 1 --2- 172.21.15.32:0/1095902203 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ab80cf720 0x7f3ab8157fe0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3aa800e870 tx=0x7f3aa800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:57.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.564+0000 7f3aa6ffd700 1 -- 172.21.15.32:0/1095902203 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8009590 con 0x7f3ab80cf720 2023-06-20T13:32:57.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.565+0000 7f3aa6ffd700 1 -- 172.21.15.32:0/1095902203 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa800ee70 con 0x7f3ab80cf720 2023-06-20T13:32:57.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.565+0000 7f3aa6ffd700 1 -- 172.21.15.32:0/1095902203 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa800ca50 con 0x7f3ab80cf720 2023-06-20T13:32:57.570 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.565+0000 7f3abcfff700 1 -- 172.21.15.32:0/1095902203 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab80c7bf0 con 0x7f3ab80cf720 2023-06-20T13:32:57.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.565+0000 7f3abcfff700 1 -- 172.21.15.32:0/1095902203 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab80c95e0 con 0x7f3ab80cf720 2023-06-20T13:32:57.571 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.566+0000 7f3abcfff700 1 -- 172.21.15.32:0/1095902203 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab80ca6f0 con 0x7f3ab80cf720 2023-06-20T13:32:57.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.567+0000 7f3aa6ffd700 1 -- 172.21.15.32:0/1095902203 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3aa800cbb0 con 0x7f3ab80cf720 2023-06-20T13:32:57.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.568+0000 7f3aa6ffd700 1 --2- 172.21.15.32:0/1095902203 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f3a9806ace0 0x7f3a9806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:57.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.568+0000 7f3aa6ffd700 1 -- 172.21.15.32:0/1095902203 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3aa80896b0 con 0x7f3ab80cf720 2023-06-20T13:32:57.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.568+0000 7f3ab5d9b700 1 --2- 172.21.15.32:0/1095902203 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f3a9806ace0 0x7f3a9806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:57.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.568+0000 7f3ab5d9b700 1 --2- 172.21.15.32:0/1095902203 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f3a9806ace0 0x7f3a9806d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3ab815ac70 tx=0x7f3aac008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:57.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.572+0000 7f3aa6ffd700 1 -- 172.21.15.32:0/1095902203 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3aa8057f90 con 0x7f3ab80cf720 2023-06-20T13:32:57.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.780+0000 7f3abcfff700 1 -- 172.21.15.32:0/1095902203 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ab804ea60 con 0x7f3ab80cf720 2023-06-20T13:32:57.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.781+0000 7f3aa6ffd700 1 -- 172.21.15.32:0/1095902203 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20096 (secure 0 0 0) 0x7f3aa800ce60 con 0x7f3ab80cf720 2023-06-20T13:32:57.784 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:32:57.785 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":27,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:32:25.570940+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-20T13:32:18.120021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-20T13:32:19.503624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-20T13:32:23.074912+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:32:57.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.784+0000 7f3abcfff700 1 -- 172.21.15.32:0/1095902203 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f3a9806ace0 msgr2=0x7f3a9806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:57.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.784+0000 7f3abcfff700 1 --2- 172.21.15.32:0/1095902203 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f3a9806ace0 0x7f3a9806d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3ab815ac70 tx=0x7f3aac008030 comp rx=0 tx=0).stop 2023-06-20T13:32:57.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.784+0000 7f3abcfff700 1 -- 172.21.15.32:0/1095902203 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ab80cf720 msgr2=0x7f3ab8157fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:57.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.784+0000 7f3abcfff700 1 --2- 172.21.15.32:0/1095902203 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ab80cf720 0x7f3ab8157fe0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3aa800e870 tx=0x7f3aa800ec30 comp rx=0 tx=0).stop 2023-06-20T13:32:57.788 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.784+0000 7f3abcfff700 1 -- 172.21.15.32:0/1095902203 shutdown_connections 2023-06-20T13:32:57.788 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.784+0000 7f3abcfff700 1 --2- 172.21.15.32:0/1095902203 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f3a9806ace0 0x7f3a9806d190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:57.788 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.784+0000 7f3abcfff700 1 --2- 172.21.15.32:0/1095902203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3ab815c460 0x7f3ab81e7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:57.788 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.784+0000 7f3abcfff700 1 --2- 172.21.15.32:0/1095902203 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3ab80cf720 0x7f3ab8157fe0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:57.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.784+0000 7f3abcfff700 1 --2- 172.21.15.32:0/1095902203 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3ab80d2640 0x7f3ab80c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:57.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.784+0000 7f3abcfff700 1 -- 172.21.15.32:0/1095902203 >> 172.21.15.32:0/1095902203 conn(0x7f3ab8071660 msgr2=0x7f3ab806b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:57.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.784+0000 7f3abcfff700 1 -- 172.21.15.32:0/1095902203 shutdown_connections 2023-06-20T13:32:57.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:57.784+0000 7f3abcfff700 1 -- 172.21.15.32:0/1095902203 wait complete. 2023-06-20T13:32:57.805 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-20T13:32:05.308022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-20T13:32:12.857161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-20T13:32:18.120021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-20T13:32:19.503624+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-20T13:32:23.074912+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-20T13:32:57.806 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-20T13:32:58.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.010+0000 7fcc8c1ff700 1 Processor -- start 2023-06-20T13:32:58.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.011+0000 7fcc8c1ff700 1 -- start start 2023-06-20T13:32:58.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.012+0000 7fcc8c1ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc840b8430 0x7fcc840cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:58.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.012+0000 7fcc8c1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcc840cfc60 0x7fcc840d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:58.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.012+0000 7fcc8c1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc840d0b20 con 0x7fcc840d3730 2023-06-20T13:32:58.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.012+0000 7fcc8c1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc840b8800 con 0x7fcc840cfc60 2023-06-20T13:32:58.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.012+0000 7fcc8c1ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc840b4ee0 con 0x7fcc840b8430 2023-06-20T13:32:58.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.012+0000 7fcc89f9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc840b8430 0x7fcc840cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:58.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.012+0000 7fcc8a79c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcc840cfc60 0x7fcc840d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:58.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.012+0000 7fcc89f9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc840b8430 0x7fcc840cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.32:35750/0 (socket says 172.21.15.32:35750) 2023-06-20T13:32:58.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.012+0000 7fcc8a79c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcc840cfc60 0x7fcc840d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:46316/0 (socket says 172.21.15.32:46316) 2023-06-20T13:32:58.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.012+0000 7fcc89f9b700 1 -- 172.21.15.32:0/1759916365 learned_addr learned my addr 172.21.15.32:0/1759916365 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:58.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.012+0000 7fcc8979a700 1 --1- 172.21.15.32:0/1759916365 >> v1:172.21.15.115:6789/0 conn(0x7fcc840d3730 0x7fcc840cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.32:34342/0 (socket says 172.21.15.32:34342) 2023-06-20T13:32:58.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.013+0000 7fcc88f99700 1 -- 172.21.15.32:0/1759916365 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3799308740 0 0) 0x7fcc840d0b20 con 0x7fcc840d3730 2023-06-20T13:32:58.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.013+0000 7fcc88f99700 1 -- 172.21.15.32:0/1759916365 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc700035b0 con 0x7fcc840d3730 2023-06-20T13:32:58.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.013+0000 7fcc8a79c700 1 -- 172.21.15.32:0/1759916365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc840b8430 msgr2=0x7fcc840cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:58.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.013+0000 7fcc8a79c700 1 --2- 172.21.15.32:0/1759916365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc840b8430 0x7fcc840cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:58.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.013+0000 7fcc8a79c700 1 -- 172.21.15.32:0/1759916365 >> v1:172.21.15.115:6789/0 conn(0x7fcc840d3730 legacy=0x7fcc840cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:58.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.013+0000 7fcc8a79c700 1 -- 172.21.15.32:0/1759916365 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc840b51c0 con 0x7fcc840cfc60 2023-06-20T13:32:58.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.013+0000 7fcc89f9b700 1 --2- 172.21.15.32:0/1759916365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc840b8430 0x7fcc840cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:32:58.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.013+0000 7fcc8a79c700 1 --2- 172.21.15.32:0/1759916365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc840cfc60 0x7fcc840d0fb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c009d90 tx=0x7fcc7c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba786cc5067b0c68 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:58.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.013+0000 7fcc88f99700 1 -- 172.21.15.32:0/1759916365 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c00e070 con 0x7fcc840cfc60 2023-06-20T13:32:58.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.013+0000 7fcc88f99700 1 -- 172.21.15.32:0/1759916365 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7c00bb20 con 0x7fcc840cfc60 2023-06-20T13:32:58.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.013+0000 7fcc88f99700 1 -- 172.21.15.32:0/1759916365 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c012430 con 0x7fcc840cfc60 2023-06-20T13:32:58.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.014+0000 7fcc8c1ff700 1 -- 172.21.15.32:0/1759916365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc840cfc60 msgr2=0x7fcc840d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:58.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.014+0000 7fcc8c1ff700 1 --2- 172.21.15.32:0/1759916365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc840cfc60 0x7fcc840d0fb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c009d90 tx=0x7fcc7c00b330 comp rx=0 tx=0).stop 2023-06-20T13:32:58.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.014+0000 7fcc8c1ff700 1 -- 172.21.15.32:0/1759916365 shutdown_connections 2023-06-20T13:32:58.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.014+0000 7fcc8c1ff700 1 --2- 172.21.15.32:0/1759916365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc840b8430 0x7fcc840cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:58.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.014+0000 7fcc8c1ff700 1 --2- 172.21.15.32:0/1759916365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc840cfc60 0x7fcc840d0fb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:58.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.014+0000 7fcc8c1ff700 1 -- 172.21.15.32:0/1759916365 >> 172.21.15.32:0/1759916365 conn(0x7fcc8406b3f0 msgr2=0x7fcc8406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:58.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.014+0000 7fcc8c1ff700 1 -- 172.21.15.32:0/1759916365 shutdown_connections 2023-06-20T13:32:58.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.014+0000 7fcc8c1ff700 1 -- 172.21.15.32:0/1759916365 wait complete. 2023-06-20T13:32:58.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.016+0000 7fcc8c1ff700 1 Processor -- start 2023-06-20T13:32:58.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.016+0000 7fcc8c1ff700 1 -- start start 2023-06-20T13:32:58.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.017+0000 7fcc8c1ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc840b8430 0x7fcc841502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:58.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.017+0000 7fcc8c1ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc840cfc60 0x7fcc840c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:58.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.017+0000 7fcc8c1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc840d3730 0x7fcc840cb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:58.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.017+0000 7fcc8c1ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc840c9680 con 0x7fcc840cfc60 2023-06-20T13:32:58.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.017+0000 7fcc8c1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc840c85e0 con 0x7fcc840d3730 2023-06-20T13:32:58.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.017+0000 7fcc8c1ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc840c88c0 con 0x7fcc840b8430 2023-06-20T13:32:58.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.017+0000 7fcc8979a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc840cfc60 0x7fcc840c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:58.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.017+0000 7fcc8979a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc840cfc60 0x7fcc840c7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59432/0 (socket says 172.21.15.32:59432) 2023-06-20T13:32:58.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.017+0000 7fcc8979a700 1 -- 172.21.15.32:0/3175064820 learned_addr learned my addr 172.21.15.32:0/3175064820 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:58.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.017+0000 7fcc8a79c700 1 --2- 172.21.15.32:0/3175064820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc840d3730 0x7fcc840cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:58.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.017+0000 7fcc89f9b700 1 --2- 172.21.15.32:0/3175064820 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc840b8430 0x7fcc841502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:58.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.018+0000 7fcc8979a700 1 -- 172.21.15.32:0/3175064820 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc840b8430 msgr2=0x7fcc841502b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:58.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.018+0000 7fcc8979a700 1 --2- 172.21.15.32:0/3175064820 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc840b8430 0x7fcc841502b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:58.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.018+0000 7fcc8979a700 1 -- 172.21.15.32:0/3175064820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc840d3730 msgr2=0x7fcc840cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:58.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.018+0000 7fcc8979a700 1 --2- 172.21.15.32:0/3175064820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc840d3730 0x7fcc840cb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:58.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.018+0000 7fcc8979a700 1 -- 172.21.15.32:0/3175064820 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc80009550 con 0x7fcc840cfc60 2023-06-20T13:32:58.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.018+0000 7fcc8979a700 1 --2- 172.21.15.32:0/3175064820 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc840cfc60 0x7fcc840c7c00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcc74001eb0 tx=0x7fcc7400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:58.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.018+0000 7fcc7a7fc700 1 -- 172.21.15.32:0/3175064820 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc74005cb0 con 0x7fcc840cfc60 2023-06-20T13:32:58.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.018+0000 7fcc7a7fc700 1 -- 172.21.15.32:0/3175064820 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc74005e10 con 0x7fcc840cfc60 2023-06-20T13:32:58.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.018+0000 7fcc7a7fc700 1 -- 172.21.15.32:0/3175064820 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc740072d0 con 0x7fcc840cfc60 2023-06-20T13:32:58.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.018+0000 7fcc8c1ff700 1 -- 172.21.15.32:0/3175064820 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc7c009a70 con 0x7fcc840cfc60 2023-06-20T13:32:58.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.018+0000 7fcc8c1ff700 1 -- 172.21.15.32:0/3175064820 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc840c8e80 con 0x7fcc840cfc60 2023-06-20T13:32:58.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.019+0000 7fcc8c1ff700 1 -- 172.21.15.32:0/3175064820 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc8415fbf0 con 0x7fcc840cfc60 2023-06-20T13:32:58.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.020+0000 7fcc7a7fc700 1 -- 172.21.15.32:0/3175064820 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcc74007430 con 0x7fcc840cfc60 2023-06-20T13:32:58.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.022+0000 7fcc7a7fc700 1 --2- 172.21.15.32:0/3175064820 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcc6806ace0 0x7fcc6806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:58.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.022+0000 7fcc7a7fc700 1 -- 172.21.15.32:0/3175064820 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcc740889f0 con 0x7fcc840cfc60 2023-06-20T13:32:58.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.022+0000 7fcc89f9b700 1 --2- 172.21.15.32:0/3175064820 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcc6806ace0 0x7fcc6806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:58.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.023+0000 7fcc89f9b700 1 --2- 172.21.15.32:0/3175064820 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcc6806ace0 0x7fcc6806d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcc80006d30 tx=0x7fcc800092c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:58.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.027+0000 7fcc7a7fc700 1 -- 172.21.15.32:0/3175064820 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcc74053850 con 0x7fcc840cfc60 2023-06-20T13:32:58.235 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.233+0000 7fcc8c1ff700 1 -- 172.21.15.32:0/3175064820 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcc8404ea60 con 0x7fcc840cfc60 2023-06-20T13:32:58.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.233+0000 7fcc7a7fc700 1 -- 172.21.15.32:0/3175064820 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcc74017020 con 0x7fcc840cfc60 2023-06-20T13:32:58.236 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-06-20T13:32:58.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.235+0000 7fcc8c1ff700 1 -- 172.21.15.32:0/3175064820 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcc6806ace0 msgr2=0x7fcc6806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:58.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.235+0000 7fcc8c1ff700 1 --2- 172.21.15.32:0/3175064820 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcc6806ace0 0x7fcc6806d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcc80006d30 tx=0x7fcc800092c0 comp rx=0 tx=0).stop 2023-06-20T13:32:58.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.235+0000 7fcc8c1ff700 1 -- 172.21.15.32:0/3175064820 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc840cfc60 msgr2=0x7fcc840c7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:58.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.235+0000 7fcc8c1ff700 1 --2- 172.21.15.32:0/3175064820 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc840cfc60 0x7fcc840c7c00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcc74001eb0 tx=0x7fcc7400c7b0 comp rx=0 tx=0).stop 2023-06-20T13:32:58.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.236+0000 7fcc8c1ff700 1 -- 172.21.15.32:0/3175064820 shutdown_connections 2023-06-20T13:32:58.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.236+0000 7fcc8c1ff700 1 --2- 172.21.15.32:0/3175064820 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcc6806ace0 0x7fcc6806d190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:58.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.236+0000 7fcc8c1ff700 1 --2- 172.21.15.32:0/3175064820 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc840d3730 0x7fcc840cb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:58.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.236+0000 7fcc8c1ff700 1 --2- 172.21.15.32:0/3175064820 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc840b8430 0x7fcc841502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:58.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.236+0000 7fcc8c1ff700 1 --2- 172.21.15.32:0/3175064820 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc840cfc60 0x7fcc840c7c00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:58.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.236+0000 7fcc8c1ff700 1 -- 172.21.15.32:0/3175064820 >> 172.21.15.32:0/3175064820 conn(0x7fcc8406b3f0 msgr2=0x7fcc840b61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:58.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.236+0000 7fcc8c1ff700 1 -- 172.21.15.32:0/3175064820 shutdown_connections 2023-06-20T13:32:58.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.236+0000 7fcc8c1ff700 1 -- 172.21.15.32:0/3175064820 wait complete. 2023-06-20T13:32:58.256 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-20T13:32:58.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.457+0000 7f9419fff700 1 Processor -- start 2023-06-20T13:32:58.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.457+0000 7f9419fff700 1 -- start start 2023-06-20T13:32:58.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.459+0000 7f9419fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f941415c310 0x7f94140ae470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:58.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.459+0000 7f9419fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f94140adf20 0x7f941415c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:58.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.459+0000 7f9419fff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941406b410 con 0x7f941415cc20 2023-06-20T13:32:58.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.459+0000 7f9419fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9414071fc0 con 0x7f94140adf20 2023-06-20T13:32:58.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.459+0000 7f9419fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941406b660 con 0x7f941415c310 2023-06-20T13:32:58.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.459+0000 7f9413fff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f941415cc20 0x7f94140ce260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:52936/0 (socket says 172.21.15.32:52936) 2023-06-20T13:32:58.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.459+0000 7f9413fff700 1 -- 172.21.15.32:0/4106553030 learned_addr learned my addr 172.21.15.32:0/4106553030 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:58.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.459+0000 7f94137fe700 1 --2- 172.21.15.32:0/4106553030 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f941415c310 0x7f94140ae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:58.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.459+0000 7f9412ffd700 1 --2- 172.21.15.32:0/4106553030 >> v2:172.21.15.115:3300/0 conn(0x7f94140adf20 0x7f941415c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:58.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.459+0000 7f94127fc700 1 -- 172.21.15.32:0/4106553030 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1237347514 0 0) 0x7f941406b410 con 0x7f941415cc20 2023-06-20T13:32:58.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.459+0000 7f94127fc700 1 -- 172.21.15.32:0/4106553030 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93fc0035b0 con 0x7f941415cc20 2023-06-20T13:32:58.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.460+0000 7f94127fc700 1 -- 172.21.15.32:0/4106553030 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 519360501 0 0) 0x7f93fc0035b0 con 0x7f941415cc20 2023-06-20T13:32:58.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.460+0000 7f94127fc700 1 -- 172.21.15.32:0/4106553030 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f941415c310 msgr2=0x7f94140ae470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:58.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.460+0000 7f94127fc700 1 --2- 172.21.15.32:0/4106553030 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f941415c310 0x7f94140ae470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:58.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.460+0000 7f94127fc700 1 -- 172.21.15.32:0/4106553030 >> v2:172.21.15.115:3300/0 conn(0x7f94140adf20 msgr2=0x7f941415c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:58.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.460+0000 7f94127fc700 1 --2- 172.21.15.32:0/4106553030 >> v2:172.21.15.115:3300/0 conn(0x7f94140adf20 0x7f941415c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:58.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.460+0000 7f94127fc700 1 -- 172.21.15.32:0/4106553030 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941406e500 con 0x7f941415cc20 2023-06-20T13:32:58.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.460+0000 7f94127fc700 1 -- 172.21.15.32:0/4106553030 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3380058562 0 0) 0x7f940c0019f0 con 0x7f941415cc20 2023-06-20T13:32:58.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.460+0000 7f9412ffd700 1 --2- 172.21.15.32:0/4106553030 >> v2:172.21.15.115:3300/0 conn(0x7f94140adf20 0x7f941415c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:32:58.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.460+0000 7f94127fc700 1 -- 172.21.15.32:0/4106553030 >> v1:172.21.15.32:6789/0 conn(0x7f941415cc20 legacy=0x7f94140ce260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:58.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.460+0000 7f94127fc700 1 --2- 172.21.15.32:0/4106553030 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f941415c310 0x7f93fc003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:58.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.460+0000 7f94127fc700 1 --2- 172.21.15.32:0/4106553030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93fc003f80 0x7f93fc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:58.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.460+0000 7f94127fc700 1 --2- 172.21.15.32:0/4106553030 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93fc004d90 0x7f93fc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:58.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.460+0000 7f94127fc700 1 -- 172.21.15.32:0/4106553030 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941406b660 con 0x7f93fc003f80 2023-06-20T13:32:58.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.460+0000 7f94127fc700 1 -- 172.21.15.32:0/4106553030 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc00ba10 con 0x7f93fc004d90 2023-06-20T13:32:58.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.460+0000 7f94127fc700 1 -- 172.21.15.32:0/4106553030 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc00bb50 con 0x7f941415c310 2023-06-20T13:32:58.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.460+0000 7f9412ffd700 1 --2- 172.21.15.32:0/4106553030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93fc003f80 0x7f93fc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:58.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.460+0000 7f94137fe700 1 --2- 172.21.15.32:0/4106553030 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f941415c310 0x7f93fc003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:58.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.461+0000 7f9412ffd700 1 -- 172.21.15.32:0/4106553030 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f941415c310 msgr2=0x7f93fc003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:58.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.461+0000 7f9412ffd700 1 --2- 172.21.15.32:0/4106553030 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f941415c310 0x7f93fc003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:58.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.461+0000 7f9412ffd700 1 -- 172.21.15.32:0/4106553030 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93fc004d90 msgr2=0x7f93fc005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:58.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.461+0000 7f9412ffd700 1 --2- 172.21.15.32:0/4106553030 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93fc004d90 0x7f93fc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:58.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.461+0000 7f9412ffd700 1 -- 172.21.15.32:0/4106553030 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93fc0035b0 con 0x7f93fc003f80 2023-06-20T13:32:58.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.461+0000 7f9412ffd700 1 --2- 172.21.15.32:0/4106553030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93fc003f80 0x7f93fc004850 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9408009d30 tx=0x7f93fc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a248997a0faa589 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:58.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.461+0000 7f94127fc700 1 -- 172.21.15.32:0/4106553030 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9408009e80 con 0x7f93fc003f80 2023-06-20T13:32:58.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.461+0000 7f94127fc700 1 -- 172.21.15.32:0/4106553030 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940800e9a0 con 0x7f93fc003f80 2023-06-20T13:32:58.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.461+0000 7f94127fc700 1 -- 172.21.15.32:0/4106553030 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940800ed30 con 0x7f93fc003f80 2023-06-20T13:32:58.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.461+0000 7f9419fff700 1 -- 172.21.15.32:0/4106553030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93fc003f80 msgr2=0x7f93fc004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:58.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.461+0000 7f9419fff700 1 --2- 172.21.15.32:0/4106553030 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93fc003f80 0x7f93fc004850 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9408009d30 tx=0x7f93fc005880 comp rx=0 tx=0).stop 2023-06-20T13:32:58.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.461+0000 7f9413fff700 1 -- 172.21.15.32:0/4106553030 reap_dead start 2023-06-20T13:32:58.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.462+0000 7f9419fff700 1 -- 172.21.15.32:0/4106553030 shutdown_connections 2023-06-20T13:32:58.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.462+0000 7f9419fff700 1 -- 172.21.15.32:0/4106553030 >> 172.21.15.32:0/4106553030 conn(0x7f94140cba50 msgr2=0x7f94140cbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:58.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.462+0000 7f9419fff700 1 -- 172.21.15.32:0/4106553030 shutdown_connections 2023-06-20T13:32:58.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.462+0000 7f9419fff700 1 -- 172.21.15.32:0/4106553030 wait complete. 2023-06-20T13:32:58.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.463+0000 7f9419fff700 1 Processor -- start 2023-06-20T13:32:58.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.464+0000 7f9419fff700 1 -- start start 2023-06-20T13:32:58.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.465+0000 7f9419fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93fc003f80 0x7f941415a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:58.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.465+0000 7f9419fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94140b4ab0 0x7f94140b2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:58.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.465+0000 7f94137fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93fc003f80 0x7f941415a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:58.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.465+0000 7f94137fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93fc003f80 0x7f941415a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59456/0 (socket says 172.21.15.32:59456) 2023-06-20T13:32:58.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.465+0000 7f9419fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94141e6b00 0x7f94141e6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:58.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.465+0000 7f94137fe700 1 -- 172.21.15.32:0/2265386301 learned_addr learned my addr 172.21.15.32:0/2265386301 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:58.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.465+0000 7f9419fff700 1 -- 172.21.15.32:0/2265386301 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941415ab40 con 0x7f93fc003f80 2023-06-20T13:32:58.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.465+0000 7f9419fff700 1 -- 172.21.15.32:0/2265386301 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94141e74b0 con 0x7f94140b4ab0 2023-06-20T13:32:58.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.465+0000 7f9419fff700 1 -- 172.21.15.32:0/2265386301 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94140b3180 con 0x7f94141e6b00 2023-06-20T13:32:58.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.465+0000 7f9412ffd700 1 --2- 172.21.15.32:0/2265386301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94140b4ab0 0x7f94140b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:58.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.465+0000 7f9413fff700 1 --2- 172.21.15.32:0/2265386301 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94141e6b00 0x7f94141e6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:58.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.465+0000 7f94137fe700 1 -- 172.21.15.32:0/2265386301 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94141e6b00 msgr2=0x7f94141e6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:58.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.465+0000 7f94137fe700 1 --2- 172.21.15.32:0/2265386301 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94141e6b00 0x7f94141e6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:58.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.465+0000 7f94137fe700 1 -- 172.21.15.32:0/2265386301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94140b4ab0 msgr2=0x7f94140b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:58.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.465+0000 7f94137fe700 1 --2- 172.21.15.32:0/2265386301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94140b4ab0 0x7f94140b2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:58.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.465+0000 7f94137fe700 1 -- 172.21.15.32:0/2265386301 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94140b3460 con 0x7f93fc003f80 2023-06-20T13:32:58.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.465+0000 7f9413fff700 1 --2- 172.21.15.32:0/2265386301 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94141e6b00 0x7f94141e6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:32:58.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.466+0000 7f94137fe700 1 --2- 172.21.15.32:0/2265386301 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93fc003f80 0x7f941415a600 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9404011690 tx=0x7f94040119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:58.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.466+0000 7f93fbfff700 1 -- 172.21.15.32:0/2265386301 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9404015870 con 0x7f93fc003f80 2023-06-20T13:32:58.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.466+0000 7f93fbfff700 1 -- 172.21.15.32:0/2265386301 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94040159d0 con 0x7f93fc003f80 2023-06-20T13:32:58.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.466+0000 7f9419fff700 1 -- 172.21.15.32:0/2265386301 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94140b3740 con 0x7f93fc003f80 2023-06-20T13:32:58.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.466+0000 7f93fbfff700 1 -- 172.21.15.32:0/2265386301 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9404015d40 con 0x7f93fc003f80 2023-06-20T13:32:58.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.466+0000 7f9419fff700 1 -- 172.21.15.32:0/2265386301 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94140b2d50 con 0x7f93fc003f80 2023-06-20T13:32:58.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.467+0000 7f9419fff700 1 -- 172.21.15.32:0/2265386301 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94140c65b0 con 0x7f93fc003f80 2023-06-20T13:32:58.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.468+0000 7f93fbfff700 1 -- 172.21.15.32:0/2265386301 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9404013400 con 0x7f93fc003f80 2023-06-20T13:32:58.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.469+0000 7f93fbfff700 1 --2- 172.21.15.32:0/2265386301 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f940006ace0 0x7f940006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:58.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.469+0000 7f93fbfff700 1 -- 172.21.15.32:0/2265386301 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9404089a30 con 0x7f93fc003f80 2023-06-20T13:32:58.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.469+0000 7f9412ffd700 1 --2- 172.21.15.32:0/2265386301 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f940006ace0 0x7f940006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:58.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.470+0000 7f9412ffd700 1 --2- 172.21.15.32:0/2265386301 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f940006ace0 0x7f940006d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9408000c00 tx=0x7f940801f040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:58.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.473+0000 7f93fbfff700 1 -- 172.21.15.32:0/2265386301 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f94040547e0 con 0x7f93fc003f80 2023-06-20T13:32:58.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.676+0000 7f9419fff700 1 -- 172.21.15.32:0/2265386301 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f94140b3980 con 0x7f93fc003f80 2023-06-20T13:32:58.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.677+0000 7f93fbfff700 1 -- 172.21.15.32:0/2265386301 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f94140b3980 con 0x7f93fc003f80 2023-06-20T13:32:58.680 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 8 2023-06-20T13:32:58.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.679+0000 7f9419fff700 1 -- 172.21.15.32:0/2265386301 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f940006ace0 msgr2=0x7f940006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:58.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.679+0000 7f9419fff700 1 --2- 172.21.15.32:0/2265386301 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f940006ace0 0x7f940006d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9408000c00 tx=0x7f940801f040 comp rx=0 tx=0).stop 2023-06-20T13:32:58.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.679+0000 7f9419fff700 1 -- 172.21.15.32:0/2265386301 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93fc003f80 msgr2=0x7f941415a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:58.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.679+0000 7f9419fff700 1 --2- 172.21.15.32:0/2265386301 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93fc003f80 0x7f941415a600 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9404011690 tx=0x7f94040119a0 comp rx=0 tx=0).stop 2023-06-20T13:32:58.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.679+0000 7f9419fff700 1 -- 172.21.15.32:0/2265386301 shutdown_connections 2023-06-20T13:32:58.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.679+0000 7f9419fff700 1 --2- 172.21.15.32:0/2265386301 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f940006ace0 0x7f940006d190 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:58.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.679+0000 7f9419fff700 1 --2- 172.21.15.32:0/2265386301 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f94141e6b00 0x7f94141e6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:58.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.679+0000 7f9419fff700 1 --2- 172.21.15.32:0/2265386301 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f93fc003f80 0x7f941415a600 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:58.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.679+0000 7f9419fff700 1 --2- 172.21.15.32:0/2265386301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f94140b4ab0 0x7f94140b2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:58.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.679+0000 7f9419fff700 1 -- 172.21.15.32:0/2265386301 >> 172.21.15.32:0/2265386301 conn(0x7f94140cba50 msgr2=0x7f941415d020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:58.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.679+0000 7f9419fff700 1 -- 172.21.15.32:0/2265386301 shutdown_connections 2023-06-20T13:32:58.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.679+0000 7f9419fff700 1 -- 172.21.15.32:0/2265386301 wait complete. 2023-06-20T13:32:58.700 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-20T13:32:58.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.901+0000 7fa8b23ff700 1 Processor -- start 2023-06-20T13:32:58.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.902+0000 7fa8b23ff700 1 -- start start 2023-06-20T13:32:58.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.903+0000 7fa8b23ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa8ac0b8430 0x7fa8ac0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:58.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.903+0000 7fa8b23ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa8ac0d3730 0x7fa8ac0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:58.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.903+0000 7fa8b23ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8ac0d0b20 con 0x7fa8ac0cfa90 2023-06-20T13:32:58.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.903+0000 7fa8b23ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8ac0b8800 con 0x7fa8ac0b8430 2023-06-20T13:32:58.906 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.903+0000 7fa8b23ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8ac0cfe90 con 0x7fa8ac0d3730 2023-06-20T13:32:58.906 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.903+0000 7fa8b099c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa8ac0cfa90 0x7fa8ac15feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:52940/0 (socket says 172.21.15.32:52940) 2023-06-20T13:32:58.906 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.903+0000 7fa8b099c700 1 -- 172.21.15.32:0/2316301835 learned_addr learned my addr 172.21.15.32:0/2316301835 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:58.906 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.903+0000 7fa8abfff700 1 --2- 172.21.15.32:0/2316301835 >> v2:172.21.15.32:3300/0 conn(0x7fa8ac0b8430 0x7fa8ac0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:58.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.903+0000 7fa8ab7fe700 1 --2- 172.21.15.32:0/2316301835 >> v2:172.21.15.115:3300/0 conn(0x7fa8ac0d3730 0x7fa8ac0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:58.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.904+0000 7fa8aaffd700 1 -- 172.21.15.32:0/2316301835 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 287452135 0 0) 0x7fa8ac0d0b20 con 0x7fa8ac0cfa90 2023-06-20T13:32:58.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.904+0000 7fa8aaffd700 1 -- 172.21.15.32:0/2316301835 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8940035b0 con 0x7fa8ac0cfa90 2023-06-20T13:32:58.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.904+0000 7fa8abfff700 1 -- 172.21.15.32:0/2316301835 >> v2:172.21.15.115:3300/0 conn(0x7fa8ac0d3730 msgr2=0x7fa8ac0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:58.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.904+0000 7fa8abfff700 1 --2- 172.21.15.32:0/2316301835 >> v2:172.21.15.115:3300/0 conn(0x7fa8ac0d3730 0x7fa8ac0cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:58.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.904+0000 7fa8abfff700 1 -- 172.21.15.32:0/2316301835 >> v1:172.21.15.32:6789/0 conn(0x7fa8ac0cfa90 legacy=0x7fa8ac15feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:58.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.904+0000 7fa8abfff700 1 -- 172.21.15.32:0/2316301835 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ac0b4ee0 con 0x7fa8ac0b8430 2023-06-20T13:32:58.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.904+0000 7fa8abfff700 1 --2- 172.21.15.32:0/2316301835 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8ac0b8430 0x7fa8ac0cd320 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac160f50 tx=0x7fa89c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ae67982b6f64c4 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:58.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.904+0000 7fa8aaffd700 1 -- 172.21.15.32:0/2316301835 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c011830 con 0x7fa8ac0b8430 2023-06-20T13:32:58.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.904+0000 7fa8aaffd700 1 -- 172.21.15.32:0/2316301835 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89c011990 con 0x7fa8ac0b8430 2023-06-20T13:32:58.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.904+0000 7fa8aaffd700 1 -- 172.21.15.32:0/2316301835 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c011d20 con 0x7fa8ac0b8430 2023-06-20T13:32:58.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.905+0000 7fa8b23ff700 1 -- 172.21.15.32:0/2316301835 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8ac0b8430 msgr2=0x7fa8ac0cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:58.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.905+0000 7fa8b23ff700 1 --2- 172.21.15.32:0/2316301835 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8ac0b8430 0x7fa8ac0cd320 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac160f50 tx=0x7fa89c009b20 comp rx=0 tx=0).stop 2023-06-20T13:32:58.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.905+0000 7fa8b23ff700 1 -- 172.21.15.32:0/2316301835 shutdown_connections 2023-06-20T13:32:58.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.905+0000 7fa8b23ff700 1 --2- 172.21.15.32:0/2316301835 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8ac0b8430 0x7fa8ac0cd320 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:58.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.905+0000 7fa8b23ff700 1 --2- 172.21.15.32:0/2316301835 >> v2:172.21.15.115:3300/0 conn(0x7fa8ac0d3730 0x7fa8ac0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:58.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.905+0000 7fa8b23ff700 1 -- 172.21.15.32:0/2316301835 >> 172.21.15.32:0/2316301835 conn(0x7fa8ac06b3f0 msgr2=0x7fa8ac06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:58.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.905+0000 7fa8b23ff700 1 -- 172.21.15.32:0/2316301835 shutdown_connections 2023-06-20T13:32:58.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.905+0000 7fa8b23ff700 1 -- 172.21.15.32:0/2316301835 wait complete. 2023-06-20T13:32:58.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.907+0000 7fa8b23ff700 1 Processor -- start 2023-06-20T13:32:58.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.907+0000 7fa8b23ff700 1 -- start start 2023-06-20T13:32:58.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.908+0000 7fa8b23ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8ac0b8430 0x7fa8ac1f1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:58.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.908+0000 7fa8b23ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8ac0cfa90 0x7fa8ac1f2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:58.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.908+0000 7fa8b23ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8ac0d3730 0x7fa8ac1ef6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:58.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.908+0000 7fa8b23ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac0d1a20 con 0x7fa8ac0cfa90 2023-06-20T13:32:58.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.908+0000 7fa8b23ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac1f3190 con 0x7fa8ac0d3730 2023-06-20T13:32:58.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.908+0000 7fa8b23ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ac1f33c0 con 0x7fa8ac0b8430 2023-06-20T13:32:58.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.908+0000 7fa8ab7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8ac0cfa90 0x7fa8ac1f2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:58.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.908+0000 7fa8ab7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8ac0cfa90 0x7fa8ac1f2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59476/0 (socket says 172.21.15.32:59476) 2023-06-20T13:32:58.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.908+0000 7fa8ab7fe700 1 -- 172.21.15.32:0/3870817285 learned_addr learned my addr 172.21.15.32:0/3870817285 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:58.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.908+0000 7fa8b099c700 1 --2- 172.21.15.32:0/3870817285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8ac0d3730 0x7fa8ac1ef6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:58.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.908+0000 7fa8abfff700 1 --2- 172.21.15.32:0/3870817285 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8ac0b8430 0x7fa8ac1f1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:58.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.908+0000 7fa8ab7fe700 1 -- 172.21.15.32:0/3870817285 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8ac0b8430 msgr2=0x7fa8ac1f1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:58.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.908+0000 7fa8ab7fe700 1 --2- 172.21.15.32:0/3870817285 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8ac0b8430 0x7fa8ac1f1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:58.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.909+0000 7fa8ab7fe700 1 -- 172.21.15.32:0/3870817285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8ac0d3730 msgr2=0x7fa8ac1ef6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:58.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.909+0000 7fa8ab7fe700 1 --2- 172.21.15.32:0/3870817285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8ac0d3730 0x7fa8ac1ef6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:58.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.909+0000 7fa8ab7fe700 1 -- 172.21.15.32:0/3870817285 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c0094a0 con 0x7fa8ac0cfa90 2023-06-20T13:32:58.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.909+0000 7fa8ab7fe700 1 --2- 172.21.15.32:0/3870817285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8ac0cfa90 0x7fa8ac1f2c50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000e9b0 tx=0x7fa8a000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:58.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.909+0000 7fa8a8ff9700 1 -- 172.21.15.32:0/3870817285 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0009710 con 0x7fa8ac0cfa90 2023-06-20T13:32:58.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.909+0000 7fa8a8ff9700 1 -- 172.21.15.32:0/3870817285 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a000ee50 con 0x7fa8ac0cfa90 2023-06-20T13:32:58.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.909+0000 7fa8a8ff9700 1 -- 172.21.15.32:0/3870817285 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a000ca50 con 0x7fa8ac0cfa90 2023-06-20T13:32:58.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.909+0000 7fa8b23ff700 1 -- 172.21.15.32:0/3870817285 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8ac1f36a0 con 0x7fa8ac0cfa90 2023-06-20T13:32:58.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.909+0000 7fa8b23ff700 1 -- 172.21.15.32:0/3870817285 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8ac1f3c60 con 0x7fa8ac0cfa90 2023-06-20T13:32:58.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.910+0000 7fa8b23ff700 1 -- 172.21.15.32:0/3870817285 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8ac0b21c0 con 0x7fa8ac0cfa90 2023-06-20T13:32:58.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.911+0000 7fa8a8ff9700 1 -- 172.21.15.32:0/3870817285 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa8a000cbb0 con 0x7fa8ac0cfa90 2023-06-20T13:32:58.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.912+0000 7fa8a8ff9700 1 --2- 172.21.15.32:0/3870817285 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa89806ace0 0x7fa89806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:58.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.912+0000 7fa8a8ff9700 1 -- 172.21.15.32:0/3870817285 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa8a0089760 con 0x7fa8ac0cfa90 2023-06-20T13:32:58.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.912+0000 7fa8abfff700 1 --2- 172.21.15.32:0/3870817285 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa89806ace0 0x7fa89806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:58.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.913+0000 7fa8abfff700 1 --2- 172.21.15.32:0/3870817285 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa89806ace0 0x7fa89806d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0090b0 tx=0x7fa89c01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:58.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:58.916+0000 7fa8a8ff9700 1 -- 172.21.15.32:0/3870817285 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa8a0057fa0 con 0x7fa8ac0cfa90 2023-06-20T13:32:59.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.125+0000 7fa8b23ff700 1 -- 172.21.15.32:0/3870817285 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa8ac04ea60 con 0x7fa8ac0cfa90 2023-06-20T13:32:59.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.126+0000 7fa8a8ff9700 1 -- 172.21.15.32:0/3870817285 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa8a000ce60 con 0x7fa8ac0cfa90 2023-06-20T13:32:59.129 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-06-20T13:32:59.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.128+0000 7fa8b23ff700 1 -- 172.21.15.32:0/3870817285 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa89806ace0 msgr2=0x7fa89806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:59.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.128+0000 7fa8b23ff700 1 --2- 172.21.15.32:0/3870817285 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa89806ace0 0x7fa89806d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0090b0 tx=0x7fa89c01c040 comp rx=0 tx=0).stop 2023-06-20T13:32:59.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.128+0000 7fa8b23ff700 1 -- 172.21.15.32:0/3870817285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8ac0cfa90 msgr2=0x7fa8ac1f2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:59.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.128+0000 7fa8b23ff700 1 --2- 172.21.15.32:0/3870817285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8ac0cfa90 0x7fa8ac1f2c50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000e9b0 tx=0x7fa8a000ecc0 comp rx=0 tx=0).stop 2023-06-20T13:32:59.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.128+0000 7fa8b23ff700 1 -- 172.21.15.32:0/3870817285 shutdown_connections 2023-06-20T13:32:59.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.128+0000 7fa8b23ff700 1 --2- 172.21.15.32:0/3870817285 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa89806ace0 0x7fa89806d190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:59.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.128+0000 7fa8b23ff700 1 --2- 172.21.15.32:0/3870817285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa8ac0d3730 0x7fa8ac1ef6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:59.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.128+0000 7fa8b23ff700 1 --2- 172.21.15.32:0/3870817285 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa8ac0b8430 0x7fa8ac1f1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:59.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.128+0000 7fa8b23ff700 1 --2- 172.21.15.32:0/3870817285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa8ac0cfa90 0x7fa8ac1f2c50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:59.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.128+0000 7fa8b23ff700 1 -- 172.21.15.32:0/3870817285 >> 172.21.15.32:0/3870817285 conn(0x7fa8ac06b3f0 msgr2=0x7fa8ac06b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:59.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.128+0000 7fa8b23ff700 1 -- 172.21.15.32:0/3870817285 shutdown_connections 2023-06-20T13:32:59.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.128+0000 7fa8b23ff700 1 -- 172.21.15.32:0/3870817285 wait complete. 2023-06-20T13:32:59.149 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-20T13:32:59.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.357+0000 7f28397ff700 1 Processor -- start 2023-06-20T13:32:59.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.357+0000 7f28397ff700 1 -- start start 2023-06-20T13:32:59.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.358+0000 7f28397ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f28340d3730 0x7f28340cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:59.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.358+0000 7f28397ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28340d0b20 con 0x7f28340cfa90 2023-06-20T13:32:59.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.358+0000 7f28397ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28340cfe90 con 0x7f28340b8430 2023-06-20T13:32:59.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.358+0000 7f28397ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28340cda30 con 0x7f28340d3730 2023-06-20T13:32:59.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.358+0000 7f282bfff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f28340d3730 0x7f28340cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:59.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.358+0000 7f28337fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f28340cfa90 0x7f28340d0fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:52942/0 (socket says 172.21.15.32:52942) 2023-06-20T13:32:59.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.358+0000 7f28337fe700 1 -- 172.21.15.32:0/1078232663 learned_addr learned my addr 172.21.15.32:0/1078232663 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:59.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.359+0000 7f282bfff700 1 -- 172.21.15.32:0/1078232663 >> v1:172.21.15.115:6789/0 conn(0x7f28340b8430 legacy=0x7f28340cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:59.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.359+0000 7f282bfff700 1 -- 172.21.15.32:0/1078232663 >> v1:172.21.15.32:6789/0 conn(0x7f28340cfa90 legacy=0x7f28340d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:59.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.359+0000 7f282bfff700 1 -- 172.21.15.32:0/1078232663 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28340b4ee0 con 0x7f28340d3730 2023-06-20T13:32:59.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.359+0000 7f28327fc700 1 -- 172.21.15.32:0/1078232663 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2095640983 0 0) 0x7f28340d0b20 con 0x7f28340cfa90 2023-06-20T13:32:59.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.359+0000 7f282bfff700 1 --2- 172.21.15.32:0/1078232663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28340d3730 0x7f28340cf550 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f281c009840 tx=0x7f281c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b2bce8685960d1 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:59.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.359+0000 7f28327fc700 1 -- 172.21.15.32:0/1078232663 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c011830 con 0x7f28340d3730 2023-06-20T13:32:59.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.359+0000 7f28327fc700 1 -- 172.21.15.32:0/1078232663 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281c011990 con 0x7f28340d3730 2023-06-20T13:32:59.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.359+0000 7f28327fc700 1 -- 172.21.15.32:0/1078232663 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281c011d20 con 0x7f28340d3730 2023-06-20T13:32:59.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.360+0000 7f28397ff700 1 -- 172.21.15.32:0/1078232663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28340d3730 msgr2=0x7f28340cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:59.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.360+0000 7f28397ff700 1 --2- 172.21.15.32:0/1078232663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28340d3730 0x7f28340cf550 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f281c009840 tx=0x7f281c009b50 comp rx=0 tx=0).stop 2023-06-20T13:32:59.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.360+0000 7f28397ff700 1 -- 172.21.15.32:0/1078232663 shutdown_connections 2023-06-20T13:32:59.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.360+0000 7f28397ff700 1 --2- 172.21.15.32:0/1078232663 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28340d3730 0x7f28340cf550 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:59.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.360+0000 7f28397ff700 1 -- 172.21.15.32:0/1078232663 >> 172.21.15.32:0/1078232663 conn(0x7f283406b3f0 msgr2=0x7f283406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:59.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.360+0000 7f28397ff700 1 -- 172.21.15.32:0/1078232663 shutdown_connections 2023-06-20T13:32:59.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.360+0000 7f28397ff700 1 -- 172.21.15.32:0/1078232663 wait complete. 2023-06-20T13:32:59.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.362+0000 7f28397ff700 1 Processor -- start 2023-06-20T13:32:59.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.362+0000 7f28397ff700 1 -- start start 2023-06-20T13:32:59.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.363+0000 7f28397ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28340b8430 0x7f28340c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:59.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.363+0000 7f28397ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28340cfa90 0x7f283414f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:59.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.363+0000 7f28397ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28340d3730 0x7f283415e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:59.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.363+0000 7f28397ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28341f6380 con 0x7f28340d3730 2023-06-20T13:32:59.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.363+0000 7f28397ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28340c96d0 con 0x7f28340cfa90 2023-06-20T13:32:59.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.363+0000 7f28397ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28341f5770 con 0x7f28340b8430 2023-06-20T13:32:59.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.363+0000 7f28337fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28340d3730 0x7f283415e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:59.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.363+0000 7f28337fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28340d3730 0x7f283415e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59494/0 (socket says 172.21.15.32:59494) 2023-06-20T13:32:59.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.363+0000 7f28337fe700 1 -- 172.21.15.32:0/2467134815 learned_addr learned my addr 172.21.15.32:0/2467134815 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:59.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.363+0000 7f282bfff700 1 --2- 172.21.15.32:0/2467134815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28340cfa90 0x7f283414f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:59.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.363+0000 7f2832ffd700 1 --2- 172.21.15.32:0/2467134815 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28340b8430 0x7f28340c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:59.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.364+0000 7f28337fe700 1 -- 172.21.15.32:0/2467134815 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28340b8430 msgr2=0x7f28340c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:59.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.364+0000 7f28337fe700 1 --2- 172.21.15.32:0/2467134815 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28340b8430 0x7f28340c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:59.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.364+0000 7f28337fe700 1 -- 172.21.15.32:0/2467134815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28340cfa90 msgr2=0x7f283414f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:59.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.364+0000 7f28337fe700 1 --2- 172.21.15.32:0/2467134815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28340cfa90 0x7f283414f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:59.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.364+0000 7f28337fe700 1 -- 172.21.15.32:0/2467134815 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281c0094a0 con 0x7f28340d3730 2023-06-20T13:32:59.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.364+0000 7f28337fe700 1 --2- 172.21.15.32:0/2467134815 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28340d3730 0x7f283415e940 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f282c002230 tx=0x7f282c00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:59.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.364+0000 7f282b7fe700 1 -- 172.21.15.32:0/2467134815 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c00aac0 con 0x7f28340d3730 2023-06-20T13:32:59.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.364+0000 7f282b7fe700 1 -- 172.21.15.32:0/2467134815 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282c00ac40 con 0x7f28340d3730 2023-06-20T13:32:59.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.364+0000 7f282b7fe700 1 -- 172.21.15.32:0/2467134815 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c0070d0 con 0x7f28340d3730 2023-06-20T13:32:59.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.364+0000 7f28397ff700 1 -- 172.21.15.32:0/2467134815 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28341f5a50 con 0x7f28340d3730 2023-06-20T13:32:59.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.364+0000 7f28397ff700 1 -- 172.21.15.32:0/2467134815 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28341f6010 con 0x7f28340d3730 2023-06-20T13:32:59.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.365+0000 7f28397ff700 1 -- 172.21.15.32:0/2467134815 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28340cae20 con 0x7f28340d3730 2023-06-20T13:32:59.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.366+0000 7f282b7fe700 1 -- 172.21.15.32:0/2467134815 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f282c007250 con 0x7f28340d3730 2023-06-20T13:32:59.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.367+0000 7f282b7fe700 1 --2- 172.21.15.32:0/2467134815 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f281406ace0 0x7f281406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:59.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.367+0000 7f282b7fe700 1 -- 172.21.15.32:0/2467134815 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f282c089250 con 0x7f28340d3730 2023-06-20T13:32:59.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.367+0000 7f2832ffd700 1 --2- 172.21.15.32:0/2467134815 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f281406ace0 0x7f281406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:59.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.368+0000 7f2832ffd700 1 --2- 172.21.15.32:0/2467134815 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f281406ace0 0x7f281406d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2824007fd0 tx=0x7f2824009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:59.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.371+0000 7f282b7fe700 1 -- 172.21.15.32:0/2467134815 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f28340cae20 con 0x7f28340d3730 2023-06-20T13:32:59.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.578+0000 7f28397ff700 1 -- 172.21.15.32:0/2467134815 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f28340cae20 con 0x7f28340d3730 2023-06-20T13:32:59.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.579+0000 7f282b7fe700 1 -- 172.21.15.32:0/2467134815 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f28340cae20 con 0x7f28340d3730 2023-06-20T13:32:59.582 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-06-20T13:32:59.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.581+0000 7f28397ff700 1 -- 172.21.15.32:0/2467134815 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f281406ace0 msgr2=0x7f281406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:59.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.581+0000 7f28397ff700 1 --2- 172.21.15.32:0/2467134815 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f281406ace0 0x7f281406d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2824007fd0 tx=0x7f2824009040 comp rx=0 tx=0).stop 2023-06-20T13:32:59.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.581+0000 7f28397ff700 1 -- 172.21.15.32:0/2467134815 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28340d3730 msgr2=0x7f283415e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:59.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.581+0000 7f28397ff700 1 --2- 172.21.15.32:0/2467134815 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28340d3730 0x7f283415e940 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f282c002230 tx=0x7f282c00cf50 comp rx=0 tx=0).stop 2023-06-20T13:32:59.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.581+0000 7f28397ff700 1 -- 172.21.15.32:0/2467134815 shutdown_connections 2023-06-20T13:32:59.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.581+0000 7f28397ff700 1 --2- 172.21.15.32:0/2467134815 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f281406ace0 0x7f281406d190 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:59.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.581+0000 7f28397ff700 1 --2- 172.21.15.32:0/2467134815 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28340d3730 0x7f283415e940 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:59.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.581+0000 7f28397ff700 1 --2- 172.21.15.32:0/2467134815 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28340b8430 0x7f28340c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:59.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.581+0000 7f28397ff700 1 --2- 172.21.15.32:0/2467134815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28340cfa90 0x7f283414f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:59.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.582+0000 7f28397ff700 1 -- 172.21.15.32:0/2467134815 >> 172.21.15.32:0/2467134815 conn(0x7f283406b3f0 msgr2=0x7f28340b5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:59.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.582+0000 7f28397ff700 1 -- 172.21.15.32:0/2467134815 shutdown_connections 2023-06-20T13:32:59.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.582+0000 7f28397ff700 1 -- 172.21.15.32:0/2467134815 wait complete. 2023-06-20T13:32:59.602 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-20T13:32:59.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.803+0000 7fe75fdff700 1 Processor -- start 2023-06-20T13:32:59.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.803+0000 7fe75fdff700 1 -- start start 2023-06-20T13:32:59.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.804+0000 7fe75fdff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7580b8430 0x7fe7580cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:59.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.804+0000 7fe75fdff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe7580cfc60 0x7fe7580d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:59.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.804+0000 7fe75fdff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7580d0b20 con 0x7fe7580d3730 2023-06-20T13:32:59.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.804+0000 7fe75fdff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7580b8800 con 0x7fe7580cfc60 2023-06-20T13:32:59.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.804+0000 7fe75fdff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7580b4ee0 con 0x7fe7580b8430 2023-06-20T13:32:59.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.804+0000 7fe75d39a700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe7580d3730 0x7fe7580cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:52948/0 (socket says 172.21.15.32:52948) 2023-06-20T13:32:59.807 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.804+0000 7fe75d39a700 1 -- 172.21.15.32:0/2016000003 learned_addr learned my addr 172.21.15.32:0/2016000003 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:32:59.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.805+0000 7fe75db9b700 1 --2- 172.21.15.32:0/2016000003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7580b8430 0x7fe7580cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:59.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.805+0000 7fe75e39c700 1 --2- 172.21.15.32:0/2016000003 >> v2:172.21.15.115:3300/0 conn(0x7fe7580cfc60 0x7fe7580d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:59.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.805+0000 7fe75cb99700 1 -- 172.21.15.32:0/2016000003 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155237303 0 0) 0x7fe7580d0b20 con 0x7fe7580d3730 2023-06-20T13:32:59.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.805+0000 7fe75cb99700 1 -- 172.21.15.32:0/2016000003 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7440035b0 con 0x7fe7580d3730 2023-06-20T13:32:59.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.805+0000 7fe75db9b700 1 -- 172.21.15.32:0/2016000003 >> v2:172.21.15.115:3300/0 conn(0x7fe7580cfc60 msgr2=0x7fe7580d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:32:59.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.805+0000 7fe75db9b700 1 --2- 172.21.15.32:0/2016000003 >> v2:172.21.15.115:3300/0 conn(0x7fe7580cfc60 0x7fe7580d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:59.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.805+0000 7fe75db9b700 1 -- 172.21.15.32:0/2016000003 >> v1:172.21.15.32:6789/0 conn(0x7fe7580d3730 legacy=0x7fe7580cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:59.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.805+0000 7fe75db9b700 1 -- 172.21.15.32:0/2016000003 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7580b51c0 con 0x7fe7580b8430 2023-06-20T13:32:59.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.805+0000 7fe75e39c700 1 --2- 172.21.15.32:0/2016000003 >> v2:172.21.15.115:3300/0 conn(0x7fe7580cfc60 0x7fe7580d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:32:59.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.805+0000 7fe75db9b700 1 --2- 172.21.15.32:0/2016000003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7580b8430 0x7fe7580cd320 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe754009840 tx=0x7fe754009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e121559722758de server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:59.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.806+0000 7fe75cb99700 1 -- 172.21.15.32:0/2016000003 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe754011830 con 0x7fe7580b8430 2023-06-20T13:32:59.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.806+0000 7fe75cb99700 1 -- 172.21.15.32:0/2016000003 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe754011990 con 0x7fe7580b8430 2023-06-20T13:32:59.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.806+0000 7fe75cb99700 1 -- 172.21.15.32:0/2016000003 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe754011d20 con 0x7fe7580b8430 2023-06-20T13:32:59.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.806+0000 7fe75fdff700 1 -- 172.21.15.32:0/2016000003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7580b8430 msgr2=0x7fe7580cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:59.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.806+0000 7fe75fdff700 1 --2- 172.21.15.32:0/2016000003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7580b8430 0x7fe7580cd320 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe754009840 tx=0x7fe754009b50 comp rx=0 tx=0).stop 2023-06-20T13:32:59.810 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.806+0000 7fe75fdff700 1 -- 172.21.15.32:0/2016000003 shutdown_connections 2023-06-20T13:32:59.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.806+0000 7fe75fdff700 1 --2- 172.21.15.32:0/2016000003 >> v2:172.21.15.115:3300/0 conn(0x7fe7580cfc60 0x7fe7580d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:59.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.806+0000 7fe75fdff700 1 --2- 172.21.15.32:0/2016000003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7580b8430 0x7fe7580cd320 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:59.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.806+0000 7fe75fdff700 1 -- 172.21.15.32:0/2016000003 >> 172.21.15.32:0/2016000003 conn(0x7fe75806b3f0 msgr2=0x7fe75806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:32:59.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.806+0000 7fe75fdff700 1 -- 172.21.15.32:0/2016000003 shutdown_connections 2023-06-20T13:32:59.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.806+0000 7fe75fdff700 1 -- 172.21.15.32:0/2016000003 wait complete. 2023-06-20T13:32:59.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.808+0000 7fe75fdff700 1 Processor -- start 2023-06-20T13:32:59.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.808+0000 7fe75fdff700 1 -- start start 2023-06-20T13:32:59.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.809+0000 7fe75fdff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7580b8430 0x7fe75814d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:59.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.809+0000 7fe75fdff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7580cfc60 0x7fe7580cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:59.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.809+0000 7fe75fdff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7580d3730 0x7fe7580c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:59.813 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.809+0000 7fe75fdff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7580c9a20 con 0x7fe7580cfc60 2023-06-20T13:32:59.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.809+0000 7fe75fdff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7580cb360 con 0x7fe7580d3730 2023-06-20T13:32:59.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.809+0000 7fe75fdff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7580cb640 con 0x7fe7580b8430 2023-06-20T13:32:59.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.809+0000 7fe75d39a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7580cfc60 0x7fe7580cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:59.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.809+0000 7fe75d39a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7580cfc60 0x7fe7580cacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:59510/0 (socket says 172.21.15.32:59510) 2023-06-20T13:32:59.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.809+0000 7fe75d39a700 1 -- 172.21.15.32:0/2793430222 learned_addr learned my addr 172.21.15.32:0/2793430222 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:32:59.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.809+0000 7fe75db9b700 1 --2- 172.21.15.32:0/2793430222 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7580b8430 0x7fe75814d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:59.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.810+0000 7fe75e39c700 1 --2- 172.21.15.32:0/2793430222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7580d3730 0x7fe7580c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:59.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.810+0000 7fe75d39a700 1 -- 172.21.15.32:0/2793430222 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7580b8430 msgr2=0x7fe75814d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:59.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.810+0000 7fe75d39a700 1 --2- 172.21.15.32:0/2793430222 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7580b8430 0x7fe75814d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:59.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.810+0000 7fe75d39a700 1 -- 172.21.15.32:0/2793430222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7580d3730 msgr2=0x7fe7580c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:32:59.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.810+0000 7fe75d39a700 1 --2- 172.21.15.32:0/2793430222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7580d3730 0x7fe7580c94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:32:59.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.810+0000 7fe75d39a700 1 -- 172.21.15.32:0/2793430222 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe750009a70 con 0x7fe7580cfc60 2023-06-20T13:32:59.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.810+0000 7fe75d39a700 1 --2- 172.21.15.32:0/2793430222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7580cfc60 0x7fe7580cacd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe748001eb0 tx=0x7fe74800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:59.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.810+0000 7fe74e7fc700 1 -- 172.21.15.32:0/2793430222 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74800cea0 con 0x7fe7580cfc60 2023-06-20T13:32:59.815 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.810+0000 7fe74e7fc700 1 -- 172.21.15.32:0/2793430222 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe748005d70 con 0x7fe7580cfc60 2023-06-20T13:32:59.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.810+0000 7fe74e7fc700 1 -- 172.21.15.32:0/2793430222 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7480072f0 con 0x7fe7580cfc60 2023-06-20T13:32:59.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.810+0000 7fe75fdff700 1 -- 172.21.15.32:0/2793430222 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7540094a0 con 0x7fe7580cfc60 2023-06-20T13:32:59.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.811+0000 7fe75fdff700 1 -- 172.21.15.32:0/2793430222 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7580cbc00 con 0x7fe7580cfc60 2023-06-20T13:32:59.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.812+0000 7fe75fdff700 1 -- 172.21.15.32:0/2793430222 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe75804ea60 con 0x7fe7580cfc60 2023-06-20T13:32:59.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.812+0000 7fe74e7fc700 1 -- 172.21.15.32:0/2793430222 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe748007450 con 0x7fe7580cfc60 2023-06-20T13:32:59.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.813+0000 7fe74e7fc700 1 --2- 172.21.15.32:0/2793430222 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe73c06ace0 0x7fe73c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:32:59.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.813+0000 7fe74e7fc700 1 -- 172.21.15.32:0/2793430222 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe748088be0 con 0x7fe7580cfc60 2023-06-20T13:32:59.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.814+0000 7fe75db9b700 1 --2- 172.21.15.32:0/2793430222 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe73c06ace0 0x7fe73c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:32:59.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.814+0000 7fe75db9b700 1 --2- 172.21.15.32:0/2793430222 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe73c06ace0 0x7fe73c06d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe754000c00 tx=0x7fe754008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:32:59.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:32:59.818+0000 7fe74e7fc700 1 -- 172.21.15.32:0/2793430222 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe748053940 con 0x7fe7580cfc60 2023-06-20T13:33:00.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.035+0000 7fe75fdff700 1 -- 172.21.15.32:0/2793430222 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe7580d2250 con 0x7fe7580cfc60 2023-06-20T13:33:00.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.035+0000 7fe74e7fc700 1 -- 172.21.15.32:0/2793430222 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe748056f60 con 0x7fe7580cfc60 2023-06-20T13:33:00.038 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-06-20T13:33:00.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.038+0000 7fe75fdff700 1 -- 172.21.15.32:0/2793430222 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe73c06ace0 msgr2=0x7fe73c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:00.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.038+0000 7fe75fdff700 1 --2- 172.21.15.32:0/2793430222 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe73c06ace0 0x7fe73c06d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe754000c00 tx=0x7fe754008030 comp rx=0 tx=0).stop 2023-06-20T13:33:00.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.038+0000 7fe75fdff700 1 -- 172.21.15.32:0/2793430222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7580cfc60 msgr2=0x7fe7580cacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:00.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.038+0000 7fe75fdff700 1 --2- 172.21.15.32:0/2793430222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7580cfc60 0x7fe7580cacd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe748001eb0 tx=0x7fe74800c7b0 comp rx=0 tx=0).stop 2023-06-20T13:33:00.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.038+0000 7fe75fdff700 1 -- 172.21.15.32:0/2793430222 shutdown_connections 2023-06-20T13:33:00.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.038+0000 7fe75fdff700 1 --2- 172.21.15.32:0/2793430222 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe73c06ace0 0x7fe73c06d190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:00.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.038+0000 7fe75fdff700 1 --2- 172.21.15.32:0/2793430222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7580d3730 0x7fe7580c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:00.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.038+0000 7fe75fdff700 1 --2- 172.21.15.32:0/2793430222 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe7580b8430 0x7fe75814d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:00.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.038+0000 7fe75fdff700 1 --2- 172.21.15.32:0/2793430222 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe7580cfc60 0x7fe7580cacd0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:00.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.038+0000 7fe75fdff700 1 -- 172.21.15.32:0/2793430222 >> 172.21.15.32:0/2793430222 conn(0x7fe75806b3f0 msgr2=0x7fe7580d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:00.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.038+0000 7fe75fdff700 1 -- 172.21.15.32:0/2793430222 shutdown_connections 2023-06-20T13:33:00.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.038+0000 7fe75fdff700 1 -- 172.21.15.32:0/2793430222 wait complete. 2023-06-20T13:33:00.059 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-20T13:33:00.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.260+0000 7facf09ff700 1 Processor -- start 2023-06-20T13:33:00.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.261+0000 7facf09ff700 1 -- start start 2023-06-20T13:33:00.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.262+0000 7facf09ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7facec070340 0x7facec06a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:00.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.262+0000 7facf09ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facec15e210 con 0x7facec157f10 2023-06-20T13:33:00.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.262+0000 7facf09ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facec15dee0 con 0x7facec070a50 2023-06-20T13:33:00.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.262+0000 7facf09ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facec06d900 con 0x7facec070340 2023-06-20T13:33:00.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.262+0000 7facea59c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7facec157f10 0x7facec15e6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55640/0 (socket says 172.21.15.32:55640) 2023-06-20T13:33:00.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.262+0000 7facea59c700 1 -- 172.21.15.32:0/2593918256 learned_addr learned my addr 172.21.15.32:0/2593918256 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:00.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.262+0000 7face959a700 1 -- 172.21.15.32:0/2593918256 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 746662518 0 0) 0x7facec15e210 con 0x7facec157f10 2023-06-20T13:33:00.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.262+0000 7face9d9b700 1 --2- 172.21.15.32:0/2593918256 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7facec070340 0x7facec06a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:00.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.263+0000 7face959a700 1 -- 172.21.15.32:0/2593918256 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facd40035b0 con 0x7facec157f10 2023-06-20T13:33:00.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.263+0000 7face959a700 1 -- 172.21.15.32:0/2593918256 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 734054751 0 0) 0x7facd40035b0 con 0x7facec157f10 2023-06-20T13:33:00.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.263+0000 7face959a700 1 -- 172.21.15.32:0/2593918256 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7facec070340 msgr2=0x7facec06a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:00.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.263+0000 7face959a700 1 --2- 172.21.15.32:0/2593918256 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7facec070340 0x7facec06a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:00.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.263+0000 7face959a700 1 -- 172.21.15.32:0/2593918256 >> v1:172.21.15.115:6789/0 conn(0x7facec070a50 legacy=0x7facec15a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:00.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.263+0000 7face959a700 1 -- 172.21.15.32:0/2593918256 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facec0c8f40 con 0x7facec157f10 2023-06-20T13:33:00.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.263+0000 7face959a700 1 -- 172.21.15.32:0/2593918256 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3380058562 0 0) 0x7facdc001670 con 0x7facec157f10 2023-06-20T13:33:00.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.263+0000 7face959a700 1 -- 172.21.15.32:0/2593918256 >> v1:172.21.15.32:6789/0 conn(0x7facec157f10 legacy=0x7facec15e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:00.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.263+0000 7face959a700 1 --2- 172.21.15.32:0/2593918256 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facd4003a30 0x7facd4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:00.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.263+0000 7face959a700 1 --2- 172.21.15.32:0/2593918256 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7facec070340 0x7facd4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:00.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.263+0000 7face959a700 1 --2- 172.21.15.32:0/2593918256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facd4004d90 0x7facd4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:00.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.263+0000 7face959a700 1 -- 172.21.15.32:0/2593918256 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facec06d900 con 0x7facd4003a30 2023-06-20T13:33:00.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.263+0000 7face959a700 1 -- 172.21.15.32:0/2593918256 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd4010030 con 0x7facd4004d90 2023-06-20T13:33:00.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.263+0000 7face959a700 1 -- 172.21.15.32:0/2593918256 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd40101f0 con 0x7facec070340 2023-06-20T13:33:00.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.263+0000 7facea59c700 1 --2- 172.21.15.32:0/2593918256 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facd4003a30 0x7facd4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:00.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.263+0000 7face9d9b700 1 --2- 172.21.15.32:0/2593918256 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7facec070340 0x7facd4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:00.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.263+0000 7facead9d700 1 --2- 172.21.15.32:0/2593918256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facd4004d90 0x7facd4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:00.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.264+0000 7facea59c700 1 -- 172.21.15.32:0/2593918256 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7facec070340 msgr2=0x7facd4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:00.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.264+0000 7facea59c700 1 --2- 172.21.15.32:0/2593918256 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7facec070340 0x7facd4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:00.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.264+0000 7facea59c700 1 -- 172.21.15.32:0/2593918256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facd4004d90 msgr2=0x7facd4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:00.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.264+0000 7facea59c700 1 --2- 172.21.15.32:0/2593918256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facd4004d90 0x7facd4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:00.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.264+0000 7facea59c700 1 -- 172.21.15.32:0/2593918256 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd40035b0 con 0x7facd4003a30 2023-06-20T13:33:00.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.264+0000 7facea59c700 1 --2- 172.21.15.32:0/2593918256 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facd4003a30 0x7facd4003e40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7facdc00c160 tx=0x7facd4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4508106414b93650 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:00.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.264+0000 7face959a700 1 -- 172.21.15.32:0/2593918256 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc007b30 con 0x7facd4003a30 2023-06-20T13:33:00.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.264+0000 7face959a700 1 -- 172.21.15.32:0/2593918256 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facdc00cce0 con 0x7facd4003a30 2023-06-20T13:33:00.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.264+0000 7face959a700 1 -- 172.21.15.32:0/2593918256 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc005ba0 con 0x7facd4003a30 2023-06-20T13:33:00.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.265+0000 7facf09ff700 1 -- 172.21.15.32:0/2593918256 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facd4003a30 msgr2=0x7facd4003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:00.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.265+0000 7facf09ff700 1 --2- 172.21.15.32:0/2593918256 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facd4003a30 0x7facd4003e40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7facdc00c160 tx=0x7facd4005880 comp rx=0 tx=0).stop 2023-06-20T13:33:00.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.265+0000 7facead9d700 1 -- 172.21.15.32:0/2593918256 reap_dead start 2023-06-20T13:33:00.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.265+0000 7facf09ff700 1 -- 172.21.15.32:0/2593918256 shutdown_connections 2023-06-20T13:33:00.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.265+0000 7facf09ff700 1 -- 172.21.15.32:0/2593918256 >> 172.21.15.32:0/2593918256 conn(0x7facec0b0390 msgr2=0x7facec0b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:00.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.265+0000 7facf09ff700 1 -- 172.21.15.32:0/2593918256 shutdown_connections 2023-06-20T13:33:00.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.265+0000 7facf09ff700 1 -- 172.21.15.32:0/2593918256 wait complete. 2023-06-20T13:33:00.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.267+0000 7facf09ff700 1 Processor -- start 2023-06-20T13:33:00.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.267+0000 7facf09ff700 1 -- start start 2023-06-20T13:33:00.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.268+0000 7facf09ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facd4003a30 0x7facec152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:00.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.268+0000 7facf09ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7facec0c6ca0 0x7facec0c7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:00.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.268+0000 7facf09ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facec0cdb10 0x7facec0cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:00.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.268+0000 7facf09ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facec0ce4f0 con 0x7facd4003a30 2023-06-20T13:33:00.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.268+0000 7facf09ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facec155540 con 0x7facec0cdb10 2023-06-20T13:33:00.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.268+0000 7facf09ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facec0c7f80 con 0x7facec0c6ca0 2023-06-20T13:33:00.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.268+0000 7facea59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facd4003a30 0x7facec152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:00.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.268+0000 7facea59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facd4003a30 0x7facec152e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51340/0 (socket says 172.21.15.32:51340) 2023-06-20T13:33:00.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.268+0000 7facea59c700 1 -- 172.21.15.32:0/3280530607 learned_addr learned my addr 172.21.15.32:0/3280530607 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:00.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.268+0000 7facead9d700 1 --2- 172.21.15.32:0/3280530607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facec0cdb10 0x7facec0cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:00.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.268+0000 7face9d9b700 1 --2- 172.21.15.32:0/3280530607 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7facec0c6ca0 0x7facec0c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:00.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.268+0000 7facea59c700 1 -- 172.21.15.32:0/3280530607 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7facec0c6ca0 msgr2=0x7facec0c7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:00.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.268+0000 7facea59c700 1 --2- 172.21.15.32:0/3280530607 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7facec0c6ca0 0x7facec0c7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:00.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.268+0000 7facea59c700 1 -- 172.21.15.32:0/3280530607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facec0cdb10 msgr2=0x7facec0cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:00.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.268+0000 7facea59c700 1 --2- 172.21.15.32:0/3280530607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facec0cdb10 0x7facec0cdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:00.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.268+0000 7facea59c700 1 -- 172.21.15.32:0/3280530607 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facec0c8260 con 0x7facd4003a30 2023-06-20T13:33:00.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.268+0000 7face9d9b700 1 --2- 172.21.15.32:0/3280530607 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7facec0c6ca0 0x7facec0c7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:00.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.268+0000 7facead9d700 1 --2- 172.21.15.32:0/3280530607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facec0cdb10 0x7facec0cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:00.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.269+0000 7facea59c700 1 --2- 172.21.15.32:0/3280530607 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facd4003a30 0x7facec152e30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7facdc00c750 tx=0x7facec1582e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:00.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.269+0000 7facdaffd700 1 -- 172.21.15.32:0/3280530607 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc004d40 con 0x7facd4003a30 2023-06-20T13:33:00.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.269+0000 7facdaffd700 1 -- 172.21.15.32:0/3280530607 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facdc0070d0 con 0x7facd4003a30 2023-06-20T13:33:00.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.269+0000 7facdaffd700 1 -- 172.21.15.32:0/3280530607 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc007480 con 0x7facd4003a30 2023-06-20T13:33:00.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.269+0000 7facf09ff700 1 -- 172.21.15.32:0/3280530607 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facec0c8540 con 0x7facd4003a30 2023-06-20T13:33:00.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.269+0000 7facf09ff700 1 -- 172.21.15.32:0/3280530607 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facec0c7b50 con 0x7facd4003a30 2023-06-20T13:33:00.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.270+0000 7facf09ff700 1 -- 172.21.15.32:0/3280530607 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facec04ea60 con 0x7facd4003a30 2023-06-20T13:33:00.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.271+0000 7facdaffd700 1 -- 172.21.15.32:0/3280530607 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7facdc0075e0 con 0x7facd4003a30 2023-06-20T13:33:00.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.272+0000 7facdaffd700 1 --2- 172.21.15.32:0/3280530607 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7faccc06ace0 0x7faccc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:00.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.272+0000 7facdaffd700 1 -- 172.21.15.32:0/3280530607 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7facdc08b0a0 con 0x7facd4003a30 2023-06-20T13:33:00.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.272+0000 7face9d9b700 1 --2- 172.21.15.32:0/3280530607 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7faccc06ace0 0x7faccc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:00.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.273+0000 7face9d9b700 1 --2- 172.21.15.32:0/3280530607 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7faccc06ace0 0x7faccc06d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7facec0cd300 tx=0x7face0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:00.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.276+0000 7facdaffd700 1 -- 172.21.15.32:0/3280530607 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7facdc055e90 con 0x7facd4003a30 2023-06-20T13:33:00.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.526+0000 7facf09ff700 1 -- 172.21.15.32:0/3280530607 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7facec0c5e70 con 0x7facd4003a30 2023-06-20T13:33:00.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.527+0000 7facdaffd700 1 -- 172.21.15.32:0/3280530607 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4670 (secure 0 0 0) 0x7facdc0594b0 con 0x7facd4003a30 2023-06-20T13:33:00.529 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:33:00.530 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2171664589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2171664589},{"type":"v1","addr":"172.21.15.115:6834","nonce":2171664589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/959333888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":959333888},{"type":"v1","addr":"172.21.15.32:6837","nonce":959333888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3388117179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":3388117179},{"type":"v1","addr":"172.21.15.32:6835","nonce":3388117179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-20T13:32:20.527725+0000","modified":"2023-06-20T13:32:49.006923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3566362693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3566362693},{"type":"v1","addr":"172.21.15.115:6835","nonce":3566362693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-20T13:33:00.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.529+0000 7facf09ff700 1 -- 172.21.15.32:0/3280530607 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7faccc06ace0 msgr2=0x7faccc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:00.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.529+0000 7facf09ff700 1 --2- 172.21.15.32:0/3280530607 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7faccc06ace0 0x7faccc06d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7facec0cd300 tx=0x7face0008040 comp rx=0 tx=0).stop 2023-06-20T13:33:00.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.529+0000 7facf09ff700 1 -- 172.21.15.32:0/3280530607 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facd4003a30 msgr2=0x7facec152e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:00.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.529+0000 7facf09ff700 1 --2- 172.21.15.32:0/3280530607 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facd4003a30 0x7facec152e30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7facdc00c750 tx=0x7facec1582e0 comp rx=0 tx=0).stop 2023-06-20T13:33:00.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.529+0000 7facf09ff700 1 -- 172.21.15.32:0/3280530607 shutdown_connections 2023-06-20T13:33:00.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.529+0000 7facf09ff700 1 --2- 172.21.15.32:0/3280530607 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7faccc06ace0 0x7faccc06d190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:00.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.529+0000 7facf09ff700 1 --2- 172.21.15.32:0/3280530607 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7facec0cdb10 0x7facec0cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:00.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.529+0000 7facf09ff700 1 --2- 172.21.15.32:0/3280530607 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7facd4003a30 0x7facec152e30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:00.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.529+0000 7facf09ff700 1 --2- 172.21.15.32:0/3280530607 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7facec0c6ca0 0x7facec0c7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:00.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.529+0000 7facf09ff700 1 -- 172.21.15.32:0/3280530607 >> 172.21.15.32:0/3280530607 conn(0x7facec0b0390 msgr2=0x7facec0c4300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:00.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.530+0000 7facf09ff700 1 -- 172.21.15.32:0/3280530607 shutdown_connections 2023-06-20T13:33:00.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.530+0000 7facf09ff700 1 -- 172.21.15.32:0/3280530607 wait complete. 2023-06-20T13:33:00.534 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2023-06-20T13:33:00.550 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:33:00.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.748+0000 7fb19f3ff700 1 Processor -- start 2023-06-20T13:33:00.751 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.748+0000 7fb19f3ff700 1 -- start start 2023-06-20T13:33:00.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.750+0000 7fb19f3ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb19815c460 0x7fb1980b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:00.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.750+0000 7fb19f3ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb1980d2640 0x7fb1980cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:00.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.750+0000 7fb19f3ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1980d1790 con 0x7fb1980cf720 2023-06-20T13:33:00.752 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.750+0000 7fb19f3ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1980cedd0 con 0x7fb1980d2640 2023-06-20T13:33:00.753 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.750+0000 7fb19f3ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1980cd950 con 0x7fb19815c460 2023-06-20T13:33:00.753 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.750+0000 7fb19c99a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fb1980d2640 0x7fb1980cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:00.753 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.750+0000 7fb19d99c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fb1980cf720 0x7fb1980d2b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55652/0 (socket says 172.21.15.32:55652) 2023-06-20T13:33:00.753 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.750+0000 7fb19d99c700 1 -- 172.21.15.32:0/2085565970 learned_addr learned my addr 172.21.15.32:0/2085565970 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:00.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.750+0000 7fb19d19b700 1 --2- 172.21.15.32:0/2085565970 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb19815c460 0x7fb1980b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:00.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.750+0000 7fb19c99a700 1 -- 172.21.15.32:0/2085565970 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb19815c460 msgr2=0x7fb1980b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:00.755 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.750+0000 7fb19c99a700 1 --2- 172.21.15.32:0/2085565970 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb19815c460 0x7fb1980b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:00.755 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.750+0000 7fb19c99a700 1 -- 172.21.15.32:0/2085565970 >> v1:172.21.15.32:6789/0 conn(0x7fb1980cf720 legacy=0x7fb1980d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:00.755 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.750+0000 7fb19c99a700 1 -- 172.21.15.32:0/2085565970 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1980d14b0 con 0x7fb1980d2640 2023-06-20T13:33:00.755 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.750+0000 7fb18ffff700 1 -- 172.21.15.32:0/2085565970 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3998912302 0 0) 0x7fb1980d1790 con 0x7fb1980cf720 2023-06-20T13:33:00.755 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.751+0000 7fb19c99a700 1 --2- 172.21.15.32:0/2085565970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1980d2640 0x7fb1980cf1e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb188009840 tx=0x7fb188009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2422309470beb0ca server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:00.755 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.751+0000 7fb18ffff700 1 -- 172.21.15.32:0/2085565970 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb188011830 con 0x7fb1980d2640 2023-06-20T13:33:00.755 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.751+0000 7fb18ffff700 1 -- 172.21.15.32:0/2085565970 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb188011990 con 0x7fb1980d2640 2023-06-20T13:33:00.756 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.751+0000 7fb18ffff700 1 -- 172.21.15.32:0/2085565970 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb188011d20 con 0x7fb1980d2640 2023-06-20T13:33:00.756 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.751+0000 7fb19f3ff700 1 -- 172.21.15.32:0/2085565970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1980d2640 msgr2=0x7fb1980cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:00.756 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.751+0000 7fb19f3ff700 1 --2- 172.21.15.32:0/2085565970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1980d2640 0x7fb1980cf1e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb188009840 tx=0x7fb188009b50 comp rx=0 tx=0).stop 2023-06-20T13:33:00.756 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.752+0000 7fb19f3ff700 1 -- 172.21.15.32:0/2085565970 shutdown_connections 2023-06-20T13:33:00.756 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.752+0000 7fb19f3ff700 1 --2- 172.21.15.32:0/2085565970 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb19815c460 0x7fb1980b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:00.756 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.752+0000 7fb19f3ff700 1 --2- 172.21.15.32:0/2085565970 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1980d2640 0x7fb1980cf1e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:00.756 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.752+0000 7fb19f3ff700 1 -- 172.21.15.32:0/2085565970 >> 172.21.15.32:0/2085565970 conn(0x7fb198071660 msgr2=0x7fb198071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:00.756 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.752+0000 7fb19f3ff700 1 -- 172.21.15.32:0/2085565970 shutdown_connections 2023-06-20T13:33:00.757 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.752+0000 7fb19f3ff700 1 -- 172.21.15.32:0/2085565970 wait complete. 2023-06-20T13:33:00.758 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.753+0000 7fb19f3ff700 1 Processor -- start 2023-06-20T13:33:00.758 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.754+0000 7fb19f3ff700 1 -- start start 2023-06-20T13:33:00.758 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.755+0000 7fb19f3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1980cf720 0x7fb198151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:00.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.755+0000 7fb19f3ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1980d2640 0x7fb19814e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:00.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.755+0000 7fb19f3ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb19815c460 0x7fb198156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:00.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.755+0000 7fb19f3ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb198151cc0 con 0x7fb1980d2640 2023-06-20T13:33:00.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.755+0000 7fb19f3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1980c6a60 con 0x7fb1980cf720 2023-06-20T13:33:00.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.755+0000 7fb19f3ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1981f2950 con 0x7fb19815c460 2023-06-20T13:33:00.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.755+0000 7fb19c99a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1980d2640 0x7fb19814e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:00.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.755+0000 7fb19c99a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1980d2640 0x7fb19814e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51364/0 (socket says 172.21.15.32:51364) 2023-06-20T13:33:00.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.755+0000 7fb19c99a700 1 -- 172.21.15.32:0/2762141648 learned_addr learned my addr 172.21.15.32:0/2762141648 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:00.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.755+0000 7fb19d19b700 1 --2- 172.21.15.32:0/2762141648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1980cf720 0x7fb198151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:00.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.755+0000 7fb19d99c700 1 --2- 172.21.15.32:0/2762141648 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb19815c460 0x7fb198156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:00.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.755+0000 7fb19c99a700 1 -- 172.21.15.32:0/2762141648 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb19815c460 msgr2=0x7fb198156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:00.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.755+0000 7fb19c99a700 1 --2- 172.21.15.32:0/2762141648 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb19815c460 0x7fb198156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:00.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.755+0000 7fb19c99a700 1 -- 172.21.15.32:0/2762141648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1980cf720 msgr2=0x7fb198151780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:00.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.755+0000 7fb19c99a700 1 --2- 172.21.15.32:0/2762141648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1980cf720 0x7fb198151780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:00.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.755+0000 7fb19c99a700 1 -- 172.21.15.32:0/2762141648 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1880094a0 con 0x7fb1980d2640 2023-06-20T13:33:00.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.755+0000 7fb19d99c700 1 --2- 172.21.15.32:0/2762141648 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb19815c460 0x7fb198156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:00.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.756+0000 7fb19c99a700 1 --2- 172.21.15.32:0/2762141648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1980d2640 0x7fb19814e4b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb188009b90 tx=0x7fb188004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:00.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.756+0000 7fb18dffb700 1 -- 172.21.15.32:0/2762141648 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1880036a0 con 0x7fb1980d2640 2023-06-20T13:33:00.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.756+0000 7fb18dffb700 1 -- 172.21.15.32:0/2762141648 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18801e070 con 0x7fb1980d2640 2023-06-20T13:33:00.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.756+0000 7fb18dffb700 1 -- 172.21.15.32:0/2762141648 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb188003a40 con 0x7fb1980d2640 2023-06-20T13:33:00.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.756+0000 7fb19f3ff700 1 -- 172.21.15.32:0/2762141648 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1981f2c30 con 0x7fb1980d2640 2023-06-20T13:33:00.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.756+0000 7fb19f3ff700 1 -- 172.21.15.32:0/2762141648 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb198150f80 con 0x7fb1980d2640 2023-06-20T13:33:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.757+0000 7fb19f3ff700 1 -- 172.21.15.32:0/2762141648 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb19804ea60 con 0x7fb1980d2640 2023-06-20T13:33:00.762 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.758+0000 7fb18dffb700 1 -- 172.21.15.32:0/2762141648 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb188003ba0 con 0x7fb1980d2640 2023-06-20T13:33:00.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.759+0000 7fb18dffb700 1 --2- 172.21.15.32:0/2762141648 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fb17c06ace0 0x7fb17c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:00.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.759+0000 7fb18dffb700 1 -- 172.21.15.32:0/2762141648 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb18808a7c0 con 0x7fb1980d2640 2023-06-20T13:33:00.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.759+0000 7fb19d19b700 1 --2- 172.21.15.32:0/2762141648 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fb17c06ace0 0x7fb17c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:00.763 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.760+0000 7fb19d19b700 1 --2- 172.21.15.32:0/2762141648 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fb17c06ace0 0x7fb17c06d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb198155760 tx=0x7fb194008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:00.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.763+0000 7fb18dffb700 1 -- 172.21.15.32:0/2762141648 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb188055530 con 0x7fb1980d2640 2023-06-20T13:33:00.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.969+0000 7fb19f3ff700 1 -- 172.21.15.32:0/2762141648 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1980b4fa0 con 0x7fb1980d2640 2023-06-20T13:33:00.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.971+0000 7fb18dffb700 1 -- 172.21.15.32:0/2762141648 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20191 (secure 0 0 0) 0x7fb18802c3b0 con 0x7fb1980d2640 2023-06-20T13:33:00.974 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:33:00.974 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":28,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:32:59.972093+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-20T13:32:18.120021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-20T13:32:19.503624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-20T13:32:23.074912+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:33:00.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.973+0000 7fb19f3ff700 1 -- 172.21.15.32:0/2762141648 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fb17c06ace0 msgr2=0x7fb17c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:00.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.973+0000 7fb19f3ff700 1 --2- 172.21.15.32:0/2762141648 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fb17c06ace0 0x7fb17c06d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb198155760 tx=0x7fb194008040 comp rx=0 tx=0).stop 2023-06-20T13:33:00.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.973+0000 7fb19f3ff700 1 -- 172.21.15.32:0/2762141648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1980d2640 msgr2=0x7fb19814e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:00.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.973+0000 7fb19f3ff700 1 --2- 172.21.15.32:0/2762141648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1980d2640 0x7fb19814e4b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb188009b90 tx=0x7fb188004750 comp rx=0 tx=0).stop 2023-06-20T13:33:00.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.974+0000 7fb19f3ff700 1 -- 172.21.15.32:0/2762141648 shutdown_connections 2023-06-20T13:33:00.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.974+0000 7fb19f3ff700 1 --2- 172.21.15.32:0/2762141648 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fb17c06ace0 0x7fb17c06d190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:00.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.974+0000 7fb19f3ff700 1 --2- 172.21.15.32:0/2762141648 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb19815c460 0x7fb198156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:00.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.974+0000 7fb19f3ff700 1 --2- 172.21.15.32:0/2762141648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb1980cf720 0x7fb198151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:00.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.974+0000 7fb19f3ff700 1 --2- 172.21.15.32:0/2762141648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fb1980d2640 0x7fb19814e4b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:00.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.974+0000 7fb19f3ff700 1 -- 172.21.15.32:0/2762141648 >> 172.21.15.32:0/2762141648 conn(0x7fb198071660 msgr2=0x7fb19815c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:00.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.974+0000 7fb19f3ff700 1 -- 172.21.15.32:0/2762141648 shutdown_connections 2023-06-20T13:33:00.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:00.974+0000 7fb19f3ff700 1 -- 172.21.15.32:0/2762141648 wait complete. 2023-06-20T13:33:00.996 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-20T13:32:05.308022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-20T13:32:12.857161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-20T13:32:18.120021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-20T13:32:19.503624+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-20T13:32:23.074912+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-20T13:33:00.997 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-20T13:33:01.206 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.204+0000 7f07fc3ff700 1 Processor -- start 2023-06-20T13:33:01.206 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.204+0000 7f07fc3ff700 1 -- start start 2023-06-20T13:33:01.207 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.205+0000 7f07fc3ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f07f40b8430 0x7f07f40cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:01.207 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.205+0000 7f07fc3ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07f40cfc60 0x7f07f40d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:01.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.205+0000 7f07fc3ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f40d0b20 con 0x7f07f40d3730 2023-06-20T13:33:01.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.205+0000 7f07fc3ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f40b8800 con 0x7f07f40b8430 2023-06-20T13:33:01.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.205+0000 7f07fc3ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f40b4ee0 con 0x7f07f40cfc60 2023-06-20T13:33:01.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.205+0000 7f07fa19b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f07f40b8430 0x7f07f40cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:01.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.205+0000 7f07f999a700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f07f40d3730 0x7f07f40cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55662/0 (socket says 172.21.15.32:55662) 2023-06-20T13:33:01.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.205+0000 7f07f999a700 1 -- 172.21.15.32:0/3310741843 learned_addr learned my addr 172.21.15.32:0/3310741843 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:01.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.205+0000 7f07fa99c700 1 --2- 172.21.15.32:0/3310741843 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07f40cfc60 0x7f07f40d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:01.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.206+0000 7f07fa19b700 1 -- 172.21.15.32:0/3310741843 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07f40cfc60 msgr2=0x7f07f40d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:01.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.206+0000 7f07fa19b700 1 --2- 172.21.15.32:0/3310741843 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07f40cfc60 0x7f07f40d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:01.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.206+0000 7f07fa19b700 1 -- 172.21.15.32:0/3310741843 >> v1:172.21.15.32:6789/0 conn(0x7f07f40d3730 legacy=0x7f07f40cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:01.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.206+0000 7f07f9199700 1 -- 172.21.15.32:0/3310741843 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3376045103 0 0) 0x7f07f40d0b20 con 0x7f07f40d3730 2023-06-20T13:33:01.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.206+0000 7f07fa19b700 1 -- 172.21.15.32:0/3310741843 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f40b51c0 con 0x7f07f40b8430 2023-06-20T13:33:01.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.206+0000 7f07fa19b700 1 --2- 172.21.15.32:0/3310741843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07f40b8430 0x7f07f40cd320 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f07f0009840 tx=0x7f07f0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be9fb822d5894a3 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:01.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.206+0000 7f07f9199700 1 -- 172.21.15.32:0/3310741843 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f0011830 con 0x7f07f40b8430 2023-06-20T13:33:01.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.206+0000 7f07f9199700 1 -- 172.21.15.32:0/3310741843 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f0011990 con 0x7f07f40b8430 2023-06-20T13:33:01.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.206+0000 7f07f9199700 1 -- 172.21.15.32:0/3310741843 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f0011d20 con 0x7f07f40b8430 2023-06-20T13:33:01.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.207+0000 7f07fc3ff700 1 -- 172.21.15.32:0/3310741843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07f40b8430 msgr2=0x7f07f40cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:01.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.207+0000 7f07fc3ff700 1 --2- 172.21.15.32:0/3310741843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07f40b8430 0x7f07f40cd320 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f07f0009840 tx=0x7f07f0009b50 comp rx=0 tx=0).stop 2023-06-20T13:33:01.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.207+0000 7f07fc3ff700 1 -- 172.21.15.32:0/3310741843 shutdown_connections 2023-06-20T13:33:01.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.207+0000 7f07fc3ff700 1 --2- 172.21.15.32:0/3310741843 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07f40cfc60 0x7f07f40d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:01.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.207+0000 7f07fc3ff700 1 --2- 172.21.15.32:0/3310741843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07f40b8430 0x7f07f40cd320 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:01.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.207+0000 7f07fc3ff700 1 -- 172.21.15.32:0/3310741843 >> 172.21.15.32:0/3310741843 conn(0x7f07f406b3f0 msgr2=0x7f07f406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:01.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.207+0000 7f07fc3ff700 1 -- 172.21.15.32:0/3310741843 shutdown_connections 2023-06-20T13:33:01.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.207+0000 7f07fc3ff700 1 -- 172.21.15.32:0/3310741843 wait complete. 2023-06-20T13:33:01.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.209+0000 7f07fc3ff700 1 Processor -- start 2023-06-20T13:33:01.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.210+0000 7f07fc3ff700 1 -- start start 2023-06-20T13:33:01.214 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.211+0000 7f07fc3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07f40b8430 0x7f07f4149ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:01.214 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.211+0000 7f07fc3ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07f40cfc60 0x7f07f415d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:01.214 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.211+0000 7f07fc3ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07f40d3730 0x7f07f414f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:01.214 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.211+0000 7f07fc3ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f415e9a0 con 0x7f07f40cfc60 2023-06-20T13:33:01.214 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.211+0000 7f07fc3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f415d5a0 con 0x7f07f40b8430 2023-06-20T13:33:01.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.211+0000 7f07fc3ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f41497f0 con 0x7f07f40d3730 2023-06-20T13:33:01.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.211+0000 7f07f999a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07f40cfc60 0x7f07f415d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:01.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.211+0000 7f07f999a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07f40cfc60 0x7f07f415d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51372/0 (socket says 172.21.15.32:51372) 2023-06-20T13:33:01.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.211+0000 7f07f999a700 1 -- 172.21.15.32:0/1541414693 learned_addr learned my addr 172.21.15.32:0/1541414693 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:01.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.212+0000 7f07fa99c700 1 --2- 172.21.15.32:0/1541414693 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07f40d3730 0x7f07f414f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:01.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.212+0000 7f07fa19b700 1 --2- 172.21.15.32:0/1541414693 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07f40b8430 0x7f07f4149ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:01.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.212+0000 7f07f999a700 1 -- 172.21.15.32:0/1541414693 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07f40d3730 msgr2=0x7f07f414f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:01.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.212+0000 7f07f999a700 1 --2- 172.21.15.32:0/1541414693 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07f40d3730 0x7f07f414f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:01.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.212+0000 7f07f999a700 1 -- 172.21.15.32:0/1541414693 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07f40b8430 msgr2=0x7f07f4149ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:01.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.212+0000 7f07f999a700 1 --2- 172.21.15.32:0/1541414693 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07f40b8430 0x7f07f4149ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:01.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.212+0000 7f07f999a700 1 -- 172.21.15.32:0/1541414693 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f00094a0 con 0x7f07f40cfc60 2023-06-20T13:33:01.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.212+0000 7f07fa19b700 1 --2- 172.21.15.32:0/1541414693 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07f40b8430 0x7f07f4149ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:01.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.212+0000 7f07f999a700 1 --2- 172.21.15.32:0/1541414693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07f40cfc60 0x7f07f415d060 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f07e400c750 tx=0x7f07e400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:01.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.212+0000 7f07eaffd700 1 -- 172.21.15.32:0/1541414693 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e4004c80 con 0x7f07f40cfc60 2023-06-20T13:33:01.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.212+0000 7f07eaffd700 1 -- 172.21.15.32:0/1541414693 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e4004e00 con 0x7f07f40cfc60 2023-06-20T13:33:01.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.212+0000 7f07fc3ff700 1 -- 172.21.15.32:0/1541414693 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f414c0b0 con 0x7f07f40cfc60 2023-06-20T13:33:01.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.212+0000 7f07eaffd700 1 -- 172.21.15.32:0/1541414693 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e4007310 con 0x7f07f40cfc60 2023-06-20T13:33:01.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.212+0000 7f07fc3ff700 1 -- 172.21.15.32:0/1541414693 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f414c670 con 0x7f07f40cfc60 2023-06-20T13:33:01.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.213+0000 7f07fc3ff700 1 -- 172.21.15.32:0/1541414693 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f404ea60 con 0x7f07f40cfc60 2023-06-20T13:33:01.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.214+0000 7f07eaffd700 1 -- 172.21.15.32:0/1541414693 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f07e4007470 con 0x7f07f40cfc60 2023-06-20T13:33:01.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.215+0000 7f07eaffd700 1 --2- 172.21.15.32:0/1541414693 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f07d806ace0 0x7f07d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:01.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.215+0000 7f07eaffd700 1 -- 172.21.15.32:0/1541414693 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f07e40895c0 con 0x7f07f40cfc60 2023-06-20T13:33:01.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.216+0000 7f07fa19b700 1 --2- 172.21.15.32:0/1541414693 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f07d806ace0 0x7f07d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:01.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.216+0000 7f07fa19b700 1 --2- 172.21.15.32:0/1541414693 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f07d806ace0 0x7f07d806d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f07f00090b0 tx=0x7f07f0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:01.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.219+0000 7f07eaffd700 1 -- 172.21.15.32:0/1541414693 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f07e40542a0 con 0x7f07f40cfc60 2023-06-20T13:33:01.429 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.427+0000 7f07fc3ff700 1 -- 172.21.15.32:0/1541414693 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f07f40cf5c0 con 0x7f07f40cfc60 2023-06-20T13:33:01.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.427+0000 7f07eaffd700 1 -- 172.21.15.32:0/1541414693 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f07e40578c0 con 0x7f07f40cfc60 2023-06-20T13:33:01.430 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-06-20T13:33:01.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.429+0000 7f07fc3ff700 1 -- 172.21.15.32:0/1541414693 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f07d806ace0 msgr2=0x7f07d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:01.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.429+0000 7f07fc3ff700 1 --2- 172.21.15.32:0/1541414693 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f07d806ace0 0x7f07d806d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f07f00090b0 tx=0x7f07f0008030 comp rx=0 tx=0).stop 2023-06-20T13:33:01.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.429+0000 7f07fc3ff700 1 -- 172.21.15.32:0/1541414693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07f40cfc60 msgr2=0x7f07f415d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:01.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.429+0000 7f07fc3ff700 1 --2- 172.21.15.32:0/1541414693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07f40cfc60 0x7f07f415d060 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f07e400c750 tx=0x7f07e400cb10 comp rx=0 tx=0).stop 2023-06-20T13:33:01.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.430+0000 7f07fc3ff700 1 -- 172.21.15.32:0/1541414693 shutdown_connections 2023-06-20T13:33:01.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.430+0000 7f07fc3ff700 1 --2- 172.21.15.32:0/1541414693 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f07d806ace0 0x7f07d806d190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:01.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.430+0000 7f07fc3ff700 1 --2- 172.21.15.32:0/1541414693 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07f40d3730 0x7f07f414f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:01.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.430+0000 7f07fc3ff700 1 --2- 172.21.15.32:0/1541414693 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07f40b8430 0x7f07f4149ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:01.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.430+0000 7f07fc3ff700 1 --2- 172.21.15.32:0/1541414693 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07f40cfc60 0x7f07f415d060 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:01.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.430+0000 7f07fc3ff700 1 -- 172.21.15.32:0/1541414693 >> 172.21.15.32:0/1541414693 conn(0x7f07f406b3f0 msgr2=0x7f07f40b6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:01.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.430+0000 7f07fc3ff700 1 -- 172.21.15.32:0/1541414693 shutdown_connections 2023-06-20T13:33:01.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.430+0000 7f07fc3ff700 1 -- 172.21.15.32:0/1541414693 wait complete. 2023-06-20T13:33:01.450 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-20T13:33:01.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.650+0000 7fdb7d5ff700 1 Processor -- start 2023-06-20T13:33:01.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.650+0000 7fdb7d5ff700 1 -- start start 2023-06-20T13:33:01.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.651+0000 7fdb7d5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdb780b8430 0x7fdb780cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:01.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.651+0000 7fdb7d5ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb780cfc60 0x7fdb780d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:01.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.651+0000 7fdb7d5ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb780d0b20 con 0x7fdb780d3730 2023-06-20T13:33:01.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.651+0000 7fdb7d5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb780b8800 con 0x7fdb780b8430 2023-06-20T13:33:01.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.651+0000 7fdb7d5ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb780b4ee0 con 0x7fdb780cfc60 2023-06-20T13:33:01.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.651+0000 7fdb6ffff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fdb780d3730 0x7fdb780cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55670/0 (socket says 172.21.15.32:55670) 2023-06-20T13:33:01.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.651+0000 7fdb6ffff700 1 -- 172.21.15.32:0/2732783987 learned_addr learned my addr 172.21.15.32:0/2732783987 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:01.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.651+0000 7fdb777fe700 1 --2- 172.21.15.32:0/2732783987 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb780cfc60 0x7fdb780d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:01.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.651+0000 7fdb76ffd700 1 --2- 172.21.15.32:0/2732783987 >> v2:172.21.15.115:3300/0 conn(0x7fdb780b8430 0x7fdb780cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:01.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.652+0000 7fdb767fc700 1 -- 172.21.15.32:0/2732783987 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103620669 0 0) 0x7fdb780d0b20 con 0x7fdb780d3730 2023-06-20T13:33:01.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.652+0000 7fdb767fc700 1 -- 172.21.15.32:0/2732783987 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb640035b0 con 0x7fdb780d3730 2023-06-20T13:33:01.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.652+0000 7fdb76ffd700 1 -- 172.21.15.32:0/2732783987 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb780cfc60 msgr2=0x7fdb780d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:01.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.652+0000 7fdb76ffd700 1 --2- 172.21.15.32:0/2732783987 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb780cfc60 0x7fdb780d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:01.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.652+0000 7fdb76ffd700 1 -- 172.21.15.32:0/2732783987 >> v1:172.21.15.32:6789/0 conn(0x7fdb780d3730 legacy=0x7fdb780cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:01.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.652+0000 7fdb76ffd700 1 -- 172.21.15.32:0/2732783987 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb780b51c0 con 0x7fdb780b8430 2023-06-20T13:33:01.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.652+0000 7fdb777fe700 1 --2- 172.21.15.32:0/2732783987 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb780cfc60 0x7fdb780d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:33:01.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.652+0000 7fdb76ffd700 1 --2- 172.21.15.32:0/2732783987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb780b8430 0x7fdb780cd320 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdb68009840 tx=0x7fdb68009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5604e4c05e79fffa server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:01.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.653+0000 7fdb767fc700 1 -- 172.21.15.32:0/2732783987 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb68011830 con 0x7fdb780b8430 2023-06-20T13:33:01.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.653+0000 7fdb767fc700 1 -- 172.21.15.32:0/2732783987 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb68011990 con 0x7fdb780b8430 2023-06-20T13:33:01.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.653+0000 7fdb767fc700 1 -- 172.21.15.32:0/2732783987 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb68011d00 con 0x7fdb780b8430 2023-06-20T13:33:01.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.653+0000 7fdb7d5ff700 1 -- 172.21.15.32:0/2732783987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb780b8430 msgr2=0x7fdb780cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:01.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.653+0000 7fdb7d5ff700 1 --2- 172.21.15.32:0/2732783987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb780b8430 0x7fdb780cd320 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdb68009840 tx=0x7fdb68009b50 comp rx=0 tx=0).stop 2023-06-20T13:33:01.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.653+0000 7fdb7d5ff700 1 -- 172.21.15.32:0/2732783987 shutdown_connections 2023-06-20T13:33:01.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.653+0000 7fdb7d5ff700 1 --2- 172.21.15.32:0/2732783987 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb780cfc60 0x7fdb780d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:01.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.653+0000 7fdb7d5ff700 1 --2- 172.21.15.32:0/2732783987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb780b8430 0x7fdb780cd320 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:01.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.653+0000 7fdb7d5ff700 1 -- 172.21.15.32:0/2732783987 >> 172.21.15.32:0/2732783987 conn(0x7fdb7806b3f0 msgr2=0x7fdb7806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:01.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.653+0000 7fdb7d5ff700 1 -- 172.21.15.32:0/2732783987 shutdown_connections 2023-06-20T13:33:01.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.653+0000 7fdb7d5ff700 1 -- 172.21.15.32:0/2732783987 wait complete. 2023-06-20T13:33:01.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.655+0000 7fdb7d5ff700 1 Processor -- start 2023-06-20T13:33:01.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.655+0000 7fdb7d5ff700 1 -- start start 2023-06-20T13:33:01.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.656+0000 7fdb7d5ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb780b8430 0x7fdb780b3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:01.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.656+0000 7fdb7d5ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb780cfc60 0x7fdb7815d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:01.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.656+0000 7fdb7d5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb780d3730 0x7fdb781f1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:01.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.656+0000 7fdb7d5ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7815fc60 con 0x7fdb780cfc60 2023-06-20T13:33:01.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.656+0000 7fdb7d5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7815da80 con 0x7fdb780d3730 2023-06-20T13:33:01.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.656+0000 7fdb7d5ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7815d7e0 con 0x7fdb780b8430 2023-06-20T13:33:01.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.657+0000 7fdb6ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb780cfc60 0x7fdb7815d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:01.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.657+0000 7fdb6ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb780cfc60 0x7fdb7815d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51374/0 (socket says 172.21.15.32:51374) 2023-06-20T13:33:01.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.657+0000 7fdb6ffff700 1 -- 172.21.15.32:0/2070477478 learned_addr learned my addr 172.21.15.32:0/2070477478 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:01.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.657+0000 7fdb76ffd700 1 --2- 172.21.15.32:0/2070477478 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb780b8430 0x7fdb780b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:01.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.657+0000 7fdb777fe700 1 --2- 172.21.15.32:0/2070477478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb780d3730 0x7fdb781f1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:01.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.657+0000 7fdb6ffff700 1 -- 172.21.15.32:0/2070477478 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb780b8430 msgr2=0x7fdb780b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:01.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.657+0000 7fdb6ffff700 1 --2- 172.21.15.32:0/2070477478 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb780b8430 0x7fdb780b3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:01.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.657+0000 7fdb6ffff700 1 -- 172.21.15.32:0/2070477478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb780d3730 msgr2=0x7fdb781f1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:01.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.657+0000 7fdb6ffff700 1 --2- 172.21.15.32:0/2070477478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb780d3730 0x7fdb781f1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:01.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.657+0000 7fdb6ffff700 1 -- 172.21.15.32:0/2070477478 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb70009a70 con 0x7fdb780cfc60 2023-06-20T13:33:01.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.657+0000 7fdb6ffff700 1 --2- 172.21.15.32:0/2070477478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb780cfc60 0x7fdb7815d2a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000c700 tx=0x7fdb6000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:01.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.658+0000 7fdb6f7fe700 1 -- 172.21.15.32:0/2070477478 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb60005d70 con 0x7fdb780cfc60 2023-06-20T13:33:01.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.658+0000 7fdb6f7fe700 1 -- 172.21.15.32:0/2070477478 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb600070d0 con 0x7fdb780cfc60 2023-06-20T13:33:01.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.658+0000 7fdb6f7fe700 1 -- 172.21.15.32:0/2070477478 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb60007460 con 0x7fdb780cfc60 2023-06-20T13:33:01.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.658+0000 7fdb7d5ff700 1 -- 172.21.15.32:0/2070477478 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb680094a0 con 0x7fdb780cfc60 2023-06-20T13:33:01.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.658+0000 7fdb7d5ff700 1 -- 172.21.15.32:0/2070477478 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb780c7c50 con 0x7fdb780cfc60 2023-06-20T13:33:01.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.659+0000 7fdb7d5ff700 1 -- 172.21.15.32:0/2070477478 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb7804ea60 con 0x7fdb780cfc60 2023-06-20T13:33:01.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.660+0000 7fdb6f7fe700 1 -- 172.21.15.32:0/2070477478 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdb600075c0 con 0x7fdb780cfc60 2023-06-20T13:33:01.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.661+0000 7fdb6f7fe700 1 --2- 172.21.15.32:0/2070477478 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdb5806ace0 0x7fdb5806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:01.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.661+0000 7fdb6f7fe700 1 -- 172.21.15.32:0/2070477478 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdb60088d80 con 0x7fdb780cfc60 2023-06-20T13:33:01.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.661+0000 7fdb76ffd700 1 --2- 172.21.15.32:0/2070477478 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdb5806ace0 0x7fdb5806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:01.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.661+0000 7fdb76ffd700 1 --2- 172.21.15.32:0/2070477478 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdb5806ace0 0x7fdb5806d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdb68009fd0 tx=0x7fdb6801c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:01.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.665+0000 7fdb6f7fe700 1 -- 172.21.15.32:0/2070477478 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdb60053af0 con 0x7fdb780cfc60 2023-06-20T13:33:01.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.870+0000 7fdb7d5ff700 1 -- 172.21.15.32:0/2070477478 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdb780cf810 con 0x7fdb780cfc60 2023-06-20T13:33:01.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.871+0000 7fdb6f7fe700 1 -- 172.21.15.32:0/2070477478 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdb60057110 con 0x7fdb780cfc60 2023-06-20T13:33:01.873 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 8 2023-06-20T13:33:01.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.873+0000 7fdb7d5ff700 1 -- 172.21.15.32:0/2070477478 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdb5806ace0 msgr2=0x7fdb5806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:01.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.873+0000 7fdb7d5ff700 1 --2- 172.21.15.32:0/2070477478 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdb5806ace0 0x7fdb5806d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdb68009fd0 tx=0x7fdb6801c040 comp rx=0 tx=0).stop 2023-06-20T13:33:01.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.873+0000 7fdb7d5ff700 1 -- 172.21.15.32:0/2070477478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb780cfc60 msgr2=0x7fdb7815d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:01.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.873+0000 7fdb7d5ff700 1 --2- 172.21.15.32:0/2070477478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb780cfc60 0x7fdb7815d2a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000c700 tx=0x7fdb6000ca10 comp rx=0 tx=0).stop 2023-06-20T13:33:01.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.873+0000 7fdb7d5ff700 1 -- 172.21.15.32:0/2070477478 shutdown_connections 2023-06-20T13:33:01.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.873+0000 7fdb7d5ff700 1 --2- 172.21.15.32:0/2070477478 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdb5806ace0 0x7fdb5806d190 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:01.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.873+0000 7fdb7d5ff700 1 --2- 172.21.15.32:0/2070477478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdb780d3730 0x7fdb781f1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:01.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.873+0000 7fdb7d5ff700 1 --2- 172.21.15.32:0/2070477478 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdb780b8430 0x7fdb780b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:01.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.873+0000 7fdb7d5ff700 1 --2- 172.21.15.32:0/2070477478 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdb780cfc60 0x7fdb7815d2a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:01.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.873+0000 7fdb7d5ff700 1 -- 172.21.15.32:0/2070477478 >> 172.21.15.32:0/2070477478 conn(0x7fdb7806b3f0 msgr2=0x7fdb780b6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:01.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.873+0000 7fdb7d5ff700 1 -- 172.21.15.32:0/2070477478 shutdown_connections 2023-06-20T13:33:01.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:01.873+0000 7fdb7d5ff700 1 -- 172.21.15.32:0/2070477478 wait complete. 2023-06-20T13:33:01.893 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-20T13:33:02.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.096+0000 7f07c5bff700 1 Processor -- start 2023-06-20T13:33:02.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.097+0000 7f07c5bff700 1 -- start start 2023-06-20T13:33:02.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.098+0000 7f07c5bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f07c00b8430 0x7f07c00cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:02.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.098+0000 7f07c5bff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f07c00d3730 0x7f07c00cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:02.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.098+0000 7f07c5bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c00d0b20 con 0x7f07c00cfa90 2023-06-20T13:33:02.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.098+0000 7f07c5bff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c00b8800 con 0x7f07c00d3730 2023-06-20T13:33:02.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.098+0000 7f07c5bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c00cfe90 con 0x7f07c00b8430 2023-06-20T13:33:02.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.098+0000 7f07beffd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f07c00d3730 0x7f07c00cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:02.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.098+0000 7f07beffd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f07c00d3730 0x7f07c00cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51376/0 (socket says 172.21.15.32:51376) 2023-06-20T13:33:02.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.098+0000 7f07beffd700 1 -- 172.21.15.32:0/419247571 learned_addr learned my addr 172.21.15.32:0/419247571 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:02.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.098+0000 7f07bf7fe700 1 --2- 172.21.15.32:0/419247571 >> v2:172.21.15.115:3300/0 conn(0x7f07c00b8430 0x7f07c00cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:02.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.098+0000 7f07beffd700 1 -- 172.21.15.32:0/419247571 >> v2:172.21.15.115:3300/0 conn(0x7f07c00b8430 msgr2=0x7f07c00cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:02.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.098+0000 7f07beffd700 1 --2- 172.21.15.32:0/419247571 >> v2:172.21.15.115:3300/0 conn(0x7f07c00b8430 0x7f07c00cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:02.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.098+0000 7f07beffd700 1 -- 172.21.15.32:0/419247571 >> v1:172.21.15.115:6789/0 conn(0x7f07c00cfa90 legacy=0x7f07c015feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:02.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.098+0000 7f07beffd700 1 -- 172.21.15.32:0/419247571 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c00b4ee0 con 0x7f07c00d3730 2023-06-20T13:33:02.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.098+0000 7f07bf7fe700 1 --2- 172.21.15.32:0/419247571 >> v2:172.21.15.115:3300/0 conn(0x7f07c00b8430 0x7f07c00cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:02.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.099+0000 7f07beffd700 1 --2- 172.21.15.32:0/419247571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07c00d3730 0x7f07c00cf550 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f07c00cf520 tx=0x7f07b4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4617256b1ad7e06c server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:02.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.099+0000 7f07be7fc700 1 -- 172.21.15.32:0/419247571 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b4004230 con 0x7f07c00d3730 2023-06-20T13:33:02.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.099+0000 7f07be7fc700 1 -- 172.21.15.32:0/419247571 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b4004390 con 0x7f07c00d3730 2023-06-20T13:33:02.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.099+0000 7f07be7fc700 1 -- 172.21.15.32:0/419247571 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b40036a0 con 0x7f07c00d3730 2023-06-20T13:33:02.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.099+0000 7f07c5bff700 1 -- 172.21.15.32:0/419247571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07c00d3730 msgr2=0x7f07c00cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:02.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.099+0000 7f07c5bff700 1 --2- 172.21.15.32:0/419247571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07c00d3730 0x7f07c00cf550 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f07c00cf520 tx=0x7f07b4009bd0 comp rx=0 tx=0).stop 2023-06-20T13:33:02.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.100+0000 7f07c5bff700 1 -- 172.21.15.32:0/419247571 shutdown_connections 2023-06-20T13:33:02.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.100+0000 7f07c5bff700 1 --2- 172.21.15.32:0/419247571 >> v2:172.21.15.115:3300/0 conn(0x7f07c00b8430 0x7f07c00cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:02.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.100+0000 7f07c5bff700 1 --2- 172.21.15.32:0/419247571 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07c00d3730 0x7f07c00cf550 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:02.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.100+0000 7f07c5bff700 1 -- 172.21.15.32:0/419247571 >> 172.21.15.32:0/419247571 conn(0x7f07c006b3f0 msgr2=0x7f07c006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:02.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.100+0000 7f07c5bff700 1 -- 172.21.15.32:0/419247571 shutdown_connections 2023-06-20T13:33:02.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.100+0000 7f07c5bff700 1 -- 172.21.15.32:0/419247571 wait complete. 2023-06-20T13:33:02.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.101+0000 7f07c5bff700 1 Processor -- start 2023-06-20T13:33:02.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.102+0000 7f07c5bff700 1 -- start start 2023-06-20T13:33:02.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.102+0000 7f07c5bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07c00b8430 0x7f07c014c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:02.108 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.103+0000 7f07c5bff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07c00cfa90 0x7f07c00d1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:02.108 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.103+0000 7f07c5bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07c00d3730 0x7f07c00b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:02.108 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.103+0000 7f07c5bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c00ca020 con 0x7f07c00d3730 2023-06-20T13:33:02.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.103+0000 7f07c5bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c00ccd10 con 0x7f07c00b8430 2023-06-20T13:33:02.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.103+0000 7f07c5bff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c015dc40 con 0x7f07c00cfa90 2023-06-20T13:33:02.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.103+0000 7f07bffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07c00d3730 0x7f07c00b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:02.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.103+0000 7f07bffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07c00d3730 0x7f07c00b5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51384/0 (socket says 172.21.15.32:51384) 2023-06-20T13:33:02.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.103+0000 7f07bffff700 1 -- 172.21.15.32:0/2597026594 learned_addr learned my addr 172.21.15.32:0/2597026594 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:02.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.103+0000 7f07bf7fe700 1 --2- 172.21.15.32:0/2597026594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07c00b8430 0x7f07c014c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:02.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.103+0000 7f07beffd700 1 --2- 172.21.15.32:0/2597026594 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07c00cfa90 0x7f07c00d1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:02.111 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.103+0000 7f07bffff700 1 -- 172.21.15.32:0/2597026594 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07c00cfa90 msgr2=0x7f07c00d1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:02.111 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.103+0000 7f07bffff700 1 --2- 172.21.15.32:0/2597026594 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07c00cfa90 0x7f07c00d1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:02.111 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.103+0000 7f07bffff700 1 -- 172.21.15.32:0/2597026594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07c00b8430 msgr2=0x7f07c014c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:02.111 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.103+0000 7f07bffff700 1 --2- 172.21.15.32:0/2597026594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07c00b8430 0x7f07c014c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:02.112 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.103+0000 7f07bffff700 1 -- 172.21.15.32:0/2597026594 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b4009550 con 0x7f07c00d3730 2023-06-20T13:33:02.112 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.103+0000 7f07bf7fe700 1 --2- 172.21.15.32:0/2597026594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07c00b8430 0x7f07c014c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:02.112 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.104+0000 7f07bffff700 1 --2- 172.21.15.32:0/2597026594 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07c00d3730 0x7f07c00b5b90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f07b800cc10 tx=0x7f07b800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:02.112 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.104+0000 7f07a7fff700 1 -- 172.21.15.32:0/2597026594 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b800ab50 con 0x7f07c00d3730 2023-06-20T13:33:02.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.104+0000 7f07a7fff700 1 -- 172.21.15.32:0/2597026594 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b800acb0 con 0x7f07c00d3730 2023-06-20T13:33:02.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.104+0000 7f07a7fff700 1 -- 172.21.15.32:0/2597026594 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b8012660 con 0x7f07c00d3730 2023-06-20T13:33:02.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.104+0000 7f07c5bff700 1 -- 172.21.15.32:0/2597026594 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c00d19a0 con 0x7f07c00d3730 2023-06-20T13:33:02.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.104+0000 7f07c5bff700 1 -- 172.21.15.32:0/2597026594 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c00cc750 con 0x7f07c00d3730 2023-06-20T13:33:02.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.105+0000 7f07c5bff700 1 -- 172.21.15.32:0/2597026594 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c015da10 con 0x7f07c00d3730 2023-06-20T13:33:02.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.106+0000 7f07a7fff700 1 -- 172.21.15.32:0/2597026594 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f07b80127c0 con 0x7f07c00d3730 2023-06-20T13:33:02.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.107+0000 7f07a7fff700 1 --2- 172.21.15.32:0/2597026594 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f07ac06ace0 0x7f07ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:02.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.107+0000 7f07a7fff700 1 -- 172.21.15.32:0/2597026594 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f07b8089ff0 con 0x7f07c00d3730 2023-06-20T13:33:02.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.107+0000 7f07bf7fe700 1 --2- 172.21.15.32:0/2597026594 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f07ac06ace0 0x7f07ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:02.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.108+0000 7f07bf7fe700 1 --2- 172.21.15.32:0/2597026594 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f07ac06ace0 0x7f07ac06d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f07b000aa20 tx=0x7f07b0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:02.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.112+0000 7f07a7fff700 1 -- 172.21.15.32:0/2597026594 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f07b80bc310 con 0x7f07c00d3730 2023-06-20T13:33:02.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.317+0000 7f07c5bff700 1 -- 172.21.15.32:0/2597026594 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f07c015ddb0 con 0x7f07c00d3730 2023-06-20T13:33:02.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.318+0000 7f07a7fff700 1 -- 172.21.15.32:0/2597026594 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f07b80160a0 con 0x7f07c00d3730 2023-06-20T13:33:02.320 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-06-20T13:33:02.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.320+0000 7f07c5bff700 1 -- 172.21.15.32:0/2597026594 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f07ac06ace0 msgr2=0x7f07ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:02.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.320+0000 7f07c5bff700 1 --2- 172.21.15.32:0/2597026594 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f07ac06ace0 0x7f07ac06d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f07b000aa20 tx=0x7f07b0008040 comp rx=0 tx=0).stop 2023-06-20T13:33:02.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.320+0000 7f07c5bff700 1 -- 172.21.15.32:0/2597026594 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07c00d3730 msgr2=0x7f07c00b5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:02.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.320+0000 7f07c5bff700 1 --2- 172.21.15.32:0/2597026594 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07c00d3730 0x7f07c00b5b90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f07b800cc10 tx=0x7f07b800a060 comp rx=0 tx=0).stop 2023-06-20T13:33:02.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.320+0000 7f07c5bff700 1 -- 172.21.15.32:0/2597026594 shutdown_connections 2023-06-20T13:33:02.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.320+0000 7f07c5bff700 1 --2- 172.21.15.32:0/2597026594 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f07ac06ace0 0x7f07ac06d190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:02.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.320+0000 7f07c5bff700 1 --2- 172.21.15.32:0/2597026594 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f07c00d3730 0x7f07c00b5b90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:02.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.320+0000 7f07c5bff700 1 --2- 172.21.15.32:0/2597026594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f07c00b8430 0x7f07c014c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:02.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.320+0000 7f07c5bff700 1 --2- 172.21.15.32:0/2597026594 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f07c00cfa90 0x7f07c00d1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:02.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.320+0000 7f07c5bff700 1 -- 172.21.15.32:0/2597026594 >> 172.21.15.32:0/2597026594 conn(0x7f07c006b3f0 msgr2=0x7f07c015a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:02.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.320+0000 7f07c5bff700 1 -- 172.21.15.32:0/2597026594 shutdown_connections 2023-06-20T13:33:02.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.321+0000 7f07c5bff700 1 -- 172.21.15.32:0/2597026594 wait complete. 2023-06-20T13:33:02.341 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-20T13:33:02.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.542+0000 7f0308bff700 1 Processor -- start 2023-06-20T13:33:02.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.543+0000 7f0308bff700 1 -- start start 2023-06-20T13:33:02.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.544+0000 7f0308bff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03040cfc60 0x7f0304167010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:02.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.544+0000 7f0308bff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03040d0b20 con 0x7f03040d3730 2023-06-20T13:33:02.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.544+0000 7f0308bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03040b4ee0 con 0x7f03040b8430 2023-06-20T13:33:02.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.544+0000 7f0308bff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03040cda30 con 0x7f03040cfc60 2023-06-20T13:33:02.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.544+0000 7f02fbfff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f03040d3730 0x7f03040cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55676/0 (socket says 172.21.15.32:55676) 2023-06-20T13:33:02.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.544+0000 7f02fbfff700 1 -- 172.21.15.32:0/2837520574 learned_addr learned my addr 172.21.15.32:0/2837520574 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:02.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.544+0000 7f0302d9d700 1 --2- 172.21.15.32:0/2837520574 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03040cfc60 0x7f0304167010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:02.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.545+0000 7f0301d9b700 1 -- 172.21.15.32:0/2837520574 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3236726047 0 0) 0x7f03040d0b20 con 0x7f03040d3730 2023-06-20T13:33:02.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.545+0000 7f0301d9b700 1 -- 172.21.15.32:0/2837520574 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02f00035b0 con 0x7f03040d3730 2023-06-20T13:33:02.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.545+0000 7f0301d9b700 1 -- 172.21.15.32:0/2837520574 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3939551346 0 0) 0x7f03040b4ee0 con 0x7f03040b8430 2023-06-20T13:33:02.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.545+0000 7f0301d9b700 1 -- 172.21.15.32:0/2837520574 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03040d0b20 con 0x7f03040b8430 2023-06-20T13:33:02.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.545+0000 7f0302d9d700 1 -- 172.21.15.32:0/2837520574 >> v1:172.21.15.115:6789/0 conn(0x7f03040b8430 legacy=0x7f03040cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:02.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.545+0000 7f0302d9d700 1 -- 172.21.15.32:0/2837520574 >> v1:172.21.15.32:6789/0 conn(0x7f03040d3730 legacy=0x7f03040cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:02.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.545+0000 7f0301d9b700 1 -- 172.21.15.32:0/2837520574 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3334513197 0 0) 0x7f02f00035b0 con 0x7f03040d3730 2023-06-20T13:33:02.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.545+0000 7f0302d9d700 1 -- 172.21.15.32:0/2837520574 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03040b51c0 con 0x7f03040cfc60 2023-06-20T13:33:02.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.545+0000 7f0302d9d700 1 --2- 172.21.15.32:0/2837520574 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03040cfc60 0x7f0304167010 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f02fc009dc0 tx=0x7f02fc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31cd4878f16d945c server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:02.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.545+0000 7f0301d9b700 1 -- 172.21.15.32:0/2837520574 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02fc00e070 con 0x7f03040cfc60 2023-06-20T13:33:02.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.546+0000 7f0301d9b700 1 -- 172.21.15.32:0/2837520574 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02fc003a20 con 0x7f03040cfc60 2023-06-20T13:33:02.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.546+0000 7f0301d9b700 1 -- 172.21.15.32:0/2837520574 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec001670 con 0x7f03040cfc60 2023-06-20T13:33:02.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.546+0000 7f0308bff700 1 -- 172.21.15.32:0/2837520574 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03040cfc60 msgr2=0x7f0304167010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:02.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.546+0000 7f0308bff700 1 --2- 172.21.15.32:0/2837520574 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03040cfc60 0x7f0304167010 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f02fc009dc0 tx=0x7f02fc00b330 comp rx=0 tx=0).stop 2023-06-20T13:33:02.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.546+0000 7f0308bff700 1 -- 172.21.15.32:0/2837520574 shutdown_connections 2023-06-20T13:33:02.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.546+0000 7f0308bff700 1 --2- 172.21.15.32:0/2837520574 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03040cfc60 0x7f0304167010 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:02.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.546+0000 7f0308bff700 1 -- 172.21.15.32:0/2837520574 >> 172.21.15.32:0/2837520574 conn(0x7f030406b3f0 msgr2=0x7f030406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:02.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.546+0000 7f0308bff700 1 -- 172.21.15.32:0/2837520574 shutdown_connections 2023-06-20T13:33:02.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.546+0000 7f0308bff700 1 -- 172.21.15.32:0/2837520574 wait complete. 2023-06-20T13:33:02.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.548+0000 7f0308bff700 1 Processor -- start 2023-06-20T13:33:02.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.548+0000 7f0308bff700 1 -- start start 2023-06-20T13:33:02.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.549+0000 7f0308bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03040b8430 0x7f030415c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:02.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.549+0000 7f0308bff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03040cfc60 0x7f0304155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:02.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.549+0000 7f0308bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03040d3730 0x7f03040b5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:02.555 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.549+0000 7f0308bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030415cf10 con 0x7f03040d3730 2023-06-20T13:33:02.555 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.549+0000 7f0308bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030415d1f0 con 0x7f03040b8430 2023-06-20T13:33:02.555 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.549+0000 7f0308bff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f030415d4d0 con 0x7f03040cfc60 2023-06-20T13:33:02.555 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.549+0000 7f0302d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03040d3730 0x7f03040b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:02.555 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.549+0000 7f0302d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03040d3730 0x7f03040b5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51398/0 (socket says 172.21.15.32:51398) 2023-06-20T13:33:02.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.549+0000 7f0302d9d700 1 -- 172.21.15.32:0/4238770043 learned_addr learned my addr 172.21.15.32:0/4238770043 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:02.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.549+0000 7f02fbfff700 1 --2- 172.21.15.32:0/4238770043 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03040cfc60 0x7f0304155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:02.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.549+0000 7f030259c700 1 --2- 172.21.15.32:0/4238770043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03040b8430 0x7f030415c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:02.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.550+0000 7f0302d9d700 1 -- 172.21.15.32:0/4238770043 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03040cfc60 msgr2=0x7f0304155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:02.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.550+0000 7f0302d9d700 1 --2- 172.21.15.32:0/4238770043 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03040cfc60 0x7f0304155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:02.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.550+0000 7f0302d9d700 1 -- 172.21.15.32:0/4238770043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03040b8430 msgr2=0x7f030415c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:02.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.550+0000 7f0302d9d700 1 --2- 172.21.15.32:0/4238770043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03040b8430 0x7f030415c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:02.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.550+0000 7f0302d9d700 1 -- 172.21.15.32:0/4238770043 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02fc009a70 con 0x7f03040d3730 2023-06-20T13:33:02.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.550+0000 7f030259c700 1 --2- 172.21.15.32:0/4238770043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03040b8430 0x7f030415c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:02.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.550+0000 7f0302d9d700 1 --2- 172.21.15.32:0/4238770043 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03040d3730 0x7f03040b5970 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f02fc009d90 tx=0x7f02fc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:02.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.550+0000 7f02faffd700 1 -- 172.21.15.32:0/4238770043 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02fc004540 con 0x7f03040d3730 2023-06-20T13:33:02.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.550+0000 7f02faffd700 1 -- 172.21.15.32:0/4238770043 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02fc0046a0 con 0x7f03040d3730 2023-06-20T13:33:02.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.550+0000 7f02faffd700 1 -- 172.21.15.32:0/4238770043 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02fc01d470 con 0x7f03040d3730 2023-06-20T13:33:02.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.550+0000 7f0308bff700 1 -- 172.21.15.32:0/4238770043 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f030415d7b0 con 0x7f03040d3730 2023-06-20T13:33:02.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.550+0000 7f0308bff700 1 -- 172.21.15.32:0/4238770043 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03040c9080 con 0x7f03040d3730 2023-06-20T13:33:02.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.551+0000 7f0308bff700 1 -- 172.21.15.32:0/4238770043 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f030404ea60 con 0x7f03040d3730 2023-06-20T13:33:02.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.552+0000 7f02faffd700 1 -- 172.21.15.32:0/4238770043 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f02fc01d5d0 con 0x7f03040d3730 2023-06-20T13:33:02.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.553+0000 7f02faffd700 1 --2- 172.21.15.32:0/4238770043 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f02e406ace0 0x7f02e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:02.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.553+0000 7f02faffd700 1 -- 172.21.15.32:0/4238770043 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f02fc08b4e0 con 0x7f03040d3730 2023-06-20T13:33:02.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.554+0000 7f030259c700 1 --2- 172.21.15.32:0/4238770043 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f02e406ace0 0x7f02e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:02.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.554+0000 7f030259c700 1 --2- 172.21.15.32:0/4238770043 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f02e406ace0 0x7f02e406d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f02f40011e0 tx=0x7f02f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:02.560 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.558+0000 7f02faffd700 1 -- 172.21.15.32:0/4238770043 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f02fc059d00 con 0x7f03040d3730 2023-06-20T13:33:02.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.766+0000 7f0308bff700 1 -- 172.21.15.32:0/4238770043 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f03040c8980 con 0x7f03040d3730 2023-06-20T13:33:02.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.767+0000 7f02faffd700 1 -- 172.21.15.32:0/4238770043 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f02fc059890 con 0x7f03040d3730 2023-06-20T13:33:02.769 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-06-20T13:33:02.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.769+0000 7f0308bff700 1 -- 172.21.15.32:0/4238770043 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f02e406ace0 msgr2=0x7f02e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:02.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.769+0000 7f0308bff700 1 --2- 172.21.15.32:0/4238770043 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f02e406ace0 0x7f02e406d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f02f40011e0 tx=0x7f02f4009040 comp rx=0 tx=0).stop 2023-06-20T13:33:02.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.769+0000 7f0308bff700 1 -- 172.21.15.32:0/4238770043 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03040d3730 msgr2=0x7f03040b5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:02.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.769+0000 7f0308bff700 1 --2- 172.21.15.32:0/4238770043 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03040d3730 0x7f03040b5970 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f02fc009d90 tx=0x7f02fc004ad0 comp rx=0 tx=0).stop 2023-06-20T13:33:02.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.769+0000 7f0308bff700 1 -- 172.21.15.32:0/4238770043 shutdown_connections 2023-06-20T13:33:02.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.769+0000 7f0308bff700 1 --2- 172.21.15.32:0/4238770043 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f02e406ace0 0x7f02e406d190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:02.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.769+0000 7f0308bff700 1 --2- 172.21.15.32:0/4238770043 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f03040d3730 0x7f03040b5970 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:02.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.769+0000 7f0308bff700 1 --2- 172.21.15.32:0/4238770043 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f03040b8430 0x7f030415c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:02.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.769+0000 7f0308bff700 1 --2- 172.21.15.32:0/4238770043 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f03040cfc60 0x7f0304155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:02.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.769+0000 7f0308bff700 1 -- 172.21.15.32:0/4238770043 >> 172.21.15.32:0/4238770043 conn(0x7f030406b3f0 msgr2=0x7f03040cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:02.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.769+0000 7f0308bff700 1 -- 172.21.15.32:0/4238770043 shutdown_connections 2023-06-20T13:33:02.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.769+0000 7f0308bff700 1 -- 172.21.15.32:0/4238770043 wait complete. 2023-06-20T13:33:02.789 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-20T13:33:02.995 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.993+0000 7f2fc9dff700 1 Processor -- start 2023-06-20T13:33:02.995 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.993+0000 7f2fc9dff700 1 -- start start 2023-06-20T13:33:02.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.994+0000 7f2fc9dff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2fc40b12b0 0x7f2fc40ac420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:02.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.994+0000 7f2fc9dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fc40ac960 0x7f2fc4163c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:02.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.994+0000 7f2fc9dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc406d2b0 con 0x7f2fc415a190 2023-06-20T13:33:02.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.994+0000 7f2fc9dff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc415a560 con 0x7f2fc40b12b0 2023-06-20T13:33:02.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.994+0000 7f2fc9dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc406d590 con 0x7f2fc40ac960 2023-06-20T13:33:02.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.994+0000 7f2fc2ffd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2fc40b12b0 0x7f2fc40ac420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:02.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.994+0000 7f2fc3fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fc40ac960 0x7f2fc4163c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:02.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.994+0000 7f2fc37fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f2fc415a190 0x7f2fc406e350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.32:56198/0 (socket says 172.21.15.32:56198) 2023-06-20T13:33:02.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.994+0000 7f2fc37fe700 1 -- 172.21.15.32:0/2131180643 learned_addr learned my addr 172.21.15.32:0/2131180643 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:02.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.995+0000 7f2fc27fc700 1 -- 172.21.15.32:0/2131180643 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 299984703 0 0) 0x7f2fc406d2b0 con 0x7f2fc415a190 2023-06-20T13:33:02.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.995+0000 7f2fc27fc700 1 -- 172.21.15.32:0/2131180643 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fac0035b0 con 0x7f2fc415a190 2023-06-20T13:33:02.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.995+0000 7f2fc3fff700 1 -- 172.21.15.32:0/2131180643 >> v2:172.21.15.32:3300/0 conn(0x7f2fc40b12b0 msgr2=0x7f2fc40ac420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:02.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.995+0000 7f2fc3fff700 1 --2- 172.21.15.32:0/2131180643 >> v2:172.21.15.32:3300/0 conn(0x7f2fc40b12b0 0x7f2fc40ac420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:02.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.995+0000 7f2fc3fff700 1 -- 172.21.15.32:0/2131180643 >> v1:172.21.15.115:6789/0 conn(0x7f2fc415a190 legacy=0x7f2fc406e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:02.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.995+0000 7f2fc3fff700 1 -- 172.21.15.32:0/2131180643 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc406d870 con 0x7f2fc40ac960 2023-06-20T13:33:02.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.995+0000 7f2fc2ffd700 1 --2- 172.21.15.32:0/2131180643 >> v2:172.21.15.32:3300/0 conn(0x7f2fc40b12b0 0x7f2fc40ac420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:33:03.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.995+0000 7f2fc3fff700 1 --2- 172.21.15.32:0/2131180643 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fc40ac960 0x7f2fc4163c90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc009d90 tx=0x7f2fbc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fae17a7166d94cc9 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:03.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.995+0000 7f2fc27fc700 1 -- 172.21.15.32:0/2131180643 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc00e070 con 0x7f2fc40ac960 2023-06-20T13:33:03.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.995+0000 7f2fc27fc700 1 -- 172.21.15.32:0/2131180643 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fbc00bb20 con 0x7f2fc40ac960 2023-06-20T13:33:03.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.995+0000 7f2fc27fc700 1 -- 172.21.15.32:0/2131180643 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc012430 con 0x7f2fc40ac960 2023-06-20T13:33:03.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.996+0000 7f2fc9dff700 1 -- 172.21.15.32:0/2131180643 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fc40ac960 msgr2=0x7f2fc4163c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:03.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.996+0000 7f2fc9dff700 1 --2- 172.21.15.32:0/2131180643 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fc40ac960 0x7f2fc4163c90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc009d90 tx=0x7f2fbc00b330 comp rx=0 tx=0).stop 2023-06-20T13:33:03.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.996+0000 7f2fc9dff700 1 -- 172.21.15.32:0/2131180643 shutdown_connections 2023-06-20T13:33:03.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.996+0000 7f2fc9dff700 1 --2- 172.21.15.32:0/2131180643 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fc40ac960 0x7f2fc4163c90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:03.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.996+0000 7f2fc9dff700 1 --2- 172.21.15.32:0/2131180643 >> v2:172.21.15.32:3300/0 conn(0x7f2fc40b12b0 0x7f2fc40ac420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:03.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.996+0000 7f2fc9dff700 1 -- 172.21.15.32:0/2131180643 >> 172.21.15.32:0/2131180643 conn(0x7f2fc4098b50 msgr2=0x7f2fc406b960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:03.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.996+0000 7f2fc9dff700 1 -- 172.21.15.32:0/2131180643 shutdown_connections 2023-06-20T13:33:03.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.996+0000 7f2fc9dff700 1 -- 172.21.15.32:0/2131180643 wait complete. 2023-06-20T13:33:03.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.999+0000 7f2fc9dff700 1 Processor -- start 2023-06-20T13:33:03.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:02.999+0000 7f2fc9dff700 1 -- start start 2023-06-20T13:33:03.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.000+0000 7f2fc9dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fc40ac960 0x7f2fc4151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:03.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.000+0000 7f2fc9dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fc40b12b0 0x7f2fc40c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:03.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.000+0000 7f2fc9dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fc415a190 0x7f2fc40c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:03.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.000+0000 7f2fc9dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc40c4d90 con 0x7f2fc40b12b0 2023-06-20T13:33:03.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.000+0000 7f2fc9dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc40c5d30 con 0x7f2fc415a190 2023-06-20T13:33:03.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.000+0000 7f2fc9dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc40c75b0 con 0x7f2fc40ac960 2023-06-20T13:33:03.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.000+0000 7f2fc2ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fc40b12b0 0x7f2fc40c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:03.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.000+0000 7f2fc2ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fc40b12b0 0x7f2fc40c52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51412/0 (socket says 172.21.15.32:51412) 2023-06-20T13:33:03.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.000+0000 7f2fc2ffd700 1 -- 172.21.15.32:0/210828229 learned_addr learned my addr 172.21.15.32:0/210828229 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:03.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.001+0000 7f2fc37fe700 1 --2- 172.21.15.32:0/210828229 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fc40ac960 0x7f2fc4151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:03.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.001+0000 7f2fc3fff700 1 --2- 172.21.15.32:0/210828229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fc415a190 0x7f2fc40c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:03.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.001+0000 7f2fc2ffd700 1 -- 172.21.15.32:0/210828229 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fc40ac960 msgr2=0x7f2fc4151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:03.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.001+0000 7f2fc2ffd700 1 --2- 172.21.15.32:0/210828229 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fc40ac960 0x7f2fc4151400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:03.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.001+0000 7f2fc2ffd700 1 -- 172.21.15.32:0/210828229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fc415a190 msgr2=0x7f2fc40c57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:03.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.001+0000 7f2fc2ffd700 1 --2- 172.21.15.32:0/210828229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fc415a190 0x7f2fc40c57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:03.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.001+0000 7f2fc2ffd700 1 -- 172.21.15.32:0/210828229 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb80094a0 con 0x7f2fc40b12b0 2023-06-20T13:33:03.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.001+0000 7f2fc2ffd700 1 --2- 172.21.15.32:0/210828229 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fc40b12b0 0x7f2fc40c52b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800ebe0 tx=0x7f2fb800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:03.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.001+0000 7f2fabfff700 1 -- 172.21.15.32:0/210828229 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8009760 con 0x7f2fc40b12b0 2023-06-20T13:33:03.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.001+0000 7f2fabfff700 1 -- 172.21.15.32:0/210828229 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb800c850 con 0x7f2fc40b12b0 2023-06-20T13:33:03.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.001+0000 7f2fabfff700 1 -- 172.21.15.32:0/210828229 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb800cbe0 con 0x7f2fc40b12b0 2023-06-20T13:33:03.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.001+0000 7f2fc9dff700 1 -- 172.21.15.32:0/210828229 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fbc009a70 con 0x7f2fc40b12b0 2023-06-20T13:33:03.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.002+0000 7f2fc9dff700 1 -- 172.21.15.32:0/210828229 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc40c7940 con 0x7f2fc40b12b0 2023-06-20T13:33:03.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.003+0000 7f2fc9dff700 1 -- 172.21.15.32:0/210828229 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc4070c90 con 0x7f2fc40b12b0 2023-06-20T13:33:03.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.004+0000 7f2fabfff700 1 -- 172.21.15.32:0/210828229 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2fb800cd40 con 0x7f2fc40b12b0 2023-06-20T13:33:03.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.005+0000 7f2fabfff700 1 --2- 172.21.15.32:0/210828229 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f2fb006ace0 0x7f2fb006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:03.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.005+0000 7f2fabfff700 1 -- 172.21.15.32:0/210828229 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2fb8089830 con 0x7f2fc40b12b0 2023-06-20T13:33:03.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.005+0000 7f2fc37fe700 1 --2- 172.21.15.32:0/210828229 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f2fb006ace0 0x7f2fb006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:03.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.006+0000 7f2fc37fe700 1 --2- 172.21.15.32:0/210828229 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f2fb006ace0 0x7f2fb006d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4001230 tx=0x7f2fb4007df0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:03.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.010+0000 7f2fabfff700 1 -- 172.21.15.32:0/210828229 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2fb8054510 con 0x7f2fc40b12b0 2023-06-20T13:33:03.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.214+0000 7f2fc9dff700 1 -- 172.21.15.32:0/210828229 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2fc40c9e90 con 0x7f2fc40b12b0 2023-06-20T13:33:03.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.215+0000 7f2fabfff700 1 -- 172.21.15.32:0/210828229 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2fb8057b30 con 0x7f2fc40b12b0 2023-06-20T13:33:03.217 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-06-20T13:33:03.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.217+0000 7f2fc9dff700 1 -- 172.21.15.32:0/210828229 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f2fb006ace0 msgr2=0x7f2fb006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:03.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.217+0000 7f2fc9dff700 1 --2- 172.21.15.32:0/210828229 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f2fb006ace0 0x7f2fb006d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4001230 tx=0x7f2fb4007df0 comp rx=0 tx=0).stop 2023-06-20T13:33:03.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.217+0000 7f2fc9dff700 1 -- 172.21.15.32:0/210828229 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fc40b12b0 msgr2=0x7f2fc40c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:03.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.217+0000 7f2fc9dff700 1 --2- 172.21.15.32:0/210828229 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fc40b12b0 0x7f2fc40c52b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800ebe0 tx=0x7f2fb800eef0 comp rx=0 tx=0).stop 2023-06-20T13:33:03.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.217+0000 7f2fc9dff700 1 -- 172.21.15.32:0/210828229 shutdown_connections 2023-06-20T13:33:03.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.217+0000 7f2fc9dff700 1 --2- 172.21.15.32:0/210828229 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f2fb006ace0 0x7f2fb006d190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:03.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.217+0000 7f2fc9dff700 1 --2- 172.21.15.32:0/210828229 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fc415a190 0x7f2fc40c57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:03.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.217+0000 7f2fc9dff700 1 --2- 172.21.15.32:0/210828229 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fc40ac960 0x7f2fc4151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:03.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.217+0000 7f2fc9dff700 1 --2- 172.21.15.32:0/210828229 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fc40b12b0 0x7f2fc40c52b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:03.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.217+0000 7f2fc9dff700 1 -- 172.21.15.32:0/210828229 >> 172.21.15.32:0/210828229 conn(0x7f2fc4098b50 msgr2=0x7f2fc40af290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:03.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.218+0000 7f2fc9dff700 1 -- 172.21.15.32:0/210828229 shutdown_connections 2023-06-20T13:33:03.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.218+0000 7f2fc9dff700 1 -- 172.21.15.32:0/210828229 wait complete. 2023-06-20T13:33:03.238 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-20T13:33:03.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.436+0000 7fdd9ffff700 1 Processor -- start 2023-06-20T13:33:03.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.436+0000 7fdd9ffff700 1 -- start start 2023-06-20T13:33:03.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.437+0000 7fdd9ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd9815c350 0x7fdd980cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:03.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.437+0000 7fdd9ffff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdd980cf410 0x7fdd980cf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:03.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.437+0000 7fdd9ffff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd980b54e0 con 0x7fdd980d0640 2023-06-20T13:33:03.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.437+0000 7fdd9ffff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd980cf040 con 0x7fdd980cf410 2023-06-20T13:33:03.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.437+0000 7fdd9ffff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd980cfdc0 con 0x7fdd9815c350 2023-06-20T13:33:03.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.438+0000 7fdd9e59c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fdd980d0640 0x7fdd980d0a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55690/0 (socket says 172.21.15.32:55690) 2023-06-20T13:33:03.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.438+0000 7fdd9e59c700 1 -- 172.21.15.32:0/3965362636 learned_addr learned my addr 172.21.15.32:0/3965362636 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:03.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.438+0000 7fdd9d59a700 1 --2- 172.21.15.32:0/3965362636 >> v2:172.21.15.115:3300/0 conn(0x7fdd980cf410 0x7fdd980cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:03.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.438+0000 7fdd9dd9b700 1 --2- 172.21.15.32:0/3965362636 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd9815c350 0x7fdd980cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:03.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.438+0000 7fdd9cd99700 1 -- 172.21.15.32:0/3965362636 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 468700177 0 0) 0x7fdd980b54e0 con 0x7fdd980d0640 2023-06-20T13:33:03.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.438+0000 7fdd9cd99700 1 -- 172.21.15.32:0/3965362636 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd840035b0 con 0x7fdd980d0640 2023-06-20T13:33:03.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.438+0000 7fdd9dd9b700 1 -- 172.21.15.32:0/3965362636 >> v2:172.21.15.115:3300/0 conn(0x7fdd980cf410 msgr2=0x7fdd980cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:03.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.438+0000 7fdd9dd9b700 1 --2- 172.21.15.32:0/3965362636 >> v2:172.21.15.115:3300/0 conn(0x7fdd980cf410 0x7fdd980cf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:03.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.438+0000 7fdd9dd9b700 1 -- 172.21.15.32:0/3965362636 >> v1:172.21.15.32:6789/0 conn(0x7fdd980d0640 legacy=0x7fdd980d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:03.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.438+0000 7fdd9dd9b700 1 -- 172.21.15.32:0/3965362636 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd980b4f20 con 0x7fdd9815c350 2023-06-20T13:33:03.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.438+0000 7fdd9d59a700 1 --2- 172.21.15.32:0/3965362636 >> v2:172.21.15.115:3300/0 conn(0x7fdd980cf410 0x7fdd980cf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:33:03.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.439+0000 7fdd9dd9b700 1 --2- 172.21.15.32:0/3965362636 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd9815c350 0x7fdd980cd0c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdd94009840 tx=0x7fdd94009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62465bfd696abb2e server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:03.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.439+0000 7fdd9cd99700 1 -- 172.21.15.32:0/3965362636 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd94011830 con 0x7fdd9815c350 2023-06-20T13:33:03.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.439+0000 7fdd9cd99700 1 -- 172.21.15.32:0/3965362636 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd94011990 con 0x7fdd9815c350 2023-06-20T13:33:03.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.439+0000 7fdd9cd99700 1 -- 172.21.15.32:0/3965362636 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd94011d20 con 0x7fdd9815c350 2023-06-20T13:33:03.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.439+0000 7fdd9ffff700 1 -- 172.21.15.32:0/3965362636 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd9815c350 msgr2=0x7fdd980cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:03.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.439+0000 7fdd9ffff700 1 --2- 172.21.15.32:0/3965362636 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd9815c350 0x7fdd980cd0c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdd94009840 tx=0x7fdd94009b50 comp rx=0 tx=0).stop 2023-06-20T13:33:03.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.439+0000 7fdd9ffff700 1 -- 172.21.15.32:0/3965362636 shutdown_connections 2023-06-20T13:33:03.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.439+0000 7fdd9ffff700 1 --2- 172.21.15.32:0/3965362636 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd9815c350 0x7fdd980cd0c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:03.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.439+0000 7fdd9ffff700 1 --2- 172.21.15.32:0/3965362636 >> v2:172.21.15.115:3300/0 conn(0x7fdd980cf410 0x7fdd980cf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:03.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.439+0000 7fdd9ffff700 1 -- 172.21.15.32:0/3965362636 >> 172.21.15.32:0/3965362636 conn(0x7fdd98071660 msgr2=0x7fdd98071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:03.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.440+0000 7fdd9ffff700 1 -- 172.21.15.32:0/3965362636 shutdown_connections 2023-06-20T13:33:03.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.440+0000 7fdd9ffff700 1 -- 172.21.15.32:0/3965362636 wait complete. 2023-06-20T13:33:03.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.441+0000 7fdd9ffff700 1 Processor -- start 2023-06-20T13:33:03.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.441+0000 7fdd9ffff700 1 -- start start 2023-06-20T13:33:03.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.442+0000 7fdd9ffff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd980cf410 0x7fdd98153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:03.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.442+0000 7fdd9ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd980d0640 0x7fdd9815a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:03.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.442+0000 7fdd9ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd9815a5b0 0x7fdd980cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:03.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.442+0000 7fdd9ffff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9815f5d0 con 0x7fdd9815a5b0 2023-06-20T13:33:03.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.442+0000 7fdd9ffff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9815aa30 con 0x7fdd980cf410 2023-06-20T13:33:03.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.442+0000 7fdd9ffff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd980cc980 con 0x7fdd980d0640 2023-06-20T13:33:03.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.443+0000 7fdd9e59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd9815a5b0 0x7fdd980cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:03.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.443+0000 7fdd9e59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd9815a5b0 0x7fdd980cacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51414/0 (socket says 172.21.15.32:51414) 2023-06-20T13:33:03.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.443+0000 7fdd9e59c700 1 -- 172.21.15.32:0/2517935262 learned_addr learned my addr 172.21.15.32:0/2517935262 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:03.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.443+0000 7fdd9dd9b700 1 --2- 172.21.15.32:0/2517935262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd980cf410 0x7fdd98153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:03.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.443+0000 7fdd9d59a700 1 --2- 172.21.15.32:0/2517935262 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd980d0640 0x7fdd9815a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:03.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.443+0000 7fdd9e59c700 1 -- 172.21.15.32:0/2517935262 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd980d0640 msgr2=0x7fdd9815a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:03.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.443+0000 7fdd9e59c700 1 --2- 172.21.15.32:0/2517935262 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd980d0640 0x7fdd9815a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:03.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.443+0000 7fdd9e59c700 1 -- 172.21.15.32:0/2517935262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd980cf410 msgr2=0x7fdd98153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:03.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.443+0000 7fdd9e59c700 1 --2- 172.21.15.32:0/2517935262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd980cf410 0x7fdd98153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:03.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.443+0000 7fdd9e59c700 1 -- 172.21.15.32:0/2517935262 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd880094a0 con 0x7fdd9815a5b0 2023-06-20T13:33:03.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.443+0000 7fdd9e59c700 1 --2- 172.21.15.32:0/2517935262 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd9815a5b0 0x7fdd980cacb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdd9000caa0 tx=0x7fdd9000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:03.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.444+0000 7fdd8e7fc700 1 -- 172.21.15.32:0/2517935262 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9000aa80 con 0x7fdd9815a5b0 2023-06-20T13:33:03.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.444+0000 7fdd8e7fc700 1 -- 172.21.15.32:0/2517935262 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9000abe0 con 0x7fdd9815a5b0 2023-06-20T13:33:03.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.444+0000 7fdd8e7fc700 1 -- 172.21.15.32:0/2517935262 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd90012400 con 0x7fdd9815a5b0 2023-06-20T13:33:03.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.444+0000 7fdd9ffff700 1 -- 172.21.15.32:0/2517935262 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd940094a0 con 0x7fdd9815a5b0 2023-06-20T13:33:03.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.444+0000 7fdd9ffff700 1 -- 172.21.15.32:0/2517935262 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd980cbbc0 con 0x7fdd9815a5b0 2023-06-20T13:33:03.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.445+0000 7fdd9ffff700 1 -- 172.21.15.32:0/2517935262 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd9804ea60 con 0x7fdd9815a5b0 2023-06-20T13:33:03.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.446+0000 7fdd8e7fc700 1 -- 172.21.15.32:0/2517935262 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdd9001b3b0 con 0x7fdd9815a5b0 2023-06-20T13:33:03.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.447+0000 7fdd8e7fc700 1 --2- 172.21.15.32:0/2517935262 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdd7c06ace0 0x7fdd7c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:03.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.447+0000 7fdd8e7fc700 1 -- 172.21.15.32:0/2517935262 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdd90089590 con 0x7fdd9815a5b0 2023-06-20T13:33:03.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.447+0000 7fdd9dd9b700 1 --2- 172.21.15.32:0/2517935262 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdd7c06ace0 0x7fdd7c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:03.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.448+0000 7fdd9dd9b700 1 --2- 172.21.15.32:0/2517935262 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdd7c06ace0 0x7fdd7c06d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdd94000c00 tx=0x7fdd94008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:03.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.451+0000 7fdd8e7fc700 1 -- 172.21.15.32:0/2517935262 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdd90054300 con 0x7fdd9815a5b0 2023-06-20T13:33:03.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.700+0000 7fdd9ffff700 1 -- 172.21.15.32:0/2517935262 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd980b2020 con 0x7fdd9815a5b0 2023-06-20T13:33:03.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.700+0000 7fdd8e7fc700 1 -- 172.21.15.32:0/2517935262 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4670 (secure 0 0 0) 0x7fdd90057920 con 0x7fdd9815a5b0 2023-06-20T13:33:03.703 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:33:03.703 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2171664589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2171664589},{"type":"v1","addr":"172.21.15.115:6834","nonce":2171664589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/959333888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":959333888},{"type":"v1","addr":"172.21.15.32:6837","nonce":959333888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3388117179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":3388117179},{"type":"v1","addr":"172.21.15.32:6835","nonce":3388117179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-20T13:32:20.527725+0000","modified":"2023-06-20T13:32:49.006923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3566362693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3566362693},{"type":"v1","addr":"172.21.15.115:6835","nonce":3566362693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-20T13:33:03.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.703+0000 7fdd9ffff700 1 -- 172.21.15.32:0/2517935262 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdd7c06ace0 msgr2=0x7fdd7c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:03.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.703+0000 7fdd9ffff700 1 --2- 172.21.15.32:0/2517935262 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdd7c06ace0 0x7fdd7c06d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdd94000c00 tx=0x7fdd94008030 comp rx=0 tx=0).stop 2023-06-20T13:33:03.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.703+0000 7fdd9ffff700 1 -- 172.21.15.32:0/2517935262 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd9815a5b0 msgr2=0x7fdd980cacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:03.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.703+0000 7fdd9ffff700 1 --2- 172.21.15.32:0/2517935262 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd9815a5b0 0x7fdd980cacb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdd9000caa0 tx=0x7fdd9000ce60 comp rx=0 tx=0).stop 2023-06-20T13:33:03.705 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.703+0000 7fdd9ffff700 1 -- 172.21.15.32:0/2517935262 shutdown_connections 2023-06-20T13:33:03.706 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.703+0000 7fdd9ffff700 1 --2- 172.21.15.32:0/2517935262 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdd7c06ace0 0x7fdd7c06d190 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:03.706 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.703+0000 7fdd9ffff700 1 --2- 172.21.15.32:0/2517935262 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd9815a5b0 0x7fdd980cacb0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:03.706 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.703+0000 7fdd9ffff700 1 --2- 172.21.15.32:0/2517935262 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd980cf410 0x7fdd98153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:03.706 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.703+0000 7fdd9ffff700 1 --2- 172.21.15.32:0/2517935262 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd980d0640 0x7fdd9815a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:03.706 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.703+0000 7fdd9ffff700 1 -- 172.21.15.32:0/2517935262 >> 172.21.15.32:0/2517935262 conn(0x7fdd98071660 msgr2=0x7fdd980b3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:03.706 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.703+0000 7fdd9ffff700 1 -- 172.21.15.32:0/2517935262 shutdown_connections 2023-06-20T13:33:03.706 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.703+0000 7fdd9ffff700 1 -- 172.21.15.32:0/2517935262 wait complete. 2023-06-20T13:33:03.707 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2023-06-20T13:33:03.723 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:33:03.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.921+0000 7fa6d31ff700 1 Processor -- start 2023-06-20T13:33:03.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.921+0000 7fa6d31ff700 1 -- start start 2023-06-20T13:33:03.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.922+0000 7fa6d31ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6cc15c290 0x7fa6cc0ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:03.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.922+0000 7fa6d31ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa6cc0cef10 0x7fa6cc069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:03.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.922+0000 7fa6d31ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6cc0cdad0 con 0x7fa6cc0cf360 2023-06-20T13:33:03.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.922+0000 7fa6d31ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6cc0725c0 con 0x7fa6cc0cef10 2023-06-20T13:33:03.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.922+0000 7fa6d31ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc0abdf0 con 0x7fa6cc15c290 2023-06-20T13:33:03.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.922+0000 7fa6d179c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa6cc0cf360 0x7fa6cc06f260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55698/0 (socket says 172.21.15.32:55698) 2023-06-20T13:33:03.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.922+0000 7fa6d179c700 1 -- 172.21.15.32:0/4262713954 learned_addr learned my addr 172.21.15.32:0/4262713954 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:03.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.922+0000 7fa6cbfff700 1 --2- 172.21.15.32:0/4262713954 >> v2:172.21.15.115:3300/0 conn(0x7fa6cc0cef10 0x7fa6cc069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:03.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.922+0000 7fa6d0f9b700 1 --2- 172.21.15.32:0/4262713954 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6cc15c290 0x7fa6cc0ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:03.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.923+0000 7fa6cb7fe700 1 -- 172.21.15.32:0/4262713954 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 993519802 0 0) 0x7fa6cc0cdad0 con 0x7fa6cc0cf360 2023-06-20T13:33:03.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.923+0000 7fa6cb7fe700 1 -- 172.21.15.32:0/4262713954 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6bc0035b0 con 0x7fa6cc0cf360 2023-06-20T13:33:03.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.923+0000 7fa6cbfff700 1 -- 172.21.15.32:0/4262713954 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6cc15c290 msgr2=0x7fa6cc0ab8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:03.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.923+0000 7fa6cbfff700 1 --2- 172.21.15.32:0/4262713954 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6cc15c290 0x7fa6cc0ab8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:03.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.923+0000 7fa6cbfff700 1 -- 172.21.15.32:0/4262713954 >> v1:172.21.15.32:6789/0 conn(0x7fa6cc0cf360 legacy=0x7fa6cc06f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:03.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.923+0000 7fa6cbfff700 1 -- 172.21.15.32:0/4262713954 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6cc0cd550 con 0x7fa6cc0cef10 2023-06-20T13:33:03.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.923+0000 7fa6cbfff700 1 --2- 172.21.15.32:0/4262713954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6cc0cef10 0x7fa6cc069f30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8009840 tx=0x7fa6b8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70971857dd23cd2c server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:03.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.923+0000 7fa6cb7fe700 1 -- 172.21.15.32:0/4262713954 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b8011830 con 0x7fa6cc0cef10 2023-06-20T13:33:03.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.924+0000 7fa6cb7fe700 1 -- 172.21.15.32:0/4262713954 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b8011990 con 0x7fa6cc0cef10 2023-06-20T13:33:03.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.924+0000 7fa6cb7fe700 1 -- 172.21.15.32:0/4262713954 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b8011d20 con 0x7fa6cc0cef10 2023-06-20T13:33:03.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.924+0000 7fa6d31ff700 1 -- 172.21.15.32:0/4262713954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6cc0cef10 msgr2=0x7fa6cc069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:03.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.924+0000 7fa6d31ff700 1 --2- 172.21.15.32:0/4262713954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6cc0cef10 0x7fa6cc069f30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8009840 tx=0x7fa6b8009b50 comp rx=0 tx=0).stop 2023-06-20T13:33:03.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.924+0000 7fa6d31ff700 1 -- 172.21.15.32:0/4262713954 shutdown_connections 2023-06-20T13:33:03.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.924+0000 7fa6d31ff700 1 --2- 172.21.15.32:0/4262713954 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6cc15c290 0x7fa6cc0ab8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:03.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.924+0000 7fa6d31ff700 1 --2- 172.21.15.32:0/4262713954 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6cc0cef10 0x7fa6cc069f30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:03.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.924+0000 7fa6d31ff700 1 -- 172.21.15.32:0/4262713954 >> 172.21.15.32:0/4262713954 conn(0x7fa6cc06d450 msgr2=0x7fa6cc06d850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:03.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.924+0000 7fa6d31ff700 1 -- 172.21.15.32:0/4262713954 shutdown_connections 2023-06-20T13:33:03.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.924+0000 7fa6d31ff700 1 -- 172.21.15.32:0/4262713954 wait complete. 2023-06-20T13:33:03.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.926+0000 7fa6d31ff700 1 Processor -- start 2023-06-20T13:33:03.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.926+0000 7fa6d31ff700 1 -- start start 2023-06-20T13:33:03.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.927+0000 7fa6d31ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6cc0cef10 0x7fa6cc156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:03.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.927+0000 7fa6d31ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6cc0cf360 0x7fa6cc0b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:03.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.927+0000 7fa6d31ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6cc15c290 0x7fa6cc156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:03.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.927+0000 7fa6d31ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc0c32e0 con 0x7fa6cc0cf360 2023-06-20T13:33:03.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.927+0000 7fa6d31ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc0c35c0 con 0x7fa6cc15c290 2023-06-20T13:33:03.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.927+0000 7fa6d31ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc0b2f80 con 0x7fa6cc0cef10 2023-06-20T13:33:03.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.927+0000 7fa6cbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6cc0cf360 0x7fa6cc0b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:03.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.927+0000 7fa6cbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6cc0cf360 0x7fa6cc0b2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51416/0 (socket says 172.21.15.32:51416) 2023-06-20T13:33:03.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.927+0000 7fa6cbfff700 1 -- 172.21.15.32:0/2895230573 learned_addr learned my addr 172.21.15.32:0/2895230573 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:03.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.928+0000 7fa6d0f9b700 1 --2- 172.21.15.32:0/2895230573 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6cc0cef10 0x7fa6cc156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:03.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.928+0000 7fa6d179c700 1 --2- 172.21.15.32:0/2895230573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6cc15c290 0x7fa6cc156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:03.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.928+0000 7fa6cbfff700 1 -- 172.21.15.32:0/2895230573 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6cc0cef10 msgr2=0x7fa6cc156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:03.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.928+0000 7fa6cbfff700 1 --2- 172.21.15.32:0/2895230573 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6cc0cef10 0x7fa6cc156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:03.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.928+0000 7fa6cbfff700 1 -- 172.21.15.32:0/2895230573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6cc15c290 msgr2=0x7fa6cc156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:03.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.928+0000 7fa6cbfff700 1 --2- 172.21.15.32:0/2895230573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6cc15c290 0x7fa6cc156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:03.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.928+0000 7fa6cbfff700 1 -- 172.21.15.32:0/2895230573 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b80094a0 con 0x7fa6cc0cf360 2023-06-20T13:33:03.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.928+0000 7fa6d0f9b700 1 --2- 172.21.15.32:0/2895230573 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6cc0cef10 0x7fa6cc156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:03.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.928+0000 7fa6d179c700 1 --2- 172.21.15.32:0/2895230573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6cc15c290 0x7fa6cc156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:03.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.928+0000 7fa6cbfff700 1 --2- 172.21.15.32:0/2895230573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6cc0cf360 0x7fa6cc0b2610 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8000c00 tx=0x7fa6b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:03.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.928+0000 7fa6c97fa700 1 -- 172.21.15.32:0/2895230573 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b80036a0 con 0x7fa6cc0cf360 2023-06-20T13:33:03.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.928+0000 7fa6c97fa700 1 -- 172.21.15.32:0/2895230573 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b801f070 con 0x7fa6cc0cf360 2023-06-20T13:33:03.935 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.928+0000 7fa6c97fa700 1 -- 172.21.15.32:0/2895230573 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b8003a60 con 0x7fa6cc0cf360 2023-06-20T13:33:03.935 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.928+0000 7fa6d31ff700 1 -- 172.21.15.32:0/2895230573 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6cc0b3260 con 0x7fa6cc0cf360 2023-06-20T13:33:03.935 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.929+0000 7fa6d31ff700 1 -- 172.21.15.32:0/2895230573 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6cc1565b0 con 0x7fa6cc0cf360 2023-06-20T13:33:03.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.930+0000 7fa6d31ff700 1 -- 172.21.15.32:0/2895230573 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6cc04ea60 con 0x7fa6cc0cf360 2023-06-20T13:33:03.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.930+0000 7fa6c97fa700 1 -- 172.21.15.32:0/2895230573 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa6b8003bc0 con 0x7fa6cc0cf360 2023-06-20T13:33:03.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.931+0000 7fa6c97fa700 1 --2- 172.21.15.32:0/2895230573 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa6b006ace0 0x7fa6b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:03.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.932+0000 7fa6c97fa700 1 -- 172.21.15.32:0/2895230573 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa6b8021070 con 0x7fa6cc0cf360 2023-06-20T13:33:03.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.932+0000 7fa6d0f9b700 1 --2- 172.21.15.32:0/2895230573 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa6b006ace0 0x7fa6b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:03.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.932+0000 7fa6d0f9b700 1 --2- 172.21.15.32:0/2895230573 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa6b006ace0 0x7fa6b006d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0009b90 tx=0x7fa6c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:03.938 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:03.936+0000 7fa6c97fa700 1 -- 172.21.15.32:0/2895230573 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa6b8055db0 con 0x7fa6cc0cf360 2023-06-20T13:33:04.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.143+0000 7fa6d31ff700 1 -- 172.21.15.32:0/2895230573 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6cc0c3700 con 0x7fa6cc0cf360 2023-06-20T13:33:04.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.145+0000 7fa6c97fa700 1 -- 172.21.15.32:0/2895230573 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20191 (secure 0 0 0) 0x7fa6b80593d0 con 0x7fa6cc0cf360 2023-06-20T13:33:04.147 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:33:04.147 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":29,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:33:00.976862+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-20T13:32:18.120021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-20T13:32:19.503624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-20T13:32:23.074912+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:33:04.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.147+0000 7fa6d31ff700 1 -- 172.21.15.32:0/2895230573 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa6b006ace0 msgr2=0x7fa6b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:04.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.147+0000 7fa6d31ff700 1 --2- 172.21.15.32:0/2895230573 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa6b006ace0 0x7fa6b006d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0009b90 tx=0x7fa6c0008040 comp rx=0 tx=0).stop 2023-06-20T13:33:04.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.147+0000 7fa6d31ff700 1 -- 172.21.15.32:0/2895230573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6cc0cf360 msgr2=0x7fa6cc0b2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:04.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.147+0000 7fa6d31ff700 1 --2- 172.21.15.32:0/2895230573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6cc0cf360 0x7fa6cc0b2610 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8000c00 tx=0x7fa6b8004750 comp rx=0 tx=0).stop 2023-06-20T13:33:04.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.147+0000 7fa6d31ff700 1 -- 172.21.15.32:0/2895230573 shutdown_connections 2023-06-20T13:33:04.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.147+0000 7fa6d31ff700 1 --2- 172.21.15.32:0/2895230573 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa6b006ace0 0x7fa6b006d190 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:04.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.147+0000 7fa6d31ff700 1 --2- 172.21.15.32:0/2895230573 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6cc15c290 0x7fa6cc156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:04.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.147+0000 7fa6d31ff700 1 --2- 172.21.15.32:0/2895230573 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6cc0cef10 0x7fa6cc156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:04.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.147+0000 7fa6d31ff700 1 --2- 172.21.15.32:0/2895230573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6cc0cf360 0x7fa6cc0b2610 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:04.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.147+0000 7fa6d31ff700 1 -- 172.21.15.32:0/2895230573 >> 172.21.15.32:0/2895230573 conn(0x7fa6cc06d450 msgr2=0x7fa6cc069f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:04.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.147+0000 7fa6d31ff700 1 -- 172.21.15.32:0/2895230573 shutdown_connections 2023-06-20T13:33:04.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.147+0000 7fa6d31ff700 1 -- 172.21.15.32:0/2895230573 wait complete. 2023-06-20T13:33:04.167 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-20T13:33:04.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.365+0000 7f55e8dff700 1 Processor -- start 2023-06-20T13:33:04.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.365+0000 7f55e8dff700 1 -- start start 2023-06-20T13:33:04.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.366+0000 7f55e8dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f55e40d2640 0x7f55e40b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:04.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.366+0000 7f55e8dff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f55e40cf8f0 0x7f55e415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:04.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.366+0000 7f55e8dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e40d1790 con 0x7f55e415c460 2023-06-20T13:33:04.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.366+0000 7f55e8dff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55e40cedd0 con 0x7f55e40cf8f0 2023-06-20T13:33:04.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.366+0000 7f55e8dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55e40cd950 con 0x7f55e40d2640 2023-06-20T13:33:04.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.367+0000 7f55e2d9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f55e40cf8f0 0x7f55e415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:04.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.367+0000 7f55e2d9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f55e40cf8f0 0x7f55e415fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51430/0 (socket says 172.21.15.32:51430) 2023-06-20T13:33:04.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.367+0000 7f55e1d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f55e40d2640 0x7f55e40b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:04.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.367+0000 7f55e2d9d700 1 -- 172.21.15.32:0/4005729908 learned_addr learned my addr 172.21.15.32:0/4005729908 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:04.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.367+0000 7f55e2d9d700 1 -- 172.21.15.32:0/4005729908 >> v2:172.21.15.115:3300/0 conn(0x7f55e40d2640 msgr2=0x7f55e40b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:04.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.367+0000 7f55e2d9d700 1 --2- 172.21.15.32:0/4005729908 >> v2:172.21.15.115:3300/0 conn(0x7f55e40d2640 0x7f55e40b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:04.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.367+0000 7f55e2d9d700 1 -- 172.21.15.32:0/4005729908 >> v1:172.21.15.115:6789/0 conn(0x7f55e415c460 legacy=0x7f55e40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:04.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.367+0000 7f55e2d9d700 1 -- 172.21.15.32:0/4005729908 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e40d14b0 con 0x7f55e40cf8f0 2023-06-20T13:33:04.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.367+0000 7f55e2d9d700 1 --2- 172.21.15.32:0/4005729908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55e40cf8f0 0x7f55e415fe20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f55e415fd80 tx=0x7f55dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a10132c42755aaff server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:04.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.368+0000 7f55e159a700 1 -- 172.21.15.32:0/4005729908 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55dc00e070 con 0x7f55e40cf8f0 2023-06-20T13:33:04.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.368+0000 7f55e159a700 1 -- 172.21.15.32:0/4005729908 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55dc00b910 con 0x7f55e40cf8f0 2023-06-20T13:33:04.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.368+0000 7f55e159a700 1 -- 172.21.15.32:0/4005729908 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55dc00bcc0 con 0x7f55e40cf8f0 2023-06-20T13:33:04.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.368+0000 7f55e8dff700 1 -- 172.21.15.32:0/4005729908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55e40cf8f0 msgr2=0x7f55e415fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:04.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.368+0000 7f55e8dff700 1 --2- 172.21.15.32:0/4005729908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55e40cf8f0 0x7f55e415fe20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f55e415fd80 tx=0x7f55dc00b330 comp rx=0 tx=0).stop 2023-06-20T13:33:04.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.368+0000 7f55e8dff700 1 -- 172.21.15.32:0/4005729908 shutdown_connections 2023-06-20T13:33:04.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.368+0000 7f55e8dff700 1 --2- 172.21.15.32:0/4005729908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55e40cf8f0 0x7f55e415fe20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:04.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.368+0000 7f55e8dff700 1 --2- 172.21.15.32:0/4005729908 >> v2:172.21.15.115:3300/0 conn(0x7f55e40d2640 0x7f55e40b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:04.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.368+0000 7f55e8dff700 1 -- 172.21.15.32:0/4005729908 >> 172.21.15.32:0/4005729908 conn(0x7f55e4071660 msgr2=0x7f55e4071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:04.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.368+0000 7f55e8dff700 1 -- 172.21.15.32:0/4005729908 shutdown_connections 2023-06-20T13:33:04.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.368+0000 7f55e8dff700 1 -- 172.21.15.32:0/4005729908 wait complete. 2023-06-20T13:33:04.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.370+0000 7f55e8dff700 1 Processor -- start 2023-06-20T13:33:04.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.370+0000 7f55e8dff700 1 -- start start 2023-06-20T13:33:04.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.371+0000 7f55e8dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55e40cf8f0 0x7f55e4156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:04.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.371+0000 7f55e8dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55e40d2640 0x7f55e4157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:04.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.371+0000 7f55e8dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55e415c460 0x7f55e4155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:04.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.371+0000 7f55e8dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e415d9b0 con 0x7f55e40d2640 2023-06-20T13:33:04.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.371+0000 7f55e8dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e415cda0 con 0x7f55e40cf8f0 2023-06-20T13:33:04.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.371+0000 7f55e8dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e415d080 con 0x7f55e415c460 2023-06-20T13:33:04.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.371+0000 7f55e1d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55e40d2640 0x7f55e4157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:04.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.371+0000 7f55e1d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55e40d2640 0x7f55e4157050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51444/0 (socket says 172.21.15.32:51444) 2023-06-20T13:33:04.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.371+0000 7f55e259c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55e40cf8f0 0x7f55e4156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:04.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.371+0000 7f55e1d9b700 1 -- 172.21.15.32:0/3636456350 learned_addr learned my addr 172.21.15.32:0/3636456350 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:04.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.371+0000 7f55e2d9d700 1 --2- 172.21.15.32:0/3636456350 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55e415c460 0x7f55e4155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:04.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.372+0000 7f55e1d9b700 1 -- 172.21.15.32:0/3636456350 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55e415c460 msgr2=0x7f55e4155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:04.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.372+0000 7f55e1d9b700 1 --2- 172.21.15.32:0/3636456350 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55e415c460 0x7f55e4155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:04.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.372+0000 7f55e1d9b700 1 -- 172.21.15.32:0/3636456350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55e40cf8f0 msgr2=0x7f55e4156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:04.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.372+0000 7f55e1d9b700 1 --2- 172.21.15.32:0/3636456350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55e40cf8f0 0x7f55e4156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:04.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.372+0000 7f55e1d9b700 1 -- 172.21.15.32:0/3636456350 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55dc009b30 con 0x7f55e40d2640 2023-06-20T13:33:04.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.372+0000 7f55e1d9b700 1 --2- 172.21.15.32:0/3636456350 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55e40d2640 0x7f55e4157050 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f55d800e870 tx=0x7f55d800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:04.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.372+0000 7f55d2ffd700 1 -- 172.21.15.32:0/3636456350 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d8009590 con 0x7f55e40d2640 2023-06-20T13:33:04.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.372+0000 7f55d2ffd700 1 -- 172.21.15.32:0/3636456350 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d8013680 con 0x7f55e40d2640 2023-06-20T13:33:04.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.372+0000 7f55e8dff700 1 -- 172.21.15.32:0/3636456350 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55e415d360 con 0x7f55e40d2640 2023-06-20T13:33:04.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.372+0000 7f55d2ffd700 1 -- 172.21.15.32:0/3636456350 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d80139f0 con 0x7f55e40d2640 2023-06-20T13:33:04.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.372+0000 7f55e8dff700 1 -- 172.21.15.32:0/3636456350 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55e415de40 con 0x7f55e40d2640 2023-06-20T13:33:04.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.373+0000 7f55e8dff700 1 -- 172.21.15.32:0/3636456350 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55e404ea60 con 0x7f55e40d2640 2023-06-20T13:33:04.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.374+0000 7f55d2ffd700 1 -- 172.21.15.32:0/3636456350 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f55d8013b50 con 0x7f55e40d2640 2023-06-20T13:33:04.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.375+0000 7f55d2ffd700 1 --2- 172.21.15.32:0/3636456350 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f55c406ace0 0x7f55c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:04.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.375+0000 7f55d2ffd700 1 -- 172.21.15.32:0/3636456350 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f55d8089680 con 0x7f55e40d2640 2023-06-20T13:33:04.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.376+0000 7f55e259c700 1 --2- 172.21.15.32:0/3636456350 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f55c406ace0 0x7f55c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:04.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.376+0000 7f55e259c700 1 --2- 172.21.15.32:0/3636456350 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f55c406ace0 0x7f55c406d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f55d4007fd0 tx=0x7f55d4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:04.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.379+0000 7f55d2ffd700 1 -- 172.21.15.32:0/3636456350 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f55d8057e80 con 0x7f55e40d2640 2023-06-20T13:33:04.629 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.627+0000 7f55e8dff700 1 -- 172.21.15.32:0/3636456350 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55e415daf0 con 0x7f55e40d2640 2023-06-20T13:33:04.630 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.627+0000 7f55d2ffd700 1 -- 172.21.15.32:0/3636456350 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f55d8057a10 con 0x7f55e40d2640 2023-06-20T13:33:04.630 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:33:04.630 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2171664589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2171664589},{"type":"v1","addr":"172.21.15.115:6834","nonce":2171664589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/959333888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":959333888},{"type":"v1","addr":"172.21.15.32:6837","nonce":959333888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3388117179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":3388117179},{"type":"v1","addr":"172.21.15.32:6835","nonce":3388117179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-20T13:32:20.527725+0000","modified":"2023-06-20T13:32:49.006923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3566362693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3566362693},{"type":"v1","addr":"172.21.15.115:6835","nonce":3566362693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-20T13:33:04.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.630+0000 7f55e8dff700 1 -- 172.21.15.32:0/3636456350 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f55c406ace0 msgr2=0x7f55c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:04.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.630+0000 7f55e8dff700 1 --2- 172.21.15.32:0/3636456350 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f55c406ace0 0x7f55c406d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f55d4007fd0 tx=0x7f55d4009040 comp rx=0 tx=0).stop 2023-06-20T13:33:04.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.630+0000 7f55e8dff700 1 -- 172.21.15.32:0/3636456350 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55e40d2640 msgr2=0x7f55e4157050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:04.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.630+0000 7f55e8dff700 1 --2- 172.21.15.32:0/3636456350 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55e40d2640 0x7f55e4157050 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f55d800e870 tx=0x7f55d800eb80 comp rx=0 tx=0).stop 2023-06-20T13:33:04.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.630+0000 7f55e8dff700 1 -- 172.21.15.32:0/3636456350 shutdown_connections 2023-06-20T13:33:04.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.630+0000 7f55e8dff700 1 --2- 172.21.15.32:0/3636456350 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f55c406ace0 0x7f55c406d190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:04.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.630+0000 7f55e8dff700 1 --2- 172.21.15.32:0/3636456350 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55e415c460 0x7f55e4155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:04.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.630+0000 7f55e8dff700 1 --2- 172.21.15.32:0/3636456350 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55e40cf8f0 0x7f55e4156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:04.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.630+0000 7f55e8dff700 1 --2- 172.21.15.32:0/3636456350 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f55e40d2640 0x7f55e4157050 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:04.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.630+0000 7f55e8dff700 1 -- 172.21.15.32:0/3636456350 >> 172.21.15.32:0/3636456350 conn(0x7f55e4071660 msgr2=0x7f55e40b7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:04.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.630+0000 7f55e8dff700 1 -- 172.21.15.32:0/3636456350 shutdown_connections 2023-06-20T13:33:04.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:04.630+0000 7f55e8dff700 1 -- 172.21.15.32:0/3636456350 wait complete. 2023-06-20T13:33:04.634 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2023-06-20T13:33:05.052 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-20T13:32:20.527725+0000', 'modified': '2023-06-20T13:32:49.006923+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4300}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4300': {'gid': 4300, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.115:6835/3566362693', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6833', 'nonce': 3566362693}, {'type': 'v1', 'addr': '172.21.15.115:6835', 'nonce': 3566362693}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-20T13:33:05.053 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-20T13:33:05.053 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-06-20T13:33:05.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.259+0000 7fcd47fff700 1 Processor -- start 2023-06-20T13:33:05.261 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.259+0000 7fcd47fff700 1 -- start start 2023-06-20T13:33:05.262 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.260+0000 7fcd47fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcd4015c460 0x7fcd400b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:05.262 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.260+0000 7fcd47fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd400cf8f0 0x7fcd4015fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:05.262 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.260+0000 7fcd47fff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd400d1790 con 0x7fcd400d2640 2023-06-20T13:33:05.262 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.260+0000 7fcd47fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd400cedd0 con 0x7fcd4015c460 2023-06-20T13:33:05.263 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.260+0000 7fcd47fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd400cd950 con 0x7fcd400cf8f0 2023-06-20T13:33:05.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.260+0000 7fcd45d9b700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcd4015c460 0x7fcd400b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:05.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.260+0000 7fcd4559a700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fcd400d2640 0x7fcd400cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55714/0 (socket says 172.21.15.32:55714) 2023-06-20T13:33:05.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.260+0000 7fcd4559a700 1 -- 172.21.15.32:0/3989477931 learned_addr learned my addr 172.21.15.32:0/3989477931 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:05.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.260+0000 7fcd4659c700 1 --2- 172.21.15.32:0/3989477931 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd400cf8f0 0x7fcd4015fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:05.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.261+0000 7fcd45d9b700 1 -- 172.21.15.32:0/3989477931 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd400cf8f0 msgr2=0x7fcd4015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:05.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.261+0000 7fcd44d99700 1 -- 172.21.15.32:0/3989477931 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4114225305 0 0) 0x7fcd400d1790 con 0x7fcd400d2640 2023-06-20T13:33:05.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.261+0000 7fcd45d9b700 1 --2- 172.21.15.32:0/3989477931 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd400cf8f0 0x7fcd4015fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.261+0000 7fcd45d9b700 1 -- 172.21.15.32:0/3989477931 >> v1:172.21.15.32:6789/0 conn(0x7fcd400d2640 legacy=0x7fcd400cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:05.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.261+0000 7fcd45d9b700 1 -- 172.21.15.32:0/3989477931 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd400d14b0 con 0x7fcd4015c460 2023-06-20T13:33:05.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.261+0000 7fcd45d9b700 1 --2- 172.21.15.32:0/3989477931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd4015c460 0x7fcd400b59d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009840 tx=0x7fcd3c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e2c50c2e6258f28 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:05.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.261+0000 7fcd44d99700 1 -- 172.21.15.32:0/3989477931 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c011830 con 0x7fcd4015c460 2023-06-20T13:33:05.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.262+0000 7fcd44d99700 1 -- 172.21.15.32:0/3989477931 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3c011990 con 0x7fcd4015c460 2023-06-20T13:33:05.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.262+0000 7fcd44d99700 1 -- 172.21.15.32:0/3989477931 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c011d20 con 0x7fcd4015c460 2023-06-20T13:33:05.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.262+0000 7fcd47fff700 1 -- 172.21.15.32:0/3989477931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd4015c460 msgr2=0x7fcd400b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:05.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.262+0000 7fcd47fff700 1 --2- 172.21.15.32:0/3989477931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd4015c460 0x7fcd400b59d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009840 tx=0x7fcd3c009b50 comp rx=0 tx=0).stop 2023-06-20T13:33:05.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.262+0000 7fcd47fff700 1 -- 172.21.15.32:0/3989477931 shutdown_connections 2023-06-20T13:33:05.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.262+0000 7fcd47fff700 1 --2- 172.21.15.32:0/3989477931 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd400cf8f0 0x7fcd4015fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.262+0000 7fcd47fff700 1 --2- 172.21.15.32:0/3989477931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd4015c460 0x7fcd400b59d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.262+0000 7fcd47fff700 1 -- 172.21.15.32:0/3989477931 >> 172.21.15.32:0/3989477931 conn(0x7fcd40071660 msgr2=0x7fcd40071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:05.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.262+0000 7fcd47fff700 1 -- 172.21.15.32:0/3989477931 shutdown_connections 2023-06-20T13:33:05.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.262+0000 7fcd47fff700 1 -- 172.21.15.32:0/3989477931 wait complete. 2023-06-20T13:33:05.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.264+0000 7fcd47fff700 1 Processor -- start 2023-06-20T13:33:05.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.264+0000 7fcd47fff700 1 -- start start 2023-06-20T13:33:05.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.265+0000 7fcd47fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd400cf8f0 0x7fcd400cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:05.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.265+0000 7fcd47fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd400d2640 0x7fcd401579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:05.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.265+0000 7fcd47fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd4015c460 0x7fcd40157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:05.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.265+0000 7fcd47fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd40158450 con 0x7fcd400cf8f0 2023-06-20T13:33:05.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.265+0000 7fcd47fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd400c7fb0 con 0x7fcd400d2640 2023-06-20T13:33:05.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.265+0000 7fcd47fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd400c9cf0 con 0x7fcd4015c460 2023-06-20T13:33:05.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.266+0000 7fcd45d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd400cf8f0 0x7fcd400cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:05.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.266+0000 7fcd45d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd400cf8f0 0x7fcd400cc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51450/0 (socket says 172.21.15.32:51450) 2023-06-20T13:33:05.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.266+0000 7fcd45d9b700 1 -- 172.21.15.32:0/2954863786 learned_addr learned my addr 172.21.15.32:0/2954863786 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:05.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.266+0000 7fcd4559a700 1 --2- 172.21.15.32:0/2954863786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd400d2640 0x7fcd401579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:05.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.266+0000 7fcd4659c700 1 --2- 172.21.15.32:0/2954863786 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd4015c460 0x7fcd40157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:05.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.266+0000 7fcd45d9b700 1 -- 172.21.15.32:0/2954863786 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd4015c460 msgr2=0x7fcd40157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:05.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.266+0000 7fcd45d9b700 1 --2- 172.21.15.32:0/2954863786 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd4015c460 0x7fcd40157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.266+0000 7fcd45d9b700 1 -- 172.21.15.32:0/2954863786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd400d2640 msgr2=0x7fcd401579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:05.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.266+0000 7fcd45d9b700 1 --2- 172.21.15.32:0/2954863786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd400d2640 0x7fcd401579d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.266+0000 7fcd45d9b700 1 -- 172.21.15.32:0/2954863786 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3c0094a0 con 0x7fcd400cf8f0 2023-06-20T13:33:05.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.266+0000 7fcd4559a700 1 --2- 172.21.15.32:0/2954863786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd400d2640 0x7fcd401579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:05.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.266+0000 7fcd45d9b700 1 --2- 172.21.15.32:0/2954863786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd400cf8f0 0x7fcd400cc020 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009b90 tx=0x7fcd3c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:05.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.267+0000 7fcd367fc700 1 -- 172.21.15.32:0/2954863786 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c0038a0 con 0x7fcd400cf8f0 2023-06-20T13:33:05.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.267+0000 7fcd367fc700 1 -- 172.21.15.32:0/2954863786 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3c01e070 con 0x7fcd400cf8f0 2023-06-20T13:33:05.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.267+0000 7fcd47fff700 1 -- 172.21.15.32:0/2954863786 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd400c9fd0 con 0x7fcd400cf8f0 2023-06-20T13:33:05.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.267+0000 7fcd367fc700 1 -- 172.21.15.32:0/2954863786 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c003c40 con 0x7fcd400cf8f0 2023-06-20T13:33:05.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.267+0000 7fcd47fff700 1 -- 172.21.15.32:0/2954863786 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd400ca590 con 0x7fcd400cf8f0 2023-06-20T13:33:05.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.270+0000 7fcd367fc700 1 -- 172.21.15.32:0/2954863786 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcd3c02d450 con 0x7fcd400cf8f0 2023-06-20T13:33:05.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.271+0000 7fcd367fc700 1 --2- 172.21.15.32:0/2954863786 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcd2406ace0 0x7fcd2406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:05.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.271+0000 7fcd367fc700 1 -- 172.21.15.32:0/2954863786 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcd3c08a820 con 0x7fcd400cf8f0 2023-06-20T13:33:05.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.271+0000 7fcd4559a700 1 --2- 172.21.15.32:0/2954863786 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcd2406ace0 0x7fcd2406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:05.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.272+0000 7fcd4559a700 1 --2- 172.21.15.32:0/2954863786 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcd2406ace0 0x7fcd2406d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcd30000f60 tx=0x7fcd30007d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:05.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.273+0000 7fcd5b9efb80 1 Processor -- start 2023-06-20T13:33:05.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.273+0000 7fcd5b9efb80 1 -- start start 2023-06-20T13:33:05.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.274+0000 7fcd5b9efb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557196621320 0x5571966216f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:05.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.274+0000 7fcd5b9efb80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5571965f46d0 0x5571965f7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:05.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.274+0000 7fcd5b9efb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571965f25b0 0x55719661e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:05.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.274+0000 7fcd5b9efb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719656bea0 con 0x5571965f25b0 2023-06-20T13:33:05.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.274+0000 7fcd5b9efb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571964df600 con 0x557196621320 2023-06-20T13:33:05.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.274+0000 7fcd5b9efb80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55719654e910 con 0x5571965f46d0 2023-06-20T13:33:05.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.274+0000 7fcd4659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571965f25b0 0x55719661e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:05.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.274+0000 7fcd4659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571965f25b0 0x55719661e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51466/0 (socket says 172.21.15.32:51466) 2023-06-20T13:33:05.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.274+0000 7fcd4659c700 1 -- 172.21.15.32:0/4001938702 learned_addr learned my addr 172.21.15.32:0/4001938702 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:05.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.274+0000 7fcd45d9b700 1 --2- 172.21.15.32:0/4001938702 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557196621320 0x5571966216f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:05.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.274+0000 7fcd4559a700 1 --2- 172.21.15.32:0/4001938702 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5571965f46d0 0x5571965f7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:05.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.274+0000 7fcd4659c700 1 -- 172.21.15.32:0/4001938702 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5571965f46d0 msgr2=0x5571965f7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:05.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.274+0000 7fcd4659c700 1 --2- 172.21.15.32:0/4001938702 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5571965f46d0 0x5571965f7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.274+0000 7fcd4659c700 1 -- 172.21.15.32:0/4001938702 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557196621320 msgr2=0x5571966216f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:05.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.274+0000 7fcd4659c700 1 --2- 172.21.15.32:0/4001938702 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557196621320 0x5571966216f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.279 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.275+0000 7fcd4659c700 1 -- 172.21.15.32:0/4001938702 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55719633b790 con 0x5571965f25b0 2023-06-20T13:33:05.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.275+0000 7fcd4659c700 1 --2- 172.21.15.32:0/4001938702 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571965f25b0 0x55719661e510 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcd380074f0 tx=0x7fcd38009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d27532a8cee7195 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:05.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.275+0000 7fcd237fe700 1 -- 172.21.15.32:0/4001938702 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3800e030 con 0x5571965f25b0 2023-06-20T13:33:05.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.275+0000 7fcd237fe700 1 -- 172.21.15.32:0/4001938702 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd380153f0 con 0x5571965f25b0 2023-06-20T13:33:05.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.275+0000 7fcd237fe700 1 -- 172.21.15.32:0/4001938702 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd38009ca0 con 0x5571965f25b0 2023-06-20T13:33:05.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.276+0000 7fcd5b9efb80 1 -- 172.21.15.32:0/4001938702 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571965f25b0 msgr2=0x55719661e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:05.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.276+0000 7fcd5b9efb80 1 --2- 172.21.15.32:0/4001938702 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571965f25b0 0x55719661e510 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcd380074f0 tx=0x7fcd38009750 comp rx=0 tx=0).stop 2023-06-20T13:33:05.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.276+0000 7fcd5b9efb80 1 -- 172.21.15.32:0/4001938702 shutdown_connections 2023-06-20T13:33:05.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.276+0000 7fcd5b9efb80 1 --2- 172.21.15.32:0/4001938702 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571965f25b0 0x55719661e510 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.276+0000 7fcd5b9efb80 1 --2- 172.21.15.32:0/4001938702 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557196621320 0x5571966216f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.276+0000 7fcd5b9efb80 1 --2- 172.21.15.32:0/4001938702 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5571965f46d0 0x5571965f7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.276+0000 7fcd5b9efb80 1 -- 172.21.15.32:0/4001938702 >> 172.21.15.32:0/4001938702 conn(0x5571965ebdd0 msgr2=0x55719663c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:05.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.276+0000 7fcd5b9efb80 1 -- 172.21.15.32:0/4001938702 shutdown_connections 2023-06-20T13:33:05.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.276+0000 7fcd5b9efb80 1 -- 172.21.15.32:0/4001938702 wait complete. 2023-06-20T13:33:05.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.277+0000 7fcd5b9efb80 1 -- start start 2023-06-20T13:33:05.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.277+0000 7fcd5b9efb80 1 Processor -- start 2023-06-20T13:33:05.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.279+0000 7fcd5b9efb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571965f25b0 0x557196620210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:05.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.279+0000 7fcd5b9efb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571965f46d0 0x55719661f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:05.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.279+0000 7fcd5b9efb80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x557196621320 0x55719664e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:05.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.279+0000 7fcd5b9efb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x557196547be0 con 0x5571965f25b0 2023-06-20T13:33:05.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.279+0000 7fcd5b9efb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571965055b0 con 0x5571965f46d0 2023-06-20T13:33:05.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.279+0000 7fcd5b9efb80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x5571964eb910 con 0x557196621320 2023-06-20T13:33:05.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.279+0000 7fcd5b9efb80 10 client.0 _ll_register_callbacks cb 0x557196503b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-20T13:33:05.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.279+0000 7fcd45d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571965f25b0 0x557196620210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:05.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.279+0000 7fcd45d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571965f25b0 0x557196620210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51470/0 (socket says 172.21.15.32:51470) 2023-06-20T13:33:05.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.279+0000 7fcd45d9b700 1 -- 172.21.15.32:0/611260799 learned_addr learned my addr 172.21.15.32:0/611260799 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:05.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.279+0000 7fcd4659c700 1 --2- 172.21.15.32:0/611260799 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x557196621320 0x55719664e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:05.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.279+0000 7fcd4559a700 1 --2- 172.21.15.32:0/611260799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571965f46d0 0x55719661f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:05.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.280+0000 7fcd45d9b700 1 -- 172.21.15.32:0/611260799 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x557196621320 msgr2=0x55719664e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:05.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.280+0000 7fcd45d9b700 1 --2- 172.21.15.32:0/611260799 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x557196621320 0x55719664e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.285 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.280+0000 7fcd45d9b700 1 -- 172.21.15.32:0/611260799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571965f46d0 msgr2=0x55719661f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:05.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.280+0000 7fcd45d9b700 1 --2- 172.21.15.32:0/611260799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571965f46d0 0x55719661f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.280+0000 7fcd45d9b700 1 -- 172.21.15.32:0/611260799 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd38009e00 con 0x5571965f25b0 2023-06-20T13:33:05.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.280+0000 7fcd45d9b700 1 --2- 172.21.15.32:0/611260799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571965f25b0 0x557196620210 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009ea0 tx=0x7fcd3c058c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6f0656a65a324c server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:05.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.280+0000 7fcd20ff9700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-06-20T13:33:05.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.280+0000 7fcd20ff9700 1 -- 172.21.15.32:0/611260799 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c05d210 con 0x5571965f25b0 2023-06-20T13:33:05.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.280+0000 7fcd20ff9700 1 -- 172.21.15.32:0/611260799 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcd3c0615a0 con 0x5571965f25b0 2023-06-20T13:33:05.286 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.280+0000 7fcd5b9efb80 1 -- 172.21.15.32:0/611260799 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5571965e93e0 con 0x5571965f25b0 2023-06-20T13:33:05.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.280+0000 7fcd20ff9700 1 -- 172.21.15.32:0/611260799 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd3c058740 con 0x5571965f25b0 2023-06-20T13:33:05.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.280+0000 7fcd5b9efb80 10 client.4836 fetch_fsmap learned FSMap version 8 2023-06-20T13:33:05.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.280+0000 7fcd5b9efb80 1 -- 172.21.15.32:0/611260799 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5571964280a0 con 0x5571965f25b0 2023-06-20T13:33:05.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.280+0000 7fcd20ff9700 1 -- 172.21.15.32:0/611260799 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5571965e93e0 con 0x5571965f25b0 2023-06-20T13:33:05.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.281+0000 7fcd20ff9700 1 -- 172.21.15.32:0/611260799 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 8) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fcd3c061110 con 0x5571965f25b0 2023-06-20T13:33:05.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.281+0000 7fcd5b9efb80 10 client.4836 fetch_fsmap finished waiting for FSMap version 8 2023-06-20T13:33:05.287 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.281+0000 7fcd5b9efb80 10 client.4836 resolve_mds: resolved name 'b' to daemon mds.b 2023-06-20T13:33:05.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.281+0000 7fcd5b9efb80 20 client.4836 populate_metadata read hostname 'smithi032' 2023-06-20T13:33:05.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.281+0000 7fcd5b9efb80 1 --2- 172.21.15.32:0/611260799 >> [v2:172.21.15.115:6833/3566362693,v1:172.21.15.115:6835/3566362693] conn(0x55719661d640 0x55719661da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:05.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.281+0000 7fcd5b9efb80 4 client.4836 mds_command: new command op to 4300 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-20T13:33:05.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.281+0000 7fcd5b9efb80 1 -- 172.21.15.32:0/611260799 --> [v2:172.21.15.115:6833/3566362693,v1:172.21.15.115:6835/3566362693] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5571965c5a50 con 0x55719661d640 2023-06-20T13:33:05.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.281+0000 7fcd4559a700 1 --2- 172.21.15.32:0/611260799 >> [v2:172.21.15.115:6833/3566362693,v1:172.21.15.115:6835/3566362693] conn(0x55719661d640 0x55719661da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:05.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.282+0000 7fcd4559a700 1 --2- 172.21.15.32:0/611260799 >> [v2:172.21.15.115:6833/3566362693,v1:172.21.15.115:6835/3566362693] conn(0x55719661d640 0x55719661da10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9427031949df5562 server_cookie=d291ad9de9f77227 in_seq=0 out_seq=0 2023-06-20T13:33:05.288 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.282+0000 7fcd20ff9700 10 client.4836 ms_handle_connect on v2:172.21.15.115:6833/3566362693 2023-06-20T13:33:05.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.282+0000 7fcd20ff9700 1 -- 172.21.15.32:0/611260799 <== mds.0 v2:172.21.15.115:6833/3566362693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5571965c5a50 con 0x55719661d640 2023-06-20T13:33:05.289 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.283+0000 7fcd20ff9700 10 client.4836 handle_command_reply: tid=0 2023-06-20T13:33:05.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.283+0000 7fcd5b9efb80 1 client.4836 shutdown 2023-06-20T13:33:05.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.283+0000 7fcd5b9efb80 1 -- 172.21.15.32:0/611260799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571965f25b0 msgr2=0x557196620210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:05.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.283+0000 7fcd5b9efb80 1 --2- 172.21.15.32:0/611260799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571965f25b0 0x557196620210 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009ea0 tx=0x7fcd3c058c00 comp rx=0 tx=0).stop 2023-06-20T13:33:05.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.283+0000 7fcd5b9efb80 1 -- 172.21.15.32:0/611260799 shutdown_connections 2023-06-20T13:33:05.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.283+0000 7fcd5b9efb80 1 --2- 172.21.15.32:0/611260799 >> [v2:172.21.15.115:6833/3566362693,v1:172.21.15.115:6835/3566362693] conn(0x55719661d640 0x55719661da10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.283+0000 7fcd5b9efb80 1 --2- 172.21.15.32:0/611260799 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x557196621320 0x55719664e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.283+0000 7fcd5b9efb80 1 --2- 172.21.15.32:0/611260799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571965f25b0 0x557196620210 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.283+0000 7fcd5b9efb80 1 --2- 172.21.15.32:0/611260799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571965f46d0 0x55719661f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.283+0000 7fcd20ff9700 0 client.4836 ms_handle_reset on v2:172.21.15.115:6833/3566362693 2023-06-20T13:33:05.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.283+0000 7fcd5b9efb80 1 -- 172.21.15.32:0/611260799 >> 172.21.15.32:0/611260799 conn(0x5571965ebdd0 msgr2=0x5571965f1530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:05.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.283+0000 7fcd5b9efb80 1 -- 172.21.15.32:0/611260799 shutdown_connections 2023-06-20T13:33:05.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.283+0000 7fcd5b9efb80 1 -- 172.21.15.32:0/611260799 wait complete. 2023-06-20T13:33:05.291 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.283+0000 7fcd5b9efb80 20 client.4836 trim_cache size 0 max 16384 2023-06-20T13:33:05.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.302+0000 7fcd5b9efb80 1 Processor -- start 2023-06-20T13:33:05.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.302+0000 7fcd5b9efb80 1 -- start start 2023-06-20T13:33:05.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.302+0000 7fcd5b9efb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571965ebdd0 0x557196620820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:05.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.303+0000 7fcd5b9efb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571965f25b0 0x55719664a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:05.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.303+0000 7fcd5b9efb80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5571965f46d0 0x55719664a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:05.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.303+0000 7fcd5b9efb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719633c390 con 0x5571965ebdd0 2023-06-20T13:33:05.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.303+0000 7fcd5b9efb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x557196638db0 con 0x5571965f25b0 2023-06-20T13:33:05.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.303+0000 7fcd5b9efb80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x5571966400b0 con 0x5571965f46d0 2023-06-20T13:33:05.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.303+0000 7fcd45d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571965ebdd0 0x557196620820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:05.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.303+0000 7fcd45d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571965ebdd0 0x557196620820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51476/0 (socket says 172.21.15.32:51476) 2023-06-20T13:33:05.306 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.303+0000 7fcd45d9b700 1 -- 172.21.15.32:0/3063772215 learned_addr learned my addr 172.21.15.32:0/3063772215 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:05.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.303+0000 7fcd45d9b700 1 -- 172.21.15.32:0/3063772215 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5571965f46d0 msgr2=0x55719664a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:05.307 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.303+0000 7fcd45d9b700 1 --2- 172.21.15.32:0/3063772215 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5571965f46d0 0x55719664a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.303+0000 7fcd4559a700 1 --2- 172.21.15.32:0/3063772215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571965f25b0 0x55719664a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:05.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.303+0000 7fcd45d9b700 1 -- 172.21.15.32:0/3063772215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571965f25b0 msgr2=0x55719664a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:05.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.303+0000 7fcd45d9b700 1 --2- 172.21.15.32:0/3063772215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571965f25b0 0x55719664a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.303+0000 7fcd45d9b700 1 -- 172.21.15.32:0/3063772215 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55719650db10 con 0x5571965ebdd0 2023-06-20T13:33:05.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.303+0000 7fcd4559a700 1 --2- 172.21.15.32:0/3063772215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571965f25b0 0x55719664a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:05.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.303+0000 7fcd45d9b700 1 --2- 172.21.15.32:0/3063772215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571965ebdd0 0x557196620820 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c058f50 tx=0x7fcd3c026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9640b4708b0c1faf server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:05.308 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.304+0000 7fcd23fff700 1 -- 172.21.15.32:0/3063772215 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c05f0b0 con 0x5571965ebdd0 2023-06-20T13:33:05.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.304+0000 7fcd23fff700 1 -- 172.21.15.32:0/3063772215 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3c0615a0 con 0x5571965ebdd0 2023-06-20T13:33:05.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.304+0000 7fcd23fff700 1 -- 172.21.15.32:0/3063772215 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c05d210 con 0x5571965ebdd0 2023-06-20T13:33:05.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.304+0000 7fcd5b9efb80 1 -- 172.21.15.32:0/3063772215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571965ebdd0 msgr2=0x557196620820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:05.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.304+0000 7fcd5b9efb80 1 --2- 172.21.15.32:0/3063772215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571965ebdd0 0x557196620820 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c058f50 tx=0x7fcd3c026000 comp rx=0 tx=0).stop 2023-06-20T13:33:05.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.304+0000 7fcd5b9efb80 1 -- 172.21.15.32:0/3063772215 shutdown_connections 2023-06-20T13:33:05.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.304+0000 7fcd5b9efb80 1 --2- 172.21.15.32:0/3063772215 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5571965f46d0 0x55719664a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.304+0000 7fcd5b9efb80 1 --2- 172.21.15.32:0/3063772215 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571965ebdd0 0x557196620820 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.304+0000 7fcd5b9efb80 1 --2- 172.21.15.32:0/3063772215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571965f25b0 0x55719664a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.304+0000 7fcd5b9efb80 1 -- 172.21.15.32:0/3063772215 >> 172.21.15.32:0/3063772215 conn(0x5571965e9090 msgr2=0x55719665ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:05.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.304+0000 7fcd5b9efb80 1 -- 172.21.15.32:0/3063772215 shutdown_connections 2023-06-20T13:33:05.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.304+0000 7fcd5b9efb80 1 -- 172.21.15.32:0/3063772215 wait complete. 2023-06-20T13:33:05.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.305+0000 7fcd5b9efb80 1 -- start start 2023-06-20T13:33:05.310 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.305+0000 7fcd5b9efb80 1 Processor -- start 2023-06-20T13:33:05.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.307+0000 7fcd5b9efb80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571965ebdd0 0x55719661e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:05.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.307+0000 7fcd5b9efb80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571965f25b0 0x55719663eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:05.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.307+0000 7fcd5b9efb80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5571965f46d0 0x55719663f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:05.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.307+0000 7fcd5b9efb80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719663faa0 con 0x5571965f25b0 2023-06-20T13:33:05.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.307+0000 7fcd5b9efb80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719664a520 con 0x5571965ebdd0 2023-06-20T13:33:05.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.307+0000 7fcd5b9efb80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55719661c670 con 0x5571965f46d0 2023-06-20T13:33:05.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.307+0000 7fcd5b9efb80 10 client.0 _ll_register_callbacks cb 0x7fcd3c058e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-20T13:33:05.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.307+0000 7fcd4559a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571965f25b0 0x55719663eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:05.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.307+0000 7fcd4559a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571965f25b0 0x55719663eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51490/0 (socket says 172.21.15.32:51490) 2023-06-20T13:33:05.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.307+0000 7fcd4559a700 1 -- 172.21.15.32:0/2439659473 learned_addr learned my addr 172.21.15.32:0/2439659473 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:05.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.307+0000 7fcd4659c700 1 --2- 172.21.15.32:0/2439659473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5571965f46d0 0x55719663f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:05.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.307+0000 7fcd45d9b700 1 --2- 172.21.15.32:0/2439659473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571965ebdd0 0x55719661e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:05.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.308+0000 7fcd4559a700 1 -- 172.21.15.32:0/2439659473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5571965f46d0 msgr2=0x55719663f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:05.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.308+0000 7fcd4559a700 1 --2- 172.21.15.32:0/2439659473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5571965f46d0 0x55719663f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.308+0000 7fcd4559a700 1 -- 172.21.15.32:0/2439659473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571965ebdd0 msgr2=0x55719661e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:05.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.308+0000 7fcd4559a700 1 --2- 172.21.15.32:0/2439659473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571965ebdd0 0x55719661e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.308+0000 7fcd4559a700 1 -- 172.21.15.32:0/2439659473 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5571964280a0 con 0x5571965f25b0 2023-06-20T13:33:05.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.308+0000 7fcd4559a700 1 --2- 172.21.15.32:0/2439659473 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571965f25b0 0x55719663eca0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x557196621c30 tx=0x7fcd30000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9556b33e88ff80a server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:05.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.308+0000 7fcd20ff9700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-06-20T13:33:05.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.308+0000 7fcd20ff9700 1 -- 172.21.15.32:0/2439659473 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd30026cf0 con 0x5571965f25b0 2023-06-20T13:33:05.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.308+0000 7fcd20ff9700 1 -- 172.21.15.32:0/2439659473 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcd30015b80 con 0x5571965f25b0 2023-06-20T13:33:05.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.308+0000 7fcd5b9efb80 1 -- 172.21.15.32:0/2439659473 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcd380153f0 con 0x5571965f25b0 2023-06-20T13:33:05.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.308+0000 7fcd20ff9700 1 -- 172.21.15.32:0/2439659473 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd30026e50 con 0x5571965f25b0 2023-06-20T13:33:05.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.308+0000 7fcd5b9efb80 10 client.4842 fetch_fsmap learned FSMap version 8 2023-06-20T13:33:05.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.308+0000 7fcd5b9efb80 1 -- 172.21.15.32:0/2439659473 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55719639c1d0 con 0x5571965f25b0 2023-06-20T13:33:05.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.309+0000 7fcd20ff9700 1 -- 172.21.15.32:0/2439659473 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd380153f0 con 0x5571965f25b0 2023-06-20T13:33:05.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.309+0000 7fcd20ff9700 1 -- 172.21.15.32:0/2439659473 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 8) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fcd3002e030 con 0x5571965f25b0 2023-06-20T13:33:05.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.309+0000 7fcd5b9efb80 10 client.4842 fetch_fsmap finished waiting for FSMap version 8 2023-06-20T13:33:05.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.309+0000 7fcd5b9efb80 10 client.4842 resolve_mds: resolved name 'b' to daemon mds.b 2023-06-20T13:33:05.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.309+0000 7fcd5b9efb80 20 client.4842 populate_metadata read hostname 'smithi032' 2023-06-20T13:33:05.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.309+0000 7fcd5b9efb80 1 --2- 172.21.15.32:0/2439659473 >> [v2:172.21.15.115:6833/3566362693,v1:172.21.15.115:6835/3566362693] conn(0x557196621320 0x5571965f7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:05.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.309+0000 7fcd5b9efb80 4 client.4842 mds_command: new command op to 4300 tid=0[{"prefix": "status"}] 2023-06-20T13:33:05.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.309+0000 7fcd5b9efb80 1 -- 172.21.15.32:0/2439659473 --> [v2:172.21.15.115:6833/3566362693,v1:172.21.15.115:6835/3566362693] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557196540d20 con 0x557196621320 2023-06-20T13:33:05.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.309+0000 7fcd45d9b700 1 --2- 172.21.15.32:0/2439659473 >> [v2:172.21.15.115:6833/3566362693,v1:172.21.15.115:6835/3566362693] conn(0x557196621320 0x5571965f7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:05.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.310+0000 7fcd45d9b700 1 --2- 172.21.15.32:0/2439659473 >> [v2:172.21.15.115:6833/3566362693,v1:172.21.15.115:6835/3566362693] conn(0x557196621320 0x5571965f7f20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68b091309d5a0db server_cookie=fcc61dfdf2a17ad7 in_seq=0 out_seq=0 2023-06-20T13:33:05.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.310+0000 7fcd20ff9700 10 client.4842 ms_handle_connect on v2:172.21.15.115:6833/3566362693 2023-06-20T13:33:05.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.310+0000 7fcd20ff9700 1 -- 172.21.15.32:0/2439659473 <== mds.0 v2:172.21.15.115:6833/3566362693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x557196540d20 con 0x557196621320 2023-06-20T13:33:05.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.310+0000 7fcd20ff9700 10 client.4842 handle_command_reply: tid=0 2023-06-20T13:33:05.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.310+0000 7fcd5b9efb80 1 client.4842 shutdown 2023-06-20T13:33:05.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.310+0000 7fcd5b9efb80 1 -- 172.21.15.32:0/2439659473 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571965f25b0 msgr2=0x55719663eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:05.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.310+0000 7fcd5b9efb80 1 --2- 172.21.15.32:0/2439659473 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571965f25b0 0x55719663eca0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x557196621c30 tx=0x7fcd30000ed0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.310+0000 7fcd5b9efb80 1 -- 172.21.15.32:0/2439659473 shutdown_connections 2023-06-20T13:33:05.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.310+0000 7fcd5b9efb80 1 --2- 172.21.15.32:0/2439659473 >> [v2:172.21.15.115:6833/3566362693,v1:172.21.15.115:6835/3566362693] conn(0x557196621320 0x5571965f7f20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.310+0000 7fcd5b9efb80 1 --2- 172.21.15.32:0/2439659473 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5571965f46d0 0x55719663f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.310+0000 7fcd5b9efb80 1 --2- 172.21.15.32:0/2439659473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5571965ebdd0 0x55719661e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.310+0000 7fcd5b9efb80 1 --2- 172.21.15.32:0/2439659473 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x5571965f25b0 0x55719663eca0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.310+0000 7fcd20ff9700 0 client.4842 ms_handle_reset on v2:172.21.15.115:6833/3566362693 2023-06-20T13:33:05.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.310+0000 7fcd5b9efb80 1 -- 172.21.15.32:0/2439659473 >> 172.21.15.32:0/2439659473 conn(0x5571965e9090 msgr2=0x55719660d340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:05.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.310+0000 7fcd5b9efb80 1 -- 172.21.15.32:0/2439659473 shutdown_connections 2023-06-20T13:33:05.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.310+0000 7fcd5b9efb80 1 -- 172.21.15.32:0/2439659473 wait complete. 2023-06-20T13:33:05.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.311+0000 7fcd5b9efb80 20 client.4842 trim_cache size 0 max 16384 2023-06-20T13:33:05.320 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-06-20T13:33:05.320 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_fsid": "8ec09bdb-4968-488f-bf51-7b0f1e92355f", 2023-06-20T13:33:05.320 INFO:teuthology.orchestra.run.smithi032.stdout: "whoami": 0, 2023-06-20T13:33:05.320 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 4300, 2023-06-20T13:33:05.320 INFO:teuthology.orchestra.run.smithi032.stdout: "want_state": "up:active", 2023-06-20T13:33:05.320 INFO:teuthology.orchestra.run.smithi032.stdout: "state": "up:active", 2023-06-20T13:33:05.320 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs", 2023-06-20T13:33:05.321 INFO:teuthology.orchestra.run.smithi032.stdout: "rank_uptime": 44.308231059999997, 2023-06-20T13:33:05.321 INFO:teuthology.orchestra.run.smithi032.stdout: "mdsmap_epoch": 8, 2023-06-20T13:33:05.321 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch": 29, 2023-06-20T13:33:05.321 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch_barrier": 27, 2023-06-20T13:33:05.321 INFO:teuthology.orchestra.run.smithi032.stdout: "uptime": 51.139080350999997 2023-06-20T13:33:05.321 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-06-20T13:33:05.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.311+0000 7fcd47fff700 1 -- 172.21.15.32:0/2954863786 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcd2406ace0 msgr2=0x7fcd2406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:05.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.311+0000 7fcd47fff700 1 --2- 172.21.15.32:0/2954863786 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcd2406ace0 0x7fcd2406d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcd30000f60 tx=0x7fcd30007d30 comp rx=0 tx=0).stop 2023-06-20T13:33:05.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.311+0000 7fcd47fff700 1 -- 172.21.15.32:0/2954863786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd400cf8f0 msgr2=0x7fcd400cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:05.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.311+0000 7fcd47fff700 1 --2- 172.21.15.32:0/2954863786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd400cf8f0 0x7fcd400cc020 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009b90 tx=0x7fcd3c004750 comp rx=0 tx=0).stop 2023-06-20T13:33:05.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.311+0000 7fcd47fff700 1 -- 172.21.15.32:0/2954863786 shutdown_connections 2023-06-20T13:33:05.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.311+0000 7fcd47fff700 1 --2- 172.21.15.32:0/2954863786 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcd2406ace0 0x7fcd2406d190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.311+0000 7fcd47fff700 1 --2- 172.21.15.32:0/2954863786 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcd4015c460 0x7fcd40157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.311+0000 7fcd47fff700 1 --2- 172.21.15.32:0/2954863786 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcd400cf8f0 0x7fcd400cc020 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.311+0000 7fcd47fff700 1 --2- 172.21.15.32:0/2954863786 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcd400d2640 0x7fcd401579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:05.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.311+0000 7fcd47fff700 1 -- 172.21.15.32:0/2954863786 >> 172.21.15.32:0/2954863786 conn(0x7fcd40071660 msgr2=0x7fcd4015c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:05.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.311+0000 7fcd47fff700 1 -- 172.21.15.32:0/2954863786 shutdown_connections 2023-06-20T13:33:05.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:05.312+0000 7fcd47fff700 1 -- 172.21.15.32:0/2954863786 wait complete. 2023-06-20T13:33:05.331 INFO:teuthology.run_tasks:Running task kclient... 2023-06-20T13:33:05.353 INFO:tasks.kclient:Mounting kernel clients... 2023-06-20T13:33:05.354 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-06-20T13:33:05.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:05.354 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2023-06-20T13:33:05.401 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-06-20T13:33:05.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:05.402 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-06-20T13:33:05.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:05.473 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link delete ceph-brx 2023-06-20T13:33:05.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:05.589 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2023-06-20T13:33:05.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:05.638 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link delete ceph-brx 2023-06-20T13:33:05.712 INFO:teuthology.orchestra.run.smithi032.stderr:Cannot find device "ceph-brx" 2023-06-20T13:33:05.714 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-20T13:33:05.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:05.715 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-06-20T13:33:05.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:05.768 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link delete ceph-brx 2023-06-20T13:33:05.844 INFO:teuthology.orchestra.run.smithi115.stderr:Cannot find device "ceph-brx" 2023-06-20T13:33:05.846 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-20T13:33:05.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:05.847 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-06-20T13:33:05.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:05.894 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link delete ceph-brx 2023-06-20T13:33:05.964 INFO:teuthology.orchestra.run.smithi115.stderr:Cannot find device "ceph-brx" 2023-06-20T13:33:05.967 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-20T13:33:05.967 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-06-20T13:33:05.968 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-20T13:33:05.968 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-20T13:33:05.969 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-20T13:33:06.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.169+0000 7fcadfdff700 1 Processor -- start 2023-06-20T13:33:06.172 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.169+0000 7fcadfdff700 1 -- start start 2023-06-20T13:33:06.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.170+0000 7fcadfdff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcad8156be0 0x7fcad80cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:06.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.171+0000 7fcadfdff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcad80cd600 0x7fcad80cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:06.173 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.171+0000 7fcadfdff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad80cda70 con 0x7fcad80cb4f0 2023-06-20T13:33:06.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.171+0000 7fcadfdff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad8156fb0 con 0x7fcad80cd600 2023-06-20T13:33:06.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.171+0000 7fcadfdff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad815da40 con 0x7fcad8156be0 2023-06-20T13:33:06.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.171+0000 7fcade39c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fcad80cb4f0 0x7fcad8070340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:55718/0 (socket says 172.21.15.32:55718) 2023-06-20T13:33:06.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.171+0000 7fcade39c700 1 -- 172.21.15.32:0/1047600890 learned_addr learned my addr 172.21.15.32:0/1047600890 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:06.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.171+0000 7fcadd39a700 1 --2- 172.21.15.32:0/1047600890 >> v2:172.21.15.32:3300/0 conn(0x7fcad80cd600 0x7fcad80cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:06.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.171+0000 7fcaddb9b700 1 --2- 172.21.15.32:0/1047600890 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcad8156be0 0x7fcad80cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:06.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.171+0000 7fcadcb99700 1 -- 172.21.15.32:0/1047600890 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 534874146 0 0) 0x7fcad0001490 con 0x7fcad80cb4f0 2023-06-20T13:33:06.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.171+0000 7fcadcb99700 1 -- 172.21.15.32:0/1047600890 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcac40035b0 con 0x7fcad80cb4f0 2023-06-20T13:33:06.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.171+0000 7fcadd39a700 1 -- 172.21.15.32:0/1047600890 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcad8156be0 msgr2=0x7fcad80cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:06.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.171+0000 7fcadd39a700 1 --2- 172.21.15.32:0/1047600890 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcad8156be0 0x7fcad80cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:06.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.171+0000 7fcadd39a700 1 -- 172.21.15.32:0/1047600890 >> v1:172.21.15.32:6789/0 conn(0x7fcad80cb4f0 legacy=0x7fcad8070340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:06.176 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.171+0000 7fcadd39a700 1 -- 172.21.15.32:0/1047600890 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad80cbc00 con 0x7fcad80cd600 2023-06-20T13:33:06.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.171+0000 7fcaddb9b700 1 --2- 172.21.15.32:0/1047600890 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcad8156be0 0x7fcad80cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:33:06.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.172+0000 7fcadd39a700 1 --2- 172.21.15.32:0/1047600890 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcad80cd600 0x7fcad80cafb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcac8009870 tx=0x7fcac8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7d49e085070248 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:06.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.172+0000 7fcadcb99700 1 -- 172.21.15.32:0/1047600890 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac8011830 con 0x7fcad80cd600 2023-06-20T13:33:06.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.172+0000 7fcadcb99700 1 -- 172.21.15.32:0/1047600890 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac8011990 con 0x7fcad80cd600 2023-06-20T13:33:06.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.172+0000 7fcadcb99700 1 -- 172.21.15.32:0/1047600890 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac8011d20 con 0x7fcad80cd600 2023-06-20T13:33:06.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.172+0000 7fcadfdff700 1 -- 172.21.15.32:0/1047600890 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcad80cd600 msgr2=0x7fcad80cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:06.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.172+0000 7fcadfdff700 1 --2- 172.21.15.32:0/1047600890 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcad80cd600 0x7fcad80cafb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcac8009870 tx=0x7fcac8009b80 comp rx=0 tx=0).stop 2023-06-20T13:33:06.177 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.173+0000 7fcadfdff700 1 -- 172.21.15.32:0/1047600890 shutdown_connections 2023-06-20T13:33:06.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.173+0000 7fcadfdff700 1 --2- 172.21.15.32:0/1047600890 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcad8156be0 0x7fcad80cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:06.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.173+0000 7fcadfdff700 1 --2- 172.21.15.32:0/1047600890 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcad80cd600 0x7fcad80cafb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:06.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.173+0000 7fcadfdff700 1 -- 172.21.15.32:0/1047600890 >> 172.21.15.32:0/1047600890 conn(0x7fcad80b0390 msgr2=0x7fcad80b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:06.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.173+0000 7fcadfdff700 1 -- 172.21.15.32:0/1047600890 shutdown_connections 2023-06-20T13:33:06.178 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.173+0000 7fcadfdff700 1 -- 172.21.15.32:0/1047600890 wait complete. 2023-06-20T13:33:06.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.175+0000 7fcadfdff700 1 Processor -- start 2023-06-20T13:33:06.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.175+0000 7fcadfdff700 1 -- start start 2023-06-20T13:33:06.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.176+0000 7fcadfdff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcad80cb4f0 0x7fcad80c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:06.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.176+0000 7fcadfdff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcad80cd600 0x7fcad8154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:06.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.177+0000 7fcadfdff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcad8156be0 0x7fcad8070b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:06.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.177+0000 7fcadfdff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad80c4e90 con 0x7fcad80cb4f0 2023-06-20T13:33:06.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.177+0000 7fcadfdff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad8159b20 con 0x7fcad8156be0 2023-06-20T13:33:06.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.177+0000 7fcadfdff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad80c3d20 con 0x7fcad80cd600 2023-06-20T13:33:06.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.177+0000 7fcaddb9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcad80cb4f0 0x7fcad80c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:06.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.177+0000 7fcaddb9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcad80cb4f0 0x7fcad80c41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51500/0 (socket says 172.21.15.32:51500) 2023-06-20T13:33:06.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.177+0000 7fcaddb9b700 1 -- 172.21.15.32:0/423879722 learned_addr learned my addr 172.21.15.32:0/423879722 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:06.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.177+0000 7fcade39c700 1 --2- 172.21.15.32:0/423879722 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcad8156be0 0x7fcad8070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:06.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.177+0000 7fcadd39a700 1 --2- 172.21.15.32:0/423879722 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcad80cd600 0x7fcad8154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:06.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.177+0000 7fcaddb9b700 1 -- 172.21.15.32:0/423879722 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcad80cd600 msgr2=0x7fcad8154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:06.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.177+0000 7fcaddb9b700 1 --2- 172.21.15.32:0/423879722 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcad80cd600 0x7fcad8154dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:06.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.177+0000 7fcaddb9b700 1 -- 172.21.15.32:0/423879722 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcad8156be0 msgr2=0x7fcad8070b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:06.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.177+0000 7fcaddb9b700 1 --2- 172.21.15.32:0/423879722 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcad8156be0 0x7fcad8070b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:06.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.177+0000 7fcaddb9b700 1 -- 172.21.15.32:0/423879722 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad40094a0 con 0x7fcad80cb4f0 2023-06-20T13:33:06.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.177+0000 7fcade39c700 1 --2- 172.21.15.32:0/423879722 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcad8156be0 0x7fcad8070b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:06.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.177+0000 7fcaddb9b700 1 --2- 172.21.15.32:0/423879722 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcad80cb4f0 0x7fcad80c41b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcad400ebe0 tx=0x7fcad4009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:06.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.178+0000 7fcace7fc700 1 -- 172.21.15.32:0/423879722 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad400c8b0 con 0x7fcad80cb4f0 2023-06-20T13:33:06.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.178+0000 7fcace7fc700 1 -- 172.21.15.32:0/423879722 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad400ca10 con 0x7fcad80cb4f0 2023-06-20T13:33:06.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.178+0000 7fcadfdff700 1 -- 172.21.15.32:0/423879722 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac80094a0 con 0x7fcad80cb4f0 2023-06-20T13:33:06.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.178+0000 7fcace7fc700 1 -- 172.21.15.32:0/423879722 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad400cda0 con 0x7fcad80cb4f0 2023-06-20T13:33:06.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.178+0000 7fcadfdff700 1 -- 172.21.15.32:0/423879722 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad80c36d0 con 0x7fcad80cb4f0 2023-06-20T13:33:06.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.179+0000 7fcadfdff700 1 -- 172.21.15.32:0/423879722 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad804ea60 con 0x7fcad80cb4f0 2023-06-20T13:33:06.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.180+0000 7fcace7fc700 1 -- 172.21.15.32:0/423879722 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcad4013470 con 0x7fcad80cb4f0 2023-06-20T13:33:06.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.181+0000 7fcace7fc700 1 --2- 172.21.15.32:0/423879722 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcabc06ace0 0x7fcabc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:06.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.181+0000 7fcace7fc700 1 -- 172.21.15.32:0/423879722 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcad40899f0 con 0x7fcad80cb4f0 2023-06-20T13:33:06.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.181+0000 7fcadd39a700 1 --2- 172.21.15.32:0/423879722 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcabc06ace0 0x7fcabc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:06.184 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.181+0000 7fcadd39a700 1 --2- 172.21.15.32:0/423879722 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcabc06ace0 0x7fcabc06d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcac80090b0 tx=0x7fcac8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:06.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.185+0000 7fcace7fc700 1 -- 172.21.15.32:0/423879722 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcad40546d0 con 0x7fcad80cb4f0 2023-06-20T13:33:06.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.436+0000 7fcadfdff700 1 -- 172.21.15.32:0/423879722 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcad80cc6d0 con 0x7fcad80cb4f0 2023-06-20T13:33:06.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.437+0000 7fcace7fc700 1 -- 172.21.15.32:0/423879722 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7fcad4057cf0 con 0x7fcad80cb4f0 2023-06-20T13:33:06.439 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-20T13:33:06.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.439+0000 7fcadfdff700 1 -- 172.21.15.32:0/423879722 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcabc06ace0 msgr2=0x7fcabc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:06.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.439+0000 7fcadfdff700 1 --2- 172.21.15.32:0/423879722 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcabc06ace0 0x7fcabc06d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcac80090b0 tx=0x7fcac8008030 comp rx=0 tx=0).stop 2023-06-20T13:33:06.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.439+0000 7fcadfdff700 1 -- 172.21.15.32:0/423879722 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcad80cb4f0 msgr2=0x7fcad80c41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:06.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.439+0000 7fcadfdff700 1 --2- 172.21.15.32:0/423879722 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcad80cb4f0 0x7fcad80c41b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcad400ebe0 tx=0x7fcad4009e20 comp rx=0 tx=0).stop 2023-06-20T13:33:06.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.439+0000 7fcadfdff700 1 -- 172.21.15.32:0/423879722 shutdown_connections 2023-06-20T13:33:06.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.439+0000 7fcadfdff700 1 --2- 172.21.15.32:0/423879722 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcabc06ace0 0x7fcabc06d190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:06.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.439+0000 7fcadfdff700 1 --2- 172.21.15.32:0/423879722 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcad8156be0 0x7fcad8070b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:06.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.439+0000 7fcadfdff700 1 --2- 172.21.15.32:0/423879722 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcad80cb4f0 0x7fcad80c41b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:06.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.439+0000 7fcadfdff700 1 --2- 172.21.15.32:0/423879722 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcad80cd600 0x7fcad8154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:06.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.439+0000 7fcadfdff700 1 -- 172.21.15.32:0/423879722 >> 172.21.15.32:0/423879722 conn(0x7fcad80b0390 msgr2=0x7fcad8155bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:06.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.440+0000 7fcadfdff700 1 -- 172.21.15.32:0/423879722 shutdown_connections 2023-06-20T13:33:06.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:06.440+0000 7fcadfdff700 1 -- 172.21.15.32:0/423879722 wait complete. 2023-06-20T13:33:06.460 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-20T13:33:06.460 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-20T13:33:06.460 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2023-06-20T13:33:06.460 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-20T13:33:06.460 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-20T13:33:06.461 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-20T13:33:06.461 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-20T13:33:06.461 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-20T13:33:06.461 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-20T13:33:06.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:06.462 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2023-06-20T13:33:06.507 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-20T13:33:06.507 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-20T13:33:06.508 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2023-06-20T13:33:06.508 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:06.508 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2023-06-20T13:33:06.508 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:06.508 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-20T13:33:06.508 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2023-06-20T13:33:06.508 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f0 2023-06-20T13:33:06.508 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-20T13:33:06.509 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2023-06-20T13:33:06.509 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f1 2023-06-20T13:33:06.509 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-20T13:33:06.509 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2023-06-20T13:33:06.509 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f0 2023-06-20T13:33:06.509 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-06-20T13:33:06.509 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42063sec preferred_lft 42063sec 2023-06-20T13:33:06.509 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link 2023-06-20T13:33:06.510 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:06.510 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-20T13:33:06.510 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2023-06-20T13:33:06.510 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f1 2023-06-20T13:33:06.511 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-20T13:33:06.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:06.511 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-06-20T13:33:06.512 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-06-20T13:33:06.512 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link add name ceph-brx type bridge 2023-06-20T13:33:06.512 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip addr flush dev ceph-brx 2023-06-20T13:33:06.512 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set ceph-brx up 2023-06-20T13:33:06.513 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-20T13:33:06.513 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-06-20T13:33:06.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:06.713 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-20T13:33:06.782 INFO:teuthology.orchestra.run.smithi032.stdout:1 2023-06-20T13:33:06.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:06.785 DEBUG:teuthology.orchestra.run.smithi032:> route 2023-06-20T13:33:06.834 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2023-06-20T13:33:06.834 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-20T13:33:06.834 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-06-20T13:33:06.835 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-06-20T13:33:06.835 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-20T13:33:06.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:06.836 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-06-20T13:33:06.836 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-06-20T13:33:06.837 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-20T13:33:06.837 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-20T13:33:06.837 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-20T13:33:06.837 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-06-20T13:33:07.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:07.009 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2023-06-20T13:33:07.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:07.056 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list-id 2023-06-20T13:33:07.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:07.143 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-06-20T13:33:07.143 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-06-20T13:33:07.144 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-20T13:33:07.144 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-06-20T13:33:07.145 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-06-20T13:33:07.289 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-06-20T13:33:07.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:07.289 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-06-20T13:33:07.290 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-06-20T13:33:07.290 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-06-20T13:33:07.290 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-20T13:33:07.290 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-06-20T13:33:07.291 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-06-20T13:33:07.291 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-06-20T13:33:07.291 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-06-20T13:33:07.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:07.538 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-06-20T13:33:07.538 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-06-20T13:33:07.538 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.0 up 2023-06-20T13:33:07.538 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set dev brx.0 master ceph-brx 2023-06-20T13:33:07.539 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-06-20T13:33:07.717 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-20T13:33:07.718 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-20T13:33:07.764 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-20T13:33:07.764 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-20T13:33:07.765 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-20T13:33:07.849 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-06-20T13:33:07.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:07.849 DEBUG:teuthology.orchestra.run.smithi032:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-20T13:33:07.995 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-20T13:33:07.996 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-20T13:33:08.379 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:33:08.385 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:33:08.433 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-20T13:33:08.433 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-20T13:33:08.433 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-06-20T13:33:08.434 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: trying mount with new device syntax: 0@8ec09bdb-4968-488f-bf51-7b0f1e92355f.cephfs=/ 2023-06-20T13:33:08.434 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.32:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2023-06-20T13:33:08.439 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-20T13:33:08.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:08.440 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-20T13:33:08.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:08.512 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-20T13:33:08.640 INFO:teuthology.orchestra.run.smithi032.stdout:client4854 2023-06-20T13:33:08.641 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:33:08.641 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-20T13:33:08.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:08.687 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-20T13:33:08.814 INFO:teuthology.orchestra.run.smithi032.stdout:client4854 2023-06-20T13:33:08.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:08.815 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-20T13:33:08.903 INFO:teuthology.orchestra.run.smithi032.stdout:client4854 2023-06-20T13:33:08.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:08.904 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/8ec09bdb-4968-488f-bf51-7b0f1e92355f.client4854/status') 2023-06-20T13:33:09.012 INFO:teuthology.orchestra.run.smithi032.stdout:instance: client.4854 (3)192.168.0.1:0/3384993924 2023-06-20T13:33:09.012 INFO:teuthology.orchestra.run.smithi032.stdout:blocklisted: false 2023-06-20T13:33:09.012 INFO:teuthology.orchestra.run.smithi032.stderr:0+1 records in 2023-06-20T13:33:09.013 INFO:teuthology.orchestra.run.smithi032.stderr:0+1 records out 2023-06-20T13:33:09.013 INFO:teuthology.orchestra.run.smithi032.stderr:69 bytes copied, 5.4659e-05 s, 1.3 MB/s 2023-06-20T13:33:09.015 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-06-20T13:33:09.015 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-20T13:33:09.015 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-06-20T13:33:09.016 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-20T13:33:09.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.216+0000 7ffa37bff700 1 Processor -- start 2023-06-20T13:33:09.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.216+0000 7ffa37bff700 1 -- start start 2023-06-20T13:33:09.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.217+0000 7ffa37bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ffa3015c460 0x7ffa300b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:09.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.217+0000 7ffa37bff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa300d2640 0x7ffa300cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:09.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.217+0000 7ffa37bff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ffa300cf720 0x7ffa300cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:09.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.217+0000 7ffa37bff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa300cedd0 con 0x7ffa300cf720 2023-06-20T13:33:09.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.217+0000 7ffa37bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa300d1790 con 0x7ffa3015c460 2023-06-20T13:33:09.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.217+0000 7ffa37bff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa300cd950 con 0x7ffa300d2640 2023-06-20T13:33:09.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.217+0000 7ffa3619c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ffa300cf720 0x7ffa300cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:09.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.218+0000 7ffa3619c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ffa300cf720 0x7ffa300cfbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51506/0 (socket says 172.21.15.32:51506) 2023-06-20T13:33:09.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.218+0000 7ffa3619c700 1 -- 172.21.15.32:0/1155454705 learned_addr learned my addr 172.21.15.32:0/1155454705 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:09.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.218+0000 7ffa3519a700 1 --2- 172.21.15.32:0/1155454705 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa300d2640 0x7ffa300cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:09.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.218+0000 7ffa3599b700 1 --2- 172.21.15.32:0/1155454705 >> v2:172.21.15.115:3300/0 conn(0x7ffa3015c460 0x7ffa300b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:09.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.218+0000 7ffa3619c700 1 -- 172.21.15.32:0/1155454705 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa300d2640 msgr2=0x7ffa300cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:09.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.218+0000 7ffa3619c700 1 --2- 172.21.15.32:0/1155454705 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa300d2640 0x7ffa300cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:09.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.218+0000 7ffa3619c700 1 -- 172.21.15.32:0/1155454705 >> v2:172.21.15.115:3300/0 conn(0x7ffa3015c460 msgr2=0x7ffa300b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:09.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.218+0000 7ffa3619c700 1 --2- 172.21.15.32:0/1155454705 >> v2:172.21.15.115:3300/0 conn(0x7ffa3015c460 0x7ffa300b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:09.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.218+0000 7ffa3619c700 1 -- 172.21.15.32:0/1155454705 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa300d14b0 con 0x7ffa300cf720 2023-06-20T13:33:09.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.218+0000 7ffa3519a700 1 --2- 172.21.15.32:0/1155454705 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa300d2640 0x7ffa300cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:09.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.218+0000 7ffa3599b700 1 --2- 172.21.15.32:0/1155454705 >> v2:172.21.15.115:3300/0 conn(0x7ffa3015c460 0x7ffa300b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:09.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.218+0000 7ffa3619c700 1 --2- 172.21.15.32:0/1155454705 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa300cf720 0x7ffa300cfbc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffa300b4f00 tx=0x7ffa2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f04d5c360c90123c server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:09.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.218+0000 7ffa34999700 1 -- 172.21.15.32:0/1155454705 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2800e070 con 0x7ffa300cf720 2023-06-20T13:33:09.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.218+0000 7ffa34999700 1 -- 172.21.15.32:0/1155454705 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2800b9c0 con 0x7ffa300cf720 2023-06-20T13:33:09.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.218+0000 7ffa34999700 1 -- 172.21.15.32:0/1155454705 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2800bd70 con 0x7ffa300cf720 2023-06-20T13:33:09.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.219+0000 7ffa37bff700 1 -- 172.21.15.32:0/1155454705 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa300cf720 msgr2=0x7ffa300cfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:09.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.219+0000 7ffa37bff700 1 --2- 172.21.15.32:0/1155454705 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa300cf720 0x7ffa300cfbc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffa300b4f00 tx=0x7ffa2800b330 comp rx=0 tx=0).stop 2023-06-20T13:33:09.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.219+0000 7ffa37bff700 1 -- 172.21.15.32:0/1155454705 shutdown_connections 2023-06-20T13:33:09.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.219+0000 7ffa37bff700 1 --2- 172.21.15.32:0/1155454705 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa300cf720 0x7ffa300cfbc0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:09.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.219+0000 7ffa37bff700 1 --2- 172.21.15.32:0/1155454705 >> v2:172.21.15.115:3300/0 conn(0x7ffa3015c460 0x7ffa300b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:09.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.219+0000 7ffa37bff700 1 --2- 172.21.15.32:0/1155454705 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa300d2640 0x7ffa300cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:09.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.219+0000 7ffa37bff700 1 -- 172.21.15.32:0/1155454705 >> 172.21.15.32:0/1155454705 conn(0x7ffa30071660 msgr2=0x7ffa30071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:09.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.219+0000 7ffa37bff700 1 -- 172.21.15.32:0/1155454705 shutdown_connections 2023-06-20T13:33:09.226 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.219+0000 7ffa37bff700 1 -- 172.21.15.32:0/1155454705 wait complete. 2023-06-20T13:33:09.227 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.221+0000 7ffa37bff700 1 Processor -- start 2023-06-20T13:33:09.227 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.221+0000 7ffa37bff700 1 -- start start 2023-06-20T13:33:09.227 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.222+0000 7ffa37bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa300cf720 0x7ffa3015ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:09.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.222+0000 7ffa37bff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa300d2640 0x7ffa300caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:09.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.222+0000 7ffa37bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa3015c460 0x7ffa301580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:09.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.222+0000 7ffa37bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa300cbce0 con 0x7ffa300cf720 2023-06-20T13:33:09.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.222+0000 7ffa37bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa300cb1e0 con 0x7ffa3015c460 2023-06-20T13:33:09.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.222+0000 7ffa37bff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa30158600 con 0x7ffa300d2640 2023-06-20T13:33:09.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.222+0000 7ffa3599b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa300cf720 0x7ffa3015ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:09.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.222+0000 7ffa3599b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa300cf720 0x7ffa3015ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:51514/0 (socket says 172.21.15.32:51514) 2023-06-20T13:33:09.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.222+0000 7ffa3599b700 1 -- 172.21.15.32:0/3446659108 learned_addr learned my addr 172.21.15.32:0/3446659108 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:09.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.223+0000 7ffa3619c700 1 --2- 172.21.15.32:0/3446659108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa3015c460 0x7ffa301580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:09.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.223+0000 7ffa3519a700 1 --2- 172.21.15.32:0/3446659108 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa300d2640 0x7ffa300caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:09.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.223+0000 7ffa3599b700 1 -- 172.21.15.32:0/3446659108 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa300d2640 msgr2=0x7ffa300caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:09.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.223+0000 7ffa3599b700 1 --2- 172.21.15.32:0/3446659108 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa300d2640 0x7ffa300caca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:09.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.223+0000 7ffa3599b700 1 -- 172.21.15.32:0/3446659108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa3015c460 msgr2=0x7ffa301580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:09.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.223+0000 7ffa3599b700 1 --2- 172.21.15.32:0/3446659108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa3015c460 0x7ffa301580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:09.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.223+0000 7ffa3599b700 1 -- 172.21.15.32:0/3446659108 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa28009b30 con 0x7ffa300cf720 2023-06-20T13:33:09.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.223+0000 7ffa3599b700 1 --2- 172.21.15.32:0/3446659108 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa300cf720 0x7ffa3015ab30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c00c7f0 tx=0x7ffa2c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:09.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.223+0000 7ffa267fc700 1 -- 172.21.15.32:0/3446659108 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c011800 con 0x7ffa300cf720 2023-06-20T13:33:09.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.223+0000 7ffa267fc700 1 -- 172.21.15.32:0/3446659108 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2c011960 con 0x7ffa300cf720 2023-06-20T13:33:09.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.223+0000 7ffa267fc700 1 -- 172.21.15.32:0/3446659108 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c011d10 con 0x7ffa300cf720 2023-06-20T13:33:09.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.223+0000 7ffa37bff700 1 -- 172.21.15.32:0/3446659108 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa300cb440 con 0x7ffa300cf720 2023-06-20T13:33:09.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.223+0000 7ffa37bff700 1 -- 172.21.15.32:0/3446659108 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa300cba00 con 0x7ffa300cf720 2023-06-20T13:33:09.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.224+0000 7ffa37bff700 1 -- 172.21.15.32:0/3446659108 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa3004ea60 con 0x7ffa300cf720 2023-06-20T13:33:09.231 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.225+0000 7ffa267fc700 1 -- 172.21.15.32:0/3446659108 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffa2c018360 con 0x7ffa300cf720 2023-06-20T13:33:09.231 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.226+0000 7ffa267fc700 1 --2- 172.21.15.32:0/3446659108 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ffa1406ace0 0x7ffa1406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:09.231 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.226+0000 7ffa267fc700 1 -- 172.21.15.32:0/3446659108 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ffa2c0897a0 con 0x7ffa300cf720 2023-06-20T13:33:09.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.227+0000 7ffa3519a700 1 --2- 172.21.15.32:0/3446659108 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ffa1406ace0 0x7ffa1406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:09.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.227+0000 7ffa3519a700 1 --2- 172.21.15.32:0/3446659108 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ffa1406ace0 0x7ffa1406d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffa2000aa10 tx=0x7ffa20008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:09.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.231+0000 7ffa267fc700 1 -- 172.21.15.32:0/3446659108 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ffa2c057fa0 con 0x7ffa300cf720 2023-06-20T13:33:09.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.483+0000 7ffa37bff700 1 -- 172.21.15.32:0/3446659108 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffa300b4fa0 con 0x7ffa300cf720 2023-06-20T13:33:09.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.483+0000 7ffa267fc700 1 -- 172.21.15.32:0/3446659108 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7ffa2c057b30 con 0x7ffa300cf720 2023-06-20T13:33:09.486 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-20T13:33:09.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.485+0000 7ffa37bff700 1 -- 172.21.15.32:0/3446659108 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ffa1406ace0 msgr2=0x7ffa1406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:09.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.485+0000 7ffa37bff700 1 --2- 172.21.15.32:0/3446659108 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ffa1406ace0 0x7ffa1406d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ffa2000aa10 tx=0x7ffa20008040 comp rx=0 tx=0).stop 2023-06-20T13:33:09.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.485+0000 7ffa37bff700 1 -- 172.21.15.32:0/3446659108 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa300cf720 msgr2=0x7ffa3015ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:09.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.486+0000 7ffa37bff700 1 --2- 172.21.15.32:0/3446659108 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa300cf720 0x7ffa3015ab30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c00c7f0 tx=0x7ffa2c00cbb0 comp rx=0 tx=0).stop 2023-06-20T13:33:09.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.486+0000 7ffa37bff700 1 -- 172.21.15.32:0/3446659108 shutdown_connections 2023-06-20T13:33:09.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.486+0000 7ffa37bff700 1 --2- 172.21.15.32:0/3446659108 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ffa1406ace0 0x7ffa1406d190 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:09.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.486+0000 7ffa37bff700 1 --2- 172.21.15.32:0/3446659108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffa3015c460 0x7ffa301580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:09.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.486+0000 7ffa37bff700 1 --2- 172.21.15.32:0/3446659108 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffa300cf720 0x7ffa3015ab30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:09.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.486+0000 7ffa37bff700 1 --2- 172.21.15.32:0/3446659108 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffa300d2640 0x7ffa300caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:09.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.486+0000 7ffa37bff700 1 -- 172.21.15.32:0/3446659108 >> 172.21.15.32:0/3446659108 conn(0x7ffa30071660 msgr2=0x7ffa300b78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:09.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.486+0000 7ffa37bff700 1 -- 172.21.15.32:0/3446659108 shutdown_connections 2023-06-20T13:33:09.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:09.486+0000 7ffa37bff700 1 -- 172.21.15.32:0/3446659108 wait complete. 2023-06-20T13:33:09.506 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-20T13:33:09.506 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-20T13:33:09.507 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2023-06-20T13:33:09.507 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-06-20T13:33:09.507 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-06-20T13:33:09.507 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-20T13:33:09.507 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-20T13:33:09.508 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-20T13:33:09.508 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-06-20T13:33:09.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:09.508 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2023-06-20T13:33:09.554 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-20T13:33:09.555 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-20T13:33:09.555 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2023-06-20T13:33:09.555 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:09.556 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2023-06-20T13:33:09.556 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:09.556 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-20T13:33:09.556 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2023-06-20T13:33:09.556 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f0 2023-06-20T13:33:09.556 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-20T13:33:09.557 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2023-06-20T13:33:09.557 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f1 2023-06-20T13:33:09.557 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-20T13:33:09.557 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2023-06-20T13:33:09.557 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f0 2023-06-20T13:33:09.557 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-06-20T13:33:09.557 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 42060sec preferred_lft 42060sec 2023-06-20T13:33:09.557 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link 2023-06-20T13:33:09.558 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:09.558 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-20T13:33:09.558 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2023-06-20T13:33:09.558 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f1 2023-06-20T13:33:09.558 INFO:teuthology.orchestra.run.smithi032.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-20T13:33:09.558 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 22:b0:3d:6a:82:8a brd ff:ff:ff:ff:ff:ff 2023-06-20T13:33:09.558 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-20T13:33:09.559 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:09.559 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::f8d6:73ff:fef6:470b/64 scope link 2023-06-20T13:33:09.559 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:09.559 INFO:teuthology.orchestra.run.smithi032.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-20T13:33:09.559 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 22:b0:3d:6a:82:8a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-20T13:33:09.559 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::20b0:3dff:fe6a:828a/64 scope link 2023-06-20T13:33:09.559 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:09.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:09.561 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-20T13:33:09.629 INFO:teuthology.orchestra.run.smithi032.stdout:1 2023-06-20T13:33:09.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:09.632 DEBUG:teuthology.orchestra.run.smithi032:> route 2023-06-20T13:33:09.681 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2023-06-20T13:33:09.682 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-20T13:33:09.682 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-06-20T13:33:09.682 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-06-20T13:33:09.683 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-20T13:33:09.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:09.684 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-06-20T13:33:09.684 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-06-20T13:33:09.685 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-20T13:33:09.686 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-20T13:33:09.686 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-20T13:33:09.687 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-06-20T13:33:09.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:09.857 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2023-06-20T13:33:09.903 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-20T13:33:09.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:09.905 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list-id 2023-06-20T13:33:09.950 INFO:teuthology.orchestra.run.smithi032.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-06-20T13:33:09.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:09.951 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-06-20T13:33:09.952 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-06-20T13:33:09.952 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-20T13:33:09.952 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-06-20T13:33:09.952 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-06-20T13:33:10.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:10.136 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-06-20T13:33:10.207 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-20T13:33:10.207 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-20T13:33:10.208 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2023-06-20T13:33:10.208 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:10.208 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2023-06-20T13:33:10.208 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:10.208 INFO:teuthology.orchestra.run.smithi032.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-20T13:33:10.208 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether f6:7f:fe:81:ec:f1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-20T13:33:10.209 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-20T13:33:10.209 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:10.209 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::f47f:feff:fe81:ecf1/64 scope link 2023-06-20T13:33:10.209 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:10.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:10.210 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-06-20T13:33:10.281 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-20T13:33:10.282 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-20T13:33:10.282 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2023-06-20T13:33:10.282 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:10.282 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2023-06-20T13:33:10.282 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:10.282 INFO:teuthology.orchestra.run.smithi032.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-20T13:33:10.283 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether f6:7f:fe:81:ec:f1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-20T13:33:10.283 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-20T13:33:10.283 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:10.283 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::f47f:feff:fe81:ecf1/64 scope link 2023-06-20T13:33:10.283 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:10.284 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-06-20T13:33:10.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:10.285 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-06-20T13:33:10.285 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-06-20T13:33:10.285 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-06-20T13:33:10.286 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-06-20T13:33:10.286 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-06-20T13:33:10.286 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-06-20T13:33:10.286 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-06-20T13:33:10.286 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-06-20T13:33:10.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:10.534 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-06-20T13:33:10.534 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-06-20T13:33:10.534 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.1 up 2023-06-20T13:33:10.534 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set dev brx.1 master ceph-brx 2023-06-20T13:33:10.535 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-06-20T13:33:10.714 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-20T13:33:10.715 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-06-20T13:33:10.761 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-06-20T13:33:10.761 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-20T13:33:10.762 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-06-20T13:33:10.845 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-06-20T13:33:10.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:10.846 DEBUG:teuthology.orchestra.run.smithi032:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-20T13:33:10.992 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-20T13:33:10.992 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-20T13:33:11.019 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-20T13:33:11.019 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-20T13:33:11.019 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-06-20T13:33:11.019 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: trying mount with new device syntax: 2@8ec09bdb-4968-488f-bf51-7b0f1e92355f.cephfs=/ 2023-06-20T13:33:11.020 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.32:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2023-06-20T13:33:11.023 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-20T13:33:11.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:11.024 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-06-20T13:33:11.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:11.094 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-20T13:33:11.181 INFO:teuthology.orchestra.run.smithi032.stdout:client4863 2023-06-20T13:33:11.181 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:33:11.181 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-20T13:33:11.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:11.228 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-20T13:33:11.356 INFO:teuthology.orchestra.run.smithi032.stdout:client4863 2023-06-20T13:33:11.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:11.357 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-20T13:33:11.444 INFO:teuthology.orchestra.run.smithi032.stdout:client4863 2023-06-20T13:33:11.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:11.445 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/8ec09bdb-4968-488f-bf51-7b0f1e92355f.client4863/status') 2023-06-20T13:33:11.553 INFO:teuthology.orchestra.run.smithi032.stdout:instance: client.4863 (3)192.168.0.2:0/1680634401 2023-06-20T13:33:11.553 INFO:teuthology.orchestra.run.smithi032.stdout:blocklisted: false 2023-06-20T13:33:11.553 INFO:teuthology.orchestra.run.smithi032.stderr:0+1 records in 2023-06-20T13:33:11.554 INFO:teuthology.orchestra.run.smithi032.stderr:0+1 records out 2023-06-20T13:33:11.554 INFO:teuthology.orchestra.run.smithi032.stderr:69 bytes copied, 5.371e-05 s, 1.3 MB/s 2023-06-20T13:33:11.555 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-06-20T13:33:11.556 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-20T13:33:11.556 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-20T13:33:11.556 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-20T13:33:11.757 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.755+0000 7fa3a8bff700 1 Processor -- start 2023-06-20T13:33:11.757 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.755+0000 7fa3a8bff700 1 -- start start 2023-06-20T13:33:11.758 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.756+0000 7fa3a8bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa3a415c460 0x7fa3a40b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:11.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.756+0000 7fa3a8bff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3a40cf8f0 0x7fa3a415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:11.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.756+0000 7fa3a8bff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a40d1790 con 0x7fa3a40d2640 2023-06-20T13:33:11.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.756+0000 7fa3a8bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a40cedd0 con 0x7fa3a415c460 2023-06-20T13:33:11.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.756+0000 7fa3a8bff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a40cd950 con 0x7fa3a40cf8f0 2023-06-20T13:33:11.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.756+0000 7fa3a1d9b700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa3a40d2640 0x7fa3a40cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41620/0 (socket says 172.21.15.32:41620) 2023-06-20T13:33:11.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.757+0000 7fa3a1d9b700 1 -- 172.21.15.32:0/4150341811 learned_addr learned my addr 172.21.15.32:0/4150341811 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:11.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.757+0000 7fa3a259c700 1 --2- 172.21.15.32:0/4150341811 >> v2:172.21.15.115:3300/0 conn(0x7fa3a415c460 0x7fa3a40b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:11.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.757+0000 7fa3a2d9d700 1 --2- 172.21.15.32:0/4150341811 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3a40cf8f0 0x7fa3a415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:11.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.757+0000 7fa3a159a700 1 -- 172.21.15.32:0/4150341811 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3846031019 0 0) 0x7fa3a40d1790 con 0x7fa3a40d2640 2023-06-20T13:33:11.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.757+0000 7fa3a159a700 1 -- 172.21.15.32:0/4150341811 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa38c0035b0 con 0x7fa3a40d2640 2023-06-20T13:33:11.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.757+0000 7fa3a2d9d700 1 -- 172.21.15.32:0/4150341811 >> v2:172.21.15.115:3300/0 conn(0x7fa3a415c460 msgr2=0x7fa3a40b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:11.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.757+0000 7fa3a2d9d700 1 --2- 172.21.15.32:0/4150341811 >> v2:172.21.15.115:3300/0 conn(0x7fa3a415c460 0x7fa3a40b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:11.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.757+0000 7fa3a2d9d700 1 -- 172.21.15.32:0/4150341811 >> v1:172.21.15.32:6789/0 conn(0x7fa3a40d2640 legacy=0x7fa3a40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:11.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.757+0000 7fa3a2d9d700 1 -- 172.21.15.32:0/4150341811 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a40d14b0 con 0x7fa3a40cf8f0 2023-06-20T13:33:11.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.757+0000 7fa3a259c700 1 --2- 172.21.15.32:0/4150341811 >> v2:172.21.15.115:3300/0 conn(0x7fa3a415c460 0x7fa3a40b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:33:11.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.758+0000 7fa3a2d9d700 1 --2- 172.21.15.32:0/4150341811 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3a40cf8f0 0x7fa3a415fe20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009d90 tx=0x7fa39c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=928f317c23b923b8 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:11.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.758+0000 7fa3a159a700 1 -- 172.21.15.32:0/4150341811 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c00e070 con 0x7fa3a40cf8f0 2023-06-20T13:33:11.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.758+0000 7fa3a159a700 1 -- 172.21.15.32:0/4150341811 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39c00bb20 con 0x7fa3a40cf8f0 2023-06-20T13:33:11.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.758+0000 7fa3a159a700 1 -- 172.21.15.32:0/4150341811 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c00be90 con 0x7fa3a40cf8f0 2023-06-20T13:33:11.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.758+0000 7fa3a8bff700 1 -- 172.21.15.32:0/4150341811 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3a40cf8f0 msgr2=0x7fa3a415fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:11.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.758+0000 7fa3a8bff700 1 --2- 172.21.15.32:0/4150341811 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3a40cf8f0 0x7fa3a415fe20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009d90 tx=0x7fa39c00b330 comp rx=0 tx=0).stop 2023-06-20T13:33:11.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.759+0000 7fa3a8bff700 1 -- 172.21.15.32:0/4150341811 shutdown_connections 2023-06-20T13:33:11.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.759+0000 7fa3a8bff700 1 --2- 172.21.15.32:0/4150341811 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3a40cf8f0 0x7fa3a415fe20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:11.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.759+0000 7fa3a8bff700 1 --2- 172.21.15.32:0/4150341811 >> v2:172.21.15.115:3300/0 conn(0x7fa3a415c460 0x7fa3a40b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:11.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.759+0000 7fa3a8bff700 1 -- 172.21.15.32:0/4150341811 >> 172.21.15.32:0/4150341811 conn(0x7fa3a4071660 msgr2=0x7fa3a4071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:11.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.759+0000 7fa3a8bff700 1 -- 172.21.15.32:0/4150341811 shutdown_connections 2023-06-20T13:33:11.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.759+0000 7fa3a8bff700 1 -- 172.21.15.32:0/4150341811 wait complete. 2023-06-20T13:33:11.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.761+0000 7fa3a8bff700 1 Processor -- start 2023-06-20T13:33:11.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.761+0000 7fa3a8bff700 1 -- start start 2023-06-20T13:33:11.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.762+0000 7fa3a8bff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3a40cf8f0 0x7fa3a414fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:11.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.762+0000 7fa3a8bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3a40d2640 0x7fa3a40c7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:11.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.762+0000 7fa3a8bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3a415c460 0x7fa3a4158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:11.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.762+0000 7fa3a8bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a415e9c0 con 0x7fa3a415c460 2023-06-20T13:33:11.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.762+0000 7fa3a8bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a415ddb0 con 0x7fa3a40d2640 2023-06-20T13:33:11.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.762+0000 7fa3a8bff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a415e090 con 0x7fa3a40cf8f0 2023-06-20T13:33:11.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.762+0000 7fa3a2d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3a415c460 0x7fa3a4158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:11.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.762+0000 7fa3a2d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3a415c460 0x7fa3a4158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38062/0 (socket says 172.21.15.32:38062) 2023-06-20T13:33:11.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.762+0000 7fa3a2d9d700 1 -- 172.21.15.32:0/2262066361 learned_addr learned my addr 172.21.15.32:0/2262066361 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:11.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.762+0000 7fa3a259c700 1 --2- 172.21.15.32:0/2262066361 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3a40cf8f0 0x7fa3a414fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:11.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.762+0000 7fa3a1d9b700 1 --2- 172.21.15.32:0/2262066361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3a40d2640 0x7fa3a40c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:11.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.763+0000 7fa3a2d9d700 1 -- 172.21.15.32:0/2262066361 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3a40cf8f0 msgr2=0x7fa3a414fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:11.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.763+0000 7fa3a2d9d700 1 --2- 172.21.15.32:0/2262066361 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3a40cf8f0 0x7fa3a414fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:11.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.763+0000 7fa3a2d9d700 1 -- 172.21.15.32:0/2262066361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3a40d2640 msgr2=0x7fa3a40c7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:11.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.763+0000 7fa3a2d9d700 1 --2- 172.21.15.32:0/2262066361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3a40d2640 0x7fa3a40c7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:11.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.763+0000 7fa3a2d9d700 1 -- 172.21.15.32:0/2262066361 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3940094a0 con 0x7fa3a415c460 2023-06-20T13:33:11.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.763+0000 7fa3a2d9d700 1 --2- 172.21.15.32:0/2262066361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3a415c460 0x7fa3a4158200 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa39c014040 tx=0x7fa39c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:11.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.763+0000 7fa392ffd700 1 -- 172.21.15.32:0/2262066361 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c007000 con 0x7fa3a415c460 2023-06-20T13:33:11.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.763+0000 7fa392ffd700 1 -- 172.21.15.32:0/2262066361 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39c012650 con 0x7fa3a415c460 2023-06-20T13:33:11.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.763+0000 7fa392ffd700 1 -- 172.21.15.32:0/2262066361 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c012a00 con 0x7fa3a415c460 2023-06-20T13:33:11.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.763+0000 7fa3a8bff700 1 -- 172.21.15.32:0/2262066361 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa39c009a70 con 0x7fa3a415c460 2023-06-20T13:33:11.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.763+0000 7fa3a8bff700 1 -- 172.21.15.32:0/2262066361 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a415e650 con 0x7fa3a415c460 2023-06-20T13:33:11.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.764+0000 7fa3a8bff700 1 -- 172.21.15.32:0/2262066361 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a404ea60 con 0x7fa3a415c460 2023-06-20T13:33:11.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.765+0000 7fa392ffd700 1 -- 172.21.15.32:0/2262066361 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa39c012b60 con 0x7fa3a415c460 2023-06-20T13:33:11.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.766+0000 7fa392ffd700 1 --2- 172.21.15.32:0/2262066361 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa38406ace0 0x7fa38406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:11.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.766+0000 7fa392ffd700 1 -- 172.21.15.32:0/2262066361 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa39c08b4a0 con 0x7fa3a415c460 2023-06-20T13:33:11.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.767+0000 7fa3a259c700 1 --2- 172.21.15.32:0/2262066361 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa38406ace0 0x7fa38406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:11.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.767+0000 7fa3a259c700 1 --2- 172.21.15.32:0/2262066361 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa38406ace0 0x7fa38406d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa394009d70 tx=0x7fa394009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:11.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:11.770+0000 7fa392ffd700 1 -- 172.21.15.32:0/2262066361 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa39c0563e0 con 0x7fa3a415c460 2023-06-20T13:33:12.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:12.028+0000 7fa3a8bff700 1 -- 172.21.15.32:0/2262066361 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa3a415eb00 con 0x7fa3a415c460 2023-06-20T13:33:12.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:12.029+0000 7fa392ffd700 1 -- 172.21.15.32:0/2262066361 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7fa39c059a00 con 0x7fa3a415c460 2023-06-20T13:33:12.031 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-20T13:33:12.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:12.031+0000 7fa3a8bff700 1 -- 172.21.15.32:0/2262066361 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa38406ace0 msgr2=0x7fa38406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:12.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:12.031+0000 7fa3a8bff700 1 --2- 172.21.15.32:0/2262066361 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa38406ace0 0x7fa38406d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa394009d70 tx=0x7fa394009210 comp rx=0 tx=0).stop 2023-06-20T13:33:12.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:12.031+0000 7fa3a8bff700 1 -- 172.21.15.32:0/2262066361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3a415c460 msgr2=0x7fa3a4158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:12.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:12.031+0000 7fa3a8bff700 1 --2- 172.21.15.32:0/2262066361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3a415c460 0x7fa3a4158200 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa39c014040 tx=0x7fa39c004ad0 comp rx=0 tx=0).stop 2023-06-20T13:33:12.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:12.031+0000 7fa3a8bff700 1 -- 172.21.15.32:0/2262066361 shutdown_connections 2023-06-20T13:33:12.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:12.031+0000 7fa3a8bff700 1 --2- 172.21.15.32:0/2262066361 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa38406ace0 0x7fa38406d190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:12.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:12.031+0000 7fa3a8bff700 1 --2- 172.21.15.32:0/2262066361 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa3a415c460 0x7fa3a4158200 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:12.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:12.031+0000 7fa3a8bff700 1 --2- 172.21.15.32:0/2262066361 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa3a40cf8f0 0x7fa3a414fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:12.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:12.031+0000 7fa3a8bff700 1 --2- 172.21.15.32:0/2262066361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa3a40d2640 0x7fa3a40c7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:12.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:12.031+0000 7fa3a8bff700 1 -- 172.21.15.32:0/2262066361 >> 172.21.15.32:0/2262066361 conn(0x7fa3a4071660 msgr2=0x7fa3a40b8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:12.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:12.031+0000 7fa3a8bff700 1 -- 172.21.15.32:0/2262066361 shutdown_connections 2023-06-20T13:33:12.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:12.031+0000 7fa3a8bff700 1 -- 172.21.15.32:0/2262066361 wait complete. 2023-06-20T13:33:12.051 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-20T13:33:12.052 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-20T13:33:12.052 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-06-20T13:33:12.052 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-06-20T13:33:12.053 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-20T13:33:12.053 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-20T13:33:12.053 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-20T13:33:12.053 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-20T13:33:12.054 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-20T13:33:12.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:12.054 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-06-20T13:33:12.106 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-20T13:33:12.106 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-20T13:33:12.107 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-06-20T13:33:12.107 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:12.107 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-06-20T13:33:12.107 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:12.107 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-20T13:33:12.107 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-06-20T13:33:12.107 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-06-20T13:33:12.108 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-20T13:33:12.108 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-06-20T13:33:12.108 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-06-20T13:33:12.108 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-20T13:33:12.108 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-06-20T13:33:12.108 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-20T13:33:12.108 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-06-20T13:33:12.109 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-06-20T13:33:12.109 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 41803sec preferred_lft 41803sec 2023-06-20T13:33:12.109 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-06-20T13:33:12.109 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:12.110 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-20T13:33:12.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:12.111 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-06-20T13:33:12.111 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-06-20T13:33:12.112 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link add name ceph-brx type bridge 2023-06-20T13:33:12.112 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip addr flush dev ceph-brx 2023-06-20T13:33:12.112 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set ceph-brx up 2023-06-20T13:33:12.112 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-20T13:33:12.113 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-06-20T13:33:12.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:12.590 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-20T13:33:12.696 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-06-20T13:33:12.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:12.699 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-06-20T13:33:12.778 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-06-20T13:33:12.779 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-20T13:33:12.779 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-20T13:33:12.779 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-20T13:33:12.779 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-20T13:33:12.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:12.781 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-06-20T13:33:12.781 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-06-20T13:33:12.781 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-20T13:33:12.781 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-20T13:33:12.782 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-20T13:33:12.782 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-06-20T13:33:13.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:13.440 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-06-20T13:33:13.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:13.488 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list-id 2023-06-20T13:33:13.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:13.575 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-06-20T13:33:13.575 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-06-20T13:33:13.575 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-20T13:33:13.576 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-06-20T13:33:13.576 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-06-20T13:33:13.716 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-06-20T13:33:13.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:13.717 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-06-20T13:33:13.718 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-06-20T13:33:13.718 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-06-20T13:33:13.718 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-20T13:33:13.718 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-06-20T13:33:13.718 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-06-20T13:33:13.719 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-06-20T13:33:13.719 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-06-20T13:33:13.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:13.983 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-06-20T13:33:13.984 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-06-20T13:33:13.984 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.0 up 2023-06-20T13:33:13.984 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set dev brx.0 master ceph-brx 2023-06-20T13:33:13.984 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-06-20T13:33:14.166 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-20T13:33:14.166 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-06-20T13:33:14.212 INFO:teuthology.orchestra.run.smithi115.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-06-20T13:33:14.213 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-20T13:33:14.213 DEBUG:teuthology.orchestra.run.smithi115:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-06-20T13:33:14.297 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-06-20T13:33:14.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:14.298 DEBUG:teuthology.orchestra.run.smithi115:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-20T13:33:14.444 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-20T13:33:14.445 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-20T13:33:14.896 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-20T13:33:14.897 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-20T13:33:14.897 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-06-20T13:33:14.897 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: trying mount with new device syntax: 1@8ec09bdb-4968-488f-bf51-7b0f1e92355f.cephfs=/ 2023-06-20T13:33:14.897 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.32:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2023-06-20T13:33:14.901 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-20T13:33:14.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:14.902 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-06-20T13:33:14.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:14.972 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-20T13:33:15.066 INFO:teuthology.orchestra.run.smithi115.stdout:client4682 2023-06-20T13:33:15.066 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:33:15.067 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-20T13:33:15.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:15.112 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-20T13:33:15.239 INFO:teuthology.orchestra.run.smithi115.stdout:client4682 2023-06-20T13:33:15.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:15.239 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-20T13:33:15.325 INFO:teuthology.orchestra.run.smithi115.stdout:client4682 2023-06-20T13:33:15.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:15.326 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/8ec09bdb-4968-488f-bf51-7b0f1e92355f.client4682/status') 2023-06-20T13:33:15.432 INFO:teuthology.orchestra.run.smithi115.stdout:instance: client.4682 (3)192.168.0.1:0/1198380532 2023-06-20T13:33:15.432 INFO:teuthology.orchestra.run.smithi115.stdout:blocklisted: false 2023-06-20T13:33:15.433 INFO:teuthology.orchestra.run.smithi115.stderr:0+1 records in 2023-06-20T13:33:15.433 INFO:teuthology.orchestra.run.smithi115.stderr:0+1 records out 2023-06-20T13:33:15.433 INFO:teuthology.orchestra.run.smithi115.stderr:69 bytes copied, 8.4947e-05 s, 812 kB/s 2023-06-20T13:33:15.435 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-06-20T13:33:15.435 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-20T13:33:15.435 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-06-20T13:33:15.436 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-20T13:33:15.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.646+0000 7f547b3ff700 1 Processor -- start 2023-06-20T13:33:15.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.646+0000 7f547b3ff700 1 -- start start 2023-06-20T13:33:15.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.647+0000 7f547b3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5474156be0 0x7f54740cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:15.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.647+0000 7f547b3ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f54740cd600 0x7f54740cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:15.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.647+0000 7f547b3ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54740cbc00 con 0x7f54740cb4f0 2023-06-20T13:33:15.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.647+0000 7f547b3ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5474156fb0 con 0x7f54740cd600 2023-06-20T13:33:15.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.647+0000 7f547b3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f547415da40 con 0x7f5474156be0 2023-06-20T13:33:15.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.647+0000 7f547899a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f54740cd600 0x7f54740cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:15.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.648+0000 7f547899a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f54740cd600 0x7f54740cafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38064/0 (socket says 172.21.15.32:38064) 2023-06-20T13:33:15.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.648+0000 7f547899a700 1 -- 172.21.15.32:0/2883062855 learned_addr learned my addr 172.21.15.32:0/2883062855 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:15.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.648+0000 7f547919b700 1 --2- 172.21.15.32:0/2883062855 >> v2:172.21.15.115:3300/0 conn(0x7f5474156be0 0x7f54740cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:15.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.648+0000 7f547899a700 1 -- 172.21.15.32:0/2883062855 >> v2:172.21.15.115:3300/0 conn(0x7f5474156be0 msgr2=0x7f54740cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:15.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.648+0000 7f547899a700 1 --2- 172.21.15.32:0/2883062855 >> v2:172.21.15.115:3300/0 conn(0x7f5474156be0 0x7f54740cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:15.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.648+0000 7f547899a700 1 -- 172.21.15.32:0/2883062855 >> v1:172.21.15.115:6789/0 conn(0x7f54740cb4f0 legacy=0x7f5474070340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:15.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.648+0000 7f547899a700 1 -- 172.21.15.32:0/2883062855 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54740cda50 con 0x7f54740cd600 2023-06-20T13:33:15.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.648+0000 7f547919b700 1 --2- 172.21.15.32:0/2883062855 >> v2:172.21.15.115:3300/0 conn(0x7f5474156be0 0x7f54740cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:15.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.648+0000 7f547899a700 1 --2- 172.21.15.32:0/2883062855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54740cd600 0x7f54740cafb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f547406e7e0 tx=0x7f546400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67958d8f78ad0c7a server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:15.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.648+0000 7f546bfff700 1 -- 172.21.15.32:0/2883062855 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546400dd10 con 0x7f54740cd600 2023-06-20T13:33:15.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.648+0000 7f546bfff700 1 -- 172.21.15.32:0/2883062855 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546400de70 con 0x7f54740cd600 2023-06-20T13:33:15.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.649+0000 7f546bfff700 1 -- 172.21.15.32:0/2883062855 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5464004230 con 0x7f54740cd600 2023-06-20T13:33:15.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.649+0000 7f547b3ff700 1 -- 172.21.15.32:0/2883062855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54740cd600 msgr2=0x7f54740cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:15.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.649+0000 7f547b3ff700 1 --2- 172.21.15.32:0/2883062855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54740cd600 0x7f54740cafb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f547406e7e0 tx=0x7f546400bea0 comp rx=0 tx=0).stop 2023-06-20T13:33:15.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.649+0000 7f547b3ff700 1 -- 172.21.15.32:0/2883062855 shutdown_connections 2023-06-20T13:33:15.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.649+0000 7f547b3ff700 1 --2- 172.21.15.32:0/2883062855 >> v2:172.21.15.115:3300/0 conn(0x7f5474156be0 0x7f54740cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:15.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.649+0000 7f547b3ff700 1 --2- 172.21.15.32:0/2883062855 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54740cd600 0x7f54740cafb0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:15.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.649+0000 7f547b3ff700 1 -- 172.21.15.32:0/2883062855 >> 172.21.15.32:0/2883062855 conn(0x7f54740b0390 msgr2=0x7f54740b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:15.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.649+0000 7f547b3ff700 1 -- 172.21.15.32:0/2883062855 shutdown_connections 2023-06-20T13:33:15.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.649+0000 7f547b3ff700 1 -- 172.21.15.32:0/2883062855 wait complete. 2023-06-20T13:33:15.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.651+0000 7f547b3ff700 1 Processor -- start 2023-06-20T13:33:15.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.651+0000 7f547b3ff700 1 -- start start 2023-06-20T13:33:15.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.652+0000 7f547b3ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54740cb4f0 0x7f5474150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:15.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.652+0000 7f547b3ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54740cd600 0x7f54740b3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:15.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.652+0000 7f547b3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5474156be0 0x7f54740b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:15.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.652+0000 7f547b3ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547415bd60 con 0x7f54740cb4f0 2023-06-20T13:33:15.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.652+0000 7f547b3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547415c040 con 0x7f5474156be0 2023-06-20T13:33:15.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.652+0000 7f547b3ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547415c320 con 0x7f54740cd600 2023-06-20T13:33:15.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.652+0000 7f547919b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54740cb4f0 0x7f5474150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:15.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.652+0000 7f547919b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54740cb4f0 0x7f5474150c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38068/0 (socket says 172.21.15.32:38068) 2023-06-20T13:33:15.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.652+0000 7f547919b700 1 -- 172.21.15.32:0/320294662 learned_addr learned my addr 172.21.15.32:0/320294662 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:15.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.653+0000 7f547899a700 1 --2- 172.21.15.32:0/320294662 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54740cd600 0x7f54740b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:15.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.653+0000 7f547999c700 1 --2- 172.21.15.32:0/320294662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5474156be0 0x7f54740b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:15.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.653+0000 7f547919b700 1 -- 172.21.15.32:0/320294662 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54740cd600 msgr2=0x7f54740b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:15.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.653+0000 7f547919b700 1 --2- 172.21.15.32:0/320294662 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54740cd600 0x7f54740b3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:15.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.653+0000 7f547919b700 1 -- 172.21.15.32:0/320294662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5474156be0 msgr2=0x7f54740b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:15.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.653+0000 7f547919b700 1 --2- 172.21.15.32:0/320294662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5474156be0 0x7f54740b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:15.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.653+0000 7f547919b700 1 -- 172.21.15.32:0/320294662 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546400b7f0 con 0x7f54740cb4f0 2023-06-20T13:33:15.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.653+0000 7f547919b700 1 --2- 172.21.15.32:0/320294662 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54740cb4f0 0x7f5474150c80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f547000e810 tx=0x7f547000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:15.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.653+0000 7f5469ffb700 1 -- 172.21.15.32:0/320294662 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547000c020 con 0x7f54740cb4f0 2023-06-20T13:33:15.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.653+0000 7f5469ffb700 1 -- 172.21.15.32:0/320294662 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5470004250 con 0x7f54740cb4f0 2023-06-20T13:33:15.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.653+0000 7f547b3ff700 1 -- 172.21.15.32:0/320294662 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547415c600 con 0x7f54740cb4f0 2023-06-20T13:33:15.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.653+0000 7f5469ffb700 1 -- 172.21.15.32:0/320294662 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54700036a0 con 0x7f54740cb4f0 2023-06-20T13:33:15.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.654+0000 7f547b3ff700 1 -- 172.21.15.32:0/320294662 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54741511c0 con 0x7f54740cb4f0 2023-06-20T13:33:15.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.654+0000 7f547b3ff700 1 -- 172.21.15.32:0/320294662 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5474158330 con 0x7f54740cb4f0 2023-06-20T13:33:15.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.656+0000 7f5469ffb700 1 -- 172.21.15.32:0/320294662 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5470003800 con 0x7f54740cb4f0 2023-06-20T13:33:15.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.657+0000 7f5469ffb700 1 --2- 172.21.15.32:0/320294662 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f545806ad10 0x7f545806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:15.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.657+0000 7f5469ffb700 1 -- 172.21.15.32:0/320294662 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5470089120 con 0x7f54740cb4f0 2023-06-20T13:33:15.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.657+0000 7f547899a700 1 --2- 172.21.15.32:0/320294662 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f545806ad10 0x7f545806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:15.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.658+0000 7f547899a700 1 --2- 172.21.15.32:0/320294662 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f545806ad10 0x7f545806d1c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f546400bb10 tx=0x7f546401d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:15.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.661+0000 7f5469ffb700 1 -- 172.21.15.32:0/320294662 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5474158330 con 0x7f54740cb4f0 2023-06-20T13:33:15.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.913+0000 7f547b3ff700 1 -- 172.21.15.32:0/320294662 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5474158330 con 0x7f54740cb4f0 2023-06-20T13:33:15.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.913+0000 7f5469ffb700 1 -- 172.21.15.32:0/320294662 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f5474158330 con 0x7f54740cb4f0 2023-06-20T13:33:15.916 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-20T13:33:15.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.916+0000 7f547b3ff700 1 -- 172.21.15.32:0/320294662 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f545806ad10 msgr2=0x7f545806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:15.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.916+0000 7f547b3ff700 1 --2- 172.21.15.32:0/320294662 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f545806ad10 0x7f545806d1c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f546400bb10 tx=0x7f546401d040 comp rx=0 tx=0).stop 2023-06-20T13:33:15.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.916+0000 7f547b3ff700 1 -- 172.21.15.32:0/320294662 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54740cb4f0 msgr2=0x7f5474150c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:15.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.916+0000 7f547b3ff700 1 --2- 172.21.15.32:0/320294662 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54740cb4f0 0x7f5474150c80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f547000e810 tx=0x7f547000eb20 comp rx=0 tx=0).stop 2023-06-20T13:33:15.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.916+0000 7f547b3ff700 1 -- 172.21.15.32:0/320294662 shutdown_connections 2023-06-20T13:33:15.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.916+0000 7f547b3ff700 1 --2- 172.21.15.32:0/320294662 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f545806ad10 0x7f545806d1c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:15.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.916+0000 7f547b3ff700 1 --2- 172.21.15.32:0/320294662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5474156be0 0x7f54740b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:15.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.916+0000 7f547b3ff700 1 --2- 172.21.15.32:0/320294662 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f54740cb4f0 0x7f5474150c80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:15.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.916+0000 7f547b3ff700 1 --2- 172.21.15.32:0/320294662 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f54740cd600 0x7f54740b3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:15.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.916+0000 7f547b3ff700 1 -- 172.21.15.32:0/320294662 >> 172.21.15.32:0/320294662 conn(0x7f54740b0390 msgr2=0x7f5474155550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:15.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.916+0000 7f547b3ff700 1 -- 172.21.15.32:0/320294662 shutdown_connections 2023-06-20T13:33:15.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:15.916+0000 7f547b3ff700 1 -- 172.21.15.32:0/320294662 wait complete. 2023-06-20T13:33:15.935 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-20T13:33:15.936 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-20T13:33:15.936 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi115.front.sepia.ceph.com 2023-06-20T13:33:15.936 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-06-20T13:33:15.936 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-06-20T13:33:15.936 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-20T13:33:15.937 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-20T13:33:15.937 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-20T13:33:15.937 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-06-20T13:33:15.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:15.937 DEBUG:teuthology.orchestra.run.smithi115:> ip addr 2023-06-20T13:33:15.984 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-20T13:33:15.984 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-20T13:33:15.984 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-06-20T13:33:15.985 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:15.985 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-06-20T13:33:15.985 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:15.986 INFO:teuthology.orchestra.run.smithi115.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-20T13:33:15.986 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:44 brd ff:ff:ff:ff:ff:ff 2023-06-20T13:33:15.986 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f0 2023-06-20T13:33:15.986 INFO:teuthology.orchestra.run.smithi115.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-20T13:33:15.986 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:d8:a5:45 brd ff:ff:ff:ff:ff:ff 2023-06-20T13:33:15.986 INFO:teuthology.orchestra.run.smithi115.stdout: altname enp7s0f1 2023-06-20T13:33:15.986 INFO:teuthology.orchestra.run.smithi115.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-20T13:33:15.987 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8e brd ff:ff:ff:ff:ff:ff 2023-06-20T13:33:15.987 INFO:teuthology.orchestra.run.smithi115.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-20T13:33:15.987 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether 0c:c4:7a:8f:ce:8f brd ff:ff:ff:ff:ff:ff 2023-06-20T13:33:15.987 INFO:teuthology.orchestra.run.smithi115.stdout: inet 172.21.15.115/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-06-20T13:33:15.987 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft 41799sec preferred_lft 41799sec 2023-06-20T13:33:15.987 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::ec4:7aff:fe8f:ce8f/64 scope link 2023-06-20T13:33:15.987 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:15.987 INFO:teuthology.orchestra.run.smithi115.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-20T13:33:15.988 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b2:55:43:88:dc:6b brd ff:ff:ff:ff:ff:ff 2023-06-20T13:33:15.988 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-20T13:33:15.988 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:15.988 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::383a:9ff:fea2:32c2/64 scope link 2023-06-20T13:33:15.988 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:15.988 INFO:teuthology.orchestra.run.smithi115.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-20T13:33:15.988 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b2:55:43:88:dc:6b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-20T13:33:15.988 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::b055:43ff:fe88:dc6b/64 scope link 2023-06-20T13:33:15.989 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:15.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:15.990 DEBUG:teuthology.orchestra.run.smithi115:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-20T13:33:16.058 INFO:teuthology.orchestra.run.smithi115.stdout:1 2023-06-20T13:33:16.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:16.061 DEBUG:teuthology.orchestra.run.smithi115:> route 2023-06-20T13:33:16.109 INFO:teuthology.orchestra.run.smithi115.stdout:Kernel IP routing table 2023-06-20T13:33:16.110 INFO:teuthology.orchestra.run.smithi115.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-20T13:33:16.110 INFO:teuthology.orchestra.run.smithi115.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-20T13:33:16.110 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-20T13:33:16.110 INFO:teuthology.orchestra.run.smithi115.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-20T13:33:16.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:16.111 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-06-20T13:33:16.111 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-06-20T13:33:16.111 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-20T13:33:16.111 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-20T13:33:16.112 DEBUG:teuthology.orchestra.run.smithi115:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-20T13:33:16.112 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-06-20T13:33:16.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:16.279 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list 2023-06-20T13:33:16.325 INFO:teuthology.orchestra.run.smithi115.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-06-20T13:33:16.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:16.326 DEBUG:teuthology.orchestra.run.smithi115:> ip netns list-id 2023-06-20T13:33:16.371 INFO:teuthology.orchestra.run.smithi115.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-06-20T13:33:16.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:16.373 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-06-20T13:33:16.373 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-06-20T13:33:16.373 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-06-20T13:33:16.374 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-06-20T13:33:16.374 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-06-20T13:33:16.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:16.552 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-06-20T13:33:16.622 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-20T13:33:16.623 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-20T13:33:16.623 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-06-20T13:33:16.623 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:16.623 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-06-20T13:33:16.623 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:16.623 INFO:teuthology.orchestra.run.smithi115.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-20T13:33:16.624 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b2:6d:9d:5a:2d:b7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-20T13:33:16.624 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-20T13:33:16.624 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:16.624 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::b06d:9dff:fe5a:2db7/64 scope link 2023-06-20T13:33:16.624 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:16.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:16.626 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-06-20T13:33:16.695 INFO:teuthology.orchestra.run.smithi115.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-20T13:33:16.695 INFO:teuthology.orchestra.run.smithi115.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-20T13:33:16.695 INFO:teuthology.orchestra.run.smithi115.stdout: inet 127.0.0.1/8 scope host lo 2023-06-20T13:33:16.696 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:16.696 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 ::1/128 scope host 2023-06-20T13:33:16.696 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:16.696 INFO:teuthology.orchestra.run.smithi115.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-20T13:33:16.696 INFO:teuthology.orchestra.run.smithi115.stdout: link/ether b2:6d:9d:5a:2d:b7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-20T13:33:16.696 INFO:teuthology.orchestra.run.smithi115.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-20T13:33:16.696 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:16.697 INFO:teuthology.orchestra.run.smithi115.stdout: inet6 fe80::b06d:9dff:fe5a:2db7/64 scope link 2023-06-20T13:33:16.697 INFO:teuthology.orchestra.run.smithi115.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:33:16.698 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-06-20T13:33:16.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:16.698 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-06-20T13:33:16.699 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-06-20T13:33:16.699 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-06-20T13:33:16.699 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-06-20T13:33:16.700 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-06-20T13:33:16.700 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-06-20T13:33:16.700 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-06-20T13:33:16.701 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-06-20T13:33:16.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:16.935 DEBUG:teuthology.orchestra.run.smithi115:> (cd / && exec bash -c ' 2023-06-20T13:33:16.936 DEBUG:teuthology.orchestra.run.smithi115:> set -e 2023-06-20T13:33:16.936 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set brx.1 up 2023-06-20T13:33:16.936 DEBUG:teuthology.orchestra.run.smithi115:> sudo ip link set dev brx.1 master ceph-brx 2023-06-20T13:33:16.936 DEBUG:teuthology.orchestra.run.smithi115:> ') 2023-06-20T13:33:17.118 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-20T13:33:17.119 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-06-20T13:33:17.164 INFO:teuthology.orchestra.run.smithi115.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-06-20T13:33:17.165 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-20T13:33:17.165 DEBUG:teuthology.orchestra.run.smithi115:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-06-20T13:33:17.249 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-06-20T13:33:17.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:17.250 DEBUG:teuthology.orchestra.run.smithi115:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-20T13:33:17.392 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-20T13:33:17.393 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-20T13:33:17.418 INFO:teuthology.orchestra.run.smithi115.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-20T13:33:17.419 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-20T13:33:17.419 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-06-20T13:33:17.419 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: trying mount with new device syntax: 3@8ec09bdb-4968-488f-bf51-7b0f1e92355f.cephfs=/ 2023-06-20T13:33:17.419 INFO:teuthology.orchestra.run.smithi115.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.32:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2023-06-20T13:33:17.423 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-20T13:33:17.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:17.423 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-06-20T13:33:17.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:17.492 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-20T13:33:17.578 INFO:teuthology.orchestra.run.smithi115.stdout:client4885 2023-06-20T13:33:17.579 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:33:17.579 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-20T13:33:17.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:17.625 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-20T13:33:17.751 INFO:teuthology.orchestra.run.smithi115.stdout:client4885 2023-06-20T13:33:17.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:17.752 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-20T13:33:17.839 INFO:teuthology.orchestra.run.smithi115.stdout:client4885 2023-06-20T13:33:17.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:17.840 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/8ec09bdb-4968-488f-bf51-7b0f1e92355f.client4885/status') 2023-06-20T13:33:17.946 INFO:teuthology.orchestra.run.smithi115.stdout:instance: client.4885 (3)192.168.0.2:0/422799776 2023-06-20T13:33:17.946 INFO:teuthology.orchestra.run.smithi115.stdout:blocklisted: false 2023-06-20T13:33:17.947 INFO:teuthology.orchestra.run.smithi115.stderr:0+1 records in 2023-06-20T13:33:17.947 INFO:teuthology.orchestra.run.smithi115.stderr:0+1 records out 2023-06-20T13:33:17.947 INFO:teuthology.orchestra.run.smithi115.stderr:68 bytes copied, 4.7085e-05 s, 1.4 MB/s 2023-06-20T13:33:17.949 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-06-20T13:33:17.966 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:33:18.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.179+0000 7f08ff3ff700 1 Processor -- start 2023-06-20T13:33:18.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.179+0000 7f08ff3ff700 1 -- start start 2023-06-20T13:33:18.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.180+0000 7f08ff3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f08f80cd7d0 0x7f08f80cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:18.182 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.180+0000 7f08ff3ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f80cb4f0 0x7f08f81595d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:18.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.180+0000 7f08ff3ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f80cbc00 con 0x7f08f8156be0 2023-06-20T13:33:18.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.180+0000 7f08ff3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f8156fb0 con 0x7f08f80cd7d0 2023-06-20T13:33:18.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.180+0000 7f08ff3ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f815da40 con 0x7f08f80cb4f0 2023-06-20T13:33:18.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.180+0000 7f08fd19b700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f08f8156be0 0x7f08f80cd0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41634/0 (socket says 172.21.15.32:41634) 2023-06-20T13:33:18.183 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.180+0000 7f08fd19b700 1 -- 172.21.15.32:0/3686302247 learned_addr learned my addr 172.21.15.32:0/3686302247 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:18.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.181+0000 7f08fc99a700 1 --2- 172.21.15.32:0/3686302247 >> v2:172.21.15.115:3300/0 conn(0x7f08f80cd7d0 0x7f08f80cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:18.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.181+0000 7f08fd99c700 1 --2- 172.21.15.32:0/3686302247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f80cb4f0 0x7f08f81595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:18.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.181+0000 7f08effff700 1 -- 172.21.15.32:0/3686302247 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3252301304 0 0) 0x7f08f80cbc00 con 0x7f08f8156be0 2023-06-20T13:33:18.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.181+0000 7f08effff700 1 -- 172.21.15.32:0/3686302247 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08e40035b0 con 0x7f08f8156be0 2023-06-20T13:33:18.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.181+0000 7f08fc99a700 1 -- 172.21.15.32:0/3686302247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f80cb4f0 msgr2=0x7f08f81595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:18.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.181+0000 7f08fc99a700 1 --2- 172.21.15.32:0/3686302247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f80cb4f0 0x7f08f81595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:18.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.181+0000 7f08fc99a700 1 -- 172.21.15.32:0/3686302247 >> v1:172.21.15.32:6789/0 conn(0x7f08f8156be0 legacy=0x7f08f80cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:18.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.181+0000 7f08fc99a700 1 -- 172.21.15.32:0/3686302247 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f80cb990 con 0x7f08f80cd7d0 2023-06-20T13:33:18.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.181+0000 7f08fd99c700 1 --2- 172.21.15.32:0/3686302247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f80cb4f0 0x7f08f81595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:33:18.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.181+0000 7f08fc99a700 1 --2- 172.21.15.32:0/3686302247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08f80cd7d0 0x7f08f80cafb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f08e8009870 tx=0x7f08e8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abcb9b90d978e853 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:18.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.182+0000 7f08effff700 1 -- 172.21.15.32:0/3686302247 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e8011830 con 0x7f08f80cd7d0 2023-06-20T13:33:18.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.182+0000 7f08effff700 1 -- 172.21.15.32:0/3686302247 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e8011990 con 0x7f08f80cd7d0 2023-06-20T13:33:18.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.182+0000 7f08effff700 1 -- 172.21.15.32:0/3686302247 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e8011d00 con 0x7f08f80cd7d0 2023-06-20T13:33:18.186 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.182+0000 7f08ff3ff700 1 -- 172.21.15.32:0/3686302247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08f80cd7d0 msgr2=0x7f08f80cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:18.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.182+0000 7f08ff3ff700 1 --2- 172.21.15.32:0/3686302247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08f80cd7d0 0x7f08f80cafb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f08e8009870 tx=0x7f08e8009b80 comp rx=0 tx=0).stop 2023-06-20T13:33:18.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.183+0000 7f08ff3ff700 1 -- 172.21.15.32:0/3686302247 shutdown_connections 2023-06-20T13:33:18.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.183+0000 7f08ff3ff700 1 --2- 172.21.15.32:0/3686302247 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f80cb4f0 0x7f08f81595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:18.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.183+0000 7f08ff3ff700 1 --2- 172.21.15.32:0/3686302247 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08f80cd7d0 0x7f08f80cafb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:18.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.183+0000 7f08ff3ff700 1 -- 172.21.15.32:0/3686302247 >> 172.21.15.32:0/3686302247 conn(0x7f08f80b0390 msgr2=0x7f08f80b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:18.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.183+0000 7f08ff3ff700 1 -- 172.21.15.32:0/3686302247 shutdown_connections 2023-06-20T13:33:18.187 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.183+0000 7f08ff3ff700 1 -- 172.21.15.32:0/3686302247 wait complete. 2023-06-20T13:33:18.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.184+0000 7f08ff3ff700 1 Processor -- start 2023-06-20T13:33:18.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.185+0000 7f08ff3ff700 1 -- start start 2023-06-20T13:33:18.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.185+0000 7f08ff3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08f80cb4f0 0x7f08f81553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:18.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.185+0000 7f08ff3ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08f80cd7d0 0x7f08f80c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:18.190 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.185+0000 7f08ff3ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f8156be0 0x7f08f8070780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:18.190 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.185+0000 7f08ff3ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f81e59d0 con 0x7f08f80cd7d0 2023-06-20T13:33:18.190 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.185+0000 7f08ff3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f81e2a50 con 0x7f08f80cb4f0 2023-06-20T13:33:18.190 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.185+0000 7f08ff3ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f81e2d30 con 0x7f08f8156be0 2023-06-20T13:33:18.190 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.186+0000 7f08fc99a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08f80cd7d0 0x7f08f80c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:18.190 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.186+0000 7f08fc99a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08f80cd7d0 0x7f08f80c4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38076/0 (socket says 172.21.15.32:38076) 2023-06-20T13:33:18.190 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.186+0000 7f08fc99a700 1 -- 172.21.15.32:0/1687694500 learned_addr learned my addr 172.21.15.32:0/1687694500 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:18.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.186+0000 7f08fd19b700 1 --2- 172.21.15.32:0/1687694500 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08f80cb4f0 0x7f08f81553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:18.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.186+0000 7f08fd99c700 1 --2- 172.21.15.32:0/1687694500 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f8156be0 0x7f08f8070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:18.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.186+0000 7f08fc99a700 1 -- 172.21.15.32:0/1687694500 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f8156be0 msgr2=0x7f08f8070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:18.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.186+0000 7f08fc99a700 1 --2- 172.21.15.32:0/1687694500 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f8156be0 0x7f08f8070780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:18.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.186+0000 7f08fc99a700 1 -- 172.21.15.32:0/1687694500 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08f80cb4f0 msgr2=0x7f08f81553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:18.191 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.186+0000 7f08fc99a700 1 --2- 172.21.15.32:0/1687694500 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08f80cb4f0 0x7f08f81553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:18.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.186+0000 7f08fc99a700 1 -- 172.21.15.32:0/1687694500 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f0009a70 con 0x7f08f80cd7d0 2023-06-20T13:33:18.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.186+0000 7f08fd19b700 1 --2- 172.21.15.32:0/1687694500 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08f80cb4f0 0x7f08f81553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:18.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.186+0000 7f08fd99c700 1 --2- 172.21.15.32:0/1687694500 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f8156be0 0x7f08f8070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:18.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.186+0000 7f08fc99a700 1 --2- 172.21.15.32:0/1687694500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08f80cd7d0 0x7f08f80c4ed0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f08e8000c00 tx=0x7f08e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:18.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.187+0000 7f08edffb700 1 -- 172.21.15.32:0/1687694500 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e80036a0 con 0x7f08f80cd7d0 2023-06-20T13:33:18.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.187+0000 7f08edffb700 1 -- 172.21.15.32:0/1687694500 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e801f070 con 0x7f08f80cd7d0 2023-06-20T13:33:18.192 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.187+0000 7f08edffb700 1 -- 172.21.15.32:0/1687694500 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e8003a40 con 0x7f08f80cd7d0 2023-06-20T13:33:18.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.187+0000 7f08ff3ff700 1 -- 172.21.15.32:0/1687694500 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e80094a0 con 0x7f08f80cd7d0 2023-06-20T13:33:18.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.187+0000 7f08ff3ff700 1 -- 172.21.15.32:0/1687694500 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f81e32f0 con 0x7f08f80cd7d0 2023-06-20T13:33:18.193 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.188+0000 7f08ff3ff700 1 -- 172.21.15.32:0/1687694500 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f804ea60 con 0x7f08f80cd7d0 2023-06-20T13:33:18.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.189+0000 7f08edffb700 1 -- 172.21.15.32:0/1687694500 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f08e8003ba0 con 0x7f08f80cd7d0 2023-06-20T13:33:18.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.190+0000 7f08edffb700 1 --2- 172.21.15.32:0/1687694500 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f08dc06ace0 0x7f08dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:18.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.190+0000 7f08edffb700 1 -- 172.21.15.32:0/1687694500 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f08e8021070 con 0x7f08f80cd7d0 2023-06-20T13:33:18.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.190+0000 7f08fd19b700 1 --2- 172.21.15.32:0/1687694500 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f08dc06ace0 0x7f08dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:18.194 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.191+0000 7f08fd19b700 1 --2- 172.21.15.32:0/1687694500 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f08dc06ace0 0x7f08dc06d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f08f4005910 tx=0x7f08f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:18.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.195+0000 7f08edffb700 1 -- 172.21.15.32:0/1687694500 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f08e8055e30 con 0x7f08f80cd7d0 2023-06-20T13:33:18.403 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.400+0000 7f08ff3ff700 1 -- 172.21.15.32:0/1687694500 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08f80cab80 con 0x7f08f80cd7d0 2023-06-20T13:33:18.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.402+0000 7f08edffb700 1 -- 172.21.15.32:0/1687694500 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20191 (secure 0 0 0) 0x7f08e8015090 con 0x7f08f80cd7d0 2023-06-20T13:33:18.405 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:33:18.405 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":29,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:33:00.976862+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-20T13:32:18.120021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-20T13:32:19.503624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-20T13:32:23.074912+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:33:18.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.404+0000 7f08ff3ff700 1 -- 172.21.15.32:0/1687694500 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f08dc06ace0 msgr2=0x7f08dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:18.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.404+0000 7f08ff3ff700 1 --2- 172.21.15.32:0/1687694500 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f08dc06ace0 0x7f08dc06d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f08f4005910 tx=0x7f08f4009040 comp rx=0 tx=0).stop 2023-06-20T13:33:18.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.404+0000 7f08ff3ff700 1 -- 172.21.15.32:0/1687694500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08f80cd7d0 msgr2=0x7f08f80c4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:18.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.404+0000 7f08ff3ff700 1 --2- 172.21.15.32:0/1687694500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08f80cd7d0 0x7f08f80c4ed0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f08e8000c00 tx=0x7f08e8004750 comp rx=0 tx=0).stop 2023-06-20T13:33:18.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.405+0000 7f08ff3ff700 1 -- 172.21.15.32:0/1687694500 shutdown_connections 2023-06-20T13:33:18.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.405+0000 7f08ff3ff700 1 --2- 172.21.15.32:0/1687694500 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f08dc06ace0 0x7f08dc06d190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:18.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.405+0000 7f08ff3ff700 1 --2- 172.21.15.32:0/1687694500 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08f8156be0 0x7f08f8070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:18.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.405+0000 7f08ff3ff700 1 --2- 172.21.15.32:0/1687694500 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08f80cb4f0 0x7f08f81553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:18.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.405+0000 7f08ff3ff700 1 --2- 172.21.15.32:0/1687694500 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08f80cd7d0 0x7f08f80c4ed0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:18.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.405+0000 7f08ff3ff700 1 -- 172.21.15.32:0/1687694500 >> 172.21.15.32:0/1687694500 conn(0x7f08f80b0390 msgr2=0x7f08f80b38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:18.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.405+0000 7f08ff3ff700 1 -- 172.21.15.32:0/1687694500 shutdown_connections 2023-06-20T13:33:18.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.405+0000 7f08ff3ff700 1 -- 172.21.15.32:0/1687694500 wait complete. 2023-06-20T13:33:18.426 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-20T13:32:05.308022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-20T13:32:12.857161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-20T13:32:18.120021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-20T13:32:19.503624+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-20T13:32:23.074912+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-20T13:33:18.428 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-20T13:33:18.631 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.629+0000 7f73e11ff700 1 Processor -- start 2023-06-20T13:33:18.632 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.630+0000 7f73e11ff700 1 -- start start 2023-06-20T13:33:18.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.631+0000 7f73e11ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f73dc0b8430 0x7f73dc0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:18.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.631+0000 7f73e11ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73dc0cfc60 0x7f73dc0d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:18.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.631+0000 7f73e11ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73dc0d0b20 con 0x7f73dc0d3730 2023-06-20T13:33:18.633 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.631+0000 7f73e11ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73dc0b8800 con 0x7f73dc0b8430 2023-06-20T13:33:18.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.631+0000 7f73e11ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc0b4ee0 con 0x7f73dc0cfc60 2023-06-20T13:33:18.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.631+0000 7f73dad9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f73dc0b8430 0x7f73dc0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:18.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.631+0000 7f73dad9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f73dc0b8430 0x7f73dc0cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38080/0 (socket says 172.21.15.32:38080) 2023-06-20T13:33:18.634 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.631+0000 7f73dad9d700 1 -- 172.21.15.32:0/54564086 learned_addr learned my addr 172.21.15.32:0/54564086 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:18.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.631+0000 7f73db59e700 1 --2- 172.21.15.32:0/54564086 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73dc0cfc60 0x7f73dc0d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:18.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.631+0000 7f73dad9d700 1 -- 172.21.15.32:0/54564086 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73dc0cfc60 msgr2=0x7f73dc0d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:18.635 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.631+0000 7f73dad9d700 1 --2- 172.21.15.32:0/54564086 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73dc0cfc60 0x7f73dc0d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:18.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.631+0000 7f73dad9d700 1 -- 172.21.15.32:0/54564086 >> v1:172.21.15.32:6789/0 conn(0x7f73dc0d3730 legacy=0x7f73dc0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:18.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.631+0000 7f73dad9d700 1 -- 172.21.15.32:0/54564086 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73dc0b51c0 con 0x7f73dc0b8430 2023-06-20T13:33:18.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.632+0000 7f73dad9d700 1 --2- 172.21.15.32:0/54564086 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73dc0b8430 0x7f73dc0cd320 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f73cc0098f0 tx=0x7f73cc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319b9f5af988577d server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:18.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.632+0000 7f73da59c700 1 -- 172.21.15.32:0/54564086 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc00b8a0 con 0x7f73dc0b8430 2023-06-20T13:33:18.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.632+0000 7f73da59c700 1 -- 172.21.15.32:0/54564086 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73cc00ba00 con 0x7f73dc0b8430 2023-06-20T13:33:18.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.632+0000 7f73da59c700 1 -- 172.21.15.32:0/54564086 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc00bd90 con 0x7f73dc0b8430 2023-06-20T13:33:18.636 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.632+0000 7f73e11ff700 1 -- 172.21.15.32:0/54564086 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73dc0b8430 msgr2=0x7f73dc0cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:18.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.632+0000 7f73e11ff700 1 --2- 172.21.15.32:0/54564086 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73dc0b8430 0x7f73dc0cd320 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f73cc0098f0 tx=0x7f73cc009c00 comp rx=0 tx=0).stop 2023-06-20T13:33:18.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.633+0000 7f73e11ff700 1 -- 172.21.15.32:0/54564086 shutdown_connections 2023-06-20T13:33:18.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.633+0000 7f73e11ff700 1 --2- 172.21.15.32:0/54564086 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73dc0cfc60 0x7f73dc0d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:18.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.633+0000 7f73e11ff700 1 --2- 172.21.15.32:0/54564086 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73dc0b8430 0x7f73dc0cd320 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:18.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.633+0000 7f73e11ff700 1 -- 172.21.15.32:0/54564086 >> 172.21.15.32:0/54564086 conn(0x7f73dc06b3f0 msgr2=0x7f73dc06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:18.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.633+0000 7f73e11ff700 1 -- 172.21.15.32:0/54564086 shutdown_connections 2023-06-20T13:33:18.637 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.633+0000 7f73e11ff700 1 -- 172.21.15.32:0/54564086 wait complete. 2023-06-20T13:33:18.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.634+0000 7f73e11ff700 1 Processor -- start 2023-06-20T13:33:18.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.635+0000 7f73e11ff700 1 -- start start 2023-06-20T13:33:18.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.636+0000 7f73e11ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73dc0b8430 0x7f73dc14be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:18.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.636+0000 7f73e11ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73dc0cfc60 0x7f73dc15d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:18.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.636+0000 7f73e11ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73dc0d3730 0x7f73dc0c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:18.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.636+0000 7f73e11ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc0cb040 con 0x7f73dc0cfc60 2023-06-20T13:33:18.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.636+0000 7f73e11ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc0cb8e0 con 0x7f73dc0d3730 2023-06-20T13:33:18.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.636+0000 7f73e11ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73dc15db20 con 0x7f73dc0b8430 2023-06-20T13:33:18.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.636+0000 7f73d3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73dc0cfc60 0x7f73dc15d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:18.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.636+0000 7f73d3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73dc0cfc60 0x7f73dc15d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38096/0 (socket says 172.21.15.32:38096) 2023-06-20T13:33:18.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.636+0000 7f73d3fff700 1 -- 172.21.15.32:0/582176069 learned_addr learned my addr 172.21.15.32:0/582176069 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:18.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.636+0000 7f73dad9d700 1 --2- 172.21.15.32:0/582176069 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73dc0b8430 0x7f73dc14be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:18.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.636+0000 7f73db59e700 1 --2- 172.21.15.32:0/582176069 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73dc0d3730 0x7f73dc0c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:18.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.636+0000 7f73d3fff700 1 -- 172.21.15.32:0/582176069 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73dc0b8430 msgr2=0x7f73dc14be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:18.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.636+0000 7f73d3fff700 1 --2- 172.21.15.32:0/582176069 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73dc0b8430 0x7f73dc14be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:18.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.636+0000 7f73d3fff700 1 -- 172.21.15.32:0/582176069 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73dc0d3730 msgr2=0x7f73dc0c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:18.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.636+0000 7f73d3fff700 1 --2- 172.21.15.32:0/582176069 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73dc0d3730 0x7f73dc0c8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:18.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.636+0000 7f73d3fff700 1 -- 172.21.15.32:0/582176069 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73cc009550 con 0x7f73dc0cfc60 2023-06-20T13:33:18.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.637+0000 7f73d3fff700 1 --2- 172.21.15.32:0/582176069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73dc0cfc60 0x7f73dc15d110 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f73c400c4e0 tx=0x7f73c400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:18.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.637+0000 7f73d37fe700 1 -- 172.21.15.32:0/582176069 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c40052d0 con 0x7f73dc0cfc60 2023-06-20T13:33:18.642 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.637+0000 7f73d37fe700 1 -- 172.21.15.32:0/582176069 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c4005430 con 0x7f73dc0cfc60 2023-06-20T13:33:18.642 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.637+0000 7f73d37fe700 1 -- 172.21.15.32:0/582176069 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c40038c0 con 0x7f73dc0cfc60 2023-06-20T13:33:18.642 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.637+0000 7f73e11ff700 1 -- 172.21.15.32:0/582176069 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73dc0cb290 con 0x7f73dc0cfc60 2023-06-20T13:33:18.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.637+0000 7f73e11ff700 1 -- 172.21.15.32:0/582176069 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73dc14c3b0 con 0x7f73dc0cfc60 2023-06-20T13:33:18.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.638+0000 7f73e11ff700 1 -- 172.21.15.32:0/582176069 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73dc14c540 con 0x7f73dc0cfc60 2023-06-20T13:33:18.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.639+0000 7f73d37fe700 1 -- 172.21.15.32:0/582176069 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f73c4003a20 con 0x7f73dc0cfc60 2023-06-20T13:33:18.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.640+0000 7f73d37fe700 1 --2- 172.21.15.32:0/582176069 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f73bc06ace0 0x7f73bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:18.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.640+0000 7f73d37fe700 1 -- 172.21.15.32:0/582176069 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f73c4088b20 con 0x7f73dc0cfc60 2023-06-20T13:33:18.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.640+0000 7f73dad9d700 1 --2- 172.21.15.32:0/582176069 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f73bc06ace0 0x7f73bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:18.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.641+0000 7f73dad9d700 1 --2- 172.21.15.32:0/582176069 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f73bc06ace0 0x7f73bc06d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f73cc014040 tx=0x7f73cc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:18.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.645+0000 7f73d37fe700 1 -- 172.21.15.32:0/582176069 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f73c4053890 con 0x7f73dc0cfc60 2023-06-20T13:33:18.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.848+0000 7f73e11ff700 1 -- 172.21.15.32:0/582176069 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f73dc0cba50 con 0x7f73dc0cfc60 2023-06-20T13:33:18.851 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.849+0000 7f73d37fe700 1 -- 172.21.15.32:0/582176069 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f73c4056eb0 con 0x7f73dc0cfc60 2023-06-20T13:33:18.851 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-06-20T13:33:18.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.851+0000 7f73e11ff700 1 -- 172.21.15.32:0/582176069 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f73bc06ace0 msgr2=0x7f73bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:18.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.851+0000 7f73e11ff700 1 --2- 172.21.15.32:0/582176069 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f73bc06ace0 0x7f73bc06d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f73cc014040 tx=0x7f73cc008030 comp rx=0 tx=0).stop 2023-06-20T13:33:18.854 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.851+0000 7f73e11ff700 1 -- 172.21.15.32:0/582176069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73dc0cfc60 msgr2=0x7f73dc15d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:18.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.851+0000 7f73e11ff700 1 --2- 172.21.15.32:0/582176069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73dc0cfc60 0x7f73dc15d110 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f73c400c4e0 tx=0x7f73c400c7f0 comp rx=0 tx=0).stop 2023-06-20T13:33:18.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.851+0000 7f73e11ff700 1 -- 172.21.15.32:0/582176069 shutdown_connections 2023-06-20T13:33:18.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.851+0000 7f73e11ff700 1 --2- 172.21.15.32:0/582176069 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f73bc06ace0 0x7f73bc06d190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:18.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.851+0000 7f73e11ff700 1 --2- 172.21.15.32:0/582176069 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73dc0d3730 0x7f73dc0c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:18.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.851+0000 7f73e11ff700 1 --2- 172.21.15.32:0/582176069 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73dc0b8430 0x7f73dc14be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:18.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.851+0000 7f73e11ff700 1 --2- 172.21.15.32:0/582176069 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f73dc0cfc60 0x7f73dc15d110 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:18.855 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.851+0000 7f73e11ff700 1 -- 172.21.15.32:0/582176069 >> 172.21.15.32:0/582176069 conn(0x7f73dc06b3f0 msgr2=0x7f73dc0b7850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.852+0000 7f73e11ff700 1 -- 172.21.15.32:0/582176069 shutdown_connections 2023-06-20T13:33:18.856 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:18.852+0000 7f73e11ff700 1 -- 172.21.15.32:0/582176069 wait complete. 2023-06-20T13:33:18.871 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-20T13:33:19.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.073+0000 7f560e1ff700 1 Processor -- start 2023-06-20T13:33:19.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.073+0000 7f560e1ff700 1 -- start start 2023-06-20T13:33:19.076 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.074+0000 7f560e1ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f560806e130 0x7f56080cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:19.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.074+0000 7f560e1ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56080cb000 con 0x7f56080b3ec0 2023-06-20T13:33:19.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.074+0000 7f560e1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f560815b6c0 con 0x7f560806a640 2023-06-20T13:33:19.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.074+0000 7f560e1ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56080ca8d0 con 0x7f560806e130 2023-06-20T13:33:19.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.074+0000 7f56077fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f56080b3ec0 0x7f5608069f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:41652/0 (socket says 172.21.15.32:41652) 2023-06-20T13:33:19.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.075+0000 7f56077fe700 1 -- 172.21.15.32:0/1691107947 learned_addr learned my addr 172.21.15.32:0/1691107947 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:19.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.075+0000 7f5606ffd700 1 --2- 172.21.15.32:0/1691107947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f560806e130 0x7f56080cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:19.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.075+0000 7f56067fc700 1 -- 172.21.15.32:0/1691107947 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400114893 0 0) 0x7f56080cb000 con 0x7f56080b3ec0 2023-06-20T13:33:19.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.075+0000 7f56067fc700 1 -- 172.21.15.32:0/1691107947 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55f00035b0 con 0x7f56080b3ec0 2023-06-20T13:33:19.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.075+0000 7f5606ffd700 1 -- 172.21.15.32:0/1691107947 >> v1:172.21.15.115:6789/0 conn(0x7f560806a640 legacy=0x7f56081573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:19.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.075+0000 7f5606ffd700 1 -- 172.21.15.32:0/1691107947 >> v1:172.21.15.32:6789/0 conn(0x7f56080b3ec0 legacy=0x7f5608069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:19.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.075+0000 7f5606ffd700 1 -- 172.21.15.32:0/1691107947 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56080c9460 con 0x7f560806e130 2023-06-20T13:33:19.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.075+0000 7f5606ffd700 1 --2- 172.21.15.32:0/1691107947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f560806e130 0x7f56080cf390 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f55fc009870 tx=0x7f55fc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a6b4065e4f72903 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:19.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.078+0000 7f56067fc700 1 -- 172.21.15.32:0/1691107947 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc011830 con 0x7f560806e130 2023-06-20T13:33:19.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.078+0000 7f56067fc700 1 -- 172.21.15.32:0/1691107947 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55fc011990 con 0x7f560806e130 2023-06-20T13:33:19.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.078+0000 7f56067fc700 1 -- 172.21.15.32:0/1691107947 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc011d20 con 0x7f560806e130 2023-06-20T13:33:19.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.078+0000 7f560e1ff700 1 -- 172.21.15.32:0/1691107947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f560806e130 msgr2=0x7f56080cf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:19.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.078+0000 7f560e1ff700 1 --2- 172.21.15.32:0/1691107947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f560806e130 0x7f56080cf390 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f55fc009870 tx=0x7f55fc009b80 comp rx=0 tx=0).stop 2023-06-20T13:33:19.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.078+0000 7f560e1ff700 1 -- 172.21.15.32:0/1691107947 shutdown_connections 2023-06-20T13:33:19.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.078+0000 7f560e1ff700 1 --2- 172.21.15.32:0/1691107947 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f560806e130 0x7f56080cf390 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:19.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.078+0000 7f560e1ff700 1 -- 172.21.15.32:0/1691107947 >> 172.21.15.32:0/1691107947 conn(0x7f56080b0fd0 msgr2=0x7f56080ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:19.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.078+0000 7f560e1ff700 1 -- 172.21.15.32:0/1691107947 shutdown_connections 2023-06-20T13:33:19.083 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.078+0000 7f560e1ff700 1 -- 172.21.15.32:0/1691107947 wait complete. 2023-06-20T13:33:19.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.080+0000 7f560e1ff700 1 Processor -- start 2023-06-20T13:33:19.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.080+0000 7f560e1ff700 1 -- start start 2023-06-20T13:33:19.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.081+0000 7f560e1ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f560806a640 0x7f560814bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:19.084 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.081+0000 7f560e1ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f560806e130 0x7f56080c22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:19.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.081+0000 7f560e1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56080b3ec0 0x7f560814c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:19.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.081+0000 7f560e1ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56080c37f0 con 0x7f560806e130 2023-06-20T13:33:19.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.081+0000 7f560e1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56080c2be0 con 0x7f56080b3ec0 2023-06-20T13:33:19.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.081+0000 7f560e1ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56080c2ec0 con 0x7f560806a640 2023-06-20T13:33:19.085 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.081+0000 7f5606ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f560806e130 0x7f56080c22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:19.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.081+0000 7f5606ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f560806e130 0x7f56080c22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38104/0 (socket says 172.21.15.32:38104) 2023-06-20T13:33:19.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.082+0000 7f5606ffd700 1 -- 172.21.15.32:0/2870427547 learned_addr learned my addr 172.21.15.32:0/2870427547 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:19.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.082+0000 7f56077fe700 1 --2- 172.21.15.32:0/2870427547 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f560806a640 0x7f560814bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:19.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.082+0000 7f5607fff700 1 --2- 172.21.15.32:0/2870427547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56080b3ec0 0x7f560814c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:19.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.082+0000 7f5606ffd700 1 -- 172.21.15.32:0/2870427547 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f560806a640 msgr2=0x7f560814bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:19.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.082+0000 7f5606ffd700 1 --2- 172.21.15.32:0/2870427547 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f560806a640 0x7f560814bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:19.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.082+0000 7f5606ffd700 1 -- 172.21.15.32:0/2870427547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56080b3ec0 msgr2=0x7f560814c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:19.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.082+0000 7f5606ffd700 1 --2- 172.21.15.32:0/2870427547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56080b3ec0 0x7f560814c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:19.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.082+0000 7f5606ffd700 1 -- 172.21.15.32:0/2870427547 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55fc0094a0 con 0x7f560806e130 2023-06-20T13:33:19.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.082+0000 7f5607fff700 1 --2- 172.21.15.32:0/2870427547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56080b3ec0 0x7f560814c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:19.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.082+0000 7f5606ffd700 1 --2- 172.21.15.32:0/2870427547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f560806e130 0x7f56080c22e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f55fc0097c0 tx=0x7f55fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:19.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.082+0000 7f55effff700 1 -- 172.21.15.32:0/2870427547 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc0036a0 con 0x7f560806e130 2023-06-20T13:33:19.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.083+0000 7f55effff700 1 -- 172.21.15.32:0/2870427547 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55fc01f070 con 0x7f560806e130 2023-06-20T13:33:19.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.083+0000 7f55effff700 1 -- 172.21.15.32:0/2870427547 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc003a20 con 0x7f560806e130 2023-06-20T13:33:19.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.083+0000 7f560e1ff700 1 -- 172.21.15.32:0/2870427547 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56080c31a0 con 0x7f560806e130 2023-06-20T13:33:19.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.083+0000 7f560e1ff700 1 -- 172.21.15.32:0/2870427547 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f560814c0d0 con 0x7f560806e130 2023-06-20T13:33:19.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.084+0000 7f560e1ff700 1 -- 172.21.15.32:0/2870427547 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5608066a70 con 0x7f560806e130 2023-06-20T13:33:19.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.085+0000 7f55effff700 1 -- 172.21.15.32:0/2870427547 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f55fc003b80 con 0x7f560806e130 2023-06-20T13:33:19.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.086+0000 7f55effff700 1 --2- 172.21.15.32:0/2870427547 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f55f406ace0 0x7f55f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:19.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.086+0000 7f55effff700 1 -- 172.21.15.32:0/2870427547 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f55fc021070 con 0x7f560806e130 2023-06-20T13:33:19.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.086+0000 7f56077fe700 1 --2- 172.21.15.32:0/2870427547 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f55f406ace0 0x7f55f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:19.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.087+0000 7f56077fe700 1 --2- 172.21.15.32:0/2870427547 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f55f406ace0 0x7f55f406d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f55f8007fd0 tx=0x7f55f8007dc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:19.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.090+0000 7f55effff700 1 -- 172.21.15.32:0/2870427547 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f55fc055ee0 con 0x7f560806e130 2023-06-20T13:33:19.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.297+0000 7f560e1ff700 1 -- 172.21.15.32:0/2870427547 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f560804ea60 con 0x7f560806e130 2023-06-20T13:33:19.300 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.298+0000 7f55effff700 1 -- 172.21.15.32:0/2870427547 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f55fc059500 con 0x7f560806e130 2023-06-20T13:33:19.300 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 8 2023-06-20T13:33:19.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.300+0000 7f560e1ff700 1 -- 172.21.15.32:0/2870427547 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f55f406ace0 msgr2=0x7f55f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:19.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.300+0000 7f560e1ff700 1 --2- 172.21.15.32:0/2870427547 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f55f406ace0 0x7f55f406d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f55f8007fd0 tx=0x7f55f8007dc0 comp rx=0 tx=0).stop 2023-06-20T13:33:19.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.300+0000 7f560e1ff700 1 -- 172.21.15.32:0/2870427547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f560806e130 msgr2=0x7f56080c22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:19.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.300+0000 7f560e1ff700 1 --2- 172.21.15.32:0/2870427547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f560806e130 0x7f56080c22e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f55fc0097c0 tx=0x7f55fc004750 comp rx=0 tx=0).stop 2023-06-20T13:33:19.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.300+0000 7f560e1ff700 1 -- 172.21.15.32:0/2870427547 shutdown_connections 2023-06-20T13:33:19.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.300+0000 7f560e1ff700 1 --2- 172.21.15.32:0/2870427547 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f55f406ace0 0x7f55f406d190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:19.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.300+0000 7f560e1ff700 1 --2- 172.21.15.32:0/2870427547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56080b3ec0 0x7f560814c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:19.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.300+0000 7f560e1ff700 1 --2- 172.21.15.32:0/2870427547 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f560806a640 0x7f560814bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:19.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.300+0000 7f560e1ff700 1 --2- 172.21.15.32:0/2870427547 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f560806e130 0x7f56080c22e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:19.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.300+0000 7f560e1ff700 1 -- 172.21.15.32:0/2870427547 >> 172.21.15.32:0/2870427547 conn(0x7f56080b0fd0 msgr2=0x7f5608159d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:19.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.300+0000 7f560e1ff700 1 -- 172.21.15.32:0/2870427547 shutdown_connections 2023-06-20T13:33:19.304 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.300+0000 7f560e1ff700 1 -- 172.21.15.32:0/2870427547 wait complete. 2023-06-20T13:33:19.320 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-20T13:33:19.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.522+0000 7fbd22fff700 1 Processor -- start 2023-06-20T13:33:19.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.522+0000 7fbd22fff700 1 -- start start 2023-06-20T13:33:19.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.523+0000 7fbd22fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd1c0d3730 0x7fbd1c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:19.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.523+0000 7fbd22fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbd1c0cfa90 0x7fbd1c0d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:19.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.523+0000 7fbd22fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd1c0d0b20 con 0x7fbd1c0b8430 2023-06-20T13:33:19.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.523+0000 7fbd22fff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd1c0cda30 con 0x7fbd1c0cfa90 2023-06-20T13:33:19.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.523+0000 7fbd22fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c0b8800 con 0x7fbd1c0d3730 2023-06-20T13:33:19.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.523+0000 7fbd2159c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbd1c0cfa90 0x7fbd1c0d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:19.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.523+0000 7fbd2159c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbd1c0cfa90 0x7fbd1c0d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38118/0 (socket says 172.21.15.32:38118) 2023-06-20T13:33:19.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.523+0000 7fbd2159c700 1 -- 172.21.15.32:0/500211634 learned_addr learned my addr 172.21.15.32:0/500211634 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:19.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.524+0000 7fbd1bfff700 1 --2- 172.21.15.32:0/500211634 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd1c0d3730 0x7fbd1c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:19.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.524+0000 7fbd2159c700 1 -- 172.21.15.32:0/500211634 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd1c0d3730 msgr2=0x7fbd1c0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:19.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.524+0000 7fbd2159c700 1 --2- 172.21.15.32:0/500211634 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd1c0d3730 0x7fbd1c0cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:19.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.524+0000 7fbd2159c700 1 -- 172.21.15.32:0/500211634 >> v1:172.21.15.115:6789/0 conn(0x7fbd1c0b8430 legacy=0x7fbd1c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:19.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.524+0000 7fbd2159c700 1 -- 172.21.15.32:0/500211634 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1c0cfeb0 con 0x7fbd1c0cfa90 2023-06-20T13:33:19.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.524+0000 7fbd2159c700 1 --2- 172.21.15.32:0/500211634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd1c0cfa90 0x7fbd1c0d0fb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009e50 tx=0x7fbd1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8bb6187c9169a96 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:19.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.524+0000 7fbd1b7fe700 1 -- 172.21.15.32:0/500211634 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1400e070 con 0x7fbd1c0cfa90 2023-06-20T13:33:19.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.524+0000 7fbd1b7fe700 1 -- 172.21.15.32:0/500211634 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd14003a20 con 0x7fbd1c0cfa90 2023-06-20T13:33:19.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.524+0000 7fbd1b7fe700 1 -- 172.21.15.32:0/500211634 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd14003dd0 con 0x7fbd1c0cfa90 2023-06-20T13:33:19.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.525+0000 7fbd22fff700 1 -- 172.21.15.32:0/500211634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd1c0cfa90 msgr2=0x7fbd1c0d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:19.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.525+0000 7fbd22fff700 1 --2- 172.21.15.32:0/500211634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd1c0cfa90 0x7fbd1c0d0fb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009e50 tx=0x7fbd1400b330 comp rx=0 tx=0).stop 2023-06-20T13:33:19.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.525+0000 7fbd22fff700 1 -- 172.21.15.32:0/500211634 shutdown_connections 2023-06-20T13:33:19.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.525+0000 7fbd22fff700 1 --2- 172.21.15.32:0/500211634 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd1c0cfa90 0x7fbd1c0d0fb0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:19.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.525+0000 7fbd22fff700 1 --2- 172.21.15.32:0/500211634 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd1c0d3730 0x7fbd1c0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:19.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.525+0000 7fbd22fff700 1 -- 172.21.15.32:0/500211634 >> 172.21.15.32:0/500211634 conn(0x7fbd1c06b3f0 msgr2=0x7fbd1c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:19.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.525+0000 7fbd22fff700 1 -- 172.21.15.32:0/500211634 shutdown_connections 2023-06-20T13:33:19.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.525+0000 7fbd22fff700 1 -- 172.21.15.32:0/500211634 wait complete. 2023-06-20T13:33:19.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.527+0000 7fbd22fff700 1 Processor -- start 2023-06-20T13:33:19.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.527+0000 7fbd22fff700 1 -- start start 2023-06-20T13:33:19.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.528+0000 7fbd22fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd1c0b8430 0x7fbd1c150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:19.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.528+0000 7fbd22fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd1c0cfa90 0x7fbd1c0cb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:19.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.528+0000 7fbd22fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd1c0d3730 0x7fbd1c15e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:19.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.528+0000 7fbd22fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c150780 con 0x7fbd1c0d3730 2023-06-20T13:33:19.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.528+0000 7fbd22fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c0cc6a0 con 0x7fbd1c0cfa90 2023-06-20T13:33:19.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.528+0000 7fbd22fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c0cba90 con 0x7fbd1c0b8430 2023-06-20T13:33:19.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.528+0000 7fbd2159c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd1c0d3730 0x7fbd1c15e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:19.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.528+0000 7fbd2159c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd1c0d3730 0x7fbd1c15e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:38128/0 (socket says 172.21.15.32:38128) 2023-06-20T13:33:19.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.528+0000 7fbd2159c700 1 -- 172.21.15.32:0/2782708308 learned_addr learned my addr 172.21.15.32:0/2782708308 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:19.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.528+0000 7fbd20d9b700 1 --2- 172.21.15.32:0/2782708308 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd1c0b8430 0x7fbd1c150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:19.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.528+0000 7fbd1bfff700 1 --2- 172.21.15.32:0/2782708308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd1c0cfa90 0x7fbd1c0cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:19.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.528+0000 7fbd2159c700 1 -- 172.21.15.32:0/2782708308 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd1c0b8430 msgr2=0x7fbd1c150240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:19.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.528+0000 7fbd2159c700 1 --2- 172.21.15.32:0/2782708308 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd1c0b8430 0x7fbd1c150240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:19.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.528+0000 7fbd2159c700 1 -- 172.21.15.32:0/2782708308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd1c0cfa90 msgr2=0x7fbd1c0cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:19.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.528+0000 7fbd2159c700 1 --2- 172.21.15.32:0/2782708308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd1c0cfa90 0x7fbd1c0cb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:19.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.528+0000 7fbd2159c700 1 -- 172.21.15.32:0/2782708308 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd14009b30 con 0x7fbd1c0d3730 2023-06-20T13:33:19.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.529+0000 7fbd2159c700 1 --2- 172.21.15.32:0/2782708308 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd1c0d3730 0x7fbd1c15e920 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c06c780 tx=0x7fbd14004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:19.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.529+0000 7fbd197fa700 1 -- 172.21.15.32:0/2782708308 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd14004440 con 0x7fbd1c0d3730 2023-06-20T13:33:19.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.529+0000 7fbd197fa700 1 -- 172.21.15.32:0/2782708308 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd140045c0 con 0x7fbd1c0d3730 2023-06-20T13:33:19.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.529+0000 7fbd197fa700 1 -- 172.21.15.32:0/2782708308 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd14004970 con 0x7fbd1c0d3730 2023-06-20T13:33:19.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.529+0000 7fbd22fff700 1 -- 172.21.15.32:0/2782708308 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd1c0cbd70 con 0x7fbd1c0d3730 2023-06-20T13:33:19.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.529+0000 7fbd22fff700 1 -- 172.21.15.32:0/2782708308 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1c0cc330 con 0x7fbd1c0d3730 2023-06-20T13:33:19.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.530+0000 7fbd22fff700 1 -- 172.21.15.32:0/2782708308 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd1c0cc830 con 0x7fbd1c0d3730 2023-06-20T13:33:19.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.531+0000 7fbd197fa700 1 -- 172.21.15.32:0/2782708308 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbd14012430 con 0x7fbd1c0d3730 2023-06-20T13:33:19.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.532+0000 7fbd197fa700 1 --2- 172.21.15.32:0/2782708308 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fbd0006ace0 0x7fbd0006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:19.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.532+0000 7fbd197fa700 1 -- 172.21.15.32:0/2782708308 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbd1408ab20 con 0x7fbd1c0d3730 2023-06-20T13:33:19.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.532+0000 7fbd20d9b700 1 --2- 172.21.15.32:0/2782708308 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fbd0006ace0 0x7fbd0006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:19.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.533+0000 7fbd20d9b700 1 --2- 172.21.15.32:0/2782708308 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fbd0006ace0 0x7fbd0006d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbd10007fd0 tx=0x7fbd10007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:19.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.536+0000 7fbd197fa700 1 -- 172.21.15.32:0/2782708308 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbd14059320 con 0x7fbd1c0d3730 2023-06-20T13:33:19.745 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.743+0000 7fbd22fff700 1 -- 172.21.15.32:0/2782708308 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbd1c04ea60 con 0x7fbd1c0d3730 2023-06-20T13:33:19.746 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.744+0000 7fbd197fa700 1 -- 172.21.15.32:0/2782708308 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbd14007310 con 0x7fbd1c0d3730 2023-06-20T13:33:19.746 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-06-20T13:33:19.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.747+0000 7fbd22fff700 1 -- 172.21.15.32:0/2782708308 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fbd0006ace0 msgr2=0x7fbd0006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:19.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.747+0000 7fbd22fff700 1 --2- 172.21.15.32:0/2782708308 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fbd0006ace0 0x7fbd0006d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbd10007fd0 tx=0x7fbd10007ec0 comp rx=0 tx=0).stop 2023-06-20T13:33:19.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.747+0000 7fbd22fff700 1 -- 172.21.15.32:0/2782708308 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd1c0d3730 msgr2=0x7fbd1c15e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:19.749 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.747+0000 7fbd22fff700 1 --2- 172.21.15.32:0/2782708308 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd1c0d3730 0x7fbd1c15e920 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c06c780 tx=0x7fbd14004ad0 comp rx=0 tx=0).stop 2023-06-20T13:33:19.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.747+0000 7fbd22fff700 1 -- 172.21.15.32:0/2782708308 shutdown_connections 2023-06-20T13:33:19.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.747+0000 7fbd22fff700 1 --2- 172.21.15.32:0/2782708308 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fbd0006ace0 0x7fbd0006d190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:19.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.747+0000 7fbd22fff700 1 --2- 172.21.15.32:0/2782708308 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbd1c0d3730 0x7fbd1c15e920 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:19.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.747+0000 7fbd22fff700 1 --2- 172.21.15.32:0/2782708308 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbd1c0b8430 0x7fbd1c150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:19.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.747+0000 7fbd22fff700 1 --2- 172.21.15.32:0/2782708308 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbd1c0cfa90 0x7fbd1c0cb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:19.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.747+0000 7fbd22fff700 1 -- 172.21.15.32:0/2782708308 >> 172.21.15.32:0/2782708308 conn(0x7fbd1c06b3f0 msgr2=0x7fbd1c0d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:19.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.747+0000 7fbd22fff700 1 -- 172.21.15.32:0/2782708308 shutdown_connections 2023-06-20T13:33:19.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.747+0000 7fbd22fff700 1 -- 172.21.15.32:0/2782708308 wait complete. 2023-06-20T13:33:19.767 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-20T13:33:19.970 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.968+0000 7f88a97ff700 1 Processor -- start 2023-06-20T13:33:19.971 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.968+0000 7f88a97ff700 1 -- start start 2023-06-20T13:33:19.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.969+0000 7f88a97ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f88a40b8430 0x7f88a40cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:19.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.969+0000 7f88a97ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88a40d3730 0x7f88a40cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:19.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.969+0000 7f88a97ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f88a40cfa90 0x7f88a415feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:19.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.969+0000 7f88a97ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a40b8800 con 0x7f88a40b8430 2023-06-20T13:33:19.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.969+0000 7f88a97ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a40d0b20 con 0x7f88a40cfa90 2023-06-20T13:33:19.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.969+0000 7f88a97ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a40cfeb0 con 0x7f88a40d3730 2023-06-20T13:33:19.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.970+0000 7f88a2ffd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f88a40b8430 0x7f88a40cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:19.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.970+0000 7f88a2ffd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f88a40b8430 0x7f88a40cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39000/0 (socket says 172.21.15.32:39000) 2023-06-20T13:33:19.973 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.970+0000 7f88a2ffd700 1 -- 172.21.15.32:0/1790949038 learned_addr learned my addr 172.21.15.32:0/1790949038 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:19.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.970+0000 7f889bfff700 1 --2- 172.21.15.32:0/1790949038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88a40d3730 0x7f88a40cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:19.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.970+0000 7f88a37fe700 1 --2- 172.21.15.32:0/1790949038 >> v2:172.21.15.115:3300/0 conn(0x7f88a40cfa90 0x7f88a415feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:19.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.970+0000 7f88a2ffd700 1 -- 172.21.15.32:0/1790949038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88a40d3730 msgr2=0x7f88a40cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:19.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.970+0000 7f88a2ffd700 1 --2- 172.21.15.32:0/1790949038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88a40d3730 0x7f88a40cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:19.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.970+0000 7f88a2ffd700 1 -- 172.21.15.32:0/1790949038 >> v2:172.21.15.115:3300/0 conn(0x7f88a40cfa90 msgr2=0x7f88a415feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:19.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.970+0000 7f88a2ffd700 1 --2- 172.21.15.32:0/1790949038 >> v2:172.21.15.115:3300/0 conn(0x7f88a40cfa90 0x7f88a415feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:19.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.970+0000 7f88a2ffd700 1 -- 172.21.15.32:0/1790949038 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a40b4ee0 con 0x7f88a40b8430 2023-06-20T13:33:19.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.970+0000 7f889bfff700 1 --2- 172.21.15.32:0/1790949038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88a40d3730 0x7f88a40cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:19.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.970+0000 7f88a2ffd700 1 --2- 172.21.15.32:0/1790949038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88a40b8430 0x7f88a40cd320 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f88a406c570 tx=0x7f8894009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=303d7de1e931be1c server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:19.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.971+0000 7f88a27fc700 1 -- 172.21.15.32:0/1790949038 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8894011830 con 0x7f88a40b8430 2023-06-20T13:33:19.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.971+0000 7f88a27fc700 1 -- 172.21.15.32:0/1790949038 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8894011990 con 0x7f88a40b8430 2023-06-20T13:33:19.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.971+0000 7f88a27fc700 1 -- 172.21.15.32:0/1790949038 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8894011d20 con 0x7f88a40b8430 2023-06-20T13:33:19.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.971+0000 7f88a97ff700 1 -- 172.21.15.32:0/1790949038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88a40b8430 msgr2=0x7f88a40cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:19.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.971+0000 7f88a97ff700 1 --2- 172.21.15.32:0/1790949038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88a40b8430 0x7f88a40cd320 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f88a406c570 tx=0x7f8894009bd0 comp rx=0 tx=0).stop 2023-06-20T13:33:19.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.971+0000 7f88a97ff700 1 -- 172.21.15.32:0/1790949038 shutdown_connections 2023-06-20T13:33:19.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.971+0000 7f88a97ff700 1 --2- 172.21.15.32:0/1790949038 >> v2:172.21.15.115:3300/0 conn(0x7f88a40cfa90 0x7f88a415feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:19.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.971+0000 7f88a97ff700 1 --2- 172.21.15.32:0/1790949038 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88a40b8430 0x7f88a40cd320 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:19.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.971+0000 7f88a97ff700 1 --2- 172.21.15.32:0/1790949038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88a40d3730 0x7f88a40cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:19.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.971+0000 7f88a97ff700 1 -- 172.21.15.32:0/1790949038 >> 172.21.15.32:0/1790949038 conn(0x7f88a406b3f0 msgr2=0x7f88a406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:19.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.971+0000 7f88a97ff700 1 -- 172.21.15.32:0/1790949038 shutdown_connections 2023-06-20T13:33:19.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.971+0000 7f88a97ff700 1 -- 172.21.15.32:0/1790949038 wait complete. 2023-06-20T13:33:19.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.973+0000 7f88a97ff700 1 Processor -- start 2023-06-20T13:33:19.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.973+0000 7f88a97ff700 1 -- start start 2023-06-20T13:33:19.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.974+0000 7f88a97ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88a40b8430 0x7f88a4150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:19.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.974+0000 7f88a97ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88a40cfa90 0x7f88a40c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:19.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.974+0000 7f88a97ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88a40d3730 0x7f88a40c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:19.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.974+0000 7f88a97ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a40c8b50 con 0x7f88a40d3730 2023-06-20T13:33:19.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.974+0000 7f88a97ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a40c9030 con 0x7f88a40cfa90 2023-06-20T13:33:19.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.974+0000 7f88a97ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a40c8d50 con 0x7f88a40b8430 2023-06-20T13:33:19.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.975+0000 7f88a2ffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88a40b8430 0x7f88a4150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:19.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.974+0000 7f88a37fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88a40d3730 0x7f88a40c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:19.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.975+0000 7f88a2ffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88a40b8430 0x7f88a4150070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.32:53354/0 (socket says 172.21.15.32:53354) 2023-06-20T13:33:19.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.975+0000 7f88a2ffd700 1 -- 172.21.15.32:0/3347486730 learned_addr learned my addr 172.21.15.32:0/3347486730 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:19.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.975+0000 7f889bfff700 1 --2- 172.21.15.32:0/3347486730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88a40cfa90 0x7f88a40c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:19.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.975+0000 7f88a2ffd700 1 -- 172.21.15.32:0/3347486730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88a40cfa90 msgr2=0x7f88a40c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:19.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.975+0000 7f88a2ffd700 1 --2- 172.21.15.32:0/3347486730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88a40cfa90 0x7f88a40c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:19.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.975+0000 7f88a2ffd700 1 -- 172.21.15.32:0/3347486730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88a40d3730 msgr2=0x7f88a40c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:19.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.975+0000 7f88a2ffd700 1 --2- 172.21.15.32:0/3347486730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88a40d3730 0x7f88a40c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:19.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.975+0000 7f88a2ffd700 1 -- 172.21.15.32:0/3347486730 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8894009550 con 0x7f88a40b8430 2023-06-20T13:33:19.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.975+0000 7f88a37fe700 1 --2- 172.21.15.32:0/3347486730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88a40d3730 0x7f88a40c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:33:19.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.975+0000 7f88a2ffd700 1 --2- 172.21.15.32:0/3347486730 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88a40b8430 0x7f88a4150070 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8894009c10 tx=0x7f8894004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:19.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.975+0000 7f889b7fe700 1 -- 172.21.15.32:0/3347486730 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8894004450 con 0x7f88a40b8430 2023-06-20T13:33:19.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.976+0000 7f889b7fe700 1 -- 172.21.15.32:0/3347486730 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889401e070 con 0x7f88a40b8430 2023-06-20T13:33:19.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.976+0000 7f889b7fe700 1 -- 172.21.15.32:0/3347486730 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88940038e0 con 0x7f88a40b8430 2023-06-20T13:33:19.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.976+0000 7f88a97ff700 1 -- 172.21.15.32:0/3347486730 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a41f2fd0 con 0x7f88a40b8430 2023-06-20T13:33:19.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.976+0000 7f88a97ff700 1 -- 172.21.15.32:0/3347486730 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a41f3590 con 0x7f88a40b8430 2023-06-20T13:33:19.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.977+0000 7f88a97ff700 1 -- 172.21.15.32:0/3347486730 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88a41f3780 con 0x7f88a40b8430 2023-06-20T13:33:19.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.978+0000 7f889b7fe700 1 -- 172.21.15.32:0/3347486730 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8894003a40 con 0x7f88a40b8430 2023-06-20T13:33:19.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.979+0000 7f889b7fe700 1 --2- 172.21.15.32:0/3347486730 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f888406ace0 0x7f888406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:19.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.979+0000 7f889b7fe700 1 -- 172.21.15.32:0/3347486730 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f889408a980 con 0x7f88a40b8430 2023-06-20T13:33:19.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.979+0000 7f889bfff700 1 --2- 172.21.15.32:0/3347486730 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f888406ace0 0x7f888406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:19.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.980+0000 7f889bfff700 1 --2- 172.21.15.32:0/3347486730 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f888406ace0 0x7f888406d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f88a415cea0 tx=0x7f888c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:19.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:19.983+0000 7f889b7fe700 1 -- 172.21.15.32:0/3347486730 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8894055770 con 0x7f88a40b8430 2023-06-20T13:33:20.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.195+0000 7f88a97ff700 1 -- 172.21.15.32:0/3347486730 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f88a404ea60 con 0x7f88a40b8430 2023-06-20T13:33:20.198 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.196+0000 7f889b7fe700 1 -- 172.21.15.32:0/3347486730 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8894058d90 con 0x7f88a40b8430 2023-06-20T13:33:20.199 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-06-20T13:33:20.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.199+0000 7f88a97ff700 1 -- 172.21.15.32:0/3347486730 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f888406ace0 msgr2=0x7f888406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:20.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.199+0000 7f88a97ff700 1 --2- 172.21.15.32:0/3347486730 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f888406ace0 0x7f888406d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f88a415cea0 tx=0x7f888c008040 comp rx=0 tx=0).stop 2023-06-20T13:33:20.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.199+0000 7f88a97ff700 1 -- 172.21.15.32:0/3347486730 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88a40b8430 msgr2=0x7f88a4150070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:20.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.199+0000 7f88a97ff700 1 --2- 172.21.15.32:0/3347486730 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88a40b8430 0x7f88a4150070 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8894009c10 tx=0x7f8894004750 comp rx=0 tx=0).stop 2023-06-20T13:33:20.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.199+0000 7f88a97ff700 1 -- 172.21.15.32:0/3347486730 shutdown_connections 2023-06-20T13:33:20.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.199+0000 7f88a97ff700 1 --2- 172.21.15.32:0/3347486730 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f888406ace0 0x7f888406d190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:20.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.199+0000 7f88a97ff700 1 --2- 172.21.15.32:0/3347486730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f88a40d3730 0x7f88a40c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:20.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.199+0000 7f88a97ff700 1 --2- 172.21.15.32:0/3347486730 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88a40b8430 0x7f88a4150070 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:20.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.199+0000 7f88a97ff700 1 --2- 172.21.15.32:0/3347486730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88a40cfa90 0x7f88a40c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:20.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.199+0000 7f88a97ff700 1 -- 172.21.15.32:0/3347486730 >> 172.21.15.32:0/3347486730 conn(0x7f88a406b3f0 msgr2=0x7f88a415bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:20.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.199+0000 7f88a97ff700 1 -- 172.21.15.32:0/3347486730 shutdown_connections 2023-06-20T13:33:20.203 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.199+0000 7f88a97ff700 1 -- 172.21.15.32:0/3347486730 wait complete. 2023-06-20T13:33:20.219 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-20T13:33:20.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.420+0000 7f06adbff700 1 Processor -- start 2023-06-20T13:33:20.423 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.421+0000 7f06adbff700 1 -- start start 2023-06-20T13:33:20.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.422+0000 7f06adbff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f06a815c3e0 0x7f06a80b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:20.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.422+0000 7f06adbff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f06a81605d0 0x7f06a80af150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:20.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.422+0000 7f06adbff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a80b0440 con 0x7f06a80ccd30 2023-06-20T13:33:20.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.422+0000 7f06adbff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06a80cd180 con 0x7f06a815c3e0 2023-06-20T13:33:20.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.422+0000 7f06adbff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06a815c7b0 con 0x7f06a81605d0 2023-06-20T13:33:20.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.422+0000 7f06a77fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f06a815c3e0 0x7f06a80b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:20.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.422+0000 7f06a6ffd700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f06a80ccd30 0x7f06a815fec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36784/0 (socket says 172.21.15.32:36784) 2023-06-20T13:33:20.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.422+0000 7f06a6ffd700 1 -- 172.21.15.32:0/80744887 learned_addr learned my addr 172.21.15.32:0/80744887 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:20.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.422+0000 7f06a7fff700 1 --2- 172.21.15.32:0/80744887 >> v2:172.21.15.115:3300/0 conn(0x7f06a81605d0 0x7f06a80af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:20.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.423+0000 7f06a77fe700 1 -- 172.21.15.32:0/80744887 >> v2:172.21.15.115:3300/0 conn(0x7f06a81605d0 msgr2=0x7f06a80af150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:20.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.423+0000 7f06a77fe700 1 --2- 172.21.15.32:0/80744887 >> v2:172.21.15.115:3300/0 conn(0x7f06a81605d0 0x7f06a80af150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:20.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.423+0000 7f06a77fe700 1 -- 172.21.15.32:0/80744887 >> v1:172.21.15.32:6789/0 conn(0x7f06a80ccd30 legacy=0x7f06a815fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:20.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.423+0000 7f06a77fe700 1 -- 172.21.15.32:0/80744887 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a80af830 con 0x7f06a815c3e0 2023-06-20T13:33:20.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.423+0000 7f06a77fe700 1 --2- 172.21.15.32:0/80744887 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06a815c3e0 0x7f06a80b08d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f06a80c9dc0 tx=0x7f0698009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2dda89a6189922 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:20.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.423+0000 7f06a67fc700 1 -- 172.21.15.32:0/80744887 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0698005e30 con 0x7f06a815c3e0 2023-06-20T13:33:20.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.423+0000 7f06a67fc700 1 -- 172.21.15.32:0/80744887 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0698006030 con 0x7f06a815c3e0 2023-06-20T13:33:20.427 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.423+0000 7f06a67fc700 1 -- 172.21.15.32:0/80744887 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06980063c0 con 0x7f06a815c3e0 2023-06-20T13:33:20.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.424+0000 7f06adbff700 1 -- 172.21.15.32:0/80744887 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06a815c3e0 msgr2=0x7f06a80b08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:20.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.424+0000 7f06adbff700 1 --2- 172.21.15.32:0/80744887 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06a815c3e0 0x7f06a80b08d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f06a80c9dc0 tx=0x7f0698009b00 comp rx=0 tx=0).stop 2023-06-20T13:33:20.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.424+0000 7f06adbff700 1 -- 172.21.15.32:0/80744887 shutdown_connections 2023-06-20T13:33:20.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.424+0000 7f06adbff700 1 --2- 172.21.15.32:0/80744887 >> v2:172.21.15.115:3300/0 conn(0x7f06a81605d0 0x7f06a80af150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:20.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.424+0000 7f06adbff700 1 --2- 172.21.15.32:0/80744887 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06a815c3e0 0x7f06a80b08d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:20.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.424+0000 7f06adbff700 1 -- 172.21.15.32:0/80744887 >> 172.21.15.32:0/80744887 conn(0x7f06a806b960 msgr2=0x7f06a8098a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:20.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.424+0000 7f06adbff700 1 -- 172.21.15.32:0/80744887 shutdown_connections 2023-06-20T13:33:20.428 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.424+0000 7f06adbff700 1 -- 172.21.15.32:0/80744887 wait complete. 2023-06-20T13:33:20.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.425+0000 7f06adbff700 1 Processor -- start 2023-06-20T13:33:20.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.426+0000 7f06adbff700 1 -- start start 2023-06-20T13:33:20.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.426+0000 7f06adbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06a80ccd30 0x7f06a81f1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:20.430 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.427+0000 7f06adbff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06a815c3e0 0x7f06a80b2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:20.431 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.427+0000 7f06adbff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06a81605d0 0x7f06a80b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:20.431 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.427+0000 7f06adbff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a8147750 con 0x7f06a815c3e0 2023-06-20T13:33:20.431 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.427+0000 7f06adbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a80cfed0 con 0x7f06a80ccd30 2023-06-20T13:33:20.431 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.427+0000 7f06adbff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a80cfa40 con 0x7f06a81605d0 2023-06-20T13:33:20.431 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.427+0000 7f06a6ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06a815c3e0 0x7f06a80b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:20.431 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.427+0000 7f06a6ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06a815c3e0 0x7f06a80b2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39024/0 (socket says 172.21.15.32:39024) 2023-06-20T13:33:20.431 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.427+0000 7f06a6ffd700 1 -- 172.21.15.32:0/3295028832 learned_addr learned my addr 172.21.15.32:0/3295028832 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:20.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.427+0000 7f06a77fe700 1 --2- 172.21.15.32:0/3295028832 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06a80ccd30 0x7f06a81f1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:20.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.427+0000 7f06a7fff700 1 --2- 172.21.15.32:0/3295028832 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06a81605d0 0x7f06a80b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:20.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.427+0000 7f06a6ffd700 1 -- 172.21.15.32:0/3295028832 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06a81605d0 msgr2=0x7f06a80b2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:20.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.427+0000 7f06a6ffd700 1 --2- 172.21.15.32:0/3295028832 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06a81605d0 0x7f06a80b2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:20.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.427+0000 7f06a6ffd700 1 -- 172.21.15.32:0/3295028832 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06a80ccd30 msgr2=0x7f06a81f1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:20.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.427+0000 7f06a6ffd700 1 --2- 172.21.15.32:0/3295028832 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06a80ccd30 0x7f06a81f1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:20.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.427+0000 7f06a6ffd700 1 -- 172.21.15.32:0/3295028832 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0698009430 con 0x7f06a815c3e0 2023-06-20T13:33:20.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.428+0000 7f06a6ffd700 1 --2- 172.21.15.32:0/3295028832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06a815c3e0 0x7f06a80b2660 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f069c00c550 tx=0x7f069c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:20.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.428+0000 7f068ffff700 1 -- 172.21.15.32:0/3295028832 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c005d70 con 0x7f06a815c3e0 2023-06-20T13:33:20.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.428+0000 7f068ffff700 1 -- 172.21.15.32:0/3295028832 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069c0070d0 con 0x7f06a815c3e0 2023-06-20T13:33:20.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.428+0000 7f068ffff700 1 -- 172.21.15.32:0/3295028832 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c007440 con 0x7f06a815c3e0 2023-06-20T13:33:20.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.428+0000 7f06adbff700 1 -- 172.21.15.32:0/3295028832 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06a80cee30 con 0x7f06a815c3e0 2023-06-20T13:33:20.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.428+0000 7f06adbff700 1 -- 172.21.15.32:0/3295028832 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a80cf3f0 con 0x7f06a815c3e0 2023-06-20T13:33:20.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.429+0000 7f06adbff700 1 -- 172.21.15.32:0/3295028832 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06a80cd650 con 0x7f06a815c3e0 2023-06-20T13:33:20.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.430+0000 7f068ffff700 1 -- 172.21.15.32:0/3295028832 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f069c0075a0 con 0x7f06a815c3e0 2023-06-20T13:33:20.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.431+0000 7f068ffff700 1 --2- 172.21.15.32:0/3295028832 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f069406ace0 0x7f069406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:20.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.431+0000 7f068ffff700 1 -- 172.21.15.32:0/3295028832 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f069c0889e0 con 0x7f06a815c3e0 2023-06-20T13:33:20.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.431+0000 7f06a77fe700 1 --2- 172.21.15.32:0/3295028832 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f069406ace0 0x7f069406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:20.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.432+0000 7f06a77fe700 1 --2- 172.21.15.32:0/3295028832 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f069406ace0 0x7f069406d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0698000c00 tx=0x7f0698008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:20.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.435+0000 7f068ffff700 1 -- 172.21.15.32:0/3295028832 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f069c053800 con 0x7f06a815c3e0 2023-06-20T13:33:20.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.641+0000 7f06adbff700 1 -- 172.21.15.32:0/3295028832 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f06a804ea60 con 0x7f06a815c3e0 2023-06-20T13:33:20.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.641+0000 7f068ffff700 1 -- 172.21.15.32:0/3295028832 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f069c056e20 con 0x7f06a815c3e0 2023-06-20T13:33:20.644 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-06-20T13:33:20.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.644+0000 7f06adbff700 1 -- 172.21.15.32:0/3295028832 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f069406ace0 msgr2=0x7f069406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:20.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.644+0000 7f06adbff700 1 --2- 172.21.15.32:0/3295028832 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f069406ace0 0x7f069406d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0698000c00 tx=0x7f0698008070 comp rx=0 tx=0).stop 2023-06-20T13:33:20.646 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.644+0000 7f06adbff700 1 -- 172.21.15.32:0/3295028832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06a815c3e0 msgr2=0x7f06a80b2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:20.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.644+0000 7f06adbff700 1 --2- 172.21.15.32:0/3295028832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06a815c3e0 0x7f06a80b2660 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f069c00c550 tx=0x7f069c00c860 comp rx=0 tx=0).stop 2023-06-20T13:33:20.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.644+0000 7f06adbff700 1 -- 172.21.15.32:0/3295028832 shutdown_connections 2023-06-20T13:33:20.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.644+0000 7f06adbff700 1 --2- 172.21.15.32:0/3295028832 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f069406ace0 0x7f069406d190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:20.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.644+0000 7f06adbff700 1 --2- 172.21.15.32:0/3295028832 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06a81605d0 0x7f06a80b2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:20.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.644+0000 7f06adbff700 1 --2- 172.21.15.32:0/3295028832 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06a80ccd30 0x7f06a81f1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:20.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.644+0000 7f06adbff700 1 --2- 172.21.15.32:0/3295028832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f06a815c3e0 0x7f06a80b2660 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:20.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.644+0000 7f06adbff700 1 -- 172.21.15.32:0/3295028832 >> 172.21.15.32:0/3295028832 conn(0x7f06a806b960 msgr2=0x7f06a806d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:20.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.644+0000 7f06adbff700 1 -- 172.21.15.32:0/3295028832 shutdown_connections 2023-06-20T13:33:20.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.644+0000 7f06adbff700 1 -- 172.21.15.32:0/3295028832 wait complete. 2023-06-20T13:33:20.664 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:33:20.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.863+0000 7f1ac19ff700 1 Processor -- start 2023-06-20T13:33:20.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.863+0000 7f1ac19ff700 1 -- start start 2023-06-20T13:33:20.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.864+0000 7f1ac19ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1abc15c460 0x7f1abc0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:20.867 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.864+0000 7f1ac19ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1abc0cf8f0 0x7f1abc15fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:20.867 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.864+0000 7f1ac19ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1abc0d1790 con 0x7f1abc0d2640 2023-06-20T13:33:20.867 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.864+0000 7f1ac19ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1abc0cedd0 con 0x7f1abc0cf8f0 2023-06-20T13:33:20.867 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.864+0000 7f1ac19ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc0cd950 con 0x7f1abc15c460 2023-06-20T13:33:20.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.865+0000 7f1abaffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1abc15c460 0x7f1abc0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:20.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.865+0000 7f1abb7fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1abc0cf8f0 0x7f1abc15fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:20.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.865+0000 7f1abaffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1abc15c460 0x7f1abc0b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.32:53372/0 (socket says 172.21.15.32:53372) 2023-06-20T13:33:20.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.865+0000 7f1abaffd700 1 -- 172.21.15.32:0/2491452572 learned_addr learned my addr 172.21.15.32:0/2491452572 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:20.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.865+0000 7f1abb7fe700 1 -- 172.21.15.32:0/2491452572 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1abc15c460 msgr2=0x7f1abc0b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:20.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.865+0000 7f1abb7fe700 1 --2- 172.21.15.32:0/2491452572 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1abc15c460 0x7f1abc0b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:20.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.865+0000 7f1abb7fe700 1 -- 172.21.15.32:0/2491452572 >> v1:172.21.15.115:6789/0 conn(0x7f1abc0d2640 legacy=0x7f1abc0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:20.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.865+0000 7f1abb7fe700 1 -- 172.21.15.32:0/2491452572 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1abc0d14b0 con 0x7f1abc0cf8f0 2023-06-20T13:33:20.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.866+0000 7f1abb7fe700 1 --2- 172.21.15.32:0/2491452572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1abc0cf8f0 0x7f1abc15fe20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4009d90 tx=0x7f1ab400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ddb4b5f18f66adb server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:20.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.866+0000 7f1ab9ffb700 1 -- 172.21.15.32:0/2491452572 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab400e070 con 0x7f1abc0cf8f0 2023-06-20T13:33:20.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.866+0000 7f1ab9ffb700 1 -- 172.21.15.32:0/2491452572 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab400bb20 con 0x7f1abc0cf8f0 2023-06-20T13:33:20.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.866+0000 7f1ab9ffb700 1 -- 172.21.15.32:0/2491452572 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab4012430 con 0x7f1abc0cf8f0 2023-06-20T13:33:20.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.866+0000 7f1ac19ff700 1 -- 172.21.15.32:0/2491452572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1abc0cf8f0 msgr2=0x7f1abc15fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:20.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.866+0000 7f1ac19ff700 1 --2- 172.21.15.32:0/2491452572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1abc0cf8f0 0x7f1abc15fe20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4009d90 tx=0x7f1ab400b330 comp rx=0 tx=0).stop 2023-06-20T13:33:20.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.866+0000 7f1ac19ff700 1 -- 172.21.15.32:0/2491452572 shutdown_connections 2023-06-20T13:33:20.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.866+0000 7f1ac19ff700 1 --2- 172.21.15.32:0/2491452572 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1abc15c460 0x7f1abc0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:20.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.866+0000 7f1ac19ff700 1 --2- 172.21.15.32:0/2491452572 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1abc0cf8f0 0x7f1abc15fe20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:20.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.866+0000 7f1ac19ff700 1 -- 172.21.15.32:0/2491452572 >> 172.21.15.32:0/2491452572 conn(0x7f1abc071660 msgr2=0x7f1abc071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:20.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.867+0000 7f1ac19ff700 1 -- 172.21.15.32:0/2491452572 shutdown_connections 2023-06-20T13:33:20.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.867+0000 7f1ac19ff700 1 -- 172.21.15.32:0/2491452572 wait complete. 2023-06-20T13:33:20.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.869+0000 7f1ac19ff700 1 Processor -- start 2023-06-20T13:33:20.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.869+0000 7f1ac19ff700 1 -- start start 2023-06-20T13:33:20.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.870+0000 7f1ac19ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1abc0cf8f0 0x7f1abc0ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:20.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.870+0000 7f1ac19ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1abc0d2640 0x7f1abc144170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:20.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.870+0000 7f1ac19ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1abc15c460 0x7f1abc1446b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:20.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.870+0000 7f1ac19ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc0c8140 con 0x7f1abc15c460 2023-06-20T13:33:20.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.870+0000 7f1ac19ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc0ca710 con 0x7f1abc0cf8f0 2023-06-20T13:33:20.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.870+0000 7f1ac19ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc1426b0 con 0x7f1abc0d2640 2023-06-20T13:33:20.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.871+0000 7f1abb7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1abc15c460 0x7f1abc1446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:20.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.871+0000 7f1abb7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1abc15c460 0x7f1abc1446b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39034/0 (socket says 172.21.15.32:39034) 2023-06-20T13:33:20.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.871+0000 7f1abb7fe700 1 -- 172.21.15.32:0/4007359731 learned_addr learned my addr 172.21.15.32:0/4007359731 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:20.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.871+0000 7f1aba7fc700 1 --2- 172.21.15.32:0/4007359731 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1abc0d2640 0x7f1abc144170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:20.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.871+0000 7f1abaffd700 1 --2- 172.21.15.32:0/4007359731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1abc0cf8f0 0x7f1abc0ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:20.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.871+0000 7f1abb7fe700 1 -- 172.21.15.32:0/4007359731 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1abc0d2640 msgr2=0x7f1abc144170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:20.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.871+0000 7f1abb7fe700 1 --2- 172.21.15.32:0/4007359731 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1abc0d2640 0x7f1abc144170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:20.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.871+0000 7f1abb7fe700 1 -- 172.21.15.32:0/4007359731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1abc0cf8f0 msgr2=0x7f1abc0ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:20.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.871+0000 7f1abb7fe700 1 --2- 172.21.15.32:0/4007359731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1abc0cf8f0 0x7f1abc0ca1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:20.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.871+0000 7f1abb7fe700 1 -- 172.21.15.32:0/4007359731 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab4009a70 con 0x7f1abc15c460 2023-06-20T13:33:20.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.872+0000 7f1abb7fe700 1 --2- 172.21.15.32:0/4007359731 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1abc15c460 0x7f1abc1446b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1ab400b370 tx=0x7f1ab4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:20.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.872+0000 7f1aa3fff700 1 -- 172.21.15.32:0/4007359731 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab4012430 con 0x7f1abc15c460 2023-06-20T13:33:20.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.872+0000 7f1aa3fff700 1 -- 172.21.15.32:0/4007359731 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab4020070 con 0x7f1abc15c460 2023-06-20T13:33:20.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.872+0000 7f1ac19ff700 1 -- 172.21.15.32:0/4007359731 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1abc15bc80 con 0x7f1abc15c460 2023-06-20T13:33:20.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.872+0000 7f1aa3fff700 1 -- 172.21.15.32:0/4007359731 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab40098f0 con 0x7f1abc15c460 2023-06-20T13:33:20.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.872+0000 7f1ac19ff700 1 -- 172.21.15.32:0/4007359731 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1abc0c7a80 con 0x7f1abc15c460 2023-06-20T13:33:20.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.873+0000 7f1ac19ff700 1 -- 172.21.15.32:0/4007359731 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1abc0c8280 con 0x7f1abc15c460 2023-06-20T13:33:20.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.874+0000 7f1aa3fff700 1 -- 172.21.15.32:0/4007359731 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1ab4004040 con 0x7f1abc15c460 2023-06-20T13:33:20.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.875+0000 7f1aa3fff700 1 --2- 172.21.15.32:0/4007359731 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1aa806ace0 0x7f1aa806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:20.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.875+0000 7f1aa3fff700 1 -- 172.21.15.32:0/4007359731 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1ab4022070 con 0x7f1abc15c460 2023-06-20T13:33:20.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.875+0000 7f1abaffd700 1 --2- 172.21.15.32:0/4007359731 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1aa806ace0 0x7f1aa806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:20.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.876+0000 7f1abaffd700 1 --2- 172.21.15.32:0/4007359731 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1aa806ace0 0x7f1aa806d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1aac009bd0 tx=0x7f1aac0092c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:20.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:20.879+0000 7f1aa3fff700 1 -- 172.21.15.32:0/4007359731 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1abc0c8280 con 0x7f1abc15c460 2023-06-20T13:33:21.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.091+0000 7f1ac19ff700 1 -- 172.21.15.32:0/4007359731 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1abc0c8280 con 0x7f1abc15c460 2023-06-20T13:33:21.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.092+0000 7f1aa3fff700 1 -- 172.21.15.32:0/4007359731 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20191 (secure 0 0 0) 0x7f1abc0c8280 con 0x7f1abc15c460 2023-06-20T13:33:21.095 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:33:21.095 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":29,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:33:00.976862+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-20T13:32:18.120021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-20T13:32:19.503624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-20T13:32:23.074912+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:33:21.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.095+0000 7f1ac19ff700 1 -- 172.21.15.32:0/4007359731 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1aa806ace0 msgr2=0x7f1aa806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:21.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.095+0000 7f1ac19ff700 1 --2- 172.21.15.32:0/4007359731 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1aa806ace0 0x7f1aa806d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1aac009bd0 tx=0x7f1aac0092c0 comp rx=0 tx=0).stop 2023-06-20T13:33:21.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.095+0000 7f1ac19ff700 1 -- 172.21.15.32:0/4007359731 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1abc15c460 msgr2=0x7f1abc1446b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:21.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.095+0000 7f1ac19ff700 1 --2- 172.21.15.32:0/4007359731 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1abc15c460 0x7f1abc1446b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1ab400b370 tx=0x7f1ab4004ad0 comp rx=0 tx=0).stop 2023-06-20T13:33:21.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.095+0000 7f1ac19ff700 1 -- 172.21.15.32:0/4007359731 shutdown_connections 2023-06-20T13:33:21.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.095+0000 7f1ac19ff700 1 --2- 172.21.15.32:0/4007359731 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1aa806ace0 0x7f1aa806d190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:21.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.095+0000 7f1ac19ff700 1 --2- 172.21.15.32:0/4007359731 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1abc15c460 0x7f1abc1446b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:21.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.095+0000 7f1ac19ff700 1 --2- 172.21.15.32:0/4007359731 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1abc0cf8f0 0x7f1abc0ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:21.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.095+0000 7f1ac19ff700 1 --2- 172.21.15.32:0/4007359731 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1abc0d2640 0x7f1abc144170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:21.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.095+0000 7f1ac19ff700 1 -- 172.21.15.32:0/4007359731 >> 172.21.15.32:0/4007359731 conn(0x7f1abc071660 msgr2=0x7f1abc06b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:21.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.095+0000 7f1ac19ff700 1 -- 172.21.15.32:0/4007359731 shutdown_connections 2023-06-20T13:33:21.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.095+0000 7f1ac19ff700 1 -- 172.21.15.32:0/4007359731 wait complete. 2023-06-20T13:33:21.116 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-20T13:32:05.308022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-20T13:32:12.857161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-20T13:32:18.120021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-20T13:32:19.503624+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-20T13:32:23.074912+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-20T13:33:21.117 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-20T13:33:21.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.319+0000 7f95379ff700 1 Processor -- start 2023-06-20T13:33:21.322 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.320+0000 7f95379ff700 1 -- start start 2023-06-20T13:33:21.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.321+0000 7f95379ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95300b8430 0x7f95300cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:21.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.321+0000 7f95379ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f95300cfc60 0x7f95300d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:21.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.321+0000 7f95379ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95300d0b20 con 0x7f95300d3730 2023-06-20T13:33:21.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.321+0000 7f95379ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95300b8800 con 0x7f95300cfc60 2023-06-20T13:33:21.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.321+0000 7f95379ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95300b4ee0 con 0x7f95300b8430 2023-06-20T13:33:21.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.321+0000 7f9535f9c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f95300cfc60 0x7f95300d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:21.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.321+0000 7f9535f9c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f95300cfc60 0x7f95300d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39038/0 (socket says 172.21.15.32:39038) 2023-06-20T13:33:21.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.321+0000 7f9535f9c700 1 -- 172.21.15.32:0/851873912 learned_addr learned my addr 172.21.15.32:0/851873912 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:21.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.321+0000 7f953579b700 1 --2- 172.21.15.32:0/851873912 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95300b8430 0x7f95300cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:21.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.321+0000 7f9535f9c700 1 -- 172.21.15.32:0/851873912 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95300b8430 msgr2=0x7f95300cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:21.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.321+0000 7f9535f9c700 1 --2- 172.21.15.32:0/851873912 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95300b8430 0x7f95300cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:21.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.321+0000 7f9535f9c700 1 -- 172.21.15.32:0/851873912 >> v1:172.21.15.115:6789/0 conn(0x7f95300d3730 legacy=0x7f95300cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:21.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.322+0000 7f9535f9c700 1 -- 172.21.15.32:0/851873912 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95300b51c0 con 0x7f95300cfc60 2023-06-20T13:33:21.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.322+0000 7f9535f9c700 1 --2- 172.21.15.32:0/851873912 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95300cfc60 0x7f95300d0fb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9528009e50 tx=0x7f952800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c0cfc5b20e6a38 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:21.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.322+0000 7f9527fff700 1 -- 172.21.15.32:0/851873912 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952800e070 con 0x7f95300cfc60 2023-06-20T13:33:21.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.322+0000 7f9527fff700 1 -- 172.21.15.32:0/851873912 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952800b9c0 con 0x7f95300cfc60 2023-06-20T13:33:21.326 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.322+0000 7f9527fff700 1 -- 172.21.15.32:0/851873912 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952800bd70 con 0x7f95300cfc60 2023-06-20T13:33:21.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.322+0000 7f95379ff700 1 -- 172.21.15.32:0/851873912 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95300cfc60 msgr2=0x7f95300d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:21.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.322+0000 7f95379ff700 1 --2- 172.21.15.32:0/851873912 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95300cfc60 0x7f95300d0fb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9528009e50 tx=0x7f952800b330 comp rx=0 tx=0).stop 2023-06-20T13:33:21.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.323+0000 7f95379ff700 1 -- 172.21.15.32:0/851873912 shutdown_connections 2023-06-20T13:33:21.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.323+0000 7f95379ff700 1 --2- 172.21.15.32:0/851873912 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95300cfc60 0x7f95300d0fb0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:21.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.323+0000 7f95379ff700 1 --2- 172.21.15.32:0/851873912 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95300b8430 0x7f95300cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:21.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.323+0000 7f95379ff700 1 -- 172.21.15.32:0/851873912 >> 172.21.15.32:0/851873912 conn(0x7f953006b3f0 msgr2=0x7f953006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:21.327 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.323+0000 7f95379ff700 1 -- 172.21.15.32:0/851873912 shutdown_connections 2023-06-20T13:33:21.328 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.323+0000 7f95379ff700 1 -- 172.21.15.32:0/851873912 wait complete. 2023-06-20T13:33:21.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.324+0000 7f95379ff700 1 Processor -- start 2023-06-20T13:33:21.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.325+0000 7f95379ff700 1 -- start start 2023-06-20T13:33:21.329 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.326+0000 7f95379ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95300b8430 0x7f9530159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:21.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.326+0000 7f95379ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95300cfc60 0x7f95301e5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:21.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.326+0000 7f95379ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95300d3730 0x7f95301e6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:21.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.326+0000 7f95379ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95300c8f70 con 0x7f95300d3730 2023-06-20T13:33:21.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.326+0000 7f95379ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95301e7a60 con 0x7f95300b8430 2023-06-20T13:33:21.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.326+0000 7f95379ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95300c91c0 con 0x7f95300cfc60 2023-06-20T13:33:21.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.326+0000 7f9535f9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95300d3730 0x7f95301e6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:21.330 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.326+0000 7f9535f9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95300d3730 0x7f95301e6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39054/0 (socket says 172.21.15.32:39054) 2023-06-20T13:33:21.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.326+0000 7f9535f9c700 1 -- 172.21.15.32:0/2604192109 learned_addr learned my addr 172.21.15.32:0/2604192109 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:21.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.326+0000 7f953579b700 1 --2- 172.21.15.32:0/2604192109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95300b8430 0x7f9530159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:21.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.326+0000 7f9534f9a700 1 --2- 172.21.15.32:0/2604192109 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95300cfc60 0x7f95301e5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:21.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.326+0000 7f9535f9c700 1 -- 172.21.15.32:0/2604192109 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95300cfc60 msgr2=0x7f95301e5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:21.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.326+0000 7f9535f9c700 1 --2- 172.21.15.32:0/2604192109 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95300cfc60 0x7f95301e5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:21.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.326+0000 7f9535f9c700 1 -- 172.21.15.32:0/2604192109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95300b8430 msgr2=0x7f9530159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:21.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.326+0000 7f9535f9c700 1 --2- 172.21.15.32:0/2604192109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95300b8430 0x7f9530159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:21.331 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.326+0000 7f9535f9c700 1 -- 172.21.15.32:0/2604192109 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9528009b30 con 0x7f95300d3730 2023-06-20T13:33:21.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.327+0000 7f9535f9c700 1 --2- 172.21.15.32:0/2604192109 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95300d3730 0x7f95301e6230 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f953006c780 tx=0x7f9528004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:21.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.327+0000 7f9525ffb700 1 -- 172.21.15.32:0/2604192109 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9528004800 con 0x7f95300d3730 2023-06-20T13:33:21.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.327+0000 7f9525ffb700 1 -- 172.21.15.32:0/2604192109 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9528004960 con 0x7f95300d3730 2023-06-20T13:33:21.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.327+0000 7f9525ffb700 1 -- 172.21.15.32:0/2604192109 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952801c680 con 0x7f95300d3730 2023-06-20T13:33:21.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.327+0000 7f95379ff700 1 -- 172.21.15.32:0/2604192109 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95300c94a0 con 0x7f95300d3730 2023-06-20T13:33:21.332 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.327+0000 7f95379ff700 1 -- 172.21.15.32:0/2604192109 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95301e7710 con 0x7f95300d3730 2023-06-20T13:33:21.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.328+0000 7f95379ff700 1 -- 172.21.15.32:0/2604192109 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95300c6950 con 0x7f95300d3730 2023-06-20T13:33:21.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.329+0000 7f9525ffb700 1 -- 172.21.15.32:0/2604192109 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f952801c7e0 con 0x7f95300d3730 2023-06-20T13:33:21.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.330+0000 7f9525ffb700 1 --2- 172.21.15.32:0/2604192109 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f951406ace0 0x7f951406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:21.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.330+0000 7f9525ffb700 1 -- 172.21.15.32:0/2604192109 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f952808b400 con 0x7f95300d3730 2023-06-20T13:33:21.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.330+0000 7f953579b700 1 --2- 172.21.15.32:0/2604192109 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f951406ace0 0x7f951406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:21.334 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.331+0000 7f953579b700 1 --2- 172.21.15.32:0/2604192109 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f951406ace0 0x7f951406d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f95300c8a30 tx=0x7f952c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:21.336 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.334+0000 7f9525ffb700 1 -- 172.21.15.32:0/2604192109 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f95300c6950 con 0x7f95300d3730 2023-06-20T13:33:21.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.538+0000 7f95379ff700 1 -- 172.21.15.32:0/2604192109 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f95300c6950 con 0x7f95300d3730 2023-06-20T13:33:21.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.538+0000 7f9525ffb700 1 -- 172.21.15.32:0/2604192109 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f95300c6950 con 0x7f95300d3730 2023-06-20T13:33:21.541 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-06-20T13:33:21.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.541+0000 7f95379ff700 1 -- 172.21.15.32:0/2604192109 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f951406ace0 msgr2=0x7f951406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:21.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.541+0000 7f95379ff700 1 --2- 172.21.15.32:0/2604192109 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f951406ace0 0x7f951406d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f95300c8a30 tx=0x7f952c008040 comp rx=0 tx=0).stop 2023-06-20T13:33:21.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.541+0000 7f95379ff700 1 -- 172.21.15.32:0/2604192109 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95300d3730 msgr2=0x7f95301e6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:21.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.541+0000 7f95379ff700 1 --2- 172.21.15.32:0/2604192109 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95300d3730 0x7f95301e6230 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f953006c780 tx=0x7f9528004ad0 comp rx=0 tx=0).stop 2023-06-20T13:33:21.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.541+0000 7f95379ff700 1 -- 172.21.15.32:0/2604192109 shutdown_connections 2023-06-20T13:33:21.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.541+0000 7f95379ff700 1 --2- 172.21.15.32:0/2604192109 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f951406ace0 0x7f951406d190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:21.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.541+0000 7f95379ff700 1 --2- 172.21.15.32:0/2604192109 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95300d3730 0x7f95301e6230 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:21.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.541+0000 7f95379ff700 1 --2- 172.21.15.32:0/2604192109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95300b8430 0x7f9530159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:21.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.541+0000 7f95379ff700 1 --2- 172.21.15.32:0/2604192109 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95300cfc60 0x7f95301e5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:21.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.541+0000 7f95379ff700 1 -- 172.21.15.32:0/2604192109 >> 172.21.15.32:0/2604192109 conn(0x7f953006b3f0 msgr2=0x7f95300b6890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:21.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.541+0000 7f95379ff700 1 -- 172.21.15.32:0/2604192109 shutdown_connections 2023-06-20T13:33:21.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.541+0000 7f95379ff700 1 -- 172.21.15.32:0/2604192109 wait complete. 2023-06-20T13:33:21.561 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-20T13:33:21.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.763+0000 7f35f6dff700 1 Processor -- start 2023-06-20T13:33:21.766 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.763+0000 7f35f6dff700 1 -- start start 2023-06-20T13:33:21.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.764+0000 7f35f6dff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f35f00b8430 0x7f35f00cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:21.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.764+0000 7f35f6dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35f00d3730 0x7f35f00cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:21.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.765+0000 7f35f6dff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f00d0b20 con 0x7f35f00cfa90 2023-06-20T13:33:21.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.765+0000 7f35f6dff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f00b8800 con 0x7f35f00b8430 2023-06-20T13:33:21.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.765+0000 7f35f6dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f00cfeb0 con 0x7f35f00d3730 2023-06-20T13:33:21.767 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.765+0000 7f35f4b9b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f35f00b8430 0x7f35f00cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:21.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.765+0000 7f35f539c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f35f00cfa90 0x7f35f015feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36800/0 (socket says 172.21.15.32:36800) 2023-06-20T13:33:21.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.765+0000 7f35f539c700 1 -- 172.21.15.32:0/1139580803 learned_addr learned my addr 172.21.15.32:0/1139580803 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:21.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.765+0000 7f35effff700 1 --2- 172.21.15.32:0/1139580803 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35f00d3730 0x7f35f00cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:21.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.765+0000 7f35f4b9b700 1 -- 172.21.15.32:0/1139580803 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35f00d3730 msgr2=0x7f35f00cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:21.769 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.765+0000 7f35f4b9b700 1 --2- 172.21.15.32:0/1139580803 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35f00d3730 0x7f35f00cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:21.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.765+0000 7f35f4b9b700 1 -- 172.21.15.32:0/1139580803 >> v1:172.21.15.32:6789/0 conn(0x7f35f00cfa90 legacy=0x7f35f015feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:21.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.765+0000 7f35f4b9b700 1 -- 172.21.15.32:0/1139580803 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f00b4ee0 con 0x7f35f00b8430 2023-06-20T13:33:21.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.765+0000 7f35ef7fe700 1 -- 172.21.15.32:0/1139580803 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905909433 0 0) 0x7f35f00d0b20 con 0x7f35f00cfa90 2023-06-20T13:33:21.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.765+0000 7f35effff700 1 --2- 172.21.15.32:0/1139580803 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35f00d3730 0x7f35f00cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:21.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.766+0000 7f35f4b9b700 1 --2- 172.21.15.32:0/1139580803 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35f00b8430 0x7f35f00cd320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f35e4009840 tx=0x7f35e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcce9349c91946d8 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:21.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.766+0000 7f35ef7fe700 1 -- 172.21.15.32:0/1139580803 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e4011830 con 0x7f35f00b8430 2023-06-20T13:33:21.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.766+0000 7f35ef7fe700 1 -- 172.21.15.32:0/1139580803 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e4011990 con 0x7f35f00b8430 2023-06-20T13:33:21.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.766+0000 7f35ef7fe700 1 -- 172.21.15.32:0/1139580803 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e4011d20 con 0x7f35f00b8430 2023-06-20T13:33:21.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.766+0000 7f35f6dff700 1 -- 172.21.15.32:0/1139580803 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35f00b8430 msgr2=0x7f35f00cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:21.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.766+0000 7f35f6dff700 1 --2- 172.21.15.32:0/1139580803 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35f00b8430 0x7f35f00cd320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f35e4009840 tx=0x7f35e4009b50 comp rx=0 tx=0).stop 2023-06-20T13:33:21.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.766+0000 7f35f6dff700 1 -- 172.21.15.32:0/1139580803 shutdown_connections 2023-06-20T13:33:21.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.766+0000 7f35f6dff700 1 --2- 172.21.15.32:0/1139580803 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35f00b8430 0x7f35f00cd320 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:21.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.766+0000 7f35f6dff700 1 --2- 172.21.15.32:0/1139580803 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35f00d3730 0x7f35f00cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:21.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.766+0000 7f35f6dff700 1 -- 172.21.15.32:0/1139580803 >> 172.21.15.32:0/1139580803 conn(0x7f35f006b3f0 msgr2=0x7f35f006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:21.771 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.767+0000 7f35f6dff700 1 -- 172.21.15.32:0/1139580803 shutdown_connections 2023-06-20T13:33:21.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.767+0000 7f35f6dff700 1 -- 172.21.15.32:0/1139580803 wait complete. 2023-06-20T13:33:21.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.768+0000 7f35f6dff700 1 Processor -- start 2023-06-20T13:33:21.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.769+0000 7f35f6dff700 1 -- start start 2023-06-20T13:33:21.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.769+0000 7f35f6dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35f00b8430 0x7f35f00c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:21.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.770+0000 7f35f6dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35f00cfa90 0x7f35f01f2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:21.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.770+0000 7f35f6dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35f00d3730 0x7f35f00b3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:21.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.770+0000 7f35f6dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f015caa0 con 0x7f35f00d3730 2023-06-20T13:33:21.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.770+0000 7f35f6dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f00c6c30 con 0x7f35f00b8430 2023-06-20T13:33:21.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.770+0000 7f35f6dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f00c6f10 con 0x7f35f00cfa90 2023-06-20T13:33:21.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.770+0000 7f35f539c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35f00d3730 0x7f35f00b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:21.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.770+0000 7f35f539c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35f00d3730 0x7f35f00b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39068/0 (socket says 172.21.15.32:39068) 2023-06-20T13:33:21.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.770+0000 7f35f539c700 1 -- 172.21.15.32:0/1039403250 learned_addr learned my addr 172.21.15.32:0/1039403250 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:21.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.770+0000 7f35f4b9b700 1 --2- 172.21.15.32:0/1039403250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35f00b8430 0x7f35f00c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:21.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.770+0000 7f35f539c700 1 -- 172.21.15.32:0/1039403250 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35f00cfa90 msgr2=0x7f35f01f2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:21.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.770+0000 7f35f539c700 1 --2- 172.21.15.32:0/1039403250 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35f00cfa90 0x7f35f01f2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:21.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.770+0000 7f35f539c700 1 -- 172.21.15.32:0/1039403250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35f00b8430 msgr2=0x7f35f00c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:21.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.770+0000 7f35f539c700 1 --2- 172.21.15.32:0/1039403250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35f00b8430 0x7f35f00c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:21.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.770+0000 7f35f539c700 1 -- 172.21.15.32:0/1039403250 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e40094a0 con 0x7f35f00d3730 2023-06-20T13:33:21.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.770+0000 7f35f4b9b700 1 --2- 172.21.15.32:0/1039403250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35f00b8430 0x7f35f00c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:21.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.770+0000 7f35f539c700 1 --2- 172.21.15.32:0/1039403250 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35f00d3730 0x7f35f00b3740 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f35e800cca0 tx=0x7f35e800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:21.776 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.771+0000 7f35ed7fa700 1 -- 172.21.15.32:0/1039403250 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e800cea0 con 0x7f35f00d3730 2023-06-20T13:33:21.776 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.771+0000 7f35ed7fa700 1 -- 172.21.15.32:0/1039403250 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e800ade0 con 0x7f35f00d3730 2023-06-20T13:33:21.776 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.771+0000 7f35ed7fa700 1 -- 172.21.15.32:0/1039403250 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e8007310 con 0x7f35f00d3730 2023-06-20T13:33:21.776 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.771+0000 7f35f6dff700 1 -- 172.21.15.32:0/1039403250 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f00c71f0 con 0x7f35f00d3730 2023-06-20T13:33:21.776 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.771+0000 7f35f6dff700 1 -- 172.21.15.32:0/1039403250 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f01f2850 con 0x7f35f00d3730 2023-06-20T13:33:21.777 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.772+0000 7f35f6dff700 1 -- 172.21.15.32:0/1039403250 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f004ea60 con 0x7f35f00d3730 2023-06-20T13:33:21.777 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.773+0000 7f35ed7fa700 1 -- 172.21.15.32:0/1039403250 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f35e8007470 con 0x7f35f00d3730 2023-06-20T13:33:21.777 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.774+0000 7f35ed7fa700 1 --2- 172.21.15.32:0/1039403250 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f35d406ad10 0x7f35d406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:21.777 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.774+0000 7f35ed7fa700 1 -- 172.21.15.32:0/1039403250 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f35e80893f0 con 0x7f35f00d3730 2023-06-20T13:33:21.778 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.774+0000 7f35f4b9b700 1 --2- 172.21.15.32:0/1039403250 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f35d406ad10 0x7f35d406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:21.778 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.775+0000 7f35f4b9b700 1 --2- 172.21.15.32:0/1039403250 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f35d406ad10 0x7f35d406d1c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f35e40090b0 tx=0x7f35e4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:21.780 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.778+0000 7f35ed7fa700 1 -- 172.21.15.32:0/1039403250 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f35e80540d0 con 0x7f35f00d3730 2023-06-20T13:33:21.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.983+0000 7f35f6dff700 1 -- 172.21.15.32:0/1039403250 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f35f00ce4a0 con 0x7f35f00d3730 2023-06-20T13:33:21.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.984+0000 7f35ed7fa700 1 -- 172.21.15.32:0/1039403250 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f35e80576f0 con 0x7f35f00d3730 2023-06-20T13:33:21.986 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 8 2023-06-20T13:33:21.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.986+0000 7f35f6dff700 1 -- 172.21.15.32:0/1039403250 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f35d406ad10 msgr2=0x7f35d406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:21.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.986+0000 7f35f6dff700 1 --2- 172.21.15.32:0/1039403250 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f35d406ad10 0x7f35d406d1c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f35e40090b0 tx=0x7f35e4008030 comp rx=0 tx=0).stop 2023-06-20T13:33:21.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.986+0000 7f35f6dff700 1 -- 172.21.15.32:0/1039403250 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35f00d3730 msgr2=0x7f35f00b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:21.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.986+0000 7f35f6dff700 1 --2- 172.21.15.32:0/1039403250 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35f00d3730 0x7f35f00b3740 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f35e800cca0 tx=0x7f35e800a340 comp rx=0 tx=0).stop 2023-06-20T13:33:21.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.986+0000 7f35f6dff700 1 -- 172.21.15.32:0/1039403250 shutdown_connections 2023-06-20T13:33:21.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.986+0000 7f35f6dff700 1 --2- 172.21.15.32:0/1039403250 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f35d406ad10 0x7f35d406d1c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:21.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.986+0000 7f35f6dff700 1 --2- 172.21.15.32:0/1039403250 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f35f00d3730 0x7f35f00b3740 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:21.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.986+0000 7f35f6dff700 1 --2- 172.21.15.32:0/1039403250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f35f00b8430 0x7f35f00c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:21.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.986+0000 7f35f6dff700 1 --2- 172.21.15.32:0/1039403250 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35f00cfa90 0x7f35f01f2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:21.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.986+0000 7f35f6dff700 1 -- 172.21.15.32:0/1039403250 >> 172.21.15.32:0/1039403250 conn(0x7f35f006b3f0 msgr2=0x7f35f00b7110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:21.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.987+0000 7f35f6dff700 1 -- 172.21.15.32:0/1039403250 shutdown_connections 2023-06-20T13:33:21.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:21.987+0000 7f35f6dff700 1 -- 172.21.15.32:0/1039403250 wait complete. 2023-06-20T13:33:22.007 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-20T13:33:22.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.210+0000 7fa2c23ff700 1 Processor -- start 2023-06-20T13:33:22.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.210+0000 7fa2c23ff700 1 -- start start 2023-06-20T13:33:22.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.211+0000 7fa2c23ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2bc15c690 0x7fa2bc0adc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:22.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.211+0000 7fa2c23ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa2bc0ca1f0 0x7fa2bc0ca670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:22.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.211+0000 7fa2c23ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2bc0c9750 con 0x7fa2bc0cd0a0 2023-06-20T13:33:22.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.211+0000 7fa2c23ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2bc0cabb0 con 0x7fa2bc0ca1f0 2023-06-20T13:33:22.214 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.211+0000 7fa2c23ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc0cf1c0 con 0x7fa2bc15c690 2023-06-20T13:33:22.214 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.211+0000 7fa2bbfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2bc15c690 0x7fa2bc0adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:22.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.211+0000 7fa2c099c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa2bc0ca1f0 0x7fa2bc0ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:22.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.211+0000 7fa2c099c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa2bc0ca1f0 0x7fa2bc0ca670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:47000/0 (socket says 172.21.15.32:47000) 2023-06-20T13:33:22.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.211+0000 7fa2c099c700 1 -- 172.21.15.32:0/179614168 learned_addr learned my addr 172.21.15.32:0/179614168 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:22.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.212+0000 7fa2bbfff700 1 -- 172.21.15.32:0/179614168 >> v2:172.21.15.115:3300/0 conn(0x7fa2bc0ca1f0 msgr2=0x7fa2bc0ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:22.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.212+0000 7fa2bbfff700 1 --2- 172.21.15.32:0/179614168 >> v2:172.21.15.115:3300/0 conn(0x7fa2bc0ca1f0 0x7fa2bc0ca670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:22.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.212+0000 7fa2bbfff700 1 -- 172.21.15.32:0/179614168 >> v1:172.21.15.115:6789/0 conn(0x7fa2bc0cd0a0 legacy=0x7fa2bc06c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:22.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.212+0000 7fa2bbfff700 1 -- 172.21.15.32:0/179614168 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2bc0cd610 con 0x7fa2bc15c690 2023-06-20T13:33:22.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.212+0000 7fa2bbfff700 1 --2- 172.21.15.32:0/179614168 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2bc15c690 0x7fa2bc0adc60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac009840 tx=0x7fa2ac009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=274edcf1b7dc1ded server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:22.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.212+0000 7fa2baffd700 1 -- 172.21.15.32:0/179614168 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac011830 con 0x7fa2bc15c690 2023-06-20T13:33:22.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.212+0000 7fa2baffd700 1 -- 172.21.15.32:0/179614168 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ac011990 con 0x7fa2bc15c690 2023-06-20T13:33:22.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.212+0000 7fa2baffd700 1 -- 172.21.15.32:0/179614168 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac011d20 con 0x7fa2bc15c690 2023-06-20T13:33:22.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.213+0000 7fa2c23ff700 1 -- 172.21.15.32:0/179614168 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2bc15c690 msgr2=0x7fa2bc0adc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:22.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.213+0000 7fa2c23ff700 1 --2- 172.21.15.32:0/179614168 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2bc15c690 0x7fa2bc0adc60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac009840 tx=0x7fa2ac009b50 comp rx=0 tx=0).stop 2023-06-20T13:33:22.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.213+0000 7fa2c23ff700 1 -- 172.21.15.32:0/179614168 shutdown_connections 2023-06-20T13:33:22.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.213+0000 7fa2c23ff700 1 --2- 172.21.15.32:0/179614168 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2bc15c690 0x7fa2bc0adc60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:22.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.213+0000 7fa2c23ff700 1 --2- 172.21.15.32:0/179614168 >> v2:172.21.15.115:3300/0 conn(0x7fa2bc0ca1f0 0x7fa2bc0ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:22.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.213+0000 7fa2c23ff700 1 -- 172.21.15.32:0/179614168 >> 172.21.15.32:0/179614168 conn(0x7fa2bc0b0fd0 msgr2=0x7fa2bc0ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:22.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.213+0000 7fa2c23ff700 1 -- 172.21.15.32:0/179614168 shutdown_connections 2023-06-20T13:33:22.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.213+0000 7fa2c23ff700 1 -- 172.21.15.32:0/179614168 wait complete. 2023-06-20T13:33:22.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.215+0000 7fa2c23ff700 1 Processor -- start 2023-06-20T13:33:22.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.215+0000 7fa2c23ff700 1 -- start start 2023-06-20T13:33:22.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.216+0000 7fa2c23ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2bc0ca1f0 0x7fa2bc0c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:22.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.216+0000 7fa2c23ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2bc0cd0a0 0x7fa2bc14ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:22.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.216+0000 7fa2c23ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2bc15c690 0x7fa2bc0c2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:22.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.216+0000 7fa2c23ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc14d200 con 0x7fa2bc0ca1f0 2023-06-20T13:33:22.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.216+0000 7fa2c23ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc0c2890 con 0x7fa2bc0cd0a0 2023-06-20T13:33:22.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.216+0000 7fa2c23ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2bc0c6ae0 con 0x7fa2bc15c690 2023-06-20T13:33:22.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.216+0000 7fa2bbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2bc0ca1f0 0x7fa2bc0c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:22.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.216+0000 7fa2bbfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2bc0ca1f0 0x7fa2bc0c2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39072/0 (socket says 172.21.15.32:39072) 2023-06-20T13:33:22.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.216+0000 7fa2bbfff700 1 -- 172.21.15.32:0/1608037677 learned_addr learned my addr 172.21.15.32:0/1608037677 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:22.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.217+0000 7fa2bb7fe700 1 --2- 172.21.15.32:0/1608037677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2bc0cd0a0 0x7fa2bc14ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:22.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.217+0000 7fa2c099c700 1 --2- 172.21.15.32:0/1608037677 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2bc15c690 0x7fa2bc0c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:22.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.217+0000 7fa2bbfff700 1 -- 172.21.15.32:0/1608037677 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2bc15c690 msgr2=0x7fa2bc0c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:22.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.217+0000 7fa2bbfff700 1 --2- 172.21.15.32:0/1608037677 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2bc15c690 0x7fa2bc0c2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:22.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.217+0000 7fa2bbfff700 1 -- 172.21.15.32:0/1608037677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2bc0cd0a0 msgr2=0x7fa2bc14ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:22.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.217+0000 7fa2bbfff700 1 --2- 172.21.15.32:0/1608037677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2bc0cd0a0 0x7fa2bc14ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:22.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.217+0000 7fa2bbfff700 1 -- 172.21.15.32:0/1608037677 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac0094a0 con 0x7fa2bc0ca1f0 2023-06-20T13:33:22.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.217+0000 7fa2bbfff700 1 --2- 172.21.15.32:0/1608037677 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2bc0ca1f0 0x7fa2bc0c2cc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0090b0 tx=0x7fa2ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:22.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.217+0000 7fa2b8ff9700 1 -- 172.21.15.32:0/1608037677 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac0036a0 con 0x7fa2bc0ca1f0 2023-06-20T13:33:22.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.217+0000 7fa2b8ff9700 1 -- 172.21.15.32:0/1608037677 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ac01f070 con 0x7fa2bc0ca1f0 2023-06-20T13:33:22.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.217+0000 7fa2b8ff9700 1 -- 172.21.15.32:0/1608037677 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac003a00 con 0x7fa2bc0ca1f0 2023-06-20T13:33:22.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.217+0000 7fa2c23ff700 1 -- 172.21.15.32:0/1608037677 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2bc0c33c0 con 0x7fa2bc0ca1f0 2023-06-20T13:33:22.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.218+0000 7fa2c23ff700 1 -- 172.21.15.32:0/1608037677 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2bc0b2960 con 0x7fa2bc0ca1f0 2023-06-20T13:33:22.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.219+0000 7fa2c23ff700 1 -- 172.21.15.32:0/1608037677 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2bc066a70 con 0x7fa2bc0ca1f0 2023-06-20T13:33:22.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.220+0000 7fa2b8ff9700 1 -- 172.21.15.32:0/1608037677 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa2ac003b60 con 0x7fa2bc0ca1f0 2023-06-20T13:33:22.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.221+0000 7fa2b8ff9700 1 --2- 172.21.15.32:0/1608037677 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa2a806ace0 0x7fa2a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:22.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.221+0000 7fa2b8ff9700 1 -- 172.21.15.32:0/1608037677 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa2ac021070 con 0x7fa2bc0ca1f0 2023-06-20T13:33:22.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.221+0000 7fa2bb7fe700 1 --2- 172.21.15.32:0/1608037677 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa2a806ace0 0x7fa2a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:22.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.222+0000 7fa2bb7fe700 1 --2- 172.21.15.32:0/1608037677 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa2a806ace0 0x7fa2a806d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc1f55a0 tx=0x7fa2b0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:22.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.226+0000 7fa2b8ff9700 1 -- 172.21.15.32:0/1608037677 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa2ac055ec0 con 0x7fa2bc0ca1f0 2023-06-20T13:33:22.431 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.429+0000 7fa2c23ff700 1 -- 172.21.15.32:0/1608037677 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa2bc0c68d0 con 0x7fa2bc0ca1f0 2023-06-20T13:33:22.431 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.429+0000 7fa2b8ff9700 1 -- 172.21.15.32:0/1608037677 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa2ac0594e0 con 0x7fa2bc0ca1f0 2023-06-20T13:33:22.432 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-06-20T13:33:22.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.431+0000 7fa2c23ff700 1 -- 172.21.15.32:0/1608037677 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa2a806ace0 msgr2=0x7fa2a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:22.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.431+0000 7fa2c23ff700 1 --2- 172.21.15.32:0/1608037677 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa2a806ace0 0x7fa2a806d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc1f55a0 tx=0x7fa2b0009040 comp rx=0 tx=0).stop 2023-06-20T13:33:22.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.431+0000 7fa2c23ff700 1 -- 172.21.15.32:0/1608037677 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2bc0ca1f0 msgr2=0x7fa2bc0c2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:22.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.431+0000 7fa2c23ff700 1 --2- 172.21.15.32:0/1608037677 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2bc0ca1f0 0x7fa2bc0c2cc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0090b0 tx=0x7fa2ac004750 comp rx=0 tx=0).stop 2023-06-20T13:33:22.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.431+0000 7fa2c23ff700 1 -- 172.21.15.32:0/1608037677 shutdown_connections 2023-06-20T13:33:22.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.431+0000 7fa2c23ff700 1 --2- 172.21.15.32:0/1608037677 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa2a806ace0 0x7fa2a806d190 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:22.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.431+0000 7fa2c23ff700 1 --2- 172.21.15.32:0/1608037677 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2bc15c690 0x7fa2bc0c2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:22.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.431+0000 7fa2c23ff700 1 --2- 172.21.15.32:0/1608037677 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa2bc0ca1f0 0x7fa2bc0c2cc0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:22.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.431+0000 7fa2c23ff700 1 --2- 172.21.15.32:0/1608037677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa2bc0cd0a0 0x7fa2bc14ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:22.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.431+0000 7fa2c23ff700 1 -- 172.21.15.32:0/1608037677 >> 172.21.15.32:0/1608037677 conn(0x7fa2bc0b0fd0 msgr2=0x7fa2bc072bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:22.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.432+0000 7fa2c23ff700 1 -- 172.21.15.32:0/1608037677 shutdown_connections 2023-06-20T13:33:22.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.432+0000 7fa2c23ff700 1 -- 172.21.15.32:0/1608037677 wait complete. 2023-06-20T13:33:22.451 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-20T13:33:22.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.652+0000 7f4fa27ff700 1 Processor -- start 2023-06-20T13:33:22.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.652+0000 7f4fa27ff700 1 -- start start 2023-06-20T13:33:22.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.654+0000 7f4fa27ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4f9c0cfc60 0x7f4f9c167010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:22.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.654+0000 7f4fa27ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9c0d0b20 con 0x7f4f9c0d3730 2023-06-20T13:33:22.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.654+0000 7f4fa27ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9c0b4ee0 con 0x7f4f9c0b8430 2023-06-20T13:33:22.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.654+0000 7f4fa27ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9c0cda30 con 0x7f4f9c0cfc60 2023-06-20T13:33:22.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.654+0000 7f4f9b7fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f4f9c0d3730 0x7f4f9c0cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36812/0 (socket says 172.21.15.32:36812) 2023-06-20T13:33:22.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.654+0000 7f4f9b7fe700 1 -- 172.21.15.32:0/764940843 learned_addr learned my addr 172.21.15.32:0/764940843 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:22.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.654+0000 7f4f9affd700 1 -- 172.21.15.32:0/764940843 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3766456339 0 0) 0x7f4f9c0d0b20 con 0x7f4f9c0d3730 2023-06-20T13:33:22.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.654+0000 7f4fa0d9c700 1 --2- 172.21.15.32:0/764940843 >> v2:172.21.15.115:3300/0 conn(0x7f4f9c0cfc60 0x7f4f9c167010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:22.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.654+0000 7f4f9affd700 1 -- 172.21.15.32:0/764940843 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f840035b0 con 0x7f4f9c0d3730 2023-06-20T13:33:22.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.655+0000 7f4f9affd700 1 -- 172.21.15.32:0/764940843 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 96829860 0 0) 0x7f4f9c0b4ee0 con 0x7f4f9c0b8430 2023-06-20T13:33:22.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.655+0000 7f4f9affd700 1 -- 172.21.15.32:0/764940843 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f9c0d0b20 con 0x7f4f9c0b8430 2023-06-20T13:33:22.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.655+0000 7f4f9affd700 1 -- 172.21.15.32:0/764940843 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 481847715 0 0) 0x7f4f840035b0 con 0x7f4f9c0d3730 2023-06-20T13:33:22.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.655+0000 7f4f9affd700 1 -- 172.21.15.32:0/764940843 >> v2:172.21.15.115:3300/0 conn(0x7f4f9c0cfc60 msgr2=0x7f4f9c167010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:22.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.655+0000 7f4f9affd700 1 --2- 172.21.15.32:0/764940843 >> v2:172.21.15.115:3300/0 conn(0x7f4f9c0cfc60 0x7f4f9c167010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:22.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.655+0000 7f4f9affd700 1 -- 172.21.15.32:0/764940843 >> v1:172.21.15.115:6789/0 conn(0x7f4f9c0b8430 legacy=0x7f4f9c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:22.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.655+0000 7f4f9affd700 1 -- 172.21.15.32:0/764940843 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9c0b51c0 con 0x7f4f9c0d3730 2023-06-20T13:33:22.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.655+0000 7f4f9affd700 1 -- 172.21.15.32:0/764940843 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3380058562 0 0) 0x7f4f90001670 con 0x7f4f9c0d3730 2023-06-20T13:33:22.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.655+0000 7f4f9affd700 1 -- 172.21.15.32:0/764940843 >> v1:172.21.15.32:6789/0 conn(0x7f4f9c0d3730 legacy=0x7f4f9c0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:22.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.655+0000 7f4f9affd700 1 --2- 172.21.15.32:0/764940843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f84003be0 0x7f4f84003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:22.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.655+0000 7f4f9affd700 1 --2- 172.21.15.32:0/764940843 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f84004850 0x7f4f84004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:22.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.655+0000 7f4f9affd700 1 --2- 172.21.15.32:0/764940843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f84005200 0x7f4f8400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:22.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.655+0000 7f4f9affd700 1 -- 172.21.15.32:0/764940843 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8400c0e0 con 0x7f4f84005200 2023-06-20T13:33:22.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.655+0000 7f4f9affd700 1 -- 172.21.15.32:0/764940843 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8400c220 con 0x7f4f84003be0 2023-06-20T13:33:22.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.655+0000 7f4f9affd700 1 -- 172.21.15.32:0/764940843 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8400c3b0 con 0x7f4f84004850 2023-06-20T13:33:22.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.655+0000 7f4fa0d9c700 1 --2- 172.21.15.32:0/764940843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f84005200 0x7f4f8400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:22.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.655+0000 7f4f9bfff700 1 --2- 172.21.15.32:0/764940843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f84003be0 0x7f4f84003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:22.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.655+0000 7f4f9b7fe700 1 --2- 172.21.15.32:0/764940843 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f84004850 0x7f4f84004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:22.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.656+0000 7f4fa0d9c700 1 -- 172.21.15.32:0/764940843 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f84004850 msgr2=0x7f4f84004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:22.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.656+0000 7f4fa0d9c700 1 --2- 172.21.15.32:0/764940843 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f84004850 0x7f4f84004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:22.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.656+0000 7f4fa0d9c700 1 -- 172.21.15.32:0/764940843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f84003be0 msgr2=0x7f4f84003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:22.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.656+0000 7f4fa0d9c700 1 --2- 172.21.15.32:0/764940843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f84003be0 0x7f4f84003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:22.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.656+0000 7f4fa0d9c700 1 -- 172.21.15.32:0/764940843 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f840035b0 con 0x7f4f84005200 2023-06-20T13:33:22.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.656+0000 7f4f9bfff700 1 --2- 172.21.15.32:0/764940843 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f84003be0 0x7f4f84003fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:22.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.656+0000 7f4f9b7fe700 1 --2- 172.21.15.32:0/764940843 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f84004850 0x7f4f84004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:22.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.656+0000 7f4fa0d9c700 1 -- 172.21.15.32:0/764940843 reap_dead start 2023-06-20T13:33:22.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.656+0000 7f4fa0d9c700 1 --2- 172.21.15.32:0/764940843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f84005200 0x7f4f8400ba10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4f94009f90 tx=0x7f4f84005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db2d492187ad727 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:22.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.656+0000 7f4f9affd700 1 -- 172.21.15.32:0/764940843 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f94003a20 con 0x7f4f84005200 2023-06-20T13:33:22.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.656+0000 7f4f9affd700 1 -- 172.21.15.32:0/764940843 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9400f040 con 0x7f4f84005200 2023-06-20T13:33:22.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.656+0000 7f4f9affd700 1 -- 172.21.15.32:0/764940843 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f94003dc0 con 0x7f4f84005200 2023-06-20T13:33:22.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.657+0000 7f4fa27ff700 1 -- 172.21.15.32:0/764940843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f84005200 msgr2=0x7f4f8400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:22.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.657+0000 7f4fa27ff700 1 --2- 172.21.15.32:0/764940843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f84005200 0x7f4f8400ba10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4f94009f90 tx=0x7f4f84005880 comp rx=0 tx=0).stop 2023-06-20T13:33:22.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.657+0000 7f4fa27ff700 1 -- 172.21.15.32:0/764940843 shutdown_connections 2023-06-20T13:33:22.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.657+0000 7f4fa27ff700 1 --2- 172.21.15.32:0/764940843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f84005200 0x7f4f8400ba10 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:22.666 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.657+0000 7f4fa27ff700 1 -- 172.21.15.32:0/764940843 >> 172.21.15.32:0/764940843 conn(0x7f4f9c06b3f0 msgr2=0x7f4f9c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:22.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.657+0000 7f4fa27ff700 1 -- 172.21.15.32:0/764940843 shutdown_connections 2023-06-20T13:33:22.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.657+0000 7f4fa27ff700 1 -- 172.21.15.32:0/764940843 wait complete. 2023-06-20T13:33:22.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.658+0000 7f4fa27ff700 1 Processor -- start 2023-06-20T13:33:22.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.659+0000 7f4fa27ff700 1 -- start start 2023-06-20T13:33:22.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.660+0000 7f4fa27ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f84005200 0x7f4f9c15f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:22.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.660+0000 7f4fa27ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f9c15d290 0x7f4f9c1f2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:22.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.660+0000 7f4fa27ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f9c15a470 0x7f4f9c0b6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:22.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.660+0000 7f4fa27ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c15d050 con 0x7f4f9c15d290 2023-06-20T13:33:22.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.660+0000 7f4fa27ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c1f27d0 con 0x7f4f84005200 2023-06-20T13:33:22.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.660+0000 7f4fa27ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c15ca90 con 0x7f4f9c15a470 2023-06-20T13:33:22.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.660+0000 7f4f9b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f9c15d290 0x7f4f9c1f2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:22.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.660+0000 7f4f9b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f9c15d290 0x7f4f9c1f2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39100/0 (socket says 172.21.15.32:39100) 2023-06-20T13:33:22.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.660+0000 7f4f9b7fe700 1 -- 172.21.15.32:0/3391095959 learned_addr learned my addr 172.21.15.32:0/3391095959 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:22.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.660+0000 7f4f9bfff700 1 --2- 172.21.15.32:0/3391095959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f84005200 0x7f4f9c15f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:22.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.660+0000 7f4fa0d9c700 1 --2- 172.21.15.32:0/3391095959 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f9c15a470 0x7f4f9c0b6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:22.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.660+0000 7f4f9b7fe700 1 -- 172.21.15.32:0/3391095959 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f9c15a470 msgr2=0x7f4f9c0b6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:22.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.660+0000 7f4f9b7fe700 1 --2- 172.21.15.32:0/3391095959 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f9c15a470 0x7f4f9c0b6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:22.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.660+0000 7f4f9b7fe700 1 -- 172.21.15.32:0/3391095959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f84005200 msgr2=0x7f4f9c15f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:22.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.660+0000 7f4f9b7fe700 1 --2- 172.21.15.32:0/3391095959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f84005200 0x7f4f9c15f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:22.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.660+0000 7f4f9b7fe700 1 -- 172.21.15.32:0/3391095959 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9c15cd70 con 0x7f4f9c15d290 2023-06-20T13:33:22.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.660+0000 7f4f9bfff700 1 --2- 172.21.15.32:0/3391095959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f84005200 0x7f4f9c15f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:22.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.661+0000 7f4f9b7fe700 1 --2- 172.21.15.32:0/3391095959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f9c15d290 0x7f4f9c1f2290 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000e800 tx=0x7f4f9000eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:22.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.661+0000 7f4f98ff9700 1 -- 172.21.15.32:0/3391095959 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f90010510 con 0x7f4f9c15d290 2023-06-20T13:33:22.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.661+0000 7f4f98ff9700 1 -- 172.21.15.32:0/3391095959 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f90010670 con 0x7f4f9c15d290 2023-06-20T13:33:22.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.661+0000 7f4f98ff9700 1 -- 172.21.15.32:0/3391095959 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f900109e0 con 0x7f4f9c15d290 2023-06-20T13:33:22.673 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.661+0000 7f4fa27ff700 1 -- 172.21.15.32:0/3391095959 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f9c1f1a90 con 0x7f4f9c15d290 2023-06-20T13:33:22.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.661+0000 7f4fa27ff700 1 -- 172.21.15.32:0/3391095959 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f9c15a910 con 0x7f4f9c15d290 2023-06-20T13:33:22.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.662+0000 7f4fa27ff700 1 -- 172.21.15.32:0/3391095959 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f9c1f1fb0 con 0x7f4f9c15d290 2023-06-20T13:33:22.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.663+0000 7f4f98ff9700 1 -- 172.21.15.32:0/3391095959 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4f90010b40 con 0x7f4f9c15d290 2023-06-20T13:33:22.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.664+0000 7f4f98ff9700 1 --2- 172.21.15.32:0/3391095959 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4f8806ace0 0x7f4f8806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:22.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.664+0000 7f4f98ff9700 1 -- 172.21.15.32:0/3391095959 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4f90088f50 con 0x7f4f9c15d290 2023-06-20T13:33:22.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.664+0000 7f4f9bfff700 1 --2- 172.21.15.32:0/3391095959 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4f8806ace0 0x7f4f8806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:22.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.665+0000 7f4f9bfff700 1 --2- 172.21.15.32:0/3391095959 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4f8806ace0 0x7f4f8806d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c005630 tx=0x7f4f8c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:22.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.668+0000 7f4f98ff9700 1 -- 172.21.15.32:0/3391095959 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4f9c1f1fb0 con 0x7f4f9c15d290 2023-06-20T13:33:22.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.872+0000 7f4fa27ff700 1 -- 172.21.15.32:0/3391095959 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4f9c1f18c0 con 0x7f4f9c15d290 2023-06-20T13:33:22.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.873+0000 7f4f98ff9700 1 -- 172.21.15.32:0/3391095959 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4f90019020 con 0x7f4f9c15d290 2023-06-20T13:33:22.875 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-06-20T13:33:22.877 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.875+0000 7f4fa27ff700 1 -- 172.21.15.32:0/3391095959 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4f8806ace0 msgr2=0x7f4f8806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:22.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.875+0000 7f4fa27ff700 1 --2- 172.21.15.32:0/3391095959 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4f8806ace0 0x7f4f8806d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c005630 tx=0x7f4f8c009040 comp rx=0 tx=0).stop 2023-06-20T13:33:22.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.875+0000 7f4fa27ff700 1 -- 172.21.15.32:0/3391095959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f9c15d290 msgr2=0x7f4f9c1f2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:22.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.875+0000 7f4fa27ff700 1 --2- 172.21.15.32:0/3391095959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f9c15d290 0x7f4f9c1f2290 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000e800 tx=0x7f4f9000eb10 comp rx=0 tx=0).stop 2023-06-20T13:33:22.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.875+0000 7f4fa27ff700 1 -- 172.21.15.32:0/3391095959 shutdown_connections 2023-06-20T13:33:22.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.875+0000 7f4fa27ff700 1 --2- 172.21.15.32:0/3391095959 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4f8806ace0 0x7f4f8806d190 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:22.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.875+0000 7f4fa27ff700 1 --2- 172.21.15.32:0/3391095959 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f9c15a470 0x7f4f9c0b6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:22.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.875+0000 7f4fa27ff700 1 --2- 172.21.15.32:0/3391095959 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f84005200 0x7f4f9c15f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:22.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.875+0000 7f4fa27ff700 1 --2- 172.21.15.32:0/3391095959 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f9c15d290 0x7f4f9c1f2290 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:22.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.875+0000 7f4fa27ff700 1 -- 172.21.15.32:0/3391095959 >> 172.21.15.32:0/3391095959 conn(0x7f4f9c06b3f0 msgr2=0x7f4f9c15bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:22.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.875+0000 7f4fa27ff700 1 -- 172.21.15.32:0/3391095959 shutdown_connections 2023-06-20T13:33:22.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:22.875+0000 7f4fa27ff700 1 -- 172.21.15.32:0/3391095959 wait complete. 2023-06-20T13:33:22.895 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-20T13:33:23.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.099+0000 7ff04c3ff700 1 Processor -- start 2023-06-20T13:33:23.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.099+0000 7ff04c3ff700 1 -- start start 2023-06-20T13:33:23.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.100+0000 7ff04c3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff0440d3730 0x7ff0440cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:23.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.100+0000 7ff04c3ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0440cfa90 0x7ff0440d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:23.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.100+0000 7ff04c3ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0440d0b20 con 0x7ff0440b8430 2023-06-20T13:33:23.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.100+0000 7ff04c3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0440cda30 con 0x7ff0440d3730 2023-06-20T13:33:23.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.100+0000 7ff04c3ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0440b8800 con 0x7ff0440cfa90 2023-06-20T13:33:23.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.100+0000 7ff04a19b700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff0440b8430 0x7ff0440cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36814/0 (socket says 172.21.15.32:36814) 2023-06-20T13:33:23.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.100+0000 7ff04a19b700 1 -- 172.21.15.32:0/2323479832 learned_addr learned my addr 172.21.15.32:0/2323479832 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:23.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.100+0000 7ff04999a700 1 --2- 172.21.15.32:0/2323479832 >> v2:172.21.15.115:3300/0 conn(0x7ff0440d3730 0x7ff0440cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:23.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.100+0000 7ff04a99c700 1 --2- 172.21.15.32:0/2323479832 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0440cfa90 0x7ff0440d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:23.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.101+0000 7ff049199700 1 -- 172.21.15.32:0/2323479832 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729744321 0 0) 0x7ff0440d0b20 con 0x7ff0440b8430 2023-06-20T13:33:23.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.101+0000 7ff049199700 1 -- 172.21.15.32:0/2323479832 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0300035b0 con 0x7ff0440b8430 2023-06-20T13:33:23.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.101+0000 7ff04a99c700 1 -- 172.21.15.32:0/2323479832 >> v2:172.21.15.115:3300/0 conn(0x7ff0440d3730 msgr2=0x7ff0440cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:23.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.101+0000 7ff04a99c700 1 --2- 172.21.15.32:0/2323479832 >> v2:172.21.15.115:3300/0 conn(0x7ff0440d3730 0x7ff0440cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:23.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.101+0000 7ff04a99c700 1 -- 172.21.15.32:0/2323479832 >> v1:172.21.15.32:6789/0 conn(0x7ff0440b8430 legacy=0x7ff0440cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:23.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.101+0000 7ff04a99c700 1 -- 172.21.15.32:0/2323479832 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0440cfeb0 con 0x7ff0440cfa90 2023-06-20T13:33:23.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.101+0000 7ff04999a700 1 --2- 172.21.15.32:0/2323479832 >> v2:172.21.15.115:3300/0 conn(0x7ff0440d3730 0x7ff0440cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:33:23.108 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.101+0000 7ff04a99c700 1 --2- 172.21.15.32:0/2323479832 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0440cfa90 0x7ff0440d0fb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff03c009d90 tx=0x7ff03c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b25675da4b4fa4c8 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:23.108 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.101+0000 7ff049199700 1 -- 172.21.15.32:0/2323479832 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c00e070 con 0x7ff0440cfa90 2023-06-20T13:33:23.108 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.102+0000 7ff049199700 1 -- 172.21.15.32:0/2323479832 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03c00bb20 con 0x7ff0440cfa90 2023-06-20T13:33:23.108 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.102+0000 7ff049199700 1 -- 172.21.15.32:0/2323479832 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c012430 con 0x7ff0440cfa90 2023-06-20T13:33:23.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.102+0000 7ff04c3ff700 1 -- 172.21.15.32:0/2323479832 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0440cfa90 msgr2=0x7ff0440d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:23.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.102+0000 7ff04c3ff700 1 --2- 172.21.15.32:0/2323479832 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0440cfa90 0x7ff0440d0fb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff03c009d90 tx=0x7ff03c00b330 comp rx=0 tx=0).stop 2023-06-20T13:33:23.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.102+0000 7ff04c3ff700 1 -- 172.21.15.32:0/2323479832 shutdown_connections 2023-06-20T13:33:23.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.102+0000 7ff04c3ff700 1 --2- 172.21.15.32:0/2323479832 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0440cfa90 0x7ff0440d0fb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:23.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.102+0000 7ff04c3ff700 1 --2- 172.21.15.32:0/2323479832 >> v2:172.21.15.115:3300/0 conn(0x7ff0440d3730 0x7ff0440cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:23.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.102+0000 7ff04c3ff700 1 -- 172.21.15.32:0/2323479832 >> 172.21.15.32:0/2323479832 conn(0x7ff04406b3f0 msgr2=0x7ff04406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:23.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.102+0000 7ff04c3ff700 1 -- 172.21.15.32:0/2323479832 shutdown_connections 2023-06-20T13:33:23.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.102+0000 7ff04c3ff700 1 -- 172.21.15.32:0/2323479832 wait complete. 2023-06-20T13:33:23.112 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.104+0000 7ff04c3ff700 1 Processor -- start 2023-06-20T13:33:23.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.104+0000 7ff04c3ff700 1 -- start start 2023-06-20T13:33:23.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.105+0000 7ff04c3ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0440b8430 0x7ff0441f1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:23.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.105+0000 7ff04c3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0440cfa90 0x7ff0440b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:23.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.105+0000 7ff04c3ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0440d3730 0x7ff0440cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:23.113 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.105+0000 7ff04c3ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04415e160 con 0x7ff0440b8430 2023-06-20T13:33:23.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.105+0000 7ff04c3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0440cce40 con 0x7ff0440cfa90 2023-06-20T13:33:23.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.105+0000 7ff04c3ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04415dae0 con 0x7ff0440d3730 2023-06-20T13:33:23.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.105+0000 7ff04a19b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0440b8430 0x7ff0441f1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:23.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.105+0000 7ff04a19b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0440b8430 0x7ff0441f1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39108/0 (socket says 172.21.15.32:39108) 2023-06-20T13:33:23.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.105+0000 7ff04a19b700 1 -- 172.21.15.32:0/3780351050 learned_addr learned my addr 172.21.15.32:0/3780351050 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:23.114 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.105+0000 7ff04999a700 1 --2- 172.21.15.32:0/3780351050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0440cfa90 0x7ff0440b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:23.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.105+0000 7ff04a99c700 1 --2- 172.21.15.32:0/3780351050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0440d3730 0x7ff0440cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:23.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.106+0000 7ff04a19b700 1 -- 172.21.15.32:0/3780351050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0440d3730 msgr2=0x7ff0440cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:23.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.106+0000 7ff04a19b700 1 --2- 172.21.15.32:0/3780351050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0440d3730 0x7ff0440cc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:23.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.106+0000 7ff04a19b700 1 -- 172.21.15.32:0/3780351050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0440cfa90 msgr2=0x7ff0440b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:23.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.106+0000 7ff04a19b700 1 --2- 172.21.15.32:0/3780351050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0440cfa90 0x7ff0440b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:23.115 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.106+0000 7ff04a19b700 1 -- 172.21.15.32:0/3780351050 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0340094a0 con 0x7ff0440b8430 2023-06-20T13:33:23.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.106+0000 7ff04a99c700 1 --2- 172.21.15.32:0/3780351050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0440d3730 0x7ff0440cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:33:23.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.106+0000 7ff04a19b700 1 --2- 172.21.15.32:0/3780351050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0440b8430 0x7ff0441f1940 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff04000c700 tx=0x7ff04000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:23.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.106+0000 7ff03affd700 1 -- 172.21.15.32:0/3780351050 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff040005d70 con 0x7ff0440b8430 2023-06-20T13:33:23.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.106+0000 7ff03affd700 1 -- 172.21.15.32:0/3780351050 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0400070d0 con 0x7ff0440b8430 2023-06-20T13:33:23.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.106+0000 7ff04c3ff700 1 -- 172.21.15.32:0/3780351050 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff03c009a70 con 0x7ff0440b8430 2023-06-20T13:33:23.116 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.106+0000 7ff03affd700 1 -- 172.21.15.32:0/3780351050 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff040007460 con 0x7ff0440b8430 2023-06-20T13:33:23.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.106+0000 7ff04c3ff700 1 -- 172.21.15.32:0/3780351050 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff04415dd80 con 0x7ff0440b8430 2023-06-20T13:33:23.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.107+0000 7ff04c3ff700 1 -- 172.21.15.32:0/3780351050 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff04404ea60 con 0x7ff0440b8430 2023-06-20T13:33:23.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.108+0000 7ff03affd700 1 -- 172.21.15.32:0/3780351050 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff0400075c0 con 0x7ff0440b8430 2023-06-20T13:33:23.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.109+0000 7ff03affd700 1 --2- 172.21.15.32:0/3780351050 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff02806ace0 0x7ff02806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:23.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.109+0000 7ff03affd700 1 -- 172.21.15.32:0/3780351050 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff040088ba0 con 0x7ff0440b8430 2023-06-20T13:33:23.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.110+0000 7ff04999a700 1 --2- 172.21.15.32:0/3780351050 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff02806ace0 0x7ff02806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:23.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.110+0000 7ff04999a700 1 --2- 172.21.15.32:0/3780351050 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff02806ace0 0x7ff02806d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff0440c65e0 tx=0x7ff034009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:23.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.113+0000 7ff03affd700 1 -- 172.21.15.32:0/3780351050 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff0400539b0 con 0x7ff0440b8430 2023-06-20T13:33:23.320 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.318+0000 7ff04c3ff700 1 -- 172.21.15.32:0/3780351050 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff0440b1250 con 0x7ff0440b8430 2023-06-20T13:33:23.321 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.318+0000 7ff03affd700 1 -- 172.21.15.32:0/3780351050 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff0400170a0 con 0x7ff0440b8430 2023-06-20T13:33:23.321 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-06-20T13:33:23.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.320+0000 7ff04c3ff700 1 -- 172.21.15.32:0/3780351050 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff02806ace0 msgr2=0x7ff02806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:23.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.320+0000 7ff04c3ff700 1 --2- 172.21.15.32:0/3780351050 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff02806ace0 0x7ff02806d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff0440c65e0 tx=0x7ff034009210 comp rx=0 tx=0).stop 2023-06-20T13:33:23.323 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.320+0000 7ff04c3ff700 1 -- 172.21.15.32:0/3780351050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0440b8430 msgr2=0x7ff0441f1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:23.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.320+0000 7ff04c3ff700 1 --2- 172.21.15.32:0/3780351050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0440b8430 0x7ff0441f1940 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff04000c700 tx=0x7ff04000ca10 comp rx=0 tx=0).stop 2023-06-20T13:33:23.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.320+0000 7ff04c3ff700 1 -- 172.21.15.32:0/3780351050 shutdown_connections 2023-06-20T13:33:23.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.320+0000 7ff04c3ff700 1 --2- 172.21.15.32:0/3780351050 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff02806ace0 0x7ff02806d190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:23.324 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.320+0000 7ff04c3ff700 1 --2- 172.21.15.32:0/3780351050 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff0440d3730 0x7ff0440cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:23.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.320+0000 7ff04c3ff700 1 --2- 172.21.15.32:0/3780351050 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff0440b8430 0x7ff0441f1940 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:23.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.320+0000 7ff04c3ff700 1 --2- 172.21.15.32:0/3780351050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff0440cfa90 0x7ff0440b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:23.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.320+0000 7ff04c3ff700 1 -- 172.21.15.32:0/3780351050 >> 172.21.15.32:0/3780351050 conn(0x7ff04406b3f0 msgr2=0x7ff04415bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:23.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.321+0000 7ff04c3ff700 1 -- 172.21.15.32:0/3780351050 shutdown_connections 2023-06-20T13:33:23.325 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.321+0000 7ff04c3ff700 1 -- 172.21.15.32:0/3780351050 wait complete. 2023-06-20T13:33:23.341 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:33:23.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.541+0000 7fd976dff700 1 Processor -- start 2023-06-20T13:33:23.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.541+0000 7fd976dff700 1 -- start start 2023-06-20T13:33:23.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.543+0000 7fd976dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd97015c460 0x7fd9700b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:23.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.543+0000 7fd976dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9700cf8f0 0x7fd97015fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:23.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.543+0000 7fd976dff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9700d1790 con 0x7fd9700d2640 2023-06-20T13:33:23.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.543+0000 7fd976dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9700cedd0 con 0x7fd97015c460 2023-06-20T13:33:23.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.543+0000 7fd976dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9700cd950 con 0x7fd9700cf8f0 2023-06-20T13:33:23.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.543+0000 7fd96ffff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd9700d2640 0x7fd9700cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36822/0 (socket says 172.21.15.32:36822) 2023-06-20T13:33:23.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.543+0000 7fd96ffff700 1 -- 172.21.15.32:0/1813681804 learned_addr learned my addr 172.21.15.32:0/1813681804 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:23.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.543+0000 7fd974b9b700 1 --2- 172.21.15.32:0/1813681804 >> v2:172.21.15.115:3300/0 conn(0x7fd97015c460 0x7fd9700b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:23.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.543+0000 7fd97539c700 1 --2- 172.21.15.32:0/1813681804 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9700cf8f0 0x7fd97015fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:23.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.544+0000 7fd974b9b700 1 -- 172.21.15.32:0/1813681804 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9700cf8f0 msgr2=0x7fd97015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:23.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.544+0000 7fd974b9b700 1 --2- 172.21.15.32:0/1813681804 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9700cf8f0 0x7fd97015fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:23.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.544+0000 7fd974b9b700 1 -- 172.21.15.32:0/1813681804 >> v1:172.21.15.32:6789/0 conn(0x7fd9700d2640 legacy=0x7fd9700cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:23.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.544+0000 7fd974b9b700 1 -- 172.21.15.32:0/1813681804 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9700d14b0 con 0x7fd97015c460 2023-06-20T13:33:23.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.544+0000 7fd96f7fe700 1 -- 172.21.15.32:0/1813681804 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2611661124 0 0) 0x7fd9700d1790 con 0x7fd9700d2640 2023-06-20T13:33:23.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.544+0000 7fd974b9b700 1 --2- 172.21.15.32:0/1813681804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd97015c460 0x7fd9700b59d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd964009840 tx=0x7fd964009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48453494cdea8127 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:23.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.544+0000 7fd96f7fe700 1 -- 172.21.15.32:0/1813681804 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd964011830 con 0x7fd97015c460 2023-06-20T13:33:23.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.544+0000 7fd96f7fe700 1 -- 172.21.15.32:0/1813681804 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd964011990 con 0x7fd97015c460 2023-06-20T13:33:23.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.544+0000 7fd96f7fe700 1 -- 172.21.15.32:0/1813681804 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd964011d20 con 0x7fd97015c460 2023-06-20T13:33:23.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.545+0000 7fd976dff700 1 -- 172.21.15.32:0/1813681804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd97015c460 msgr2=0x7fd9700b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:23.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.545+0000 7fd976dff700 1 --2- 172.21.15.32:0/1813681804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd97015c460 0x7fd9700b59d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd964009840 tx=0x7fd964009b50 comp rx=0 tx=0).stop 2023-06-20T13:33:23.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.545+0000 7fd976dff700 1 -- 172.21.15.32:0/1813681804 shutdown_connections 2023-06-20T13:33:23.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.545+0000 7fd976dff700 1 --2- 172.21.15.32:0/1813681804 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9700cf8f0 0x7fd97015fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:23.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.545+0000 7fd976dff700 1 --2- 172.21.15.32:0/1813681804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd97015c460 0x7fd9700b59d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:23.551 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.545+0000 7fd976dff700 1 -- 172.21.15.32:0/1813681804 >> 172.21.15.32:0/1813681804 conn(0x7fd970071660 msgr2=0x7fd970071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:23.551 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.545+0000 7fd976dff700 1 -- 172.21.15.32:0/1813681804 shutdown_connections 2023-06-20T13:33:23.551 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.545+0000 7fd976dff700 1 -- 172.21.15.32:0/1813681804 wait complete. 2023-06-20T13:33:23.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.547+0000 7fd976dff700 1 Processor -- start 2023-06-20T13:33:23.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.547+0000 7fd976dff700 1 -- start start 2023-06-20T13:33:23.553 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.548+0000 7fd976dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9700cf8f0 0x7fd970150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:23.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.548+0000 7fd976dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9700d2640 0x7fd970152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:23.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.548+0000 7fd976dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd97015c460 0x7fd9700cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:23.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.548+0000 7fd976dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd970153100 con 0x7fd97015c460 2023-06-20T13:33:23.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.548+0000 7fd976dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9701574b0 con 0x7fd9700d2640 2023-06-20T13:33:23.554 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.548+0000 7fd976dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd970157750 con 0x7fd9700cf8f0 2023-06-20T13:33:23.555 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.548+0000 7fd97539c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd97015c460 0x7fd9700cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:23.555 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.548+0000 7fd97539c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd97015c460 0x7fd9700cbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39110/0 (socket says 172.21.15.32:39110) 2023-06-20T13:33:23.555 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.548+0000 7fd97539c700 1 -- 172.21.15.32:0/3572334006 learned_addr learned my addr 172.21.15.32:0/3572334006 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:23.555 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.548+0000 7fd96ffff700 1 --2- 172.21.15.32:0/3572334006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9700d2640 0x7fd970152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:23.555 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.548+0000 7fd974b9b700 1 --2- 172.21.15.32:0/3572334006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9700cf8f0 0x7fd970150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:23.555 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.549+0000 7fd97539c700 1 -- 172.21.15.32:0/3572334006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9700cf8f0 msgr2=0x7fd970150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:23.555 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.549+0000 7fd97539c700 1 --2- 172.21.15.32:0/3572334006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9700cf8f0 0x7fd970150d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:23.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.549+0000 7fd97539c700 1 -- 172.21.15.32:0/3572334006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9700d2640 msgr2=0x7fd970152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:23.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.549+0000 7fd97539c700 1 --2- 172.21.15.32:0/3572334006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9700d2640 0x7fd970152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:23.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.549+0000 7fd97539c700 1 -- 172.21.15.32:0/3572334006 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9640094a0 con 0x7fd97015c460 2023-06-20T13:33:23.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.549+0000 7fd97539c700 1 --2- 172.21.15.32:0/3572334006 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd97015c460 0x7fd9700cbe50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd96800efc0 tx=0x7fd96800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:23.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.549+0000 7fd96d7fa700 1 -- 172.21.15.32:0/3572334006 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96800cad0 con 0x7fd97015c460 2023-06-20T13:33:23.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.549+0000 7fd96d7fa700 1 -- 172.21.15.32:0/3572334006 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96800f040 con 0x7fd97015c460 2023-06-20T13:33:23.556 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.549+0000 7fd976dff700 1 -- 172.21.15.32:0/3572334006 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd970157a30 con 0x7fd97015c460 2023-06-20T13:33:23.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.549+0000 7fd96d7fa700 1 -- 172.21.15.32:0/3572334006 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96800ce70 con 0x7fd97015c460 2023-06-20T13:33:23.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.549+0000 7fd976dff700 1 -- 172.21.15.32:0/3572334006 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd970157ff0 con 0x7fd97015c460 2023-06-20T13:33:23.557 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.550+0000 7fd976dff700 1 -- 172.21.15.32:0/3572334006 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd97004ea60 con 0x7fd97015c460 2023-06-20T13:33:23.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.551+0000 7fd96d7fa700 1 -- 172.21.15.32:0/3572334006 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd968014480 con 0x7fd97015c460 2023-06-20T13:33:23.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.552+0000 7fd96d7fa700 1 --2- 172.21.15.32:0/3572334006 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd95406ace0 0x7fd95406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:23.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.553+0000 7fd96d7fa700 1 -- 172.21.15.32:0/3572334006 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd96808a1f0 con 0x7fd97015c460 2023-06-20T13:33:23.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.553+0000 7fd974b9b700 1 --2- 172.21.15.32:0/3572334006 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd95406ace0 0x7fd95406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:23.558 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.553+0000 7fd974b9b700 1 --2- 172.21.15.32:0/3572334006 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd95406ace0 0x7fd95406d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd9640090b0 tx=0x7fd96401c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:23.559 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.557+0000 7fd96d7fa700 1 -- 172.21.15.32:0/3572334006 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd968054f60 con 0x7fd97015c460 2023-06-20T13:33:23.768 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.766+0000 7fd976dff700 1 -- 172.21.15.32:0/3572334006 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9700c6450 con 0x7fd97015c460 2023-06-20T13:33:23.770 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.768+0000 7fd96d7fa700 1 -- 172.21.15.32:0/3572334006 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20191 (secure 0 0 0) 0x7fd968058580 con 0x7fd97015c460 2023-06-20T13:33:23.770 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:33:23.771 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":29,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:33:00.976862+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-20T13:32:18.120021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-20T13:32:19.503624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-20T13:32:23.074912+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:33:23.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.770+0000 7fd976dff700 1 -- 172.21.15.32:0/3572334006 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd95406ace0 msgr2=0x7fd95406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:23.773 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.770+0000 7fd976dff700 1 --2- 172.21.15.32:0/3572334006 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd95406ace0 0x7fd95406d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd9640090b0 tx=0x7fd96401c040 comp rx=0 tx=0).stop 2023-06-20T13:33:23.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.770+0000 7fd976dff700 1 -- 172.21.15.32:0/3572334006 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd97015c460 msgr2=0x7fd9700cbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:23.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.770+0000 7fd976dff700 1 --2- 172.21.15.32:0/3572334006 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd97015c460 0x7fd9700cbe50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd96800efc0 tx=0x7fd96800c0c0 comp rx=0 tx=0).stop 2023-06-20T13:33:23.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.770+0000 7fd976dff700 1 -- 172.21.15.32:0/3572334006 shutdown_connections 2023-06-20T13:33:23.774 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.770+0000 7fd976dff700 1 --2- 172.21.15.32:0/3572334006 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd95406ace0 0x7fd95406d190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:23.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.770+0000 7fd976dff700 1 --2- 172.21.15.32:0/3572334006 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd97015c460 0x7fd9700cbe50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:23.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.770+0000 7fd976dff700 1 --2- 172.21.15.32:0/3572334006 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd9700cf8f0 0x7fd970150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:23.775 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.770+0000 7fd976dff700 1 --2- 172.21.15.32:0/3572334006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd9700d2640 0x7fd970152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:23.776 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.770+0000 7fd976dff700 1 -- 172.21.15.32:0/3572334006 >> 172.21.15.32:0/3572334006 conn(0x7fd970071660 msgr2=0x7fd9700b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:23.776 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.771+0000 7fd976dff700 1 -- 172.21.15.32:0/3572334006 shutdown_connections 2023-06-20T13:33:23.776 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.771+0000 7fd976dff700 1 -- 172.21.15.32:0/3572334006 wait complete. 2023-06-20T13:33:23.791 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-20T13:32:05.308022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-20T13:32:12.857161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-20T13:32:18.120021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-20T13:32:19.503624+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-20T13:32:23.074912+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-20T13:33:23.791 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-20T13:33:23.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.992+0000 7f3fc77ff700 1 Processor -- start 2023-06-20T13:33:23.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.992+0000 7f3fc77ff700 1 -- start start 2023-06-20T13:33:23.995 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.993+0000 7f3fc77ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fc00b8430 0x7f3fc00cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:23.995 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.993+0000 7f3fc77ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc00d0b20 con 0x7f3fc00d3730 2023-06-20T13:33:23.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.993+0000 7f3fc77ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc00b4ee0 con 0x7f3fc00cfc60 2023-06-20T13:33:23.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.993+0000 7f3fc77ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc00b8800 con 0x7f3fc00b8430 2023-06-20T13:33:23.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.993+0000 7f3fc4d9a700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f3fc00d3730 0x7f3fc00cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36834/0 (socket says 172.21.15.32:36834) 2023-06-20T13:33:23.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.993+0000 7f3fc4d9a700 1 -- 172.21.15.32:0/2724392832 learned_addr learned my addr 172.21.15.32:0/2724392832 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:23.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.994+0000 7f3fc559b700 1 --2- 172.21.15.32:0/2724392832 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fc00b8430 0x7f3fc00cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:23.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.994+0000 7f3fb7fff700 1 -- 172.21.15.32:0/2724392832 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302240161 0 0) 0x7f3fc00d0b20 con 0x7f3fc00d3730 2023-06-20T13:33:23.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.994+0000 7f3fb7fff700 1 -- 172.21.15.32:0/2724392832 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fac0035b0 con 0x7f3fc00d3730 2023-06-20T13:33:23.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.994+0000 7f3fb7fff700 1 -- 172.21.15.32:0/2724392832 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164923988 0 0) 0x7f3fc00b4ee0 con 0x7f3fc00cfc60 2023-06-20T13:33:23.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.994+0000 7f3fb7fff700 1 -- 172.21.15.32:0/2724392832 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fc00d0b20 con 0x7f3fc00cfc60 2023-06-20T13:33:23.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.994+0000 7f3fb7fff700 1 -- 172.21.15.32:0/2724392832 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4090123422 0 0) 0x7f3fac0035b0 con 0x7f3fc00d3730 2023-06-20T13:33:23.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.994+0000 7f3fb7fff700 1 -- 172.21.15.32:0/2724392832 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fc00b8430 msgr2=0x7f3fc00cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:23.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.994+0000 7f3fb7fff700 1 --2- 172.21.15.32:0/2724392832 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fc00b8430 0x7f3fc00cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:23.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.994+0000 7f3fb7fff700 1 -- 172.21.15.32:0/2724392832 >> v1:172.21.15.115:6789/0 conn(0x7f3fc00cfc60 legacy=0x7f3fc00d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:24.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.994+0000 7f3fb7fff700 1 -- 172.21.15.32:0/2724392832 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc00b51c0 con 0x7f3fc00d3730 2023-06-20T13:33:24.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.994+0000 7f3fb7fff700 1 -- 172.21.15.32:0/2724392832 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3380058562 0 0) 0x7f3fb0001670 con 0x7f3fc00d3730 2023-06-20T13:33:24.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.994+0000 7f3fc559b700 1 --2- 172.21.15.32:0/2724392832 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fc00b8430 0x7f3fc00cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:33:24.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.994+0000 7f3fb7fff700 1 -- 172.21.15.32:0/2724392832 >> v1:172.21.15.32:6789/0 conn(0x7f3fc00d3730 legacy=0x7f3fc00cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:24.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.994+0000 7f3fb7fff700 1 --2- 172.21.15.32:0/2724392832 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fc00b8430 0x7f3fac003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:24.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.994+0000 7f3fb7fff700 1 --2- 172.21.15.32:0/2724392832 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fac004100 0x7f3fac004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:24.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.994+0000 7f3fb7fff700 1 --2- 172.21.15.32:0/2724392832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fac004d90 0x7f3fac005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:24.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.994+0000 7f3fb7fff700 1 -- 172.21.15.32:0/2724392832 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc00b8800 con 0x7f3fac004d90 2023-06-20T13:33:24.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.994+0000 7f3fb7fff700 1 -- 172.21.15.32:0/2724392832 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac00bac0 con 0x7f3fac004100 2023-06-20T13:33:24.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.994+0000 7f3fb7fff700 1 -- 172.21.15.32:0/2724392832 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac00bc80 con 0x7f3fc00b8430 2023-06-20T13:33:24.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.995+0000 7f3fc5d9c700 1 --2- 172.21.15.32:0/2724392832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fac004d90 0x7f3fac005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:24.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.995+0000 7f3fc559b700 1 --2- 172.21.15.32:0/2724392832 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fc00b8430 0x7f3fac003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:24.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.995+0000 7f3fc4d9a700 1 --2- 172.21.15.32:0/2724392832 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fac004100 0x7f3fac004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:24.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.995+0000 7f3fc559b700 1 -- 172.21.15.32:0/2724392832 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fac004100 msgr2=0x7f3fac004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:24.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.995+0000 7f3fc559b700 1 --2- 172.21.15.32:0/2724392832 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fac004100 0x7f3fac004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:24.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.995+0000 7f3fc559b700 1 -- 172.21.15.32:0/2724392832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fac004d90 msgr2=0x7f3fac005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:24.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.995+0000 7f3fc559b700 1 --2- 172.21.15.32:0/2724392832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fac004d90 0x7f3fac005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:24.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.995+0000 7f3fc559b700 1 -- 172.21.15.32:0/2724392832 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fbc0094a0 con 0x7f3fc00b8430 2023-06-20T13:33:24.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.995+0000 7f3fc4d9a700 1 --2- 172.21.15.32:0/2724392832 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fac004100 0x7f3fac004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:24.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.995+0000 7f3fc5d9c700 1 --2- 172.21.15.32:0/2724392832 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fac004d90 0x7f3fac005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:33:24.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.995+0000 7f3fc559b700 1 --2- 172.21.15.32:0/2724392832 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fc00b8430 0x7f3fac003bc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc009ce0 tx=0x7f3fac005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=835d5e5e4049b376 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:24.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.996+0000 7f3fb7fff700 1 -- 172.21.15.32:0/2724392832 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc004030 con 0x7f3fc00b8430 2023-06-20T13:33:24.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.996+0000 7f3fb7fff700 1 -- 172.21.15.32:0/2724392832 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fbc004190 con 0x7f3fc00b8430 2023-06-20T13:33:24.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.996+0000 7f3fb7fff700 1 -- 172.21.15.32:0/2724392832 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc004520 con 0x7f3fc00b8430 2023-06-20T13:33:24.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.996+0000 7f3fc77ff700 1 -- 172.21.15.32:0/2724392832 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fc00b8430 msgr2=0x7f3fac003bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:24.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.996+0000 7f3fc77ff700 1 --2- 172.21.15.32:0/2724392832 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fc00b8430 0x7f3fac003bc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc009ce0 tx=0x7f3fac005880 comp rx=0 tx=0).stop 2023-06-20T13:33:24.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.996+0000 7f3fc5d9c700 1 -- 172.21.15.32:0/2724392832 reap_dead start 2023-06-20T13:33:24.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.996+0000 7f3fc77ff700 1 -- 172.21.15.32:0/2724392832 shutdown_connections 2023-06-20T13:33:24.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.996+0000 7f3fc77ff700 1 -- 172.21.15.32:0/2724392832 >> 172.21.15.32:0/2724392832 conn(0x7f3fc006b3f0 msgr2=0x7f3fc006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:24.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.996+0000 7f3fc77ff700 1 -- 172.21.15.32:0/2724392832 shutdown_connections 2023-06-20T13:33:24.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.996+0000 7f3fc77ff700 1 -- 172.21.15.32:0/2724392832 wait complete. 2023-06-20T13:33:24.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.998+0000 7f3fc77ff700 1 Processor -- start 2023-06-20T13:33:24.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.998+0000 7f3fc77ff700 1 -- start start 2023-06-20T13:33:24.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.999+0000 7f3fc77ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fc00b8430 0x7f3fc0151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:24.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.999+0000 7f3fc77ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fc015e8e0 0x7f3fc00c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:24.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.999+0000 7f3fc77ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fc015a520 0x7f3fc015a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:24.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.999+0000 7f3fc77ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc00ca3b0 con 0x7f3fc015a520 2023-06-20T13:33:24.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.999+0000 7f3fc77ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc015aed0 con 0x7f3fc015e8e0 2023-06-20T13:33:24.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:23.999+0000 7f3fc77ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc00c6ea0 con 0x7f3fc00b8430 2023-06-20T13:33:24.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.000+0000 7f3fc5d9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fc015a520 0x7f3fc015a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:24.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.000+0000 7f3fc5d9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fc015a520 0x7f3fc015a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39128/0 (socket says 172.21.15.32:39128) 2023-06-20T13:33:24.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.000+0000 7f3fc5d9c700 1 -- 172.21.15.32:0/735262036 learned_addr learned my addr 172.21.15.32:0/735262036 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:24.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.000+0000 7f3fc4d9a700 1 --2- 172.21.15.32:0/735262036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fc015e8e0 0x7f3fc00c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:24.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.000+0000 7f3fc559b700 1 --2- 172.21.15.32:0/735262036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fc00b8430 0x7f3fc0151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:24.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.000+0000 7f3fc5d9c700 1 -- 172.21.15.32:0/735262036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fc00b8430 msgr2=0x7f3fc0151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:24.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.000+0000 7f3fc5d9c700 1 --2- 172.21.15.32:0/735262036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fc00b8430 0x7f3fc0151950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:24.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.000+0000 7f3fc5d9c700 1 -- 172.21.15.32:0/735262036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fc015e8e0 msgr2=0x7f3fc00c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:24.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.000+0000 7f3fc5d9c700 1 --2- 172.21.15.32:0/735262036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fc015e8e0 0x7f3fc00c6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:24.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.000+0000 7f3fc5d9c700 1 -- 172.21.15.32:0/735262036 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc00c7180 con 0x7f3fc015a520 2023-06-20T13:33:24.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.000+0000 7f3fc5d9c700 1 --2- 172.21.15.32:0/735262036 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fc015a520 0x7f3fc015a990 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3fc00b2100 tx=0x7f3fb800f4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:24.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.000+0000 7f3fb5ffb700 1 -- 172.21.15.32:0/735262036 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb800fd10 con 0x7f3fc015a520 2023-06-20T13:33:24.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.000+0000 7f3fb5ffb700 1 -- 172.21.15.32:0/735262036 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb800fe70 con 0x7f3fc015a520 2023-06-20T13:33:24.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.000+0000 7f3fb5ffb700 1 -- 172.21.15.32:0/735262036 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8003c40 con 0x7f3fc015a520 2023-06-20T13:33:24.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.001+0000 7f3fc77ff700 1 -- 172.21.15.32:0/735262036 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc00c7460 con 0x7f3fc015a520 2023-06-20T13:33:24.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.001+0000 7f3fc77ff700 1 -- 172.21.15.32:0/735262036 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc00c7a20 con 0x7f3fc015a520 2023-06-20T13:33:24.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.002+0000 7f3fc77ff700 1 -- 172.21.15.32:0/735262036 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc004ea60 con 0x7f3fc015a520 2023-06-20T13:33:24.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.003+0000 7f3fb5ffb700 1 -- 172.21.15.32:0/735262036 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3fb80050d0 con 0x7f3fc015a520 2023-06-20T13:33:24.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.003+0000 7f3fb5ffb700 1 --2- 172.21.15.32:0/735262036 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f3fa406ace0 0x7f3fa406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:24.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.004+0000 7f3fb5ffb700 1 -- 172.21.15.32:0/735262036 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3fb8089ce0 con 0x7f3fc015a520 2023-06-20T13:33:24.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.004+0000 7f3fc559b700 1 --2- 172.21.15.32:0/735262036 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f3fa406ace0 0x7f3fa406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:24.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.004+0000 7f3fc559b700 1 --2- 172.21.15.32:0/735262036 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f3fa406ace0 0x7f3fa406d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc0090b0 tx=0x7f3fbc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:24.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.008+0000 7f3fb5ffb700 1 -- 172.21.15.32:0/735262036 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3fb8054af0 con 0x7f3fc015a520 2023-06-20T13:33:24.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.216+0000 7f3fc77ff700 1 -- 172.21.15.32:0/735262036 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3fc0073990 con 0x7f3fc015a520 2023-06-20T13:33:24.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.217+0000 7f3fb5ffb700 1 -- 172.21.15.32:0/735262036 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3fb8058110 con 0x7f3fc015a520 2023-06-20T13:33:24.219 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-06-20T13:33:24.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.219+0000 7f3fc77ff700 1 -- 172.21.15.32:0/735262036 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f3fa406ace0 msgr2=0x7f3fa406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:24.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.219+0000 7f3fc77ff700 1 --2- 172.21.15.32:0/735262036 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f3fa406ace0 0x7f3fa406d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc0090b0 tx=0x7f3fbc008030 comp rx=0 tx=0).stop 2023-06-20T13:33:24.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.219+0000 7f3fc77ff700 1 -- 172.21.15.32:0/735262036 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fc015a520 msgr2=0x7f3fc015a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:24.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.219+0000 7f3fc77ff700 1 --2- 172.21.15.32:0/735262036 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fc015a520 0x7f3fc015a990 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3fc00b2100 tx=0x7f3fb800f4b0 comp rx=0 tx=0).stop 2023-06-20T13:33:24.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.219+0000 7f3fc77ff700 1 -- 172.21.15.32:0/735262036 shutdown_connections 2023-06-20T13:33:24.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.219+0000 7f3fc77ff700 1 --2- 172.21.15.32:0/735262036 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f3fa406ace0 0x7f3fa406d190 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:24.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.219+0000 7f3fc77ff700 1 --2- 172.21.15.32:0/735262036 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f3fc015a520 0x7f3fc015a990 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:24.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.220+0000 7f3fc77ff700 1 --2- 172.21.15.32:0/735262036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3fc00b8430 0x7f3fc0151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:24.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.220+0000 7f3fc77ff700 1 --2- 172.21.15.32:0/735262036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3fc015e8e0 0x7f3fc00c6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:24.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.220+0000 7f3fc77ff700 1 -- 172.21.15.32:0/735262036 >> 172.21.15.32:0/735262036 conn(0x7f3fc006b3f0 msgr2=0x7f3fc00d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:24.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.220+0000 7f3fc77ff700 1 -- 172.21.15.32:0/735262036 shutdown_connections 2023-06-20T13:33:24.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.220+0000 7f3fc77ff700 1 -- 172.21.15.32:0/735262036 wait complete. 2023-06-20T13:33:24.240 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-20T13:33:24.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.442+0000 7f89b41ff700 1 Processor -- start 2023-06-20T13:33:24.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.442+0000 7f89b41ff700 1 -- start start 2023-06-20T13:33:24.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.443+0000 7f89b41ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f89ac0d3730 0x7f89ac0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:24.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.443+0000 7f89b41ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89ac0d0b20 con 0x7f89ac0cfa90 2023-06-20T13:33:24.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.443+0000 7f89b41ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89ac0cfe90 con 0x7f89ac0b8430 2023-06-20T13:33:24.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.443+0000 7f89b41ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ac0cda30 con 0x7f89ac0d3730 2023-06-20T13:33:24.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.443+0000 7f89b179a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f89ac0d3730 0x7f89ac0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:24.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.443+0000 7f89b279c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f89ac0cfa90 0x7f89ac0d0fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36846/0 (socket says 172.21.15.32:36846) 2023-06-20T13:33:24.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.443+0000 7f89b279c700 1 -- 172.21.15.32:0/343230754 learned_addr learned my addr 172.21.15.32:0/343230754 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:24.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.444+0000 7f89b179a700 1 -- 172.21.15.32:0/343230754 >> v1:172.21.15.115:6789/0 conn(0x7f89ac0b8430 legacy=0x7f89ac0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:24.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.444+0000 7f89b179a700 1 -- 172.21.15.32:0/343230754 >> v1:172.21.15.32:6789/0 conn(0x7f89ac0cfa90 legacy=0x7f89ac0d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:24.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.444+0000 7f89b179a700 1 -- 172.21.15.32:0/343230754 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ac0b4ee0 con 0x7f89ac0d3730 2023-06-20T13:33:24.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.444+0000 7f89b0f99700 1 -- 172.21.15.32:0/343230754 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2620018205 0 0) 0x7f89ac0d0b20 con 0x7f89ac0cfa90 2023-06-20T13:33:24.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.444+0000 7f89b179a700 1 --2- 172.21.15.32:0/343230754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89ac0d3730 0x7f89ac0cf550 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f899c009840 tx=0x7f899c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc73c34fb66e477 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:24.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.444+0000 7f89b0f99700 1 -- 172.21.15.32:0/343230754 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c011830 con 0x7f89ac0d3730 2023-06-20T13:33:24.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.444+0000 7f89b0f99700 1 -- 172.21.15.32:0/343230754 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899c011990 con 0x7f89ac0d3730 2023-06-20T13:33:24.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.445+0000 7f89b0f99700 1 -- 172.21.15.32:0/343230754 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c011d20 con 0x7f89ac0d3730 2023-06-20T13:33:24.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.445+0000 7f89b41ff700 1 -- 172.21.15.32:0/343230754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89ac0d3730 msgr2=0x7f89ac0cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:24.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.445+0000 7f89b41ff700 1 --2- 172.21.15.32:0/343230754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89ac0d3730 0x7f89ac0cf550 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f899c009840 tx=0x7f899c009b50 comp rx=0 tx=0).stop 2023-06-20T13:33:24.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.445+0000 7f89b41ff700 1 -- 172.21.15.32:0/343230754 shutdown_connections 2023-06-20T13:33:24.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.445+0000 7f89b41ff700 1 --2- 172.21.15.32:0/343230754 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89ac0d3730 0x7f89ac0cf550 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:24.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.445+0000 7f89b41ff700 1 -- 172.21.15.32:0/343230754 >> 172.21.15.32:0/343230754 conn(0x7f89ac06b3f0 msgr2=0x7f89ac06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:24.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.445+0000 7f89b41ff700 1 -- 172.21.15.32:0/343230754 shutdown_connections 2023-06-20T13:33:24.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.445+0000 7f89b41ff700 1 -- 172.21.15.32:0/343230754 wait complete. 2023-06-20T13:33:24.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.447+0000 7f89b41ff700 1 Processor -- start 2023-06-20T13:33:24.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.447+0000 7f89b41ff700 1 -- start start 2023-06-20T13:33:24.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.448+0000 7f89b41ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89ac0b8430 0x7f89ac15a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:24.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.448+0000 7f89b41ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89ac0cfa90 0x7f89ac15e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:24.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.448+0000 7f89b41ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89ac0d3730 0x7f89ac0cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:24.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.448+0000 7f89b41ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac15e0e0 con 0x7f89ac0cfa90 2023-06-20T13:33:24.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.448+0000 7f89b41ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac15f880 con 0x7f89ac0b8430 2023-06-20T13:33:24.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.448+0000 7f89b41ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac15f5a0 con 0x7f89ac0d3730 2023-06-20T13:33:24.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.448+0000 7f89b179a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89ac0cfa90 0x7f89ac15e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:24.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.448+0000 7f89b179a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89ac0cfa90 0x7f89ac15e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39148/0 (socket says 172.21.15.32:39148) 2023-06-20T13:33:24.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.448+0000 7f89b179a700 1 -- 172.21.15.32:0/1996692198 learned_addr learned my addr 172.21.15.32:0/1996692198 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:24.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.448+0000 7f89b1f9b700 1 --2- 172.21.15.32:0/1996692198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89ac0b8430 0x7f89ac15a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:24.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.448+0000 7f89b279c700 1 --2- 172.21.15.32:0/1996692198 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89ac0d3730 0x7f89ac0cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:24.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.449+0000 7f89b179a700 1 -- 172.21.15.32:0/1996692198 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89ac0d3730 msgr2=0x7f89ac0cbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:24.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.449+0000 7f89b179a700 1 --2- 172.21.15.32:0/1996692198 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89ac0d3730 0x7f89ac0cbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:24.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.449+0000 7f89b179a700 1 -- 172.21.15.32:0/1996692198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89ac0b8430 msgr2=0x7f89ac15a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:24.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.449+0000 7f89b179a700 1 --2- 172.21.15.32:0/1996692198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89ac0b8430 0x7f89ac15a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:24.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.449+0000 7f89b179a700 1 -- 172.21.15.32:0/1996692198 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899c0094a0 con 0x7f89ac0cfa90 2023-06-20T13:33:24.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.449+0000 7f89b1f9b700 1 --2- 172.21.15.32:0/1996692198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89ac0b8430 0x7f89ac15a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:24.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.449+0000 7f89b179a700 1 --2- 172.21.15.32:0/1996692198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89ac0cfa90 0x7f89ac15e500 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f899c009b90 tx=0x7f899c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:24.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.449+0000 7f89a27fc700 1 -- 172.21.15.32:0/1996692198 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c0036a0 con 0x7f89ac0cfa90 2023-06-20T13:33:24.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.449+0000 7f89a27fc700 1 -- 172.21.15.32:0/1996692198 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899c01e070 con 0x7f89ac0cfa90 2023-06-20T13:33:24.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.449+0000 7f89b41ff700 1 -- 172.21.15.32:0/1996692198 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89ac15da20 con 0x7f89ac0cfa90 2023-06-20T13:33:24.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.449+0000 7f89a27fc700 1 -- 172.21.15.32:0/1996692198 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c003a00 con 0x7f89ac0cfa90 2023-06-20T13:33:24.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.449+0000 7f89b41ff700 1 -- 172.21.15.32:0/1996692198 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89ac15a670 con 0x7f89ac0cfa90 2023-06-20T13:33:24.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.450+0000 7f89b41ff700 1 -- 172.21.15.32:0/1996692198 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89ac15e220 con 0x7f89ac0cfa90 2023-06-20T13:33:24.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.451+0000 7f89a27fc700 1 -- 172.21.15.32:0/1996692198 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f899c003b60 con 0x7f89ac0cfa90 2023-06-20T13:33:24.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.452+0000 7f89a27fc700 1 --2- 172.21.15.32:0/1996692198 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f899006ace0 0x7f899006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:24.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.452+0000 7f89a27fc700 1 -- 172.21.15.32:0/1996692198 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f899c08a900 con 0x7f89ac0cfa90 2023-06-20T13:33:24.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.452+0000 7f89b1f9b700 1 --2- 172.21.15.32:0/1996692198 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f899006ace0 0x7f899006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:24.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.453+0000 7f89b1f9b700 1 --2- 172.21.15.32:0/1996692198 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f899006ace0 0x7f899006d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f89a8000f60 tx=0x7f89a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:24.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.456+0000 7f89a27fc700 1 -- 172.21.15.32:0/1996692198 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f89ac15e220 con 0x7f89ac0cfa90 2023-06-20T13:33:24.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.665+0000 7f89b41ff700 1 -- 172.21.15.32:0/1996692198 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f89ac15e220 con 0x7f89ac0cfa90 2023-06-20T13:33:24.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.665+0000 7f89a27fc700 1 -- 172.21.15.32:0/1996692198 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f899c015020 con 0x7f89ac0cfa90 2023-06-20T13:33:24.668 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 8 2023-06-20T13:33:24.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.668+0000 7f89b41ff700 1 -- 172.21.15.32:0/1996692198 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f899006ace0 msgr2=0x7f899006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:24.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.668+0000 7f89b41ff700 1 --2- 172.21.15.32:0/1996692198 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f899006ace0 0x7f899006d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f89a8000f60 tx=0x7f89a8009040 comp rx=0 tx=0).stop 2023-06-20T13:33:24.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.668+0000 7f89b41ff700 1 -- 172.21.15.32:0/1996692198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89ac0cfa90 msgr2=0x7f89ac15e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:24.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.668+0000 7f89b41ff700 1 --2- 172.21.15.32:0/1996692198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89ac0cfa90 0x7f89ac15e500 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f899c009b90 tx=0x7f899c004750 comp rx=0 tx=0).stop 2023-06-20T13:33:24.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.668+0000 7f89b41ff700 1 -- 172.21.15.32:0/1996692198 shutdown_connections 2023-06-20T13:33:24.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.668+0000 7f89b41ff700 1 --2- 172.21.15.32:0/1996692198 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f899006ace0 0x7f899006d190 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:24.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.668+0000 7f89b41ff700 1 --2- 172.21.15.32:0/1996692198 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89ac0d3730 0x7f89ac0cbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:24.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.668+0000 7f89b41ff700 1 --2- 172.21.15.32:0/1996692198 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89ac0b8430 0x7f89ac15a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:24.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.668+0000 7f89b41ff700 1 --2- 172.21.15.32:0/1996692198 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f89ac0cfa90 0x7f89ac15e500 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:24.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.668+0000 7f89b41ff700 1 -- 172.21.15.32:0/1996692198 >> 172.21.15.32:0/1996692198 conn(0x7f89ac06b3f0 msgr2=0x7f89ac0b7600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:24.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.668+0000 7f89b41ff700 1 -- 172.21.15.32:0/1996692198 shutdown_connections 2023-06-20T13:33:24.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.668+0000 7f89b41ff700 1 -- 172.21.15.32:0/1996692198 wait complete. 2023-06-20T13:33:24.688 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-20T13:33:24.892 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.889+0000 7fe2fb7ff700 1 Processor -- start 2023-06-20T13:33:24.892 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.890+0000 7fe2fb7ff700 1 -- start start 2023-06-20T13:33:24.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.891+0000 7fe2fb7ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe2f40d3730 0x7fe2f40cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:24.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.891+0000 7fe2fb7ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f40d0b20 con 0x7fe2f40b8430 2023-06-20T13:33:24.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.891+0000 7fe2fb7ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f40cfe90 con 0x7fe2f40cfa90 2023-06-20T13:33:24.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.891+0000 7fe2fb7ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f40cda30 con 0x7fe2f40d3730 2023-06-20T13:33:24.894 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.891+0000 7fe2f959b700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe2f40b8430 0x7fe2f40cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36858/0 (socket says 172.21.15.32:36858) 2023-06-20T13:33:24.894 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.891+0000 7fe2f959b700 1 -- 172.21.15.32:0/494845021 learned_addr learned my addr 172.21.15.32:0/494845021 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:24.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.891+0000 7fe2f8d9a700 1 --2- 172.21.15.32:0/494845021 >> v2:172.21.15.115:3300/0 conn(0x7fe2f40d3730 0x7fe2f40cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:24.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.891+0000 7fe2ebfff700 1 -- 172.21.15.32:0/494845021 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 544159801 0 0) 0x7fe2f40d0b20 con 0x7fe2f40b8430 2023-06-20T13:33:24.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.892+0000 7fe2ebfff700 1 -- 172.21.15.32:0/494845021 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2e00035b0 con 0x7fe2f40b8430 2023-06-20T13:33:24.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.892+0000 7fe2ebfff700 1 -- 172.21.15.32:0/494845021 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3973766466 0 0) 0x7fe2f40cfe90 con 0x7fe2f40cfa90 2023-06-20T13:33:24.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.892+0000 7fe2ebfff700 1 -- 172.21.15.32:0/494845021 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2f40d0b20 con 0x7fe2f40cfa90 2023-06-20T13:33:24.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.892+0000 7fe2f8d9a700 1 -- 172.21.15.32:0/494845021 >> v1:172.21.15.115:6789/0 conn(0x7fe2f40cfa90 legacy=0x7fe2f40d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:24.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.892+0000 7fe2f8d9a700 1 -- 172.21.15.32:0/494845021 >> v1:172.21.15.32:6789/0 conn(0x7fe2f40b8430 legacy=0x7fe2f40cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:24.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.892+0000 7fe2f8d9a700 1 -- 172.21.15.32:0/494845021 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f40b4ee0 con 0x7fe2f40d3730 2023-06-20T13:33:24.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.892+0000 7fe2f8d9a700 1 --2- 172.21.15.32:0/494845021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2f40d3730 0x7fe2f40cf550 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4009840 tx=0x7fe2e4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97be1496a17d9fd8 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:24.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.892+0000 7fe2ebfff700 1 -- 172.21.15.32:0/494845021 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4011830 con 0x7fe2f40d3730 2023-06-20T13:33:24.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.892+0000 7fe2ebfff700 1 -- 172.21.15.32:0/494845021 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e4011990 con 0x7fe2f40d3730 2023-06-20T13:33:24.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.892+0000 7fe2ebfff700 1 -- 172.21.15.32:0/494845021 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4011d00 con 0x7fe2f40d3730 2023-06-20T13:33:24.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.893+0000 7fe2fb7ff700 1 -- 172.21.15.32:0/494845021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2f40d3730 msgr2=0x7fe2f40cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:24.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.893+0000 7fe2fb7ff700 1 --2- 172.21.15.32:0/494845021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2f40d3730 0x7fe2f40cf550 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4009840 tx=0x7fe2e4009b50 comp rx=0 tx=0).stop 2023-06-20T13:33:24.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.893+0000 7fe2fb7ff700 1 -- 172.21.15.32:0/494845021 shutdown_connections 2023-06-20T13:33:24.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.893+0000 7fe2fb7ff700 1 --2- 172.21.15.32:0/494845021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2f40d3730 0x7fe2f40cf550 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:24.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.893+0000 7fe2fb7ff700 1 -- 172.21.15.32:0/494845021 >> 172.21.15.32:0/494845021 conn(0x7fe2f406b3f0 msgr2=0x7fe2f406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:24.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.893+0000 7fe2fb7ff700 1 -- 172.21.15.32:0/494845021 shutdown_connections 2023-06-20T13:33:24.898 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.893+0000 7fe2fb7ff700 1 -- 172.21.15.32:0/494845021 wait complete. 2023-06-20T13:33:24.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.895+0000 7fe2fb7ff700 1 Processor -- start 2023-06-20T13:33:24.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.895+0000 7fe2fb7ff700 1 -- start start 2023-06-20T13:33:24.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.896+0000 7fe2fb7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2f40b8430 0x7fe2f415d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:24.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.896+0000 7fe2fb7ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2f40cfa90 0x7fe2f415d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:24.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.896+0000 7fe2fb7ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2f40d3730 0x7fe2f41f1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:24.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.896+0000 7fe2fb7ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f415e940 con 0x7fe2f40d3730 2023-06-20T13:33:24.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.896+0000 7fe2fb7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f415df70 con 0x7fe2f40b8430 2023-06-20T13:33:24.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.896+0000 7fe2fb7ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f415e250 con 0x7fe2f40cfa90 2023-06-20T13:33:24.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.896+0000 7fe2f9d9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2f40d3730 0x7fe2f41f1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:24.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.896+0000 7fe2f9d9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2f40d3730 0x7fe2f41f1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39164/0 (socket says 172.21.15.32:39164) 2023-06-20T13:33:24.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.896+0000 7fe2f9d9c700 1 -- 172.21.15.32:0/3693247509 learned_addr learned my addr 172.21.15.32:0/3693247509 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:24.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.896+0000 7fe2f959b700 1 --2- 172.21.15.32:0/3693247509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2f40b8430 0x7fe2f415d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:24.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.896+0000 7fe2f8d9a700 1 --2- 172.21.15.32:0/3693247509 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2f40cfa90 0x7fe2f415d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:24.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.896+0000 7fe2f9d9c700 1 -- 172.21.15.32:0/3693247509 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2f40cfa90 msgr2=0x7fe2f415d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:24.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.896+0000 7fe2f9d9c700 1 --2- 172.21.15.32:0/3693247509 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2f40cfa90 0x7fe2f415d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:24.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.896+0000 7fe2f9d9c700 1 -- 172.21.15.32:0/3693247509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2f40b8430 msgr2=0x7fe2f415d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:24.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.896+0000 7fe2f9d9c700 1 --2- 172.21.15.32:0/3693247509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2f40b8430 0x7fe2f415d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:24.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.897+0000 7fe2f9d9c700 1 -- 172.21.15.32:0/3693247509 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e40094a0 con 0x7fe2f40d3730 2023-06-20T13:33:24.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.897+0000 7fe2f959b700 1 --2- 172.21.15.32:0/3693247509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2f40b8430 0x7fe2f415d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:24.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.897+0000 7fe2f9d9c700 1 --2- 172.21.15.32:0/3693247509 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2f40d3730 0x7fe2f41f1be0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00cc20 tx=0x7fe2ec00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:24.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.897+0000 7fe2e9ffb700 1 -- 172.21.15.32:0/3693247509 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec003c00 con 0x7fe2f40d3730 2023-06-20T13:33:24.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.897+0000 7fe2e9ffb700 1 -- 172.21.15.32:0/3693247509 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ec003d60 con 0x7fe2f40d3730 2023-06-20T13:33:24.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.897+0000 7fe2e9ffb700 1 -- 172.21.15.32:0/3693247509 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec00ab90 con 0x7fe2f40d3730 2023-06-20T13:33:24.902 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.897+0000 7fe2fb7ff700 1 -- 172.21.15.32:0/3693247509 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f40c9c10 con 0x7fe2f40d3730 2023-06-20T13:33:24.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.897+0000 7fe2fb7ff700 1 -- 172.21.15.32:0/3693247509 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f40ca1d0 con 0x7fe2f40d3730 2023-06-20T13:33:24.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.898+0000 7fe2fb7ff700 1 -- 172.21.15.32:0/3693247509 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f404ea60 con 0x7fe2f40d3730 2023-06-20T13:33:24.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.899+0000 7fe2e9ffb700 1 -- 172.21.15.32:0/3693247509 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe2ec00acf0 con 0x7fe2f40d3730 2023-06-20T13:33:24.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.900+0000 7fe2e9ffb700 1 --2- 172.21.15.32:0/3693247509 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe2d806ace0 0x7fe2d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:24.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.900+0000 7fe2e9ffb700 1 -- 172.21.15.32:0/3693247509 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe2ec089960 con 0x7fe2f40d3730 2023-06-20T13:33:24.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.900+0000 7fe2f959b700 1 --2- 172.21.15.32:0/3693247509 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe2d806ace0 0x7fe2d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:24.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.901+0000 7fe2f959b700 1 --2- 172.21.15.32:0/3693247509 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe2d806ace0 0x7fe2d806d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00011e0 tx=0x7fe2f0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:24.906 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:24.904+0000 7fe2e9ffb700 1 -- 172.21.15.32:0/3693247509 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe2ec054640 con 0x7fe2f40d3730 2023-06-20T13:33:25.117 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.115+0000 7fe2fb7ff700 1 -- 172.21.15.32:0/3693247509 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe2f415c190 con 0x7fe2f40d3730 2023-06-20T13:33:25.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.116+0000 7fe2e9ffb700 1 -- 172.21.15.32:0/3693247509 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe2ec057c60 con 0x7fe2f40d3730 2023-06-20T13:33:25.118 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-06-20T13:33:25.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.118+0000 7fe2fb7ff700 1 -- 172.21.15.32:0/3693247509 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe2d806ace0 msgr2=0x7fe2d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:25.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.118+0000 7fe2fb7ff700 1 --2- 172.21.15.32:0/3693247509 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe2d806ace0 0x7fe2d806d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00011e0 tx=0x7fe2f0009040 comp rx=0 tx=0).stop 2023-06-20T13:33:25.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.118+0000 7fe2fb7ff700 1 -- 172.21.15.32:0/3693247509 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2f40d3730 msgr2=0x7fe2f41f1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:25.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.118+0000 7fe2fb7ff700 1 --2- 172.21.15.32:0/3693247509 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2f40d3730 0x7fe2f41f1be0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00cc20 tx=0x7fe2ec00cf30 comp rx=0 tx=0).stop 2023-06-20T13:33:25.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.118+0000 7fe2fb7ff700 1 -- 172.21.15.32:0/3693247509 shutdown_connections 2023-06-20T13:33:25.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.118+0000 7fe2fb7ff700 1 --2- 172.21.15.32:0/3693247509 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe2d806ace0 0x7fe2d806d190 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:25.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.118+0000 7fe2fb7ff700 1 --2- 172.21.15.32:0/3693247509 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe2f40d3730 0x7fe2f41f1be0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:25.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.118+0000 7fe2fb7ff700 1 --2- 172.21.15.32:0/3693247509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2f40b8430 0x7fe2f415d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:25.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.118+0000 7fe2fb7ff700 1 --2- 172.21.15.32:0/3693247509 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2f40cfa90 0x7fe2f415d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:25.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.118+0000 7fe2fb7ff700 1 -- 172.21.15.32:0/3693247509 >> 172.21.15.32:0/3693247509 conn(0x7fe2f406b3f0 msgr2=0x7fe2f40d1930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:25.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.118+0000 7fe2fb7ff700 1 -- 172.21.15.32:0/3693247509 shutdown_connections 2023-06-20T13:33:25.122 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.118+0000 7fe2fb7ff700 1 -- 172.21.15.32:0/3693247509 wait complete. 2023-06-20T13:33:25.138 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-20T13:33:25.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.341+0000 7f56585ff700 1 Processor -- start 2023-06-20T13:33:25.343 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.341+0000 7f56585ff700 1 -- start start 2023-06-20T13:33:25.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.342+0000 7f56585ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f565015c690 0x7f56500adc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:25.344 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.342+0000 7f56585ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56500c9750 con 0x7f56500ca1f0 2023-06-20T13:33:25.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.342+0000 7f56585ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56500cf1c0 con 0x7f56500cd0a0 2023-06-20T13:33:25.345 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.342+0000 7f56585ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56500cd610 con 0x7f565015c690 2023-06-20T13:33:25.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.342+0000 7f5656b9c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f56500ca1f0 0x7f5650070440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36864/0 (socket says 172.21.15.32:36864) 2023-06-20T13:33:25.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.342+0000 7f5656b9c700 1 -- 172.21.15.32:0/185495968 learned_addr learned my addr 172.21.15.32:0/185495968 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:25.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.343+0000 7f565639b700 1 --2- 172.21.15.32:0/185495968 >> v2:172.21.15.115:3300/0 conn(0x7f565015c690 0x7f56500adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:25.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.343+0000 7f5655399700 1 -- 172.21.15.32:0/185495968 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137151679 0 0) 0x7f56500c9750 con 0x7f56500ca1f0 2023-06-20T13:33:25.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.343+0000 7f5655399700 1 -- 172.21.15.32:0/185495968 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f563c0057c0 con 0x7f56500ca1f0 2023-06-20T13:33:25.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.343+0000 7f5655399700 1 -- 172.21.15.32:0/185495968 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232279275 0 0) 0x7f56500cf1c0 con 0x7f56500cd0a0 2023-06-20T13:33:25.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.343+0000 7f5655399700 1 -- 172.21.15.32:0/185495968 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56500c9750 con 0x7f56500cd0a0 2023-06-20T13:33:25.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.343+0000 7f565639b700 1 -- 172.21.15.32:0/185495968 >> v1:172.21.15.115:6789/0 conn(0x7f56500cd0a0 legacy=0x7f565006c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:25.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.343+0000 7f5655399700 1 -- 172.21.15.32:0/185495968 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2516685653 0 0) 0x7f563c0057c0 con 0x7f56500ca1f0 2023-06-20T13:33:25.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.343+0000 7f565639b700 1 -- 172.21.15.32:0/185495968 >> v1:172.21.15.32:6789/0 conn(0x7f56500ca1f0 legacy=0x7f5650070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:25.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.343+0000 7f565639b700 1 -- 172.21.15.32:0/185495968 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56500cd8f0 con 0x7f565015c690 2023-06-20T13:33:25.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.344+0000 7f565639b700 1 --2- 172.21.15.32:0/185495968 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565015c690 0x7f56500adc60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f564c009840 tx=0x7f564c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33cd41c181fbbede server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:25.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.344+0000 7f5655399700 1 -- 172.21.15.32:0/185495968 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56480019f0 con 0x7f565015c690 2023-06-20T13:33:25.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.344+0000 7f5655399700 1 -- 172.21.15.32:0/185495968 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564c004030 con 0x7f565015c690 2023-06-20T13:33:25.348 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.344+0000 7f5655399700 1 -- 172.21.15.32:0/185495968 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c0043a0 con 0x7f565015c690 2023-06-20T13:33:25.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.344+0000 7f56585ff700 1 -- 172.21.15.32:0/185495968 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565015c690 msgr2=0x7f56500adc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:25.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.344+0000 7f56585ff700 1 --2- 172.21.15.32:0/185495968 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565015c690 0x7f56500adc60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f564c009840 tx=0x7f564c009b50 comp rx=0 tx=0).stop 2023-06-20T13:33:25.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.344+0000 7f56585ff700 1 -- 172.21.15.32:0/185495968 shutdown_connections 2023-06-20T13:33:25.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.345+0000 7f56585ff700 1 --2- 172.21.15.32:0/185495968 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f565015c690 0x7f56500adc60 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:25.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.345+0000 7f56585ff700 1 -- 172.21.15.32:0/185495968 >> 172.21.15.32:0/185495968 conn(0x7f56500b0fd0 msgr2=0x7f56500ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:25.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.345+0000 7f56585ff700 1 -- 172.21.15.32:0/185495968 shutdown_connections 2023-06-20T13:33:25.349 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.345+0000 7f56585ff700 1 -- 172.21.15.32:0/185495968 wait complete. 2023-06-20T13:33:25.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.346+0000 7f56585ff700 1 Processor -- start 2023-06-20T13:33:25.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.346+0000 7f56585ff700 1 -- start start 2023-06-20T13:33:25.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.347+0000 7f56585ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f56500ca1f0 0x7f565015a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:25.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.347+0000 7f56585ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56500cd0a0 0x7f5650149960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:25.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.347+0000 7f56585ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f565015c690 0x7f56500c7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:25.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.347+0000 7f56585ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56501552a0 con 0x7f565015c690 2023-06-20T13:33:25.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.347+0000 7f56585ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56500c8620 con 0x7f56500cd0a0 2023-06-20T13:33:25.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.347+0000 7f56585ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565015ae90 con 0x7f56500ca1f0 2023-06-20T13:33:25.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.348+0000 7f5656b9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f565015c690 0x7f56500c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:25.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.348+0000 7f5656b9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f565015c690 0x7f56500c7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39174/0 (socket says 172.21.15.32:39174) 2023-06-20T13:33:25.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.348+0000 7f5656b9c700 1 -- 172.21.15.32:0/2481007039 learned_addr learned my addr 172.21.15.32:0/2481007039 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:25.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.348+0000 7f565639b700 1 --2- 172.21.15.32:0/2481007039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f56500ca1f0 0x7f565015a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:25.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.348+0000 7f5655b9a700 1 --2- 172.21.15.32:0/2481007039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56500cd0a0 0x7f5650149960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:25.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.348+0000 7f5656b9c700 1 -- 172.21.15.32:0/2481007039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f56500ca1f0 msgr2=0x7f565015a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:25.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.348+0000 7f5656b9c700 1 --2- 172.21.15.32:0/2481007039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f56500ca1f0 0x7f565015a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:25.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.348+0000 7f5656b9c700 1 -- 172.21.15.32:0/2481007039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56500cd0a0 msgr2=0x7f5650149960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:25.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.348+0000 7f5656b9c700 1 --2- 172.21.15.32:0/2481007039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56500cd0a0 0x7f5650149960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:25.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.348+0000 7f5656b9c700 1 -- 172.21.15.32:0/2481007039 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564c0094a0 con 0x7f565015c690 2023-06-20T13:33:25.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.348+0000 7f565639b700 1 --2- 172.21.15.32:0/2481007039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f56500ca1f0 0x7f565015a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:25.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.348+0000 7f5656b9c700 1 --2- 172.21.15.32:0/2481007039 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f565015c690 0x7f56500c7020 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5648001700 tx=0x7f564800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:25.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.349+0000 7f5646ffd700 1 -- 172.21.15.32:0/2481007039 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564800ade0 con 0x7f565015c690 2023-06-20T13:33:25.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.349+0000 7f5646ffd700 1 -- 172.21.15.32:0/2481007039 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56480020c0 con 0x7f565015c690 2023-06-20T13:33:25.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.349+0000 7f5646ffd700 1 -- 172.21.15.32:0/2481007039 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5648007310 con 0x7f565015c690 2023-06-20T13:33:25.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.349+0000 7f56585ff700 1 -- 172.21.15.32:0/2481007039 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56500c7cf0 con 0x7f565015c690 2023-06-20T13:33:25.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.349+0000 7f56585ff700 1 -- 172.21.15.32:0/2481007039 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56500c82b0 con 0x7f565015c690 2023-06-20T13:33:25.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.350+0000 7f56585ff700 1 -- 172.21.15.32:0/2481007039 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5650066a70 con 0x7f565015c690 2023-06-20T13:33:25.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.351+0000 7f5646ffd700 1 -- 172.21.15.32:0/2481007039 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5648007470 con 0x7f565015c690 2023-06-20T13:33:25.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.352+0000 7f5646ffd700 1 --2- 172.21.15.32:0/2481007039 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f563406ace0 0x7f563406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:25.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.352+0000 7f5646ffd700 1 -- 172.21.15.32:0/2481007039 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5648089590 con 0x7f565015c690 2023-06-20T13:33:25.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.352+0000 7f565639b700 1 --2- 172.21.15.32:0/2481007039 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f563406ace0 0x7f563406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:25.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.353+0000 7f565639b700 1 --2- 172.21.15.32:0/2481007039 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f563406ace0 0x7f563406d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f564c0090b0 tx=0x7f564c013040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:25.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.356+0000 7f5646ffd700 1 -- 172.21.15.32:0/2481007039 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5648054270 con 0x7f565015c690 2023-06-20T13:33:25.561 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.559+0000 7f56585ff700 1 -- 172.21.15.32:0/2481007039 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5650066e80 con 0x7f565015c690 2023-06-20T13:33:25.562 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.560+0000 7f5646ffd700 1 -- 172.21.15.32:0/2481007039 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5648057890 con 0x7f565015c690 2023-06-20T13:33:25.562 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-06-20T13:33:25.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.562+0000 7f56585ff700 1 -- 172.21.15.32:0/2481007039 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f563406ace0 msgr2=0x7f563406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:25.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.562+0000 7f56585ff700 1 --2- 172.21.15.32:0/2481007039 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f563406ace0 0x7f563406d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f564c0090b0 tx=0x7f564c013040 comp rx=0 tx=0).stop 2023-06-20T13:33:25.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.562+0000 7f56585ff700 1 -- 172.21.15.32:0/2481007039 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f565015c690 msgr2=0x7f56500c7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:25.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.562+0000 7f56585ff700 1 --2- 172.21.15.32:0/2481007039 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f565015c690 0x7f56500c7020 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5648001700 tx=0x7f564800a340 comp rx=0 tx=0).stop 2023-06-20T13:33:25.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.562+0000 7f56585ff700 1 -- 172.21.15.32:0/2481007039 shutdown_connections 2023-06-20T13:33:25.565 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.562+0000 7f56585ff700 1 --2- 172.21.15.32:0/2481007039 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f563406ace0 0x7f563406d190 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:25.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.562+0000 7f56585ff700 1 --2- 172.21.15.32:0/2481007039 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f565015c690 0x7f56500c7020 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:25.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.562+0000 7f56585ff700 1 --2- 172.21.15.32:0/2481007039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f56500ca1f0 0x7f565015a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:25.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.562+0000 7f56585ff700 1 --2- 172.21.15.32:0/2481007039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56500cd0a0 0x7f5650149960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:25.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.562+0000 7f56585ff700 1 -- 172.21.15.32:0/2481007039 >> 172.21.15.32:0/2481007039 conn(0x7f56500b0fd0 msgr2=0x7f5650069f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:25.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.563+0000 7f56585ff700 1 -- 172.21.15.32:0/2481007039 shutdown_connections 2023-06-20T13:33:25.566 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.563+0000 7f56585ff700 1 -- 172.21.15.32:0/2481007039 wait complete. 2023-06-20T13:33:25.582 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-20T13:33:25.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.784+0000 7f5cb59ff700 1 Processor -- start 2023-06-20T13:33:25.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.784+0000 7f5cb59ff700 1 -- start start 2023-06-20T13:33:25.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.785+0000 7f5cb59ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5cb00cfc60 0x7f5cb0167010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:25.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.785+0000 7f5cb59ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb00d0b20 con 0x7f5cb00b8430 2023-06-20T13:33:25.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.785+0000 7f5cb59ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb00b4ee0 con 0x7f5cb00d3730 2023-06-20T13:33:25.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.785+0000 7f5cb59ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb00cda30 con 0x7f5cb00cfc60 2023-06-20T13:33:25.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.785+0000 7f5caf7fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f5cb00cfc60 0x7f5cb0167010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:25.790 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.785+0000 7f5caeffd700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f5cb00b8430 0x7f5cb00cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36880/0 (socket says 172.21.15.32:36880) 2023-06-20T13:33:25.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.785+0000 7f5caeffd700 1 -- 172.21.15.32:0/3721339865 learned_addr learned my addr 172.21.15.32:0/3721339865 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:25.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.786+0000 7f5caf7fe700 1 -- 172.21.15.32:0/3721339865 >> v1:172.21.15.115:6789/0 conn(0x7f5cb00d3730 legacy=0x7f5cb00cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:25.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.786+0000 7f5caf7fe700 1 -- 172.21.15.32:0/3721339865 >> v1:172.21.15.32:6789/0 conn(0x7f5cb00b8430 legacy=0x7f5cb00cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:25.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.786+0000 7f5caf7fe700 1 -- 172.21.15.32:0/3721339865 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb00b51c0 con 0x7f5cb00cfc60 2023-06-20T13:33:25.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.786+0000 7f5cadffb700 1 -- 172.21.15.32:0/3721339865 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 799856366 0 0) 0x7f5cb00d0b20 con 0x7f5cb00b8430 2023-06-20T13:33:25.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.786+0000 7f5caf7fe700 1 --2- 172.21.15.32:0/3721339865 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cb00cfc60 0x7f5cb0167010 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8009d90 tx=0x7f5ca800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99776dc8f9b60010 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:25.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.786+0000 7f5cadffb700 1 -- 172.21.15.32:0/3721339865 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca800e070 con 0x7f5cb00cfc60 2023-06-20T13:33:25.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.786+0000 7f5cadffb700 1 -- 172.21.15.32:0/3721339865 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca800bb90 con 0x7f5cb00cfc60 2023-06-20T13:33:25.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.786+0000 7f5cadffb700 1 -- 172.21.15.32:0/3721339865 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca8003a20 con 0x7f5cb00cfc60 2023-06-20T13:33:25.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.787+0000 7f5cb59ff700 1 -- 172.21.15.32:0/3721339865 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cb00cfc60 msgr2=0x7f5cb0167010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:25.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.787+0000 7f5cb59ff700 1 --2- 172.21.15.32:0/3721339865 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cb00cfc60 0x7f5cb0167010 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8009d90 tx=0x7f5ca800b330 comp rx=0 tx=0).stop 2023-06-20T13:33:25.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.787+0000 7f5cb59ff700 1 -- 172.21.15.32:0/3721339865 shutdown_connections 2023-06-20T13:33:25.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.787+0000 7f5cb59ff700 1 --2- 172.21.15.32:0/3721339865 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cb00cfc60 0x7f5cb0167010 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:25.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.787+0000 7f5cb59ff700 1 -- 172.21.15.32:0/3721339865 >> 172.21.15.32:0/3721339865 conn(0x7f5cb006b3f0 msgr2=0x7f5cb006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:25.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.787+0000 7f5cb59ff700 1 -- 172.21.15.32:0/3721339865 shutdown_connections 2023-06-20T13:33:25.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.787+0000 7f5cb59ff700 1 -- 172.21.15.32:0/3721339865 wait complete. 2023-06-20T13:33:25.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.789+0000 7f5cb59ff700 1 Processor -- start 2023-06-20T13:33:25.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.789+0000 7f5cb59ff700 1 -- start start 2023-06-20T13:33:25.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.790+0000 7f5cb59ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cb00b8430 0x7f5cb015e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:25.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.790+0000 7f5cb59ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cb00cfc60 0x7f5cb01f5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:25.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.790+0000 7f5cb59ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5cb00d3730 0x7f5cb00c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:25.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.790+0000 7f5cb59ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb00c8aa0 con 0x7f5cb00cfc60 2023-06-20T13:33:25.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.790+0000 7f5cb59ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb015d9b0 con 0x7f5cb00b8430 2023-06-20T13:33:25.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.790+0000 7f5cb59ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb015dc90 con 0x7f5cb00d3730 2023-06-20T13:33:25.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.790+0000 7f5cae7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cb00cfc60 0x7f5cb01f5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:25.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.790+0000 7f5cae7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cb00cfc60 0x7f5cb01f5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39198/0 (socket says 172.21.15.32:39198) 2023-06-20T13:33:25.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.790+0000 7f5cae7fc700 1 -- 172.21.15.32:0/765506252 learned_addr learned my addr 172.21.15.32:0/765506252 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:25.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.790+0000 7f5caeffd700 1 --2- 172.21.15.32:0/765506252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cb00b8430 0x7f5cb015e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:25.801 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.790+0000 7f5caf7fe700 1 --2- 172.21.15.32:0/765506252 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5cb00d3730 0x7f5cb00c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:25.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.791+0000 7f5cae7fc700 1 -- 172.21.15.32:0/765506252 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5cb00d3730 msgr2=0x7f5cb00c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:25.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.791+0000 7f5cae7fc700 1 --2- 172.21.15.32:0/765506252 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5cb00d3730 0x7f5cb00c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:25.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.791+0000 7f5cae7fc700 1 -- 172.21.15.32:0/765506252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cb00b8430 msgr2=0x7f5cb015e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:25.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.791+0000 7f5cae7fc700 1 --2- 172.21.15.32:0/765506252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cb00b8430 0x7f5cb015e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:25.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.791+0000 7f5cae7fc700 1 -- 172.21.15.32:0/765506252 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca8009a70 con 0x7f5cb00cfc60 2023-06-20T13:33:25.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.791+0000 7f5caeffd700 1 --2- 172.21.15.32:0/765506252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cb00b8430 0x7f5cb015e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:25.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.791+0000 7f5cae7fc700 1 --2- 172.21.15.32:0/765506252 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cb00cfc60 0x7f5cb01f5710 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5ca400b4a0 tx=0x7f5ca400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:25.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.791+0000 7f5c97fff700 1 -- 172.21.15.32:0/765506252 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca4011830 con 0x7f5cb00cfc60 2023-06-20T13:33:25.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.791+0000 7f5c97fff700 1 -- 172.21.15.32:0/765506252 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca4011990 con 0x7f5cb00cfc60 2023-06-20T13:33:25.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.791+0000 7f5cb59ff700 1 -- 172.21.15.32:0/765506252 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb015df70 con 0x7f5cb00cfc60 2023-06-20T13:33:25.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.791+0000 7f5c97fff700 1 -- 172.21.15.32:0/765506252 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca4011d40 con 0x7f5cb00cfc60 2023-06-20T13:33:25.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.791+0000 7f5cb59ff700 1 -- 172.21.15.32:0/765506252 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb01f5c50 con 0x7f5cb00cfc60 2023-06-20T13:33:25.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.792+0000 7f5cb59ff700 1 -- 172.21.15.32:0/765506252 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb015e490 con 0x7f5cb00cfc60 2023-06-20T13:33:25.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.793+0000 7f5c97fff700 1 -- 172.21.15.32:0/765506252 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5ca401a400 con 0x7f5cb00cfc60 2023-06-20T13:33:25.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.794+0000 7f5c97fff700 1 --2- 172.21.15.32:0/765506252 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5c9c06ace0 0x7f5c9c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:25.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.794+0000 7f5c97fff700 1 -- 172.21.15.32:0/765506252 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5ca4089580 con 0x7f5cb00cfc60 2023-06-20T13:33:25.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.794+0000 7f5caeffd700 1 --2- 172.21.15.32:0/765506252 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5c9c06ace0 0x7f5c9c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:25.804 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.795+0000 7f5caeffd700 1 --2- 172.21.15.32:0/765506252 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5c9c06ace0 0x7f5c9c06d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0000f60 tx=0x7f5ca0007ce0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:25.805 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:25.799+0000 7f5c97fff700 1 -- 172.21.15.32:0/765506252 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5cb015e490 con 0x7f5cb00cfc60 2023-06-20T13:33:26.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.003+0000 7f5cb59ff700 1 -- 172.21.15.32:0/765506252 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5cb015e490 con 0x7f5cb00cfc60 2023-06-20T13:33:26.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.004+0000 7f5c97fff700 1 -- 172.21.15.32:0/765506252 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5cb015e490 con 0x7f5cb00cfc60 2023-06-20T13:33:26.006 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-06-20T13:33:26.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.006+0000 7f5cb59ff700 1 -- 172.21.15.32:0/765506252 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5c9c06ace0 msgr2=0x7f5c9c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:26.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.006+0000 7f5cb59ff700 1 --2- 172.21.15.32:0/765506252 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5c9c06ace0 0x7f5c9c06d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0000f60 tx=0x7f5ca0007ce0 comp rx=0 tx=0).stop 2023-06-20T13:33:26.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.006+0000 7f5cb59ff700 1 -- 172.21.15.32:0/765506252 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cb00cfc60 msgr2=0x7f5cb01f5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:26.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.006+0000 7f5cb59ff700 1 --2- 172.21.15.32:0/765506252 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cb00cfc60 0x7f5cb01f5710 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5ca400b4a0 tx=0x7f5ca400b860 comp rx=0 tx=0).stop 2023-06-20T13:33:26.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.006+0000 7f5cb59ff700 1 -- 172.21.15.32:0/765506252 shutdown_connections 2023-06-20T13:33:26.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.006+0000 7f5cb59ff700 1 --2- 172.21.15.32:0/765506252 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f5c9c06ace0 0x7f5c9c06d190 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:26.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.006+0000 7f5cb59ff700 1 --2- 172.21.15.32:0/765506252 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5cb00d3730 0x7f5cb00c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:26.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.006+0000 7f5cb59ff700 1 --2- 172.21.15.32:0/765506252 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cb00b8430 0x7f5cb015e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:26.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.006+0000 7f5cb59ff700 1 --2- 172.21.15.32:0/765506252 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f5cb00cfc60 0x7f5cb01f5710 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:26.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.006+0000 7f5cb59ff700 1 -- 172.21.15.32:0/765506252 >> 172.21.15.32:0/765506252 conn(0x7f5cb006b3f0 msgr2=0x7f5cb006b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:26.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.006+0000 7f5cb59ff700 1 -- 172.21.15.32:0/765506252 shutdown_connections 2023-06-20T13:33:26.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.006+0000 7f5cb59ff700 1 -- 172.21.15.32:0/765506252 wait complete. 2023-06-20T13:33:26.026 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:33:26.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.226+0000 7f4c71dff700 1 Processor -- start 2023-06-20T13:33:26.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.226+0000 7f4c71dff700 1 -- start start 2023-06-20T13:33:26.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.227+0000 7f4c71dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c6c15c460 0x7f4c6c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:26.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.227+0000 7f4c71dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4c6c0d2640 0x7f4c6c0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:26.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.227+0000 7f4c71dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c6c0d1790 con 0x7f4c6c0cf720 2023-06-20T13:33:26.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.227+0000 7f4c71dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c6c0cedd0 con 0x7f4c6c0d2640 2023-06-20T13:33:26.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.227+0000 7f4c71dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c0cd950 con 0x7f4c6c15c460 2023-06-20T13:33:26.231 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.228+0000 7f4c6b7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c6c15c460 0x7f4c6c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:26.231 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.228+0000 7f4c6affd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4c6c0d2640 0x7f4c6c0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:26.231 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.228+0000 7f4c6b7fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c6c15c460 0x7f4c6c0b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.32:53542/0 (socket says 172.21.15.32:53542) 2023-06-20T13:33:26.231 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.228+0000 7f4c6affd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4c6c0d2640 0x7f4c6c0cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:47140/0 (socket says 172.21.15.32:47140) 2023-06-20T13:33:26.231 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.228+0000 7f4c6b7fe700 1 -- 172.21.15.32:0/548190342 learned_addr learned my addr 172.21.15.32:0/548190342 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:26.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.228+0000 7f4c6b7fe700 1 -- 172.21.15.32:0/548190342 >> v2:172.21.15.115:3300/0 conn(0x7f4c6c0d2640 msgr2=0x7f4c6c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:26.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.228+0000 7f4c6b7fe700 1 --2- 172.21.15.32:0/548190342 >> v2:172.21.15.115:3300/0 conn(0x7f4c6c0d2640 0x7f4c6c0cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:26.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.228+0000 7f4c6b7fe700 1 -- 172.21.15.32:0/548190342 >> v1:172.21.15.115:6789/0 conn(0x7f4c6c0cf720 legacy=0x7f4c6c0d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:26.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.228+0000 7f4c6b7fe700 1 -- 172.21.15.32:0/548190342 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c6c0d14b0 con 0x7f4c6c15c460 2023-06-20T13:33:26.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.228+0000 7f4c6affd700 1 --2- 172.21.15.32:0/548190342 >> v2:172.21.15.115:3300/0 conn(0x7f4c6c0d2640 0x7f4c6c0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:33:26.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.228+0000 7f4c6b7fe700 1 --2- 172.21.15.32:0/548190342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c6c15c460 0x7f4c6c0b59d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c0098f0 tx=0x7f4c5c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a96740eb4e13bfe2 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:26.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.229+0000 7f4c6a7fc700 1 -- 172.21.15.32:0/548190342 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c011830 con 0x7f4c6c15c460 2023-06-20T13:33:26.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.229+0000 7f4c6a7fc700 1 -- 172.21.15.32:0/548190342 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5c011990 con 0x7f4c6c15c460 2023-06-20T13:33:26.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.229+0000 7f4c6a7fc700 1 -- 172.21.15.32:0/548190342 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c011d20 con 0x7f4c6c15c460 2023-06-20T13:33:26.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.229+0000 7f4c71dff700 1 -- 172.21.15.32:0/548190342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c6c15c460 msgr2=0x7f4c6c0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:26.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.229+0000 7f4c71dff700 1 --2- 172.21.15.32:0/548190342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c6c15c460 0x7f4c6c0b59d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c0098f0 tx=0x7f4c5c009c00 comp rx=0 tx=0).stop 2023-06-20T13:33:26.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.229+0000 7f4c71dff700 1 -- 172.21.15.32:0/548190342 shutdown_connections 2023-06-20T13:33:26.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.229+0000 7f4c71dff700 1 --2- 172.21.15.32:0/548190342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c6c15c460 0x7f4c6c0b59d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:26.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.229+0000 7f4c71dff700 1 --2- 172.21.15.32:0/548190342 >> v2:172.21.15.115:3300/0 conn(0x7f4c6c0d2640 0x7f4c6c0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:26.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.229+0000 7f4c71dff700 1 -- 172.21.15.32:0/548190342 >> 172.21.15.32:0/548190342 conn(0x7f4c6c071660 msgr2=0x7f4c6c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:26.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.229+0000 7f4c71dff700 1 -- 172.21.15.32:0/548190342 shutdown_connections 2023-06-20T13:33:26.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.230+0000 7f4c71dff700 1 -- 172.21.15.32:0/548190342 wait complete. 2023-06-20T13:33:26.235 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.232+0000 7f4c71dff700 1 Processor -- start 2023-06-20T13:33:26.235 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.232+0000 7f4c71dff700 1 -- start start 2023-06-20T13:33:26.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.233+0000 7f4c71dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c6c0cf720 0x7f4c6c1f6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:26.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.233+0000 7f4c71dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c6c0d2640 0x7f4c6c0c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:26.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.233+0000 7f4c71dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c6c15c460 0x7f4c6c0c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:26.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.233+0000 7f4c71dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c0c8e90 con 0x7f4c6c0d2640 2023-06-20T13:33:26.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.233+0000 7f4c71dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c0c9170 con 0x7f4c6c15c460 2023-06-20T13:33:26.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.233+0000 7f4c71dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c0c9450 con 0x7f4c6c0cf720 2023-06-20T13:33:26.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.234+0000 7f4c6affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c6c0d2640 0x7f4c6c0c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:26.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.234+0000 7f4c6affd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c6c0d2640 0x7f4c6c0c85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39214/0 (socket says 172.21.15.32:39214) 2023-06-20T13:33:26.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.234+0000 7f4c6affd700 1 -- 172.21.15.32:0/3770336759 learned_addr learned my addr 172.21.15.32:0/3770336759 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:26.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.234+0000 7f4c6bfff700 1 --2- 172.21.15.32:0/3770336759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c6c15c460 0x7f4c6c0c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:26.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.234+0000 7f4c6b7fe700 1 --2- 172.21.15.32:0/3770336759 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c6c0cf720 0x7f4c6c1f6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:26.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.234+0000 7f4c6affd700 1 -- 172.21.15.32:0/3770336759 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c6c0cf720 msgr2=0x7f4c6c1f6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:26.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.234+0000 7f4c6affd700 1 --2- 172.21.15.32:0/3770336759 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c6c0cf720 0x7f4c6c1f6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:26.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.234+0000 7f4c6affd700 1 -- 172.21.15.32:0/3770336759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c6c15c460 msgr2=0x7f4c6c0c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:26.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.234+0000 7f4c6affd700 1 --2- 172.21.15.32:0/3770336759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c6c15c460 0x7f4c6c0c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:26.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.234+0000 7f4c6affd700 1 -- 172.21.15.32:0/3770336759 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c600094a0 con 0x7f4c6c0d2640 2023-06-20T13:33:26.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.234+0000 7f4c6affd700 1 --2- 172.21.15.32:0/3770336759 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c6c0d2640 0x7f4c6c0c85f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000ebe0 tx=0x7f4c6000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:26.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.235+0000 7f4c53fff700 1 -- 172.21.15.32:0/3770336759 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60009760 con 0x7f4c6c0d2640 2023-06-20T13:33:26.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.235+0000 7f4c53fff700 1 -- 172.21.15.32:0/3770336759 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6000c850 con 0x7f4c6c0d2640 2023-06-20T13:33:26.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.235+0000 7f4c71dff700 1 -- 172.21.15.32:0/3770336759 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c5c009550 con 0x7f4c6c0d2640 2023-06-20T13:33:26.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.235+0000 7f4c53fff700 1 -- 172.21.15.32:0/3770336759 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6000cbe0 con 0x7f4c6c0d2640 2023-06-20T13:33:26.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.235+0000 7f4c71dff700 1 -- 172.21.15.32:0/3770336759 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c6c0c8b30 con 0x7f4c6c0d2640 2023-06-20T13:33:26.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.236+0000 7f4c71dff700 1 -- 172.21.15.32:0/3770336759 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c6c0cb190 con 0x7f4c6c0d2640 2023-06-20T13:33:26.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.237+0000 7f4c53fff700 1 -- 172.21.15.32:0/3770336759 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4c6000cd40 con 0x7f4c6c0d2640 2023-06-20T13:33:26.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.238+0000 7f4c53fff700 1 --2- 172.21.15.32:0/3770336759 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4c5806ace0 0x7f4c5806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:26.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.238+0000 7f4c53fff700 1 -- 172.21.15.32:0/3770336759 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4c60089800 con 0x7f4c6c0d2640 2023-06-20T13:33:26.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.238+0000 7f4c6b7fe700 1 --2- 172.21.15.32:0/3770336759 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4c5806ace0 0x7f4c5806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:26.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.238+0000 7f4c6b7fe700 1 --2- 172.21.15.32:0/3770336759 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4c5806ace0 0x7f4c5806d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c000c00 tx=0x7f4c5c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:26.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.242+0000 7f4c53fff700 1 -- 172.21.15.32:0/3770336759 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4c60054570 con 0x7f4c6c0d2640 2023-06-20T13:33:26.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.451+0000 7f4c71dff700 1 -- 172.21.15.32:0/3770336759 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c6c04ea60 con 0x7f4c6c0d2640 2023-06-20T13:33:26.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.452+0000 7f4c53fff700 1 -- 172.21.15.32:0/3770336759 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20191 (secure 0 0 0) 0x7f4c60057b90 con 0x7f4c6c0d2640 2023-06-20T13:33:26.455 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:33:26.455 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":29,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:33:00.976862+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-20T13:32:18.120021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-20T13:32:19.503624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-20T13:32:23.074912+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:33:26.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.455+0000 7f4c71dff700 1 -- 172.21.15.32:0/3770336759 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4c5806ace0 msgr2=0x7f4c5806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:26.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.455+0000 7f4c71dff700 1 --2- 172.21.15.32:0/3770336759 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4c5806ace0 0x7f4c5806d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c000c00 tx=0x7f4c5c008030 comp rx=0 tx=0).stop 2023-06-20T13:33:26.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.455+0000 7f4c71dff700 1 -- 172.21.15.32:0/3770336759 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c6c0d2640 msgr2=0x7f4c6c0c85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:26.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.455+0000 7f4c71dff700 1 --2- 172.21.15.32:0/3770336759 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c6c0d2640 0x7f4c6c0c85f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000ebe0 tx=0x7f4c6000eef0 comp rx=0 tx=0).stop 2023-06-20T13:33:26.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.455+0000 7f4c71dff700 1 -- 172.21.15.32:0/3770336759 shutdown_connections 2023-06-20T13:33:26.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.455+0000 7f4c71dff700 1 --2- 172.21.15.32:0/3770336759 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4c5806ace0 0x7f4c5806d190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:26.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.455+0000 7f4c71dff700 1 --2- 172.21.15.32:0/3770336759 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4c6c15c460 0x7f4c6c0c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:26.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.455+0000 7f4c71dff700 1 --2- 172.21.15.32:0/3770336759 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4c6c0cf720 0x7f4c6c1f6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:26.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.455+0000 7f4c71dff700 1 --2- 172.21.15.32:0/3770336759 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4c6c0d2640 0x7f4c6c0c85f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:26.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.455+0000 7f4c71dff700 1 -- 172.21.15.32:0/3770336759 >> 172.21.15.32:0/3770336759 conn(0x7f4c6c071660 msgr2=0x7f4c6c153f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:26.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.455+0000 7f4c71dff700 1 -- 172.21.15.32:0/3770336759 shutdown_connections 2023-06-20T13:33:26.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.455+0000 7f4c71dff700 1 -- 172.21.15.32:0/3770336759 wait complete. 2023-06-20T13:33:26.475 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-20T13:32:05.308022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-20T13:32:12.857161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-20T13:32:18.120021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-20T13:32:19.503624+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-20T13:32:23.074912+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-20T13:33:26.476 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-20T13:33:26.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.677+0000 7f67547ff700 1 Processor -- start 2023-06-20T13:33:26.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.677+0000 7f67547ff700 1 -- start start 2023-06-20T13:33:26.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.678+0000 7f67547ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f674c0b8430 0x7f674c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:26.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.678+0000 7f67547ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f674c0cfc60 0x7f674c0d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:26.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.678+0000 7f67547ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f674c0d0b20 con 0x7f674c0d3730 2023-06-20T13:33:26.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.678+0000 7f67547ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f674c0b8800 con 0x7f674c0b8430 2023-06-20T13:33:26.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.678+0000 7f67547ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f674c0b4ee0 con 0x7f674c0cfc60 2023-06-20T13:33:26.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.679+0000 7f675259b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f674c0b8430 0x7f674c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:26.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.679+0000 7f675259b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f674c0b8430 0x7f674c0cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39224/0 (socket says 172.21.15.32:39224) 2023-06-20T13:33:26.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.679+0000 7f675259b700 1 -- 172.21.15.32:0/1997099615 learned_addr learned my addr 172.21.15.32:0/1997099615 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:26.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.679+0000 7f6752d9c700 1 --2- 172.21.15.32:0/1997099615 >> v2:172.21.15.115:3300/0 conn(0x7f674c0cfc60 0x7f674c0d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:26.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.679+0000 7f675259b700 1 -- 172.21.15.32:0/1997099615 >> v2:172.21.15.115:3300/0 conn(0x7f674c0cfc60 msgr2=0x7f674c0d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:26.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.679+0000 7f675259b700 1 --2- 172.21.15.32:0/1997099615 >> v2:172.21.15.115:3300/0 conn(0x7f674c0cfc60 0x7f674c0d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:26.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.679+0000 7f675259b700 1 -- 172.21.15.32:0/1997099615 >> v1:172.21.15.115:6789/0 conn(0x7f674c0d3730 legacy=0x7f674c0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:26.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.679+0000 7f675259b700 1 -- 172.21.15.32:0/1997099615 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674c0b51c0 con 0x7f674c0b8430 2023-06-20T13:33:26.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.680+0000 7f675259b700 1 --2- 172.21.15.32:0/1997099615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f674c0b8430 0x7f674c0cd320 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f674c0b2100 tx=0x7f6748009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78c410313d2c174 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:26.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.680+0000 7f6751599700 1 -- 172.21.15.32:0/1997099615 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674800b870 con 0x7f674c0b8430 2023-06-20T13:33:26.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.680+0000 7f6751599700 1 -- 172.21.15.32:0/1997099615 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674800b9d0 con 0x7f674c0b8430 2023-06-20T13:33:26.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.680+0000 7f6751599700 1 -- 172.21.15.32:0/1997099615 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674800bd60 con 0x7f674c0b8430 2023-06-20T13:33:26.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.680+0000 7f67547ff700 1 -- 172.21.15.32:0/1997099615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f674c0b8430 msgr2=0x7f674c0cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:26.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.680+0000 7f67547ff700 1 --2- 172.21.15.32:0/1997099615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f674c0b8430 0x7f674c0cd320 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f674c0b2100 tx=0x7f6748009bd0 comp rx=0 tx=0).stop 2023-06-20T13:33:26.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.680+0000 7f67547ff700 1 -- 172.21.15.32:0/1997099615 shutdown_connections 2023-06-20T13:33:26.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.680+0000 7f67547ff700 1 --2- 172.21.15.32:0/1997099615 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f674c0b8430 0x7f674c0cd320 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:26.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.680+0000 7f67547ff700 1 --2- 172.21.15.32:0/1997099615 >> v2:172.21.15.115:3300/0 conn(0x7f674c0cfc60 0x7f674c0d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:26.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.680+0000 7f67547ff700 1 -- 172.21.15.32:0/1997099615 >> 172.21.15.32:0/1997099615 conn(0x7f674c06b3f0 msgr2=0x7f674c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:26.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.680+0000 7f67547ff700 1 -- 172.21.15.32:0/1997099615 shutdown_connections 2023-06-20T13:33:26.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.680+0000 7f67547ff700 1 -- 172.21.15.32:0/1997099615 wait complete. 2023-06-20T13:33:26.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.682+0000 7f67547ff700 1 Processor -- start 2023-06-20T13:33:26.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.682+0000 7f67547ff700 1 -- start start 2023-06-20T13:33:26.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.683+0000 7f67547ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f674c0b8430 0x7f674c155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:26.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.683+0000 7f67547ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f674c0cfc60 0x7f674c15d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:26.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.683+0000 7f67547ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f674c0d3730 0x7f674c0b2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:26.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.683+0000 7f67547ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674c15e360 con 0x7f674c0cfc60 2023-06-20T13:33:26.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.683+0000 7f67547ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674c15e640 con 0x7f674c0b8430 2023-06-20T13:33:26.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.683+0000 7f67547ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f674c15e920 con 0x7f674c0d3730 2023-06-20T13:33:26.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.683+0000 7f6751d9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f674c0cfc60 0x7f674c15d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:26.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.683+0000 7f6751d9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f674c0cfc60 0x7f674c15d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39228/0 (socket says 172.21.15.32:39228) 2023-06-20T13:33:26.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.683+0000 7f6751d9a700 1 -- 172.21.15.32:0/1055699948 learned_addr learned my addr 172.21.15.32:0/1055699948 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:26.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.684+0000 7f675259b700 1 --2- 172.21.15.32:0/1055699948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f674c0b8430 0x7f674c155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:26.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.684+0000 7f6752d9c700 1 --2- 172.21.15.32:0/1055699948 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f674c0d3730 0x7f674c0b2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:26.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.684+0000 7f6751d9a700 1 -- 172.21.15.32:0/1055699948 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f674c0d3730 msgr2=0x7f674c0b2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:26.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.684+0000 7f6751d9a700 1 --2- 172.21.15.32:0/1055699948 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f674c0d3730 0x7f674c0b2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:26.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.684+0000 7f6751d9a700 1 -- 172.21.15.32:0/1055699948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f674c0b8430 msgr2=0x7f674c155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:26.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.684+0000 7f6751d9a700 1 --2- 172.21.15.32:0/1055699948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f674c0b8430 0x7f674c155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:26.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.684+0000 7f6751d9a700 1 -- 172.21.15.32:0/1055699948 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6748009550 con 0x7f674c0cfc60 2023-06-20T13:33:26.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.684+0000 7f6751d9a700 1 --2- 172.21.15.32:0/1055699948 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f674c0cfc60 0x7f674c15d910 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f673c00c450 tx=0x7f673c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:26.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.684+0000 7f6742ffd700 1 -- 172.21.15.32:0/1055699948 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c0052d0 con 0x7f674c0cfc60 2023-06-20T13:33:26.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.684+0000 7f6742ffd700 1 -- 172.21.15.32:0/1055699948 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673c005430 con 0x7f674c0cfc60 2023-06-20T13:33:26.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.684+0000 7f6742ffd700 1 -- 172.21.15.32:0/1055699948 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c0038c0 con 0x7f674c0cfc60 2023-06-20T13:33:26.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.684+0000 7f67547ff700 1 -- 172.21.15.32:0/1055699948 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f674c15ec00 con 0x7f674c0cfc60 2023-06-20T13:33:26.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.685+0000 7f67547ff700 1 -- 172.21.15.32:0/1055699948 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f674c0c7a40 con 0x7f674c0cfc60 2023-06-20T13:33:26.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.686+0000 7f67547ff700 1 -- 172.21.15.32:0/1055699948 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f674c0c7c00 con 0x7f674c0cfc60 2023-06-20T13:33:26.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.687+0000 7f6742ffd700 1 -- 172.21.15.32:0/1055699948 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f673c003a20 con 0x7f674c0cfc60 2023-06-20T13:33:26.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.688+0000 7f6742ffd700 1 --2- 172.21.15.32:0/1055699948 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f673006ace0 0x7f673006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:26.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.688+0000 7f6742ffd700 1 -- 172.21.15.32:0/1055699948 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f673c088ad0 con 0x7f674c0cfc60 2023-06-20T13:33:26.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.688+0000 7f675259b700 1 --2- 172.21.15.32:0/1055699948 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f673006ace0 0x7f673006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:26.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.689+0000 7f675259b700 1 --2- 172.21.15.32:0/1055699948 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f673006ace0 0x7f673006d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6748000c00 tx=0x7f6748008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:26.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.693+0000 7f6742ffd700 1 -- 172.21.15.32:0/1055699948 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f674c0c7c00 con 0x7f674c0cfc60 2023-06-20T13:33:26.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.899+0000 7f67547ff700 1 -- 172.21.15.32:0/1055699948 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f674c0c7c00 con 0x7f674c0cfc60 2023-06-20T13:33:26.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.899+0000 7f6742ffd700 1 -- 172.21.15.32:0/1055699948 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f674c0c7c00 con 0x7f674c0cfc60 2023-06-20T13:33:26.902 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-06-20T13:33:26.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.902+0000 7f67547ff700 1 -- 172.21.15.32:0/1055699948 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f673006ace0 msgr2=0x7f673006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:26.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.902+0000 7f67547ff700 1 --2- 172.21.15.32:0/1055699948 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f673006ace0 0x7f673006d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6748000c00 tx=0x7f6748008030 comp rx=0 tx=0).stop 2023-06-20T13:33:26.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.902+0000 7f67547ff700 1 -- 172.21.15.32:0/1055699948 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f674c0cfc60 msgr2=0x7f674c15d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:26.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.902+0000 7f67547ff700 1 --2- 172.21.15.32:0/1055699948 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f674c0cfc60 0x7f674c15d910 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f673c00c450 tx=0x7f673c00c760 comp rx=0 tx=0).stop 2023-06-20T13:33:26.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.902+0000 7f67547ff700 1 -- 172.21.15.32:0/1055699948 shutdown_connections 2023-06-20T13:33:26.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.902+0000 7f67547ff700 1 --2- 172.21.15.32:0/1055699948 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f673006ace0 0x7f673006d190 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:26.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.902+0000 7f67547ff700 1 --2- 172.21.15.32:0/1055699948 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f674c0d3730 0x7f674c0b2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:26.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.902+0000 7f67547ff700 1 --2- 172.21.15.32:0/1055699948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f674c0b8430 0x7f674c155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:26.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.902+0000 7f67547ff700 1 --2- 172.21.15.32:0/1055699948 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f674c0cfc60 0x7f674c15d910 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:26.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.902+0000 7f67547ff700 1 -- 172.21.15.32:0/1055699948 >> 172.21.15.32:0/1055699948 conn(0x7f674c06b3f0 msgr2=0x7f674c0b6380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:26.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.902+0000 7f67547ff700 1 -- 172.21.15.32:0/1055699948 shutdown_connections 2023-06-20T13:33:26.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:26.902+0000 7f67547ff700 1 -- 172.21.15.32:0/1055699948 wait complete. 2023-06-20T13:33:26.922 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-20T13:33:27.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.126+0000 7fa635dff700 1 Processor -- start 2023-06-20T13:33:27.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.126+0000 7fa635dff700 1 -- start start 2023-06-20T13:33:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.127+0000 7fa635dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa6300d3730 0x7fa6300cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.127+0000 7fa635dff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa6300cfa90 0x7fa6300d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.127+0000 7fa635dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6300d0b20 con 0x7fa6300b8430 2023-06-20T13:33:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.127+0000 7fa635dff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6300cda30 con 0x7fa6300cfa90 2023-06-20T13:33:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.127+0000 7fa635dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6300b8800 con 0x7fa6300d3730 2023-06-20T13:33:27.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.128+0000 7fa62ffff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa6300cfa90 0x7fa6300d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:27.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.128+0000 7fa62ffff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa6300cfa90 0x7fa6300d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39232/0 (socket says 172.21.15.32:39232) 2023-06-20T13:33:27.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.128+0000 7fa62ffff700 1 -- 172.21.15.32:0/2037903160 learned_addr learned my addr 172.21.15.32:0/2037903160 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:27.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.128+0000 7fa62effd700 1 --2- 172.21.15.32:0/2037903160 >> v2:172.21.15.115:3300/0 conn(0x7fa6300d3730 0x7fa6300cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:27.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.128+0000 7fa62ffff700 1 -- 172.21.15.32:0/2037903160 >> v2:172.21.15.115:3300/0 conn(0x7fa6300d3730 msgr2=0x7fa6300cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:27.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.128+0000 7fa62ffff700 1 --2- 172.21.15.32:0/2037903160 >> v2:172.21.15.115:3300/0 conn(0x7fa6300d3730 0x7fa6300cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:27.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.128+0000 7fa62ffff700 1 -- 172.21.15.32:0/2037903160 >> v1:172.21.15.115:6789/0 conn(0x7fa6300b8430 legacy=0x7fa6300cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:27.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.128+0000 7fa62ffff700 1 -- 172.21.15.32:0/2037903160 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6300cfe90 con 0x7fa6300cfa90 2023-06-20T13:33:27.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.129+0000 7fa62ffff700 1 --2- 172.21.15.32:0/2037903160 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6300cfa90 0x7fa6300d0fb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa630160f50 tx=0x7fa62800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=534209015bb3baef server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:27.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.129+0000 7fa62e7fc700 1 -- 172.21.15.32:0/2037903160 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62800e070 con 0x7fa6300cfa90 2023-06-20T13:33:27.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.129+0000 7fa62e7fc700 1 -- 172.21.15.32:0/2037903160 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62800b9c0 con 0x7fa6300cfa90 2023-06-20T13:33:27.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.129+0000 7fa62e7fc700 1 -- 172.21.15.32:0/2037903160 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62800bd70 con 0x7fa6300cfa90 2023-06-20T13:33:27.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.129+0000 7fa635dff700 1 -- 172.21.15.32:0/2037903160 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6300cfa90 msgr2=0x7fa6300d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:27.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.129+0000 7fa635dff700 1 --2- 172.21.15.32:0/2037903160 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6300cfa90 0x7fa6300d0fb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa630160f50 tx=0x7fa62800b330 comp rx=0 tx=0).stop 2023-06-20T13:33:27.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.129+0000 7fa635dff700 1 -- 172.21.15.32:0/2037903160 shutdown_connections 2023-06-20T13:33:27.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.129+0000 7fa635dff700 1 --2- 172.21.15.32:0/2037903160 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6300cfa90 0x7fa6300d0fb0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:27.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.129+0000 7fa635dff700 1 --2- 172.21.15.32:0/2037903160 >> v2:172.21.15.115:3300/0 conn(0x7fa6300d3730 0x7fa6300cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:27.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.129+0000 7fa635dff700 1 -- 172.21.15.32:0/2037903160 >> 172.21.15.32:0/2037903160 conn(0x7fa63006b3f0 msgr2=0x7fa63006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:27.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.129+0000 7fa635dff700 1 -- 172.21.15.32:0/2037903160 shutdown_connections 2023-06-20T13:33:27.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.129+0000 7fa635dff700 1 -- 172.21.15.32:0/2037903160 wait complete. 2023-06-20T13:33:27.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.131+0000 7fa635dff700 1 Processor -- start 2023-06-20T13:33:27.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.131+0000 7fa635dff700 1 -- start start 2023-06-20T13:33:27.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.132+0000 7fa635dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6300b8430 0x7fa630155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:27.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.132+0000 7fa635dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6300cfa90 0x7fa6300c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:27.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.132+0000 7fa635dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6300d3730 0x7fa6300ca620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:27.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.132+0000 7fa635dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63015d520 con 0x7fa6300d3730 2023-06-20T13:33:27.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.132+0000 7fa635dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63015c930 con 0x7fa6300b8430 2023-06-20T13:33:27.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.132+0000 7fa635dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63015cb80 con 0x7fa6300cfa90 2023-06-20T13:33:27.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.133+0000 7fa62ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6300d3730 0x7fa6300ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:27.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.133+0000 7fa62ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6300d3730 0x7fa6300ca620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39234/0 (socket says 172.21.15.32:39234) 2023-06-20T13:33:27.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.133+0000 7fa62ffff700 1 -- 172.21.15.32:0/3878978815 learned_addr learned my addr 172.21.15.32:0/3878978815 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:27.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.133+0000 7fa62f7fe700 1 --2- 172.21.15.32:0/3878978815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6300b8430 0x7fa630155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:27.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.133+0000 7fa62effd700 1 --2- 172.21.15.32:0/3878978815 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6300cfa90 0x7fa6300c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:27.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.133+0000 7fa62ffff700 1 -- 172.21.15.32:0/3878978815 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6300cfa90 msgr2=0x7fa6300c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:27.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.133+0000 7fa62ffff700 1 --2- 172.21.15.32:0/3878978815 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6300cfa90 0x7fa6300c6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:27.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.133+0000 7fa62ffff700 1 -- 172.21.15.32:0/3878978815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6300b8430 msgr2=0x7fa630155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:27.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.133+0000 7fa62ffff700 1 --2- 172.21.15.32:0/3878978815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6300b8430 0x7fa630155170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:27.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.133+0000 7fa62ffff700 1 -- 172.21.15.32:0/3878978815 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa628009b30 con 0x7fa6300d3730 2023-06-20T13:33:27.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.133+0000 7fa62ffff700 1 --2- 172.21.15.32:0/3878978815 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6300d3730 0x7fa6300ca620 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa63006c780 tx=0x7fa628004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:27.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.134+0000 7fa617fff700 1 -- 172.21.15.32:0/3878978815 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6280048c0 con 0x7fa6300d3730 2023-06-20T13:33:27.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.134+0000 7fa617fff700 1 -- 172.21.15.32:0/3878978815 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6280099b0 con 0x7fa6300d3730 2023-06-20T13:33:27.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.134+0000 7fa635dff700 1 -- 172.21.15.32:0/3878978815 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa63015ce60 con 0x7fa6300d3730 2023-06-20T13:33:27.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.134+0000 7fa617fff700 1 -- 172.21.15.32:0/3878978815 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62801c680 con 0x7fa6300d3730 2023-06-20T13:33:27.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.134+0000 7fa635dff700 1 -- 172.21.15.32:0/3878978815 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6301556b0 con 0x7fa6300d3730 2023-06-20T13:33:27.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.135+0000 7fa635dff700 1 -- 172.21.15.32:0/3878978815 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa63015d660 con 0x7fa6300d3730 2023-06-20T13:33:27.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.136+0000 7fa617fff700 1 -- 172.21.15.32:0/3878978815 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa62801c7e0 con 0x7fa6300d3730 2023-06-20T13:33:27.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.137+0000 7fa617fff700 1 --2- 172.21.15.32:0/3878978815 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa61c06ace0 0x7fa61c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:27.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.137+0000 7fa617fff700 1 -- 172.21.15.32:0/3878978815 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa62808b2f0 con 0x7fa6300d3730 2023-06-20T13:33:27.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.137+0000 7fa62f7fe700 1 --2- 172.21.15.32:0/3878978815 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa61c06ace0 0x7fa61c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:27.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.138+0000 7fa62f7fe700 1 --2- 172.21.15.32:0/3878978815 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa61c06ace0 0x7fa61c06d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa6200018a0 tx=0x7fa620009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:27.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.142+0000 7fa617fff700 1 -- 172.21.15.32:0/3878978815 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa63015d660 con 0x7fa6300d3730 2023-06-20T13:33:27.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.348+0000 7fa635dff700 1 -- 172.21.15.32:0/3878978815 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa63015d660 con 0x7fa6300d3730 2023-06-20T13:33:27.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.349+0000 7fa617fff700 1 -- 172.21.15.32:0/3878978815 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa63015d660 con 0x7fa6300d3730 2023-06-20T13:33:27.351 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 8 2023-06-20T13:33:27.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.351+0000 7fa635dff700 1 -- 172.21.15.32:0/3878978815 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa61c06ace0 msgr2=0x7fa61c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:27.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.351+0000 7fa635dff700 1 --2- 172.21.15.32:0/3878978815 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa61c06ace0 0x7fa61c06d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa6200018a0 tx=0x7fa620009040 comp rx=0 tx=0).stop 2023-06-20T13:33:27.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.351+0000 7fa635dff700 1 -- 172.21.15.32:0/3878978815 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6300d3730 msgr2=0x7fa6300ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:27.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.351+0000 7fa635dff700 1 --2- 172.21.15.32:0/3878978815 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6300d3730 0x7fa6300ca620 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa63006c780 tx=0x7fa628004ad0 comp rx=0 tx=0).stop 2023-06-20T13:33:27.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.351+0000 7fa635dff700 1 -- 172.21.15.32:0/3878978815 shutdown_connections 2023-06-20T13:33:27.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.351+0000 7fa635dff700 1 --2- 172.21.15.32:0/3878978815 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa61c06ace0 0x7fa61c06d190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:27.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.351+0000 7fa635dff700 1 --2- 172.21.15.32:0/3878978815 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa6300d3730 0x7fa6300ca620 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:27.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.351+0000 7fa635dff700 1 --2- 172.21.15.32:0/3878978815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa6300b8430 0x7fa630155170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:27.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.351+0000 7fa635dff700 1 --2- 172.21.15.32:0/3878978815 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa6300cfa90 0x7fa6300c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:27.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.351+0000 7fa635dff700 1 -- 172.21.15.32:0/3878978815 >> 172.21.15.32:0/3878978815 conn(0x7fa63006b3f0 msgr2=0x7fa6300b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:27.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.351+0000 7fa635dff700 1 -- 172.21.15.32:0/3878978815 shutdown_connections 2023-06-20T13:33:27.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.351+0000 7fa635dff700 1 -- 172.21.15.32:0/3878978815 wait complete. 2023-06-20T13:33:27.371 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-20T13:33:27.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.573+0000 7f50429ff700 1 Processor -- start 2023-06-20T13:33:27.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.573+0000 7f50429ff700 1 -- start start 2023-06-20T13:33:27.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.574+0000 7f50429ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f503c06a640 0x7f503c0cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:27.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.574+0000 7f50429ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503c0cb000 con 0x7f503c06e130 2023-06-20T13:33:27.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.574+0000 7f50429ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503c15b6c0 con 0x7f503c0b3ec0 2023-06-20T13:33:27.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.574+0000 7f50429ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503c0ca8d0 con 0x7f503c06a640 2023-06-20T13:33:27.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.574+0000 7f503b7fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f503c06e130 0x7f503c1573f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36890/0 (socket says 172.21.15.32:36890) 2023-06-20T13:33:27.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.574+0000 7f503b7fe700 1 -- 172.21.15.32:0/3999755360 learned_addr learned my addr 172.21.15.32:0/3999755360 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:27.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.575+0000 7f5040f9c700 1 --2- 172.21.15.32:0/3999755360 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f503c06a640 0x7f503c0cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:27.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.575+0000 7f503affd700 1 -- 172.21.15.32:0/3999755360 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4075168922 0 0) 0x7f503c0cb000 con 0x7f503c06e130 2023-06-20T13:33:27.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.575+0000 7f503affd700 1 -- 172.21.15.32:0/3999755360 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50240035b0 con 0x7f503c06e130 2023-06-20T13:33:27.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.575+0000 7f5040f9c700 1 -- 172.21.15.32:0/3999755360 >> v1:172.21.15.115:6789/0 conn(0x7f503c0b3ec0 legacy=0x7f503c069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:27.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.575+0000 7f5040f9c700 1 -- 172.21.15.32:0/3999755360 >> v1:172.21.15.32:6789/0 conn(0x7f503c06e130 legacy=0x7f503c1573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:27.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.575+0000 7f5040f9c700 1 -- 172.21.15.32:0/3999755360 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f503c0c9460 con 0x7f503c06a640 2023-06-20T13:33:27.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.575+0000 7f5040f9c700 1 --2- 172.21.15.32:0/3999755360 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f503c06a640 0x7f503c0cf390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5034009dc0 tx=0x7f503400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18eaf8bef135ff6c server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:27.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.576+0000 7f503affd700 1 -- 172.21.15.32:0/3999755360 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503400e070 con 0x7f503c06a640 2023-06-20T13:33:27.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.576+0000 7f503affd700 1 -- 172.21.15.32:0/3999755360 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503400bb20 con 0x7f503c06a640 2023-06-20T13:33:27.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.576+0000 7f503affd700 1 -- 172.21.15.32:0/3999755360 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5034012430 con 0x7f503c06a640 2023-06-20T13:33:27.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.576+0000 7f50429ff700 1 -- 172.21.15.32:0/3999755360 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f503c06a640 msgr2=0x7f503c0cf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:27.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.576+0000 7f50429ff700 1 --2- 172.21.15.32:0/3999755360 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f503c06a640 0x7f503c0cf390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5034009dc0 tx=0x7f503400b330 comp rx=0 tx=0).stop 2023-06-20T13:33:27.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.576+0000 7f50429ff700 1 -- 172.21.15.32:0/3999755360 shutdown_connections 2023-06-20T13:33:27.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.576+0000 7f50429ff700 1 --2- 172.21.15.32:0/3999755360 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f503c06a640 0x7f503c0cf390 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:27.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.576+0000 7f50429ff700 1 -- 172.21.15.32:0/3999755360 >> 172.21.15.32:0/3999755360 conn(0x7f503c0b0fd0 msgr2=0x7f503c0ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:27.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.576+0000 7f50429ff700 1 -- 172.21.15.32:0/3999755360 shutdown_connections 2023-06-20T13:33:27.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.576+0000 7f50429ff700 1 -- 172.21.15.32:0/3999755360 wait complete. 2023-06-20T13:33:27.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.579+0000 7f50429ff700 1 Processor -- start 2023-06-20T13:33:27.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.579+0000 7f50429ff700 1 -- start start 2023-06-20T13:33:27.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.580+0000 7f50429ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f503c06a640 0x7f503c0c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:27.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.580+0000 7f50429ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f503c06e130 0x7f503c0c5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:27.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.580+0000 7f50429ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f503c0b3ec0 0x7f503c0c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:27.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.580+0000 7f50429ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503c0c66d0 con 0x7f503c06a640 2023-06-20T13:33:27.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.580+0000 7f50429ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503c0c2b10 con 0x7f503c06e130 2023-06-20T13:33:27.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.580+0000 7f50429ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503c150da0 con 0x7f503c0b3ec0 2023-06-20T13:33:27.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.581+0000 7f503bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f503c06a640 0x7f503c0c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:27.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.581+0000 7f503bfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f503c06a640 0x7f503c0c8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39246/0 (socket says 172.21.15.32:39246) 2023-06-20T13:33:27.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.581+0000 7f503bfff700 1 -- 172.21.15.32:0/439963279 learned_addr learned my addr 172.21.15.32:0/439963279 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:27.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.581+0000 7f5040f9c700 1 --2- 172.21.15.32:0/439963279 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f503c0b3ec0 0x7f503c0c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:27.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.581+0000 7f503b7fe700 1 --2- 172.21.15.32:0/439963279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f503c06e130 0x7f503c0c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:27.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.581+0000 7f503bfff700 1 -- 172.21.15.32:0/439963279 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f503c0b3ec0 msgr2=0x7f503c0c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:27.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.581+0000 7f503bfff700 1 --2- 172.21.15.32:0/439963279 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f503c0b3ec0 0x7f503c0c5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:27.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.581+0000 7f503bfff700 1 -- 172.21.15.32:0/439963279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f503c06e130 msgr2=0x7f503c0c5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:27.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.581+0000 7f503bfff700 1 --2- 172.21.15.32:0/439963279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f503c06e130 0x7f503c0c5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:27.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.581+0000 7f503bfff700 1 -- 172.21.15.32:0/439963279 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5034009a70 con 0x7f503c06a640 2023-06-20T13:33:27.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.581+0000 7f503bfff700 1 --2- 172.21.15.32:0/439963279 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f503c06a640 0x7f503c0c8080 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f502c00c4e0 tx=0x7f502c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:27.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.582+0000 7f5038ff9700 1 -- 172.21.15.32:0/439963279 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c0052d0 con 0x7f503c06a640 2023-06-20T13:33:27.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.582+0000 7f5038ff9700 1 -- 172.21.15.32:0/439963279 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502c005430 con 0x7f503c06a640 2023-06-20T13:33:27.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.582+0000 7f5038ff9700 1 -- 172.21.15.32:0/439963279 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c0038c0 con 0x7f503c06a640 2023-06-20T13:33:27.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.582+0000 7f50429ff700 1 -- 172.21.15.32:0/439963279 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f503c0c63f0 con 0x7f503c06a640 2023-06-20T13:33:27.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.582+0000 7f50429ff700 1 -- 172.21.15.32:0/439963279 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f503c0c3000 con 0x7f503c06a640 2023-06-20T13:33:27.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.583+0000 7f50429ff700 1 -- 172.21.15.32:0/439963279 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f503c066a70 con 0x7f503c06a640 2023-06-20T13:33:27.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.584+0000 7f5038ff9700 1 -- 172.21.15.32:0/439963279 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f502c003a20 con 0x7f503c06a640 2023-06-20T13:33:27.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.585+0000 7f5038ff9700 1 --2- 172.21.15.32:0/439963279 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f502806ace0 0x7f502806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:27.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.585+0000 7f5038ff9700 1 -- 172.21.15.32:0/439963279 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f502c088b60 con 0x7f503c06a640 2023-06-20T13:33:27.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.585+0000 7f503b7fe700 1 --2- 172.21.15.32:0/439963279 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f502806ace0 0x7f502806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:27.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.585+0000 7f503b7fe700 1 --2- 172.21.15.32:0/439963279 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f502806ace0 0x7f502806d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f503c1f3870 tx=0x7f5030007dc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:27.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.589+0000 7f5038ff9700 1 -- 172.21.15.32:0/439963279 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f502c0538d0 con 0x7f503c06a640 2023-06-20T13:33:27.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.793+0000 7f50429ff700 1 -- 172.21.15.32:0/439963279 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f503c0c9150 con 0x7f503c06a640 2023-06-20T13:33:27.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.794+0000 7f5038ff9700 1 -- 172.21.15.32:0/439963279 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f502c056ef0 con 0x7f503c06a640 2023-06-20T13:33:27.797 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-06-20T13:33:27.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.796+0000 7f50429ff700 1 -- 172.21.15.32:0/439963279 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f502806ace0 msgr2=0x7f502806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:27.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.796+0000 7f50429ff700 1 --2- 172.21.15.32:0/439963279 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f502806ace0 0x7f502806d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f503c1f3870 tx=0x7f5030007dc0 comp rx=0 tx=0).stop 2023-06-20T13:33:27.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.796+0000 7f50429ff700 1 -- 172.21.15.32:0/439963279 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f503c06a640 msgr2=0x7f503c0c8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:27.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.796+0000 7f50429ff700 1 --2- 172.21.15.32:0/439963279 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f503c06a640 0x7f503c0c8080 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f502c00c4e0 tx=0x7f502c00c7f0 comp rx=0 tx=0).stop 2023-06-20T13:33:27.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.796+0000 7f50429ff700 1 -- 172.21.15.32:0/439963279 shutdown_connections 2023-06-20T13:33:27.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.796+0000 7f50429ff700 1 --2- 172.21.15.32:0/439963279 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f502806ace0 0x7f502806d190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:27.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.796+0000 7f50429ff700 1 --2- 172.21.15.32:0/439963279 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f503c0b3ec0 0x7f503c0c5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:27.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.796+0000 7f50429ff700 1 --2- 172.21.15.32:0/439963279 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f503c06a640 0x7f503c0c8080 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:27.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.796+0000 7f50429ff700 1 --2- 172.21.15.32:0/439963279 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f503c06e130 0x7f503c0c5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:27.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.796+0000 7f50429ff700 1 -- 172.21.15.32:0/439963279 >> 172.21.15.32:0/439963279 conn(0x7f503c0b0fd0 msgr2=0x7f503c0af360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:27.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.796+0000 7f50429ff700 1 -- 172.21.15.32:0/439963279 shutdown_connections 2023-06-20T13:33:27.800 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:27.796+0000 7f50429ff700 1 -- 172.21.15.32:0/439963279 wait complete. 2023-06-20T13:33:27.817 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-20T13:33:28.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.018+0000 7fdc829ff700 1 Processor -- start 2023-06-20T13:33:28.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.018+0000 7fdc829ff700 1 -- start start 2023-06-20T13:33:28.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.019+0000 7fdc829ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdc7c0b8430 0x7fdc7c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:28.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.019+0000 7fdc829ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdc7c0d3730 0x7fdc7c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:28.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.020+0000 7fdc829ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc7c0d0b20 con 0x7fdc7c0cfa90 2023-06-20T13:33:28.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.020+0000 7fdc829ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc7c0b8800 con 0x7fdc7c0b8430 2023-06-20T13:33:28.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.020+0000 7fdc829ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc7c0cfe90 con 0x7fdc7c0d3730 2023-06-20T13:33:28.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.020+0000 7fdc7bfff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdc7c0b8430 0x7fdc7c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:28.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.020+0000 7fdc7bfff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdc7c0b8430 0x7fdc7c0cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39248/0 (socket says 172.21.15.32:39248) 2023-06-20T13:33:28.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.020+0000 7fdc7bfff700 1 -- 172.21.15.32:0/909786117 learned_addr learned my addr 172.21.15.32:0/909786117 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:28.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.020+0000 7fdc7bfff700 1 -- 172.21.15.32:0/909786117 >> v2:172.21.15.115:3300/0 conn(0x7fdc7c0d3730 msgr2=0x7fdc7c0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:28.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.020+0000 7fdc7bfff700 1 --2- 172.21.15.32:0/909786117 >> v2:172.21.15.115:3300/0 conn(0x7fdc7c0d3730 0x7fdc7c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:28.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.020+0000 7fdc7bfff700 1 -- 172.21.15.32:0/909786117 >> v1:172.21.15.115:6789/0 conn(0x7fdc7c0cfa90 legacy=0x7fdc7c15feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:28.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.020+0000 7fdc7bfff700 1 -- 172.21.15.32:0/909786117 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc7c0b4ee0 con 0x7fdc7c0b8430 2023-06-20T13:33:28.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.020+0000 7fdc7bfff700 1 --2- 172.21.15.32:0/909786117 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc7c0b8430 0x7fdc7c0cd320 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c160f50 tx=0x7fdc6c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad0cf65ba7d930e server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:28.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.021+0000 7fdc7b7fe700 1 -- 172.21.15.32:0/909786117 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c004230 con 0x7fdc7c0b8430 2023-06-20T13:33:28.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.021+0000 7fdc7b7fe700 1 -- 172.21.15.32:0/909786117 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6c004390 con 0x7fdc7c0b8430 2023-06-20T13:33:28.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.021+0000 7fdc7b7fe700 1 -- 172.21.15.32:0/909786117 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c0036a0 con 0x7fdc7c0b8430 2023-06-20T13:33:28.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.021+0000 7fdc829ff700 1 -- 172.21.15.32:0/909786117 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc7c0b8430 msgr2=0x7fdc7c0cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:28.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.021+0000 7fdc829ff700 1 --2- 172.21.15.32:0/909786117 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc7c0b8430 0x7fdc7c0cd320 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c160f50 tx=0x7fdc6c009bd0 comp rx=0 tx=0).stop 2023-06-20T13:33:28.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.021+0000 7fdc829ff700 1 -- 172.21.15.32:0/909786117 shutdown_connections 2023-06-20T13:33:28.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.021+0000 7fdc829ff700 1 --2- 172.21.15.32:0/909786117 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc7c0b8430 0x7fdc7c0cd320 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:28.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.021+0000 7fdc829ff700 1 --2- 172.21.15.32:0/909786117 >> v2:172.21.15.115:3300/0 conn(0x7fdc7c0d3730 0x7fdc7c0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:28.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.021+0000 7fdc829ff700 1 -- 172.21.15.32:0/909786117 >> 172.21.15.32:0/909786117 conn(0x7fdc7c06b3f0 msgr2=0x7fdc7c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:28.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.022+0000 7fdc829ff700 1 -- 172.21.15.32:0/909786117 shutdown_connections 2023-06-20T13:33:28.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.022+0000 7fdc829ff700 1 -- 172.21.15.32:0/909786117 wait complete. 2023-06-20T13:33:28.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.024+0000 7fdc829ff700 1 Processor -- start 2023-06-20T13:33:28.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.024+0000 7fdc829ff700 1 -- start start 2023-06-20T13:33:28.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.025+0000 7fdc829ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc7c0b8430 0x7fdc7c1e7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:28.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.025+0000 7fdc829ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc7c0cfa90 0x7fdc7c0c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:28.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.025+0000 7fdc829ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc7c0d3730 0x7fdc7c15a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:28.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.025+0000 7fdc829ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c0c8ff0 con 0x7fdc7c0cfa90 2023-06-20T13:33:28.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.025+0000 7fdc829ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c0c8370 con 0x7fdc7c0b8430 2023-06-20T13:33:28.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.025+0000 7fdc829ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c0c8650 con 0x7fdc7c0d3730 2023-06-20T13:33:28.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.026+0000 7fdc73fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc7c0cfa90 0x7fdc7c0c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:28.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.026+0000 7fdc73fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc7c0cfa90 0x7fdc7c0c7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39258/0 (socket says 172.21.15.32:39258) 2023-06-20T13:33:28.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.026+0000 7fdc73fff700 1 -- 172.21.15.32:0/2672500191 learned_addr learned my addr 172.21.15.32:0/2672500191 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:28.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.026+0000 7fdc7bfff700 1 --2- 172.21.15.32:0/2672500191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc7c0b8430 0x7fdc7c1e7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:28.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.026+0000 7fdc80f9c700 1 --2- 172.21.15.32:0/2672500191 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc7c0d3730 0x7fdc7c15a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:28.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.026+0000 7fdc73fff700 1 -- 172.21.15.32:0/2672500191 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc7c0d3730 msgr2=0x7fdc7c15a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:28.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.026+0000 7fdc73fff700 1 --2- 172.21.15.32:0/2672500191 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc7c0d3730 0x7fdc7c15a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:28.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.026+0000 7fdc73fff700 1 -- 172.21.15.32:0/2672500191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc7c0b8430 msgr2=0x7fdc7c1e7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:28.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.026+0000 7fdc73fff700 1 --2- 172.21.15.32:0/2672500191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc7c0b8430 0x7fdc7c1e7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:28.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.026+0000 7fdc73fff700 1 -- 172.21.15.32:0/2672500191 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6c009550 con 0x7fdc7c0cfa90 2023-06-20T13:33:28.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.026+0000 7fdc7bfff700 1 --2- 172.21.15.32:0/2672500191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc7c0b8430 0x7fdc7c1e7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:28.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.026+0000 7fdc80f9c700 1 --2- 172.21.15.32:0/2672500191 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc7c0d3730 0x7fdc7c15a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:28.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.026+0000 7fdc73fff700 1 --2- 172.21.15.32:0/2672500191 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc7c0cfa90 0x7fdc7c0c7b20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdc6400b530 tx=0x7fdc6400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:28.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.027+0000 7fdc797fa700 1 -- 172.21.15.32:0/2672500191 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc64011830 con 0x7fdc7c0cfa90 2023-06-20T13:33:28.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.027+0000 7fdc797fa700 1 -- 172.21.15.32:0/2672500191 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc640119b0 con 0x7fdc7c0cfa90 2023-06-20T13:33:28.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.027+0000 7fdc797fa700 1 -- 172.21.15.32:0/2672500191 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc64011d60 con 0x7fdc7c0cfa90 2023-06-20T13:33:28.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.027+0000 7fdc829ff700 1 -- 172.21.15.32:0/2672500191 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc7c0c8930 con 0x7fdc7c0cfa90 2023-06-20T13:33:28.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.027+0000 7fdc829ff700 1 -- 172.21.15.32:0/2672500191 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc7c0c8060 con 0x7fdc7c0cfa90 2023-06-20T13:33:28.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.028+0000 7fdc829ff700 1 -- 172.21.15.32:0/2672500191 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc7c04ea60 con 0x7fdc7c0cfa90 2023-06-20T13:33:28.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.029+0000 7fdc797fa700 1 -- 172.21.15.32:0/2672500191 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdc6401a400 con 0x7fdc7c0cfa90 2023-06-20T13:33:28.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.030+0000 7fdc797fa700 1 --2- 172.21.15.32:0/2672500191 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdc5c06ace0 0x7fdc5c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:28.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.030+0000 7fdc797fa700 1 -- 172.21.15.32:0/2672500191 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdc64089880 con 0x7fdc7c0cfa90 2023-06-20T13:33:28.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.030+0000 7fdc7bfff700 1 --2- 172.21.15.32:0/2672500191 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdc5c06ace0 0x7fdc5c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:28.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.031+0000 7fdc7bfff700 1 --2- 172.21.15.32:0/2672500191 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdc5c06ace0 0x7fdc5c06d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c009c10 tx=0x7fdc6c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:28.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.034+0000 7fdc797fa700 1 -- 172.21.15.32:0/2672500191 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdc64054560 con 0x7fdc7c0cfa90 2023-06-20T13:33:28.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.243+0000 7fdc829ff700 1 -- 172.21.15.32:0/2672500191 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdc7c160d30 con 0x7fdc7c0cfa90 2023-06-20T13:33:28.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.244+0000 7fdc797fa700 1 -- 172.21.15.32:0/2672500191 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdc64057b80 con 0x7fdc7c0cfa90 2023-06-20T13:33:28.246 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-06-20T13:33:28.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.246+0000 7fdc829ff700 1 -- 172.21.15.32:0/2672500191 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdc5c06ace0 msgr2=0x7fdc5c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:28.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.246+0000 7fdc829ff700 1 --2- 172.21.15.32:0/2672500191 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdc5c06ace0 0x7fdc5c06d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c009c10 tx=0x7fdc6c008030 comp rx=0 tx=0).stop 2023-06-20T13:33:28.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.246+0000 7fdc829ff700 1 -- 172.21.15.32:0/2672500191 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc7c0cfa90 msgr2=0x7fdc7c0c7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:28.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.246+0000 7fdc829ff700 1 --2- 172.21.15.32:0/2672500191 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc7c0cfa90 0x7fdc7c0c7b20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdc6400b530 tx=0x7fdc6400b8f0 comp rx=0 tx=0).stop 2023-06-20T13:33:28.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.246+0000 7fdc829ff700 1 -- 172.21.15.32:0/2672500191 shutdown_connections 2023-06-20T13:33:28.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.246+0000 7fdc829ff700 1 --2- 172.21.15.32:0/2672500191 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdc5c06ace0 0x7fdc5c06d190 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:28.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.246+0000 7fdc829ff700 1 --2- 172.21.15.32:0/2672500191 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdc7c0d3730 0x7fdc7c15a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:28.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.246+0000 7fdc829ff700 1 --2- 172.21.15.32:0/2672500191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdc7c0b8430 0x7fdc7c1e7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:28.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.246+0000 7fdc829ff700 1 --2- 172.21.15.32:0/2672500191 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdc7c0cfa90 0x7fdc7c0c7b20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:28.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.246+0000 7fdc829ff700 1 -- 172.21.15.32:0/2672500191 >> 172.21.15.32:0/2672500191 conn(0x7fdc7c06b3f0 msgr2=0x7fdc7c0b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:28.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.246+0000 7fdc829ff700 1 -- 172.21.15.32:0/2672500191 shutdown_connections 2023-06-20T13:33:28.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.246+0000 7fdc829ff700 1 -- 172.21.15.32:0/2672500191 wait complete. 2023-06-20T13:33:28.266 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-20T13:33:28.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.468+0000 7fcbbf3ff700 1 Processor -- start 2023-06-20T13:33:28.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.469+0000 7fcbbf3ff700 1 -- start start 2023-06-20T13:33:28.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.470+0000 7fcbbf3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcbb80b8430 0x7fcbb80cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:28.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.470+0000 7fcbbf3ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcbb80cfc60 0x7fcbb80d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:28.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.470+0000 7fcbbf3ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbb80d0b20 con 0x7fcbb80d3730 2023-06-20T13:33:28.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.470+0000 7fcbbf3ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb80b8800 con 0x7fcbb80cfc60 2023-06-20T13:33:28.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.470+0000 7fcbbf3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb80b4ee0 con 0x7fcbb80b8430 2023-06-20T13:33:28.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.470+0000 7fcbbc99a700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fcbb80d3730 0x7fcbb80cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36898/0 (socket says 172.21.15.32:36898) 2023-06-20T13:33:28.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.470+0000 7fcbbc99a700 1 -- 172.21.15.32:0/111984423 learned_addr learned my addr 172.21.15.32:0/111984423 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:28.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.470+0000 7fcbbd99c700 1 --2- 172.21.15.32:0/111984423 >> v2:172.21.15.32:3300/0 conn(0x7fcbb80cfc60 0x7fcbb80d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:28.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.470+0000 7fcbbd19b700 1 --2- 172.21.15.32:0/111984423 >> v2:172.21.15.115:3300/0 conn(0x7fcbb80b8430 0x7fcbb80cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:28.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.471+0000 7fcbaffff700 1 -- 172.21.15.32:0/111984423 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1247798708 0 0) 0x7fcbb80d0b20 con 0x7fcbb80d3730 2023-06-20T13:33:28.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.471+0000 7fcbbd99c700 1 -- 172.21.15.32:0/111984423 >> v2:172.21.15.115:3300/0 conn(0x7fcbb80b8430 msgr2=0x7fcbb80cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:28.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.471+0000 7fcbbd99c700 1 --2- 172.21.15.32:0/111984423 >> v2:172.21.15.115:3300/0 conn(0x7fcbb80b8430 0x7fcbb80cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:28.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.471+0000 7fcbbd99c700 1 -- 172.21.15.32:0/111984423 >> v1:172.21.15.32:6789/0 conn(0x7fcbb80d3730 legacy=0x7fcbb80cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:28.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.471+0000 7fcbbd99c700 1 -- 172.21.15.32:0/111984423 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb80b51c0 con 0x7fcbb80cfc60 2023-06-20T13:33:28.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.471+0000 7fcbbd99c700 1 --2- 172.21.15.32:0/111984423 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbb80cfc60 0x7fcbb80d0fb0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcbb80cf520 tx=0x7fcbb000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e84d483cb27aa0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:28.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.471+0000 7fcbaffff700 1 -- 172.21.15.32:0/111984423 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb000e070 con 0x7fcbb80cfc60 2023-06-20T13:33:28.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.471+0000 7fcbaffff700 1 -- 172.21.15.32:0/111984423 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb000bb20 con 0x7fcbb80cfc60 2023-06-20T13:33:28.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.471+0000 7fcbaffff700 1 -- 172.21.15.32:0/111984423 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0012430 con 0x7fcbb80cfc60 2023-06-20T13:33:28.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.472+0000 7fcbbf3ff700 1 -- 172.21.15.32:0/111984423 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbb80cfc60 msgr2=0x7fcbb80d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:28.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.472+0000 7fcbbf3ff700 1 --2- 172.21.15.32:0/111984423 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbb80cfc60 0x7fcbb80d0fb0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcbb80cf520 tx=0x7fcbb000b330 comp rx=0 tx=0).stop 2023-06-20T13:33:28.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.472+0000 7fcbbf3ff700 1 -- 172.21.15.32:0/111984423 shutdown_connections 2023-06-20T13:33:28.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.472+0000 7fcbbf3ff700 1 --2- 172.21.15.32:0/111984423 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbb80cfc60 0x7fcbb80d0fb0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:28.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.472+0000 7fcbbf3ff700 1 --2- 172.21.15.32:0/111984423 >> v2:172.21.15.115:3300/0 conn(0x7fcbb80b8430 0x7fcbb80cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:28.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.472+0000 7fcbbf3ff700 1 -- 172.21.15.32:0/111984423 >> 172.21.15.32:0/111984423 conn(0x7fcbb806b3f0 msgr2=0x7fcbb806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:28.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.472+0000 7fcbbf3ff700 1 -- 172.21.15.32:0/111984423 shutdown_connections 2023-06-20T13:33:28.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.472+0000 7fcbbf3ff700 1 -- 172.21.15.32:0/111984423 wait complete. 2023-06-20T13:33:28.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.474+0000 7fcbbf3ff700 1 Processor -- start 2023-06-20T13:33:28.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.474+0000 7fcbbf3ff700 1 -- start start 2023-06-20T13:33:28.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.475+0000 7fcbbf3ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbb80b8430 0x7fcbb80c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:28.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.475+0000 7fcbbf3ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbb80cfc60 0x7fcbb815d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:28.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.475+0000 7fcbbf3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbb80d3730 0x7fcbb815dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:28.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.475+0000 7fcbbf3ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb815e6d0 con 0x7fcbb80cfc60 2023-06-20T13:33:28.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.475+0000 7fcbbf3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb815cc10 con 0x7fcbb80d3730 2023-06-20T13:33:28.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.475+0000 7fcbbf3ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb815e3f0 con 0x7fcbb80b8430 2023-06-20T13:33:28.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.475+0000 7fcbbc99a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbb80cfc60 0x7fcbb815d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:28.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.475+0000 7fcbbc99a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbb80cfc60 0x7fcbb815d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39264/0 (socket says 172.21.15.32:39264) 2023-06-20T13:33:28.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.475+0000 7fcbbc99a700 1 -- 172.21.15.32:0/1308614930 learned_addr learned my addr 172.21.15.32:0/1308614930 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:28.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.475+0000 7fcbbd99c700 1 --2- 172.21.15.32:0/1308614930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbb80d3730 0x7fcbb815dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:28.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.475+0000 7fcbbd19b700 1 --2- 172.21.15.32:0/1308614930 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbb80b8430 0x7fcbb80c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:28.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.476+0000 7fcbbc99a700 1 -- 172.21.15.32:0/1308614930 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbb80b8430 msgr2=0x7fcbb80c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:28.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.476+0000 7fcbbc99a700 1 --2- 172.21.15.32:0/1308614930 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbb80b8430 0x7fcbb80c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:28.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.476+0000 7fcbbc99a700 1 -- 172.21.15.32:0/1308614930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbb80d3730 msgr2=0x7fcbb815dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:28.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.476+0000 7fcbbc99a700 1 --2- 172.21.15.32:0/1308614930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbb80d3730 0x7fcbb815dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:28.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.476+0000 7fcbbc99a700 1 -- 172.21.15.32:0/1308614930 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb0009a70 con 0x7fcbb80cfc60 2023-06-20T13:33:28.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.476+0000 7fcbbc99a700 1 --2- 172.21.15.32:0/1308614930 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbb80cfc60 0x7fcbb815d7b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcba800c550 tx=0x7fcba800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:28.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.476+0000 7fcbadffb700 1 -- 172.21.15.32:0/1308614930 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba8004c80 con 0x7fcbb80cfc60 2023-06-20T13:33:28.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.476+0000 7fcbadffb700 1 -- 172.21.15.32:0/1308614930 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba8004e00 con 0x7fcbb80cfc60 2023-06-20T13:33:28.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.476+0000 7fcbadffb700 1 -- 172.21.15.32:0/1308614930 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba8007310 con 0x7fcbb80cfc60 2023-06-20T13:33:28.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.476+0000 7fcbbf3ff700 1 -- 172.21.15.32:0/1308614930 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb80c6810 con 0x7fcbb80cfc60 2023-06-20T13:33:28.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.476+0000 7fcbbf3ff700 1 -- 172.21.15.32:0/1308614930 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb80c6dd0 con 0x7fcbb80cfc60 2023-06-20T13:33:28.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.477+0000 7fcbbf3ff700 1 -- 172.21.15.32:0/1308614930 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb80c6670 con 0x7fcbb80cfc60 2023-06-20T13:33:28.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.478+0000 7fcbadffb700 1 -- 172.21.15.32:0/1308614930 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcba8007470 con 0x7fcbb80cfc60 2023-06-20T13:33:28.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.479+0000 7fcbadffb700 1 --2- 172.21.15.32:0/1308614930 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcb9c06ace0 0x7fcb9c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:28.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.479+0000 7fcbadffb700 1 -- 172.21.15.32:0/1308614930 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcba8089380 con 0x7fcbb80cfc60 2023-06-20T13:33:28.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.479+0000 7fcbbd19b700 1 --2- 172.21.15.32:0/1308614930 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcb9c06ace0 0x7fcb9c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:28.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.480+0000 7fcbbd19b700 1 --2- 172.21.15.32:0/1308614930 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcb9c06ace0 0x7fcb9c06d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4009be0 tx=0x7fcbb4009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:28.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.484+0000 7fcbadffb700 1 -- 172.21.15.32:0/1308614930 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcbb80c6670 con 0x7fcbb80cfc60 2023-06-20T13:33:28.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.689+0000 7fcbbf3ff700 1 -- 172.21.15.32:0/1308614930 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fcbb80c6670 con 0x7fcbb80cfc60 2023-06-20T13:33:28.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.689+0000 7fcbadffb700 1 -- 172.21.15.32:0/1308614930 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fcbb80c6670 con 0x7fcbb80cfc60 2023-06-20T13:33:28.693 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-06-20T13:33:28.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.692+0000 7fcbbf3ff700 1 -- 172.21.15.32:0/1308614930 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcb9c06ace0 msgr2=0x7fcb9c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:28.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.692+0000 7fcbbf3ff700 1 --2- 172.21.15.32:0/1308614930 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcb9c06ace0 0x7fcb9c06d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4009be0 tx=0x7fcbb4009210 comp rx=0 tx=0).stop 2023-06-20T13:33:28.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.692+0000 7fcbbf3ff700 1 -- 172.21.15.32:0/1308614930 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbb80cfc60 msgr2=0x7fcbb815d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:28.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.692+0000 7fcbbf3ff700 1 --2- 172.21.15.32:0/1308614930 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbb80cfc60 0x7fcbb815d7b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcba800c550 tx=0x7fcba800c860 comp rx=0 tx=0).stop 2023-06-20T13:33:28.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.692+0000 7fcbbf3ff700 1 -- 172.21.15.32:0/1308614930 shutdown_connections 2023-06-20T13:33:28.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.692+0000 7fcbbf3ff700 1 --2- 172.21.15.32:0/1308614930 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcb9c06ace0 0x7fcb9c06d190 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:28.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.692+0000 7fcbbf3ff700 1 --2- 172.21.15.32:0/1308614930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbb80d3730 0x7fcbb815dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:28.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.692+0000 7fcbbf3ff700 1 --2- 172.21.15.32:0/1308614930 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbb80b8430 0x7fcbb80c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:28.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.692+0000 7fcbbf3ff700 1 --2- 172.21.15.32:0/1308614930 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbb80cfc60 0x7fcbb815d7b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:28.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.692+0000 7fcbbf3ff700 1 -- 172.21.15.32:0/1308614930 >> 172.21.15.32:0/1308614930 conn(0x7fcbb806b3f0 msgr2=0x7fcbb80b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:28.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.692+0000 7fcbbf3ff700 1 -- 172.21.15.32:0/1308614930 shutdown_connections 2023-06-20T13:33:28.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.692+0000 7fcbbf3ff700 1 -- 172.21.15.32:0/1308614930 wait complete. 2023-06-20T13:33:28.722 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-06-20T13:33:28.723 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-06-20T13:33:28.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.922+0000 7f1cd33ff700 1 Processor -- start 2023-06-20T13:33:28.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.922+0000 7f1cd33ff700 1 -- start start 2023-06-20T13:33:28.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.923+0000 7f1cd33ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1ccc0d2640 0x7f1ccc0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:28.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.923+0000 7f1cd33ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1ccc0cf8f0 0x7f1ccc15fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:28.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.923+0000 7f1cd33ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ccc0d1790 con 0x7f1ccc15c460 2023-06-20T13:33:28.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.923+0000 7f1cd33ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ccc0cedd0 con 0x7f1ccc0cf8f0 2023-06-20T13:33:28.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.923+0000 7f1cd33ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ccc0cd950 con 0x7f1ccc0d2640 2023-06-20T13:33:28.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.923+0000 7f1cd119b700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f1ccc15c460 0x7f1ccc0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:36912/0 (socket says 172.21.15.32:36912) 2023-06-20T13:33:28.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.923+0000 7f1cd119b700 1 -- 172.21.15.32:0/3864383023 learned_addr learned my addr 172.21.15.32:0/3864383023 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:28.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.923+0000 7f1cd199c700 1 --2- 172.21.15.32:0/3864383023 >> v2:172.21.15.32:3300/0 conn(0x7f1ccc0cf8f0 0x7f1ccc15fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:28.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.924+0000 7f1cd099a700 1 --2- 172.21.15.32:0/3864383023 >> v2:172.21.15.115:3300/0 conn(0x7f1ccc0d2640 0x7f1ccc0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:28.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.924+0000 7f1cc3fff700 1 -- 172.21.15.32:0/3864383023 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582381498 0 0) 0x7f1ccc0d1790 con 0x7f1ccc15c460 2023-06-20T13:33:28.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.924+0000 7f1cc3fff700 1 -- 172.21.15.32:0/3864383023 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cb80035b0 con 0x7f1ccc15c460 2023-06-20T13:33:28.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.924+0000 7f1cd199c700 1 -- 172.21.15.32:0/3864383023 >> v2:172.21.15.115:3300/0 conn(0x7f1ccc0d2640 msgr2=0x7f1ccc0b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:28.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.924+0000 7f1cd199c700 1 --2- 172.21.15.32:0/3864383023 >> v2:172.21.15.115:3300/0 conn(0x7f1ccc0d2640 0x7f1ccc0b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:28.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.924+0000 7f1cd199c700 1 -- 172.21.15.32:0/3864383023 >> v1:172.21.15.32:6789/0 conn(0x7f1ccc15c460 legacy=0x7f1ccc0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:28.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.924+0000 7f1cd199c700 1 -- 172.21.15.32:0/3864383023 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ccc0d14b0 con 0x7f1ccc0cf8f0 2023-06-20T13:33:28.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.924+0000 7f1cd199c700 1 --2- 172.21.15.32:0/3864383023 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ccc0cf8f0 0x7f1ccc15fe20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc15fd80 tx=0x7f1cc400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561d13c8c588f208 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:28.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.924+0000 7f1cc3fff700 1 -- 172.21.15.32:0/3864383023 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc400e070 con 0x7f1ccc0cf8f0 2023-06-20T13:33:28.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.924+0000 7f1cc3fff700 1 -- 172.21.15.32:0/3864383023 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc400bb20 con 0x7f1ccc0cf8f0 2023-06-20T13:33:28.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.924+0000 7f1cc3fff700 1 -- 172.21.15.32:0/3864383023 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4012430 con 0x7f1ccc0cf8f0 2023-06-20T13:33:28.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.925+0000 7f1cd33ff700 1 -- 172.21.15.32:0/3864383023 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ccc0cf8f0 msgr2=0x7f1ccc15fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:28.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.925+0000 7f1cd33ff700 1 --2- 172.21.15.32:0/3864383023 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ccc0cf8f0 0x7f1ccc15fe20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc15fd80 tx=0x7f1cc400b330 comp rx=0 tx=0).stop 2023-06-20T13:33:28.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.925+0000 7f1cd33ff700 1 -- 172.21.15.32:0/3864383023 shutdown_connections 2023-06-20T13:33:28.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.925+0000 7f1cd33ff700 1 --2- 172.21.15.32:0/3864383023 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ccc0cf8f0 0x7f1ccc15fe20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:28.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.925+0000 7f1cd33ff700 1 --2- 172.21.15.32:0/3864383023 >> v2:172.21.15.115:3300/0 conn(0x7f1ccc0d2640 0x7f1ccc0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:28.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.925+0000 7f1cd33ff700 1 -- 172.21.15.32:0/3864383023 >> 172.21.15.32:0/3864383023 conn(0x7f1ccc071660 msgr2=0x7f1ccc071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:28.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.925+0000 7f1cd33ff700 1 -- 172.21.15.32:0/3864383023 shutdown_connections 2023-06-20T13:33:28.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.925+0000 7f1cd33ff700 1 -- 172.21.15.32:0/3864383023 wait complete. 2023-06-20T13:33:28.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.927+0000 7f1cd33ff700 1 Processor -- start 2023-06-20T13:33:28.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.927+0000 7f1cd33ff700 1 -- start start 2023-06-20T13:33:28.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.928+0000 7f1cd33ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ccc0cf8f0 0x7f1ccc1f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:28.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.928+0000 7f1cd33ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ccc0d2640 0x7f1ccc15b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:28.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.928+0000 7f1cd33ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ccc15c460 0x7f1ccc1560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:28.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.928+0000 7f1cd33ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc0c89f0 con 0x7f1ccc0d2640 2023-06-20T13:33:28.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.928+0000 7f1cd33ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc156600 con 0x7f1ccc15c460 2023-06-20T13:33:28.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.928+0000 7f1cd33ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ccc1f5660 con 0x7f1ccc0cf8f0 2023-06-20T13:33:28.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.928+0000 7f1cd099a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ccc0d2640 0x7f1ccc15b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:28.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.928+0000 7f1cd099a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ccc0d2640 0x7f1ccc15b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39276/0 (socket says 172.21.15.32:39276) 2023-06-20T13:33:28.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.928+0000 7f1cd099a700 1 -- 172.21.15.32:0/1910603839 learned_addr learned my addr 172.21.15.32:0/1910603839 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:28.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.928+0000 7f1cd119b700 1 --2- 172.21.15.32:0/1910603839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ccc0cf8f0 0x7f1ccc1f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:28.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.928+0000 7f1cd199c700 1 --2- 172.21.15.32:0/1910603839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ccc15c460 0x7f1ccc1560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:28.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.929+0000 7f1cd099a700 1 -- 172.21.15.32:0/1910603839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ccc0cf8f0 msgr2=0x7f1ccc1f2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:28.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.929+0000 7f1cd099a700 1 --2- 172.21.15.32:0/1910603839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ccc0cf8f0 0x7f1ccc1f2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:28.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.929+0000 7f1cd099a700 1 -- 172.21.15.32:0/1910603839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ccc15c460 msgr2=0x7f1ccc1560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:28.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.929+0000 7f1cd099a700 1 --2- 172.21.15.32:0/1910603839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ccc15c460 0x7f1ccc1560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:28.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.929+0000 7f1cd099a700 1 -- 172.21.15.32:0/1910603839 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc4009a70 con 0x7f1ccc0d2640 2023-06-20T13:33:28.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.929+0000 7f1cd119b700 1 --2- 172.21.15.32:0/1910603839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ccc0cf8f0 0x7f1ccc1f2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:28.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.929+0000 7f1cd099a700 1 --2- 172.21.15.32:0/1910603839 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ccc0d2640 0x7f1ccc15b8c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00d800 tx=0x7f1cbc00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:28.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.929+0000 7f1cc1ffb700 1 -- 172.21.15.32:0/1910603839 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc0125f0 con 0x7f1ccc0d2640 2023-06-20T13:33:28.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.929+0000 7f1cc1ffb700 1 -- 172.21.15.32:0/1910603839 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc012750 con 0x7f1ccc0d2640 2023-06-20T13:33:28.935 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.929+0000 7f1cd33ff700 1 -- 172.21.15.32:0/1910603839 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ccc1f5940 con 0x7f1ccc0d2640 2023-06-20T13:33:28.935 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.929+0000 7f1cc1ffb700 1 -- 172.21.15.32:0/1910603839 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc012b00 con 0x7f1ccc0d2640 2023-06-20T13:33:28.935 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.929+0000 7f1cd33ff700 1 -- 172.21.15.32:0/1910603839 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ccc159aa0 con 0x7f1ccc0d2640 2023-06-20T13:33:28.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.931+0000 7f1cd33ff700 1 -- 172.21.15.32:0/1910603839 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ccc159900 con 0x7f1ccc0d2640 2023-06-20T13:33:28.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.931+0000 7f1cc1ffb700 1 -- 172.21.15.32:0/1910603839 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1cbc012c60 con 0x7f1ccc0d2640 2023-06-20T13:33:28.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.932+0000 7f1cc1ffb700 1 --2- 172.21.15.32:0/1910603839 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1cb006ace0 0x7f1cb006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:28.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.932+0000 7f1cc1ffb700 1 -- 172.21.15.32:0/1910603839 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1cbc089c10 con 0x7f1ccc0d2640 2023-06-20T13:33:28.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.933+0000 7f1cd119b700 1 --2- 172.21.15.32:0/1910603839 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1cb006ace0 0x7f1cb006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:28.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.933+0000 7f1cd119b700 1 --2- 172.21.15.32:0/1910603839 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1cb006ace0 0x7f1cb006d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1cc80011e0 tx=0x7f1cc8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:28.938 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:28.937+0000 7f1cc1ffb700 1 -- 172.21.15.32:0/1910603839 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1ccc159900 con 0x7f1ccc0d2640 2023-06-20T13:33:29.231 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:29.229+0000 7f1cd33ff700 1 -- 172.21.15.32:0/1910603839 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f1ccc159900 con 0x7f1ccc0d2640 2023-06-20T13:33:30.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.119+0000 7f1cc1ffb700 1 -- 172.21.15.32:0/1910603839 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v87) v1 ==== 147+0+0 (secure 0 0 0) 0x7f1ccc159900 con 0x7f1ccc0d2640 2023-06-20T13:33:30.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.122+0000 7f1cd33ff700 1 -- 172.21.15.32:0/1910603839 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1cb006ace0 msgr2=0x7f1cb006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:30.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.122+0000 7f1cd33ff700 1 --2- 172.21.15.32:0/1910603839 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1cb006ace0 0x7f1cb006d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1cc80011e0 tx=0x7f1cc8009040 comp rx=0 tx=0).stop 2023-06-20T13:33:30.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.122+0000 7f1cd33ff700 1 -- 172.21.15.32:0/1910603839 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ccc0d2640 msgr2=0x7f1ccc15b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:30.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.122+0000 7f1cd33ff700 1 --2- 172.21.15.32:0/1910603839 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ccc0d2640 0x7f1ccc15b8c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc00d800 tx=0x7f1cbc00dbc0 comp rx=0 tx=0).stop 2023-06-20T13:33:30.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.122+0000 7f1cd33ff700 1 -- 172.21.15.32:0/1910603839 shutdown_connections 2023-06-20T13:33:30.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.122+0000 7f1cd33ff700 1 --2- 172.21.15.32:0/1910603839 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1cb006ace0 0x7f1cb006d190 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:30.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.122+0000 7f1cd33ff700 1 --2- 172.21.15.32:0/1910603839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ccc15c460 0x7f1ccc1560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:30.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.122+0000 7f1cd33ff700 1 --2- 172.21.15.32:0/1910603839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ccc0cf8f0 0x7f1ccc1f2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:30.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.122+0000 7f1cd33ff700 1 --2- 172.21.15.32:0/1910603839 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1ccc0d2640 0x7f1ccc15b8c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:30.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.122+0000 7f1cd33ff700 1 -- 172.21.15.32:0/1910603839 >> 172.21.15.32:0/1910603839 conn(0x7f1ccc071660 msgr2=0x7f1ccc0b8020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:30.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.122+0000 7f1cd33ff700 1 -- 172.21.15.32:0/1910603839 shutdown_connections 2023-06-20T13:33:30.127 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.122+0000 7f1cd33ff700 1 -- 172.21.15.32:0/1910603839 wait complete. 2023-06-20T13:33:30.145 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-06-20T13:33:30.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.351+0000 7f870e9ff700 1 Processor -- start 2023-06-20T13:33:30.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.351+0000 7f870e9ff700 1 -- start start 2023-06-20T13:33:30.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.352+0000 7f870e9ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f87080b8430 0x7f87080cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:30.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.352+0000 7f870e9ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f87080d3730 0x7f87080cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:30.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.353+0000 7f870e9ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87080cfa90 0x7f870815feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:30.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.353+0000 7f870e9ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87080b8800 con 0x7f87080b8430 2023-06-20T13:33:30.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.353+0000 7f870e9ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87080d0b20 con 0x7f87080d3730 2023-06-20T13:33:30.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.353+0000 7f870e9ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87080cfeb0 con 0x7f87080cfa90 2023-06-20T13:33:30.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.353+0000 7f8707fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f87080b8430 0x7f87080cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:30.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.353+0000 7f8707fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f87080b8430 0x7f87080cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34884/0 (socket says 172.21.15.32:34884) 2023-06-20T13:33:30.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.353+0000 7f8707fff700 1 -- 172.21.15.32:0/3890513641 learned_addr learned my addr 172.21.15.32:0/3890513641 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:30.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.353+0000 7f870cf9c700 1 --2- 172.21.15.32:0/3890513641 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87080cfa90 0x7f870815feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:30.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.353+0000 7f87077fe700 1 --2- 172.21.15.32:0/3890513641 >> v2:172.21.15.115:3300/0 conn(0x7f87080d3730 0x7f87080cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:30.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.353+0000 7f8707fff700 1 -- 172.21.15.32:0/3890513641 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87080cfa90 msgr2=0x7f870815feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:30.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.353+0000 7f8707fff700 1 --2- 172.21.15.32:0/3890513641 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87080cfa90 0x7f870815feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:30.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.353+0000 7f8707fff700 1 -- 172.21.15.32:0/3890513641 >> v2:172.21.15.115:3300/0 conn(0x7f87080d3730 msgr2=0x7f87080cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:30.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.353+0000 7f8707fff700 1 --2- 172.21.15.32:0/3890513641 >> v2:172.21.15.115:3300/0 conn(0x7f87080d3730 0x7f87080cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:30.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.353+0000 7f8707fff700 1 -- 172.21.15.32:0/3890513641 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87080b4ee0 con 0x7f87080b8430 2023-06-20T13:33:30.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.354+0000 7f8707fff700 1 --2- 172.21.15.32:0/3890513641 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87080b8430 0x7f87080cd320 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8708160f50 tx=0x7f86f8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df8e54587463d94 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:30.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.354+0000 7f8706ffd700 1 -- 172.21.15.32:0/3890513641 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f800b870 con 0x7f87080b8430 2023-06-20T13:33:30.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.354+0000 7f8706ffd700 1 -- 172.21.15.32:0/3890513641 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f800b9d0 con 0x7f87080b8430 2023-06-20T13:33:30.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.354+0000 7f8706ffd700 1 -- 172.21.15.32:0/3890513641 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f800bd60 con 0x7f87080b8430 2023-06-20T13:33:30.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.354+0000 7f870e9ff700 1 -- 172.21.15.32:0/3890513641 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87080b8430 msgr2=0x7f87080cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:30.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.354+0000 7f870e9ff700 1 --2- 172.21.15.32:0/3890513641 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87080b8430 0x7f87080cd320 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8708160f50 tx=0x7f86f8009bd0 comp rx=0 tx=0).stop 2023-06-20T13:33:30.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.354+0000 7f870e9ff700 1 -- 172.21.15.32:0/3890513641 shutdown_connections 2023-06-20T13:33:30.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.354+0000 7f870e9ff700 1 --2- 172.21.15.32:0/3890513641 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87080cfa90 0x7f870815feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:30.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.354+0000 7f870e9ff700 1 --2- 172.21.15.32:0/3890513641 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87080b8430 0x7f87080cd320 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:30.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.354+0000 7f870e9ff700 1 --2- 172.21.15.32:0/3890513641 >> v2:172.21.15.115:3300/0 conn(0x7f87080d3730 0x7f87080cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:30.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.354+0000 7f870e9ff700 1 -- 172.21.15.32:0/3890513641 >> 172.21.15.32:0/3890513641 conn(0x7f870806b3f0 msgr2=0x7f870806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:30.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.354+0000 7f870e9ff700 1 -- 172.21.15.32:0/3890513641 shutdown_connections 2023-06-20T13:33:30.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.355+0000 7f870e9ff700 1 -- 172.21.15.32:0/3890513641 wait complete. 2023-06-20T13:33:30.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.357+0000 7f870e9ff700 1 Processor -- start 2023-06-20T13:33:30.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.357+0000 7f870e9ff700 1 -- start start 2023-06-20T13:33:30.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.358+0000 7f870e9ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87080b8430 0x7f8708155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:30.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.358+0000 7f870e9ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87080cfa90 0x7f87081f6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:30.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.358+0000 7f870e9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87080d3730 0x7f870815ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:30.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.359+0000 7f870e9ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870815ccd0 con 0x7f87080b8430 2023-06-20T13:33:30.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.359+0000 7f870e9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870815c930 con 0x7f87080d3730 2023-06-20T13:33:30.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.359+0000 7f870e9ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87081f6d70 con 0x7f87080cfa90 2023-06-20T13:33:30.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.359+0000 7f8707fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87080b8430 0x7f8708155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:30.368 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.359+0000 7f8707fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87080b8430 0x7f8708155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34896/0 (socket says 172.21.15.32:34896) 2023-06-20T13:33:30.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.359+0000 7f8707fff700 1 -- 172.21.15.32:0/358918081 learned_addr learned my addr 172.21.15.32:0/358918081 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:30.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.359+0000 7f8707fff700 1 -- 172.21.15.32:0/358918081 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87080cfa90 msgr2=0x7f87081f6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:30.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.359+0000 7f870cf9c700 1 --2- 172.21.15.32:0/358918081 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87080d3730 0x7f870815ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:30.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.359+0000 7f8707fff700 1 --2- 172.21.15.32:0/358918081 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87080cfa90 0x7f87081f6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:30.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.359+0000 7f8707fff700 1 -- 172.21.15.32:0/358918081 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87080d3730 msgr2=0x7f870815ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:30.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.359+0000 7f8707fff700 1 --2- 172.21.15.32:0/358918081 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87080d3730 0x7f870815ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:30.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.359+0000 7f8707fff700 1 -- 172.21.15.32:0/358918081 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f8009550 con 0x7f87080b8430 2023-06-20T13:33:30.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.359+0000 7f870cf9c700 1 --2- 172.21.15.32:0/358918081 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87080d3730 0x7f870815ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:30.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.359+0000 7f8707fff700 1 --2- 172.21.15.32:0/358918081 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87080b8430 0x7f8708155290 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f86f8000c00 tx=0x7f86f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:30.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.360+0000 7f8704ff9700 1 -- 172.21.15.32:0/358918081 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f8004520 con 0x7f87080b8430 2023-06-20T13:33:30.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.360+0000 7f8704ff9700 1 -- 172.21.15.32:0/358918081 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f801e070 con 0x7f87080b8430 2023-06-20T13:33:30.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.360+0000 7f8704ff9700 1 -- 172.21.15.32:0/358918081 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f80038c0 con 0x7f87080b8430 2023-06-20T13:33:30.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.360+0000 7f870e9ff700 1 -- 172.21.15.32:0/358918081 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87081f7050 con 0x7f87080b8430 2023-06-20T13:33:30.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.360+0000 7f870e9ff700 1 -- 172.21.15.32:0/358918081 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87081f69c0 con 0x7f87080b8430 2023-06-20T13:33:30.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.361+0000 7f870e9ff700 1 -- 172.21.15.32:0/358918081 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f870815caa0 con 0x7f87080b8430 2023-06-20T13:33:30.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.362+0000 7f8704ff9700 1 -- 172.21.15.32:0/358918081 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f86f8003a20 con 0x7f87080b8430 2023-06-20T13:33:30.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.363+0000 7f8704ff9700 1 --2- 172.21.15.32:0/358918081 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f86f406ace0 0x7f86f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:30.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.363+0000 7f8704ff9700 1 -- 172.21.15.32:0/358918081 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f86f8020070 con 0x7f87080b8430 2023-06-20T13:33:30.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.363+0000 7f87077fe700 1 --2- 172.21.15.32:0/358918081 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f86f406ace0 0x7f86f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:30.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.364+0000 7f87077fe700 1 --2- 172.21.15.32:0/358918081 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f86f406ace0 0x7f86f406d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f87080d1120 tx=0x7f86fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:30.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.368+0000 7f8704ff9700 1 -- 172.21.15.32:0/358918081 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f870815caa0 con 0x7f87080b8430 2023-06-20T13:33:30.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.574+0000 7f870e9ff700 1 -- 172.21.15.32:0/358918081 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f870815caa0 con 0x7f87080b8430 2023-06-20T13:33:30.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.578+0000 7f8704ff9700 1 -- 172.21.15.32:0/358918081 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f870815caa0 con 0x7f87080b8430 2023-06-20T13:33:30.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.581+0000 7f870e9ff700 1 -- 172.21.15.32:0/358918081 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f86f406ace0 msgr2=0x7f86f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:30.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.581+0000 7f870e9ff700 1 --2- 172.21.15.32:0/358918081 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f86f406ace0 0x7f86f406d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f87080d1120 tx=0x7f86fc008040 comp rx=0 tx=0).stop 2023-06-20T13:33:30.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.581+0000 7f870e9ff700 1 -- 172.21.15.32:0/358918081 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87080b8430 msgr2=0x7f8708155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:30.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.581+0000 7f870e9ff700 1 --2- 172.21.15.32:0/358918081 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87080b8430 0x7f8708155290 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f86f8000c00 tx=0x7f86f8004750 comp rx=0 tx=0).stop 2023-06-20T13:33:30.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.581+0000 7f870e9ff700 1 -- 172.21.15.32:0/358918081 shutdown_connections 2023-06-20T13:33:30.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.581+0000 7f870e9ff700 1 --2- 172.21.15.32:0/358918081 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f86f406ace0 0x7f86f406d190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:30.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.581+0000 7f870e9ff700 1 --2- 172.21.15.32:0/358918081 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87080d3730 0x7f870815ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:30.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.581+0000 7f870e9ff700 1 --2- 172.21.15.32:0/358918081 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f87080b8430 0x7f8708155290 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:30.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.581+0000 7f870e9ff700 1 --2- 172.21.15.32:0/358918081 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87080cfa90 0x7f87081f6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:30.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.581+0000 7f870e9ff700 1 -- 172.21.15.32:0/358918081 >> 172.21.15.32:0/358918081 conn(0x7f870806b3f0 msgr2=0x7f87080cd170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:30.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.581+0000 7f870e9ff700 1 -- 172.21.15.32:0/358918081 shutdown_connections 2023-06-20T13:33:30.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:30.581+0000 7f870e9ff700 1 -- 172.21.15.32:0/358918081 wait complete. 2023-06-20T13:33:30.600 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-20T13:33:30.601 DEBUG:teuthology.orchestra.run.smithi032:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-20T13:33:30.701 DEBUG:teuthology.orchestra.run.smithi115:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-20T13:33:30.807 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-20T13:33:30.807 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:33:30.807 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-20T13:33:30.853 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:33:30.853 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-20T13:33:30.938 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:33:30.938 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-20T13:33:31.023 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:33:31.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.263+0000 7f18e6fff700 1 Processor -- start 2023-06-20T13:33:31.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.263+0000 7f18e6fff700 1 -- start start 2023-06-20T13:33:31.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.265+0000 7f18e6fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18e0156be0 0x7f18e00cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:31.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.265+0000 7f18e6fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f18e00cd600 0x7f18e00cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:31.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.265+0000 7f18e6fff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e00cda70 con 0x7f18e00cb4f0 2023-06-20T13:33:31.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.265+0000 7f18e6fff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e0156fb0 con 0x7f18e00cd600 2023-06-20T13:33:31.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.265+0000 7f18e6fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e015da40 con 0x7f18e0156be0 2023-06-20T13:33:31.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.265+0000 7f18dffff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f18e00cd600 0x7f18e00cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:31.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.265+0000 7f18e559c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f18e00cb4f0 0x7f18e0070340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43662/0 (socket says 172.21.15.32:43662) 2023-06-20T13:33:31.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.265+0000 7f18e559c700 1 -- 172.21.15.32:0/1195656284 learned_addr learned my addr 172.21.15.32:0/1195656284 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:31.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.265+0000 7f18e4d9b700 1 --2- 172.21.15.32:0/1195656284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18e0156be0 0x7f18e00cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:31.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.265+0000 7f18df7fe700 1 -- 172.21.15.32:0/1195656284 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3651255469 0 0) 0x7f18d8001490 con 0x7f18e00cb4f0 2023-06-20T13:33:31.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.265+0000 7f18df7fe700 1 -- 172.21.15.32:0/1195656284 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18d00057c0 con 0x7f18e00cb4f0 2023-06-20T13:33:31.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.265+0000 7f18dffff700 1 -- 172.21.15.32:0/1195656284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18e0156be0 msgr2=0x7f18e00cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:31.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.265+0000 7f18dffff700 1 --2- 172.21.15.32:0/1195656284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18e0156be0 0x7f18e00cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:31.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.265+0000 7f18dffff700 1 -- 172.21.15.32:0/1195656284 >> v1:172.21.15.32:6789/0 conn(0x7f18e00cb4f0 legacy=0x7f18e0070340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:31.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.265+0000 7f18dffff700 1 -- 172.21.15.32:0/1195656284 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e00cbc00 con 0x7f18e00cd600 2023-06-20T13:33:31.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.265+0000 7f18e4d9b700 1 --2- 172.21.15.32:0/1195656284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18e0156be0 0x7f18e00cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:31.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.266+0000 7f18dffff700 1 --2- 172.21.15.32:0/1195656284 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18e00cd600 0x7f18e00cafb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f18cc009870 tx=0x7f18cc009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=114f4c3414eaf670 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:31.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.266+0000 7f18df7fe700 1 -- 172.21.15.32:0/1195656284 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc011830 con 0x7f18e00cd600 2023-06-20T13:33:31.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.266+0000 7f18df7fe700 1 -- 172.21.15.32:0/1195656284 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18cc011990 con 0x7f18e00cd600 2023-06-20T13:33:31.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.266+0000 7f18df7fe700 1 -- 172.21.15.32:0/1195656284 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc011d20 con 0x7f18e00cd600 2023-06-20T13:33:31.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.266+0000 7f18e6fff700 1 -- 172.21.15.32:0/1195656284 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18e00cd600 msgr2=0x7f18e00cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:31.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.266+0000 7f18e6fff700 1 --2- 172.21.15.32:0/1195656284 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18e00cd600 0x7f18e00cafb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f18cc009870 tx=0x7f18cc009b80 comp rx=0 tx=0).stop 2023-06-20T13:33:31.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.267+0000 7f18e6fff700 1 -- 172.21.15.32:0/1195656284 shutdown_connections 2023-06-20T13:33:31.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.267+0000 7f18e6fff700 1 --2- 172.21.15.32:0/1195656284 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18e0156be0 0x7f18e00cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:31.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.267+0000 7f18e6fff700 1 --2- 172.21.15.32:0/1195656284 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18e00cd600 0x7f18e00cafb0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:31.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.267+0000 7f18e6fff700 1 -- 172.21.15.32:0/1195656284 >> 172.21.15.32:0/1195656284 conn(0x7f18e00b0390 msgr2=0x7f18e00b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:31.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.267+0000 7f18e6fff700 1 -- 172.21.15.32:0/1195656284 shutdown_connections 2023-06-20T13:33:31.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.267+0000 7f18e6fff700 1 -- 172.21.15.32:0/1195656284 wait complete. 2023-06-20T13:33:31.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.268+0000 7f18e6fff700 1 Processor -- start 2023-06-20T13:33:31.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.269+0000 7f18e6fff700 1 -- start start 2023-06-20T13:33:31.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.269+0000 7f18e6fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18e00cb4f0 0x7f18e014ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:31.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.270+0000 7f18e6fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18e00cd600 0x7f18e0153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:31.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.270+0000 7f18e6fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18e0156be0 0x7f18e0070810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:31.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.270+0000 7f18e6fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e0154ca0 con 0x7f18e00cb4f0 2023-06-20T13:33:31.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.270+0000 7f18e6fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00c5890 con 0x7f18e00cd600 2023-06-20T13:33:31.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.270+0000 7f18e6fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00c5ae0 con 0x7f18e0156be0 2023-06-20T13:33:31.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.270+0000 7f18e4d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18e00cb4f0 0x7f18e014ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:31.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.270+0000 7f18e4d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18e00cb4f0 0x7f18e014ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34914/0 (socket says 172.21.15.32:34914) 2023-06-20T13:33:31.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.270+0000 7f18e4d9b700 1 -- 172.21.15.32:0/799414363 learned_addr learned my addr 172.21.15.32:0/799414363 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:31.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.270+0000 7f18e559c700 1 --2- 172.21.15.32:0/799414363 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18e0156be0 0x7f18e0070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:31.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.270+0000 7f18e4d9b700 1 -- 172.21.15.32:0/799414363 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18e0156be0 msgr2=0x7f18e0070810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:31.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.270+0000 7f18dffff700 1 --2- 172.21.15.32:0/799414363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18e00cd600 0x7f18e0153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:31.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.270+0000 7f18e4d9b700 1 --2- 172.21.15.32:0/799414363 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18e0156be0 0x7f18e0070810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:31.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.270+0000 7f18e4d9b700 1 -- 172.21.15.32:0/799414363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18e00cd600 msgr2=0x7f18e0153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:31.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.270+0000 7f18e4d9b700 1 --2- 172.21.15.32:0/799414363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18e00cd600 0x7f18e0153d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:31.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.270+0000 7f18e4d9b700 1 -- 172.21.15.32:0/799414363 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc0094a0 con 0x7f18e00cb4f0 2023-06-20T13:33:31.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.270+0000 7f18e559c700 1 --2- 172.21.15.32:0/799414363 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18e0156be0 0x7f18e0070810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:31.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.270+0000 7f18dffff700 1 --2- 172.21.15.32:0/799414363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18e00cd600 0x7f18e0153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:31.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.270+0000 7f18e4d9b700 1 --2- 172.21.15.32:0/799414363 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18e00cb4f0 0x7f18e014ee80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f18d400e810 tx=0x7f18d400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:31.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.271+0000 7f18dd7fa700 1 -- 172.21.15.32:0/799414363 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d400c020 con 0x7f18e00cb4f0 2023-06-20T13:33:31.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.271+0000 7f18dd7fa700 1 -- 172.21.15.32:0/799414363 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d4004250 con 0x7f18e00cb4f0 2023-06-20T13:33:31.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.271+0000 7f18dd7fa700 1 -- 172.21.15.32:0/799414363 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d40036a0 con 0x7f18e00cb4f0 2023-06-20T13:33:31.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.271+0000 7f18e6fff700 1 -- 172.21.15.32:0/799414363 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e00c5dc0 con 0x7f18e00cb4f0 2023-06-20T13:33:31.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.271+0000 7f18e6fff700 1 -- 172.21.15.32:0/799414363 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e00c6380 con 0x7f18e00cb4f0 2023-06-20T13:33:31.277 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.272+0000 7f18e6fff700 1 -- 172.21.15.32:0/799414363 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e00c69d0 con 0x7f18e00cb4f0 2023-06-20T13:33:31.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.273+0000 7f18dd7fa700 1 -- 172.21.15.32:0/799414363 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f18d4003800 con 0x7f18e00cb4f0 2023-06-20T13:33:31.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.274+0000 7f18dd7fa700 1 --2- 172.21.15.32:0/799414363 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f18c406ace0 0x7f18c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:31.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.274+0000 7f18dd7fa700 1 -- 172.21.15.32:0/799414363 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f18d4089690 con 0x7f18e00cb4f0 2023-06-20T13:33:31.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.274+0000 7f18dffff700 1 --2- 172.21.15.32:0/799414363 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f18c406ace0 0x7f18c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:31.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.275+0000 7f18dffff700 1 --2- 172.21.15.32:0/799414363 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f18c406ace0 0x7f18c406d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f18e00cd0c0 tx=0x7f18cc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:31.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.278+0000 7f18dd7fa700 1 -- 172.21.15.32:0/799414363 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f18d4054370 con 0x7f18e00cb4f0 2023-06-20T13:33:31.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.483+0000 7f18e6fff700 1 -- 172.21.15.32:0/799414363 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18e00c66f0 con 0x7f18e00cb4f0 2023-06-20T13:33:31.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.484+0000 7f18dd7fa700 1 -- 172.21.15.32:0/799414363 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20191 (secure 0 0 0) 0x7f18d4057990 con 0x7f18e00cb4f0 2023-06-20T13:33:31.487 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:33:31.487 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":29,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:33:00.976862+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-20T13:32:18.120021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-20T13:32:19.503624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-20T13:32:23.074912+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:33:31.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.487+0000 7f18e6fff700 1 -- 172.21.15.32:0/799414363 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f18c406ace0 msgr2=0x7f18c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:31.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.487+0000 7f18e6fff700 1 --2- 172.21.15.32:0/799414363 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f18c406ace0 0x7f18c406d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f18e00cd0c0 tx=0x7f18cc008030 comp rx=0 tx=0).stop 2023-06-20T13:33:31.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.487+0000 7f18e6fff700 1 -- 172.21.15.32:0/799414363 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18e00cb4f0 msgr2=0x7f18e014ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:31.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.487+0000 7f18e6fff700 1 --2- 172.21.15.32:0/799414363 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18e00cb4f0 0x7f18e014ee80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f18d400e810 tx=0x7f18d400ebd0 comp rx=0 tx=0).stop 2023-06-20T13:33:31.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.487+0000 7f18e6fff700 1 -- 172.21.15.32:0/799414363 shutdown_connections 2023-06-20T13:33:31.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.487+0000 7f18e6fff700 1 --2- 172.21.15.32:0/799414363 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f18c406ace0 0x7f18c406d190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:31.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.487+0000 7f18e6fff700 1 --2- 172.21.15.32:0/799414363 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f18e0156be0 0x7f18e0070810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:31.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.487+0000 7f18e6fff700 1 --2- 172.21.15.32:0/799414363 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f18e00cb4f0 0x7f18e014ee80 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:31.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.487+0000 7f18e6fff700 1 --2- 172.21.15.32:0/799414363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f18e00cd600 0x7f18e0153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:31.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.487+0000 7f18e6fff700 1 -- 172.21.15.32:0/799414363 >> 172.21.15.32:0/799414363 conn(0x7f18e00b0390 msgr2=0x7f18e00ae5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:31.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.487+0000 7f18e6fff700 1 -- 172.21.15.32:0/799414363 shutdown_connections 2023-06-20T13:33:31.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.487+0000 7f18e6fff700 1 -- 172.21.15.32:0/799414363 wait complete. 2023-06-20T13:33:31.507 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-20T13:32:05.308022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-20T13:32:12.857161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-20T13:32:18.120021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-20T13:32:19.503624+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-20T13:32:23.074912+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-20T13:33:31.508 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-20T13:33:31.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.709+0000 7f4040fff700 1 Processor -- start 2023-06-20T13:33:31.711 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.709+0000 7f4040fff700 1 -- start start 2023-06-20T13:33:31.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.710+0000 7f4040fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f403c0cfc60 0x7f403c167010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:31.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.710+0000 7f4040fff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f403c0d0b20 con 0x7f403c0b8430 2023-06-20T13:33:31.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.710+0000 7f4040fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f403c0b4ee0 con 0x7f403c0d3730 2023-06-20T13:33:31.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.710+0000 7f4040fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f403c0cda30 con 0x7f403c0cfc60 2023-06-20T13:33:31.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.710+0000 7f403a59c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f403c0b8430 0x7f403c0cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43674/0 (socket says 172.21.15.32:43674) 2023-06-20T13:33:31.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.710+0000 7f403a59c700 1 -- 172.21.15.32:0/4292028245 learned_addr learned my addr 172.21.15.32:0/4292028245 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:31.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.711+0000 7f403ad9d700 1 --2- 172.21.15.32:0/4292028245 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f403c0cfc60 0x7f403c167010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:31.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.711+0000 7f4039d9b700 1 -- 172.21.15.32:0/4292028245 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958016545 0 0) 0x7f403c0d0b20 con 0x7f403c0b8430 2023-06-20T13:33:31.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.711+0000 7f4039d9b700 1 -- 172.21.15.32:0/4292028245 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40280035b0 con 0x7f403c0b8430 2023-06-20T13:33:31.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.711+0000 7f4039d9b700 1 -- 172.21.15.32:0/4292028245 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 975366675 0 0) 0x7f40280035b0 con 0x7f403c0b8430 2023-06-20T13:33:31.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.711+0000 7f4039d9b700 1 -- 172.21.15.32:0/4292028245 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f403c0cfc60 msgr2=0x7f403c167010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:31.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.711+0000 7f4039d9b700 1 --2- 172.21.15.32:0/4292028245 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f403c0cfc60 0x7f403c167010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:31.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.711+0000 7f4039d9b700 1 -- 172.21.15.32:0/4292028245 >> v1:172.21.15.115:6789/0 conn(0x7f403c0d3730 legacy=0x7f403c0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:31.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.711+0000 7f4039d9b700 1 -- 172.21.15.32:0/4292028245 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f403c0b51c0 con 0x7f403c0b8430 2023-06-20T13:33:31.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.711+0000 7f4039d9b700 1 -- 172.21.15.32:0/4292028245 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3380058562 0 0) 0x7f402c001670 con 0x7f403c0b8430 2023-06-20T13:33:31.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.711+0000 7f4039d9b700 1 -- 172.21.15.32:0/4292028245 >> v1:172.21.15.32:6789/0 conn(0x7f403c0b8430 legacy=0x7f403c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:31.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.711+0000 7f4039d9b700 1 --2- 172.21.15.32:0/4292028245 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f403c0cfc60 0x7f4028003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:31.716 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.711+0000 7f4039d9b700 1 --2- 172.21.15.32:0/4292028245 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4028003fb0 0x7f4028004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:31.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.711+0000 7f4039d9b700 1 --2- 172.21.15.32:0/4292028245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4028004d90 0x7f4028005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:31.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.711+0000 7f4039d9b700 1 -- 172.21.15.32:0/4292028245 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402800bac0 con 0x7f4028003fb0 2023-06-20T13:33:31.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.711+0000 7f4039d9b700 1 -- 172.21.15.32:0/4292028245 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402800bc30 con 0x7f4028004d90 2023-06-20T13:33:31.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.711+0000 7f4039d9b700 1 -- 172.21.15.32:0/4292028245 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402800bdf0 con 0x7f403c0cfc60 2023-06-20T13:33:31.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.712+0000 7f4033fff700 1 --2- 172.21.15.32:0/4292028245 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4028003fb0 0x7f4028004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:31.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.712+0000 7f403a59c700 1 --2- 172.21.15.32:0/4292028245 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f403c0cfc60 0x7f4028003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:31.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.712+0000 7f403ad9d700 1 --2- 172.21.15.32:0/4292028245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4028004d90 0x7f4028005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:31.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.712+0000 7f4033fff700 1 -- 172.21.15.32:0/4292028245 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f403c0cfc60 msgr2=0x7f4028003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:31.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.712+0000 7f4033fff700 1 --2- 172.21.15.32:0/4292028245 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f403c0cfc60 0x7f4028003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:31.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.712+0000 7f4033fff700 1 -- 172.21.15.32:0/4292028245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4028004d90 msgr2=0x7f4028005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:31.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.712+0000 7f4033fff700 1 --2- 172.21.15.32:0/4292028245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4028004d90 0x7f4028005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:31.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.712+0000 7f4033fff700 1 -- 172.21.15.32:0/4292028245 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40280035b0 con 0x7f4028003fb0 2023-06-20T13:33:31.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.712+0000 7f4033fff700 1 --2- 172.21.15.32:0/4292028245 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4028003fb0 0x7f4028004850 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4024007fd0 tx=0x7f4028005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2adae9f068fe6047 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:31.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.713+0000 7f4039d9b700 1 -- 172.21.15.32:0/4292028245 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40240052d0 con 0x7f4028003fb0 2023-06-20T13:33:31.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.713+0000 7f4039d9b700 1 -- 172.21.15.32:0/4292028245 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4024005470 con 0x7f4028003fb0 2023-06-20T13:33:31.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.713+0000 7f4039d9b700 1 -- 172.21.15.32:0/4292028245 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40240038c0 con 0x7f4028003fb0 2023-06-20T13:33:31.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.713+0000 7f4040fff700 1 -- 172.21.15.32:0/4292028245 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4028003fb0 msgr2=0x7f4028004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:31.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.713+0000 7f4040fff700 1 --2- 172.21.15.32:0/4292028245 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4028003fb0 0x7f4028004850 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4024007fd0 tx=0x7f4028005880 comp rx=0 tx=0).stop 2023-06-20T13:33:31.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.713+0000 7f403ad9d700 1 -- 172.21.15.32:0/4292028245 reap_dead start 2023-06-20T13:33:31.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.713+0000 7f4040fff700 1 -- 172.21.15.32:0/4292028245 shutdown_connections 2023-06-20T13:33:31.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.713+0000 7f4040fff700 1 -- 172.21.15.32:0/4292028245 >> 172.21.15.32:0/4292028245 conn(0x7f403c06b3f0 msgr2=0x7f403c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:31.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.713+0000 7f4040fff700 1 -- 172.21.15.32:0/4292028245 shutdown_connections 2023-06-20T13:33:31.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.713+0000 7f4040fff700 1 -- 172.21.15.32:0/4292028245 wait complete. 2023-06-20T13:33:31.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.715+0000 7f4040fff700 1 Processor -- start 2023-06-20T13:33:31.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.715+0000 7f4040fff700 1 -- start start 2023-06-20T13:33:31.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.716+0000 7f4040fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4028003fb0 0x7f403c1f1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:31.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.716+0000 7f4040fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f403c0cac60 0x7f403c0cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:31.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.716+0000 7f4040fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f403c0cb610 0x7f403c1f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:31.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.716+0000 7f4040fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403c0cba80 con 0x7f4028003fb0 2023-06-20T13:33:31.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.716+0000 7f4040fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403c15ca50 con 0x7f403c0cb610 2023-06-20T13:33:31.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.716+0000 7f4040fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f403c0cca60 con 0x7f403c0cac60 2023-06-20T13:33:31.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.716+0000 7f403a59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4028003fb0 0x7f403c1f1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:31.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.716+0000 7f403a59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4028003fb0 0x7f403c1f1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34924/0 (socket says 172.21.15.32:34924) 2023-06-20T13:33:31.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.716+0000 7f403a59c700 1 -- 172.21.15.32:0/1383346171 learned_addr learned my addr 172.21.15.32:0/1383346171 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:31.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.717+0000 7f403ad9d700 1 --2- 172.21.15.32:0/1383346171 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f403c0cb610 0x7f403c1f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:31.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.717+0000 7f4033fff700 1 --2- 172.21.15.32:0/1383346171 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f403c0cac60 0x7f403c0cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:31.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.717+0000 7f403a59c700 1 -- 172.21.15.32:0/1383346171 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f403c0cac60 msgr2=0x7f403c0cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:31.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.717+0000 7f403a59c700 1 --2- 172.21.15.32:0/1383346171 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f403c0cac60 0x7f403c0cb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:31.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.717+0000 7f403a59c700 1 -- 172.21.15.32:0/1383346171 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f403c0cb610 msgr2=0x7f403c1f5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:31.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.717+0000 7f403a59c700 1 --2- 172.21.15.32:0/1383346171 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f403c0cb610 0x7f403c1f5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:31.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.717+0000 7f403a59c700 1 -- 172.21.15.32:0/1383346171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f403c15ccf0 con 0x7f4028003fb0 2023-06-20T13:33:31.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.717+0000 7f403a59c700 1 --2- 172.21.15.32:0/1383346171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4028003fb0 0x7f403c1f1290 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f402c007290 tx=0x7f402c0075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:31.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.717+0000 7f4032ffd700 1 -- 172.21.15.32:0/1383346171 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c00f660 con 0x7f4028003fb0 2023-06-20T13:33:31.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.717+0000 7f4032ffd700 1 -- 172.21.15.32:0/1383346171 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402c00f7c0 con 0x7f4028003fb0 2023-06-20T13:33:31.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.717+0000 7f4040fff700 1 -- 172.21.15.32:0/1383346171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f403c15cfd0 con 0x7f4028003fb0 2023-06-20T13:33:31.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.717+0000 7f4032ffd700 1 -- 172.21.15.32:0/1383346171 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c00fb70 con 0x7f4028003fb0 2023-06-20T13:33:31.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.717+0000 7f4040fff700 1 -- 172.21.15.32:0/1383346171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f403c0cc680 con 0x7f4028003fb0 2023-06-20T13:33:31.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.718+0000 7f4040fff700 1 -- 172.21.15.32:0/1383346171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f403c15d4f0 con 0x7f4028003fb0 2023-06-20T13:33:31.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.719+0000 7f4032ffd700 1 -- 172.21.15.32:0/1383346171 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f402c00fcd0 con 0x7f4028003fb0 2023-06-20T13:33:31.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.720+0000 7f4032ffd700 1 --2- 172.21.15.32:0/1383346171 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f401c06ace0 0x7f401c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:31.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.720+0000 7f4032ffd700 1 -- 172.21.15.32:0/1383346171 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f402c0897d0 con 0x7f4028003fb0 2023-06-20T13:33:31.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.720+0000 7f4033fff700 1 --2- 172.21.15.32:0/1383346171 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f401c06ace0 0x7f401c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:31.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.721+0000 7f4033fff700 1 --2- 172.21.15.32:0/1383346171 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f401c06ace0 0x7f401c06d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4024007fd0 tx=0x7f4024009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:31.727 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.725+0000 7f4032ffd700 1 -- 172.21.15.32:0/1383346171 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f403c15d4f0 con 0x7f4028003fb0 2023-06-20T13:33:31.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.930+0000 7f4040fff700 1 -- 172.21.15.32:0/1383346171 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f403c15d4f0 con 0x7f4028003fb0 2023-06-20T13:33:31.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.930+0000 7f4032ffd700 1 -- 172.21.15.32:0/1383346171 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f403c15d4f0 con 0x7f4028003fb0 2023-06-20T13:33:31.933 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-06-20T13:33:31.935 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.933+0000 7f4040fff700 1 -- 172.21.15.32:0/1383346171 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f401c06ace0 msgr2=0x7f401c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:31.935 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.933+0000 7f4040fff700 1 --2- 172.21.15.32:0/1383346171 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f401c06ace0 0x7f401c06d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4024007fd0 tx=0x7f4024009030 comp rx=0 tx=0).stop 2023-06-20T13:33:31.935 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.933+0000 7f4040fff700 1 -- 172.21.15.32:0/1383346171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4028003fb0 msgr2=0x7f403c1f1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:31.935 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.933+0000 7f4040fff700 1 --2- 172.21.15.32:0/1383346171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4028003fb0 0x7f403c1f1290 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f402c007290 tx=0x7f402c0075a0 comp rx=0 tx=0).stop 2023-06-20T13:33:31.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.933+0000 7f4040fff700 1 -- 172.21.15.32:0/1383346171 shutdown_connections 2023-06-20T13:33:31.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.933+0000 7f4040fff700 1 --2- 172.21.15.32:0/1383346171 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f401c06ace0 0x7f401c06d190 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:31.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.933+0000 7f4040fff700 1 --2- 172.21.15.32:0/1383346171 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f403c0cb610 0x7f403c1f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:31.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.933+0000 7f4040fff700 1 --2- 172.21.15.32:0/1383346171 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4028003fb0 0x7f403c1f1290 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:31.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.933+0000 7f4040fff700 1 --2- 172.21.15.32:0/1383346171 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f403c0cac60 0x7f403c0cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:31.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.933+0000 7f4040fff700 1 -- 172.21.15.32:0/1383346171 >> 172.21.15.32:0/1383346171 conn(0x7f403c06b3f0 msgr2=0x7f403c0cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:31.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.933+0000 7f4040fff700 1 -- 172.21.15.32:0/1383346171 shutdown_connections 2023-06-20T13:33:31.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:31.933+0000 7f4040fff700 1 -- 172.21.15.32:0/1383346171 wait complete. 2023-06-20T13:33:31.953 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-20T13:33:32.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.156+0000 7f1044bff700 1 Processor -- start 2023-06-20T13:33:32.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.156+0000 7f1044bff700 1 -- start start 2023-06-20T13:33:32.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.157+0000 7f1044bff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f10400b8430 0x7f10400cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:32.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.157+0000 7f1044bff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10400d3730 0x7f10400cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:32.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.158+0000 7f1044bff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10400d0b20 con 0x7f10400cfa90 2023-06-20T13:33:32.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.158+0000 7f1044bff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10400b8800 con 0x7f10400b8430 2023-06-20T13:33:32.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.158+0000 7f1044bff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10400cfeb0 con 0x7f10400d3730 2023-06-20T13:33:32.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.158+0000 7f103e59c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f10400b8430 0x7f10400cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:32.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.158+0000 7f103e59c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f10400b8430 0x7f10400cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34936/0 (socket says 172.21.15.32:34936) 2023-06-20T13:33:32.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.158+0000 7f103e59c700 1 -- 172.21.15.32:0/2212935169 learned_addr learned my addr 172.21.15.32:0/2212935169 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:32.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.158+0000 7f1037fff700 1 --2- 172.21.15.32:0/2212935169 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10400d3730 0x7f10400cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:32.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.158+0000 7f103e59c700 1 -- 172.21.15.32:0/2212935169 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10400d3730 msgr2=0x7f10400cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:32.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.158+0000 7f103e59c700 1 --2- 172.21.15.32:0/2212935169 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10400d3730 0x7f10400cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:32.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.158+0000 7f103e59c700 1 -- 172.21.15.32:0/2212935169 >> v1:172.21.15.32:6789/0 conn(0x7f10400cfa90 legacy=0x7f104015feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:32.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.158+0000 7f103e59c700 1 -- 172.21.15.32:0/2212935169 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10400b4ee0 con 0x7f10400b8430 2023-06-20T13:33:32.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.158+0000 7f103dd9b700 1 -- 172.21.15.32:0/2212935169 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511575581 0 0) 0x7f10400d0b20 con 0x7f10400cfa90 2023-06-20T13:33:32.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.159+0000 7f103e59c700 1 --2- 172.21.15.32:0/2212935169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10400b8430 0x7f10400cd320 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f10300098f0 tx=0x7f1030009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e17f169f3a4d82 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:32.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.159+0000 7f103dd9b700 1 -- 172.21.15.32:0/2212935169 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1030011830 con 0x7f10400b8430 2023-06-20T13:33:32.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.159+0000 7f103dd9b700 1 -- 172.21.15.32:0/2212935169 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1030011990 con 0x7f10400b8430 2023-06-20T13:33:32.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.159+0000 7f103dd9b700 1 -- 172.21.15.32:0/2212935169 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1030011d20 con 0x7f10400b8430 2023-06-20T13:33:32.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.160+0000 7f1044bff700 1 -- 172.21.15.32:0/2212935169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10400b8430 msgr2=0x7f10400cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:32.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.160+0000 7f1044bff700 1 --2- 172.21.15.32:0/2212935169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10400b8430 0x7f10400cd320 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f10300098f0 tx=0x7f1030009c00 comp rx=0 tx=0).stop 2023-06-20T13:33:32.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.160+0000 7f1044bff700 1 -- 172.21.15.32:0/2212935169 shutdown_connections 2023-06-20T13:33:32.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.160+0000 7f1044bff700 1 --2- 172.21.15.32:0/2212935169 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10400b8430 0x7f10400cd320 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:32.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.160+0000 7f1044bff700 1 --2- 172.21.15.32:0/2212935169 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10400d3730 0x7f10400cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:32.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.160+0000 7f1044bff700 1 -- 172.21.15.32:0/2212935169 >> 172.21.15.32:0/2212935169 conn(0x7f104006b3f0 msgr2=0x7f104006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:32.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.160+0000 7f1044bff700 1 -- 172.21.15.32:0/2212935169 shutdown_connections 2023-06-20T13:33:32.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.160+0000 7f1044bff700 1 -- 172.21.15.32:0/2212935169 wait complete. 2023-06-20T13:33:32.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.162+0000 7f1044bff700 1 Processor -- start 2023-06-20T13:33:32.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.162+0000 7f1044bff700 1 -- start start 2023-06-20T13:33:32.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.163+0000 7f1044bff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10400b8430 0x7f104014aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:32.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.163+0000 7f1044bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10400cfa90 0x7f10400cac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:32.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.163+0000 7f1044bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10400d3730 0x7f10400b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:32.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.163+0000 7f1044bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10400cbb90 con 0x7f10400cfa90 2023-06-20T13:33:32.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.163+0000 7f1044bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10400cb5d0 con 0x7f10400d3730 2023-06-20T13:33:32.167 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.163+0000 7f1044bff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10400cb8b0 con 0x7f10400b8430 2023-06-20T13:33:32.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.163+0000 7f1037fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10400cfa90 0x7f10400cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:32.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.163+0000 7f1037fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10400cfa90 0x7f10400cac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34938/0 (socket says 172.21.15.32:34938) 2023-06-20T13:33:32.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.163+0000 7f1037fff700 1 -- 172.21.15.32:0/3210117287 learned_addr learned my addr 172.21.15.32:0/3210117287 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:32.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.163+0000 7f103e59c700 1 --2- 172.21.15.32:0/3210117287 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10400b8430 0x7f104014aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:32.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.163+0000 7f103ed9d700 1 --2- 172.21.15.32:0/3210117287 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10400d3730 0x7f10400b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:32.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.164+0000 7f1037fff700 1 -- 172.21.15.32:0/3210117287 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10400b8430 msgr2=0x7f104014aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:32.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.164+0000 7f1037fff700 1 --2- 172.21.15.32:0/3210117287 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10400b8430 0x7f104014aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:32.168 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.164+0000 7f1037fff700 1 -- 172.21.15.32:0/3210117287 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10400d3730 msgr2=0x7f10400b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:32.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.164+0000 7f1037fff700 1 --2- 172.21.15.32:0/3210117287 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10400d3730 0x7f10400b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:32.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.164+0000 7f1037fff700 1 -- 172.21.15.32:0/3210117287 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1030009550 con 0x7f10400cfa90 2023-06-20T13:33:32.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.164+0000 7f1037fff700 1 --2- 172.21.15.32:0/3210117287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10400cfa90 0x7f10400cac60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f102800e9b0 tx=0x7f102800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:32.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.164+0000 7f1036ffd700 1 -- 172.21.15.32:0/3210117287 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1028009710 con 0x7f10400cfa90 2023-06-20T13:33:32.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.164+0000 7f1036ffd700 1 -- 172.21.15.32:0/3210117287 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102800c850 con 0x7f10400cfa90 2023-06-20T13:33:32.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.164+0000 7f1036ffd700 1 -- 172.21.15.32:0/3210117287 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102800cbc0 con 0x7f10400cfa90 2023-06-20T13:33:32.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.164+0000 7f1044bff700 1 -- 172.21.15.32:0/3210117287 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1040156c70 con 0x7f10400cfa90 2023-06-20T13:33:32.169 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.164+0000 7f1044bff700 1 -- 172.21.15.32:0/3210117287 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f104014b3f0 con 0x7f10400cfa90 2023-06-20T13:33:32.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.165+0000 7f1044bff700 1 -- 172.21.15.32:0/3210117287 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f104004ea60 con 0x7f10400cfa90 2023-06-20T13:33:32.170 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.166+0000 7f1036ffd700 1 -- 172.21.15.32:0/3210117287 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f102800cd20 con 0x7f10400cfa90 2023-06-20T13:33:32.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.167+0000 7f1036ffd700 1 --2- 172.21.15.32:0/3210117287 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f102006ace0 0x7f102006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:32.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.167+0000 7f1036ffd700 1 -- 172.21.15.32:0/3210117287 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f10280898e0 con 0x7f10400cfa90 2023-06-20T13:33:32.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.168+0000 7f103e59c700 1 --2- 172.21.15.32:0/3210117287 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f102006ace0 0x7f102006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:32.171 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.168+0000 7f103e59c700 1 --2- 172.21.15.32:0/3210117287 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f102006ace0 0x7f102006d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1030014040 tx=0x7f1030008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:32.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.172+0000 7f1036ffd700 1 -- 172.21.15.32:0/3210117287 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f10280545c0 con 0x7f10400cfa90 2023-06-20T13:33:32.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.381+0000 7f1044bff700 1 -- 172.21.15.32:0/3210117287 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f10400b7cf0 con 0x7f10400cfa90 2023-06-20T13:33:32.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.381+0000 7f1036ffd700 1 -- 172.21.15.32:0/3210117287 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1028057be0 con 0x7f10400cfa90 2023-06-20T13:33:32.384 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 8 2023-06-20T13:33:32.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.384+0000 7f1044bff700 1 -- 172.21.15.32:0/3210117287 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f102006ace0 msgr2=0x7f102006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:32.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.384+0000 7f1044bff700 1 --2- 172.21.15.32:0/3210117287 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f102006ace0 0x7f102006d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1030014040 tx=0x7f1030008030 comp rx=0 tx=0).stop 2023-06-20T13:33:32.386 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.384+0000 7f1044bff700 1 -- 172.21.15.32:0/3210117287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10400cfa90 msgr2=0x7f10400cac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:32.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.384+0000 7f1044bff700 1 --2- 172.21.15.32:0/3210117287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10400cfa90 0x7f10400cac60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f102800e9b0 tx=0x7f102800ecc0 comp rx=0 tx=0).stop 2023-06-20T13:33:32.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.384+0000 7f1044bff700 1 -- 172.21.15.32:0/3210117287 shutdown_connections 2023-06-20T13:33:32.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.384+0000 7f1044bff700 1 --2- 172.21.15.32:0/3210117287 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f102006ace0 0x7f102006d190 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:32.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.384+0000 7f1044bff700 1 --2- 172.21.15.32:0/3210117287 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10400d3730 0x7f10400b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:32.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.384+0000 7f1044bff700 1 --2- 172.21.15.32:0/3210117287 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10400b8430 0x7f104014aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:32.387 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.384+0000 7f1044bff700 1 --2- 172.21.15.32:0/3210117287 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10400cfa90 0x7f10400cac60 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:32.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.384+0000 7f1044bff700 1 -- 172.21.15.32:0/3210117287 >> 172.21.15.32:0/3210117287 conn(0x7f104006b3f0 msgr2=0x7f104015bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:32.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.384+0000 7f1044bff700 1 -- 172.21.15.32:0/3210117287 shutdown_connections 2023-06-20T13:33:32.388 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.384+0000 7f1044bff700 1 -- 172.21.15.32:0/3210117287 wait complete. 2023-06-20T13:33:32.405 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-20T13:33:32.608 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.606+0000 7fbe451ff700 1 Processor -- start 2023-06-20T13:33:32.608 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.606+0000 7fbe451ff700 1 -- start start 2023-06-20T13:33:32.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.607+0000 7fbe451ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbe400b8430 0x7fbe400cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:32.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.607+0000 7fbe451ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe400d3730 0x7fbe400cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:32.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.607+0000 7fbe451ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe400d0b20 con 0x7fbe400cfa90 2023-06-20T13:33:32.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.607+0000 7fbe451ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe400b8800 con 0x7fbe400b8430 2023-06-20T13:33:32.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.607+0000 7fbe451ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe400cfeb0 con 0x7fbe400d3730 2023-06-20T13:33:32.612 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.607+0000 7fbe3ed9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbe400b8430 0x7fbe400cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:32.612 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.607+0000 7fbe3ed9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fbe400b8430 0x7fbe400cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34954/0 (socket says 172.21.15.32:34954) 2023-06-20T13:33:32.612 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.608+0000 7fbe3ed9d700 1 -- 172.21.15.32:0/3878356668 learned_addr learned my addr 172.21.15.32:0/3878356668 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:32.612 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.608+0000 7fbe3e59c700 1 --2- 172.21.15.32:0/3878356668 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe400d3730 0x7fbe400cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:32.612 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.608+0000 7fbe3ed9d700 1 -- 172.21.15.32:0/3878356668 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe400d3730 msgr2=0x7fbe400cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:32.612 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.608+0000 7fbe3ed9d700 1 --2- 172.21.15.32:0/3878356668 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe400d3730 0x7fbe400cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:32.613 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.608+0000 7fbe3ed9d700 1 -- 172.21.15.32:0/3878356668 >> v1:172.21.15.32:6789/0 conn(0x7fbe400cfa90 legacy=0x7fbe4015feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:32.613 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.608+0000 7fbe3ed9d700 1 -- 172.21.15.32:0/3878356668 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe400b4ee0 con 0x7fbe400b8430 2023-06-20T13:33:32.613 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.608+0000 7fbe3dd9b700 1 -- 172.21.15.32:0/3878356668 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878874312 0 0) 0x7fbe400d0b20 con 0x7fbe400cfa90 2023-06-20T13:33:32.613 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.608+0000 7fbe3e59c700 1 --2- 172.21.15.32:0/3878356668 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe400d3730 0x7fbe400cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:32.613 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.608+0000 7fbe3ed9d700 1 --2- 172.21.15.32:0/3878356668 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe400b8430 0x7fbe400cd320 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbe300098f0 tx=0x7fbe30009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd41bf89fa142ac server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:32.613 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.609+0000 7fbe3dd9b700 1 -- 172.21.15.32:0/3878356668 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3000b8a0 con 0x7fbe400b8430 2023-06-20T13:33:32.613 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.609+0000 7fbe3dd9b700 1 -- 172.21.15.32:0/3878356668 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3000ba00 con 0x7fbe400b8430 2023-06-20T13:33:32.613 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.609+0000 7fbe3dd9b700 1 -- 172.21.15.32:0/3878356668 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3000bd90 con 0x7fbe400b8430 2023-06-20T13:33:32.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.609+0000 7fbe451ff700 1 -- 172.21.15.32:0/3878356668 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe400b8430 msgr2=0x7fbe400cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:32.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.609+0000 7fbe451ff700 1 --2- 172.21.15.32:0/3878356668 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe400b8430 0x7fbe400cd320 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbe300098f0 tx=0x7fbe30009c00 comp rx=0 tx=0).stop 2023-06-20T13:33:32.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.609+0000 7fbe451ff700 1 -- 172.21.15.32:0/3878356668 shutdown_connections 2023-06-20T13:33:32.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.609+0000 7fbe451ff700 1 --2- 172.21.15.32:0/3878356668 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe400b8430 0x7fbe400cd320 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:32.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.609+0000 7fbe451ff700 1 --2- 172.21.15.32:0/3878356668 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe400d3730 0x7fbe400cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:32.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.609+0000 7fbe451ff700 1 -- 172.21.15.32:0/3878356668 >> 172.21.15.32:0/3878356668 conn(0x7fbe4006b3f0 msgr2=0x7fbe4006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:32.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.609+0000 7fbe451ff700 1 -- 172.21.15.32:0/3878356668 shutdown_connections 2023-06-20T13:33:32.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.609+0000 7fbe451ff700 1 -- 172.21.15.32:0/3878356668 wait complete. 2023-06-20T13:33:32.616 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.611+0000 7fbe451ff700 1 Processor -- start 2023-06-20T13:33:32.616 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.611+0000 7fbe451ff700 1 -- start start 2023-06-20T13:33:32.616 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.612+0000 7fbe451ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe400b8430 0x7fbe400c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:32.617 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.612+0000 7fbe451ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe400cfa90 0x7fbe4015ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:32.617 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.612+0000 7fbe451ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe400d3730 0x7fbe4015ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:32.617 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.612+0000 7fbe451ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe400ccbb0 con 0x7fbe400b8430 2023-06-20T13:33:32.617 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.612+0000 7fbe451ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe400c7960 con 0x7fbe400cfa90 2023-06-20T13:33:32.617 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.612+0000 7fbe451ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe400c6d50 con 0x7fbe400d3730 2023-06-20T13:33:32.617 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.612+0000 7fbe3ed9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe400b8430 0x7fbe400c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:32.617 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.612+0000 7fbe3ed9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe400b8430 0x7fbe400c6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34958/0 (socket says 172.21.15.32:34958) 2023-06-20T13:33:32.618 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.612+0000 7fbe3ed9d700 1 -- 172.21.15.32:0/3578895183 learned_addr learned my addr 172.21.15.32:0/3578895183 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:32.618 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.613+0000 7fbe3ed9d700 1 -- 172.21.15.32:0/3578895183 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe400d3730 msgr2=0x7fbe4015ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:32.618 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.613+0000 7fbe3ed9d700 1 --2- 172.21.15.32:0/3578895183 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe400d3730 0x7fbe4015ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:32.618 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.613+0000 7fbe3ed9d700 1 -- 172.21.15.32:0/3578895183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe400cfa90 msgr2=0x7fbe4015ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:32.618 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.613+0000 7fbe3ed9d700 1 --2- 172.21.15.32:0/3578895183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe400cfa90 0x7fbe4015ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:32.618 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.613+0000 7fbe3ed9d700 1 -- 172.21.15.32:0/3578895183 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe30009550 con 0x7fbe400b8430 2023-06-20T13:33:32.619 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.613+0000 7fbe3ed9d700 1 --2- 172.21.15.32:0/3578895183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe400b8430 0x7fbe400c6670 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbe30009c40 tx=0x7fbe30004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:32.619 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.613+0000 7fbe277fe700 1 -- 172.21.15.32:0/3578895183 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe300036a0 con 0x7fbe400b8430 2023-06-20T13:33:32.619 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.613+0000 7fbe277fe700 1 -- 172.21.15.32:0/3578895183 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3001e070 con 0x7fbe400b8430 2023-06-20T13:33:32.619 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.613+0000 7fbe277fe700 1 -- 172.21.15.32:0/3578895183 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe30003a20 con 0x7fbe400b8430 2023-06-20T13:33:32.619 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.613+0000 7fbe451ff700 1 -- 172.21.15.32:0/3578895183 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe400c7030 con 0x7fbe400b8430 2023-06-20T13:33:32.619 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.613+0000 7fbe451ff700 1 -- 172.21.15.32:0/3578895183 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe400c75f0 con 0x7fbe400b8430 2023-06-20T13:33:32.620 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.614+0000 7fbe451ff700 1 -- 172.21.15.32:0/3578895183 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe400c7b30 con 0x7fbe400b8430 2023-06-20T13:33:32.620 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.615+0000 7fbe277fe700 1 -- 172.21.15.32:0/3578895183 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbe30003b80 con 0x7fbe400b8430 2023-06-20T13:33:32.621 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.617+0000 7fbe277fe700 1 --2- 172.21.15.32:0/3578895183 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fbe2c06ace0 0x7fbe2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:32.621 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.617+0000 7fbe277fe700 1 -- 172.21.15.32:0/3578895183 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbe30020070 con 0x7fbe400b8430 2023-06-20T13:33:32.621 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.617+0000 7fbe3e59c700 1 --2- 172.21.15.32:0/3578895183 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fbe2c06ace0 0x7fbe2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:32.621 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.618+0000 7fbe3e59c700 1 --2- 172.21.15.32:0/3578895183 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fbe2c06ace0 0x7fbe2c06d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbe400b1d20 tx=0x7fbe34008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:32.623 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.621+0000 7fbe277fe700 1 -- 172.21.15.32:0/3578895183 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbe400c7b30 con 0x7fbe400b8430 2023-06-20T13:33:32.828 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.825+0000 7fbe451ff700 1 -- 172.21.15.32:0/3578895183 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbe400c7b30 con 0x7fbe400b8430 2023-06-20T13:33:32.828 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.826+0000 7fbe277fe700 1 -- 172.21.15.32:0/3578895183 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbe3002a020 con 0x7fbe400b8430 2023-06-20T13:33:32.829 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-06-20T13:33:32.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.828+0000 7fbe451ff700 1 -- 172.21.15.32:0/3578895183 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fbe2c06ace0 msgr2=0x7fbe2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:32.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.828+0000 7fbe451ff700 1 --2- 172.21.15.32:0/3578895183 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fbe2c06ace0 0x7fbe2c06d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbe400b1d20 tx=0x7fbe34008040 comp rx=0 tx=0).stop 2023-06-20T13:33:32.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.828+0000 7fbe451ff700 1 -- 172.21.15.32:0/3578895183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe400b8430 msgr2=0x7fbe400c6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:32.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.828+0000 7fbe451ff700 1 --2- 172.21.15.32:0/3578895183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe400b8430 0x7fbe400c6670 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbe30009c40 tx=0x7fbe30004750 comp rx=0 tx=0).stop 2023-06-20T13:33:32.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.828+0000 7fbe451ff700 1 -- 172.21.15.32:0/3578895183 shutdown_connections 2023-06-20T13:33:32.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.828+0000 7fbe451ff700 1 --2- 172.21.15.32:0/3578895183 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fbe2c06ace0 0x7fbe2c06d190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:32.832 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.828+0000 7fbe451ff700 1 --2- 172.21.15.32:0/3578895183 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbe400d3730 0x7fbe4015ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:32.832 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.828+0000 7fbe451ff700 1 --2- 172.21.15.32:0/3578895183 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fbe400b8430 0x7fbe400c6670 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:32.832 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.828+0000 7fbe451ff700 1 --2- 172.21.15.32:0/3578895183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe400cfa90 0x7fbe4015ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:32.832 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.828+0000 7fbe451ff700 1 -- 172.21.15.32:0/3578895183 >> 172.21.15.32:0/3578895183 conn(0x7fbe4006b3f0 msgr2=0x7fbe4015bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:32.832 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.829+0000 7fbe451ff700 1 -- 172.21.15.32:0/3578895183 shutdown_connections 2023-06-20T13:33:32.832 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:32.829+0000 7fbe451ff700 1 -- 172.21.15.32:0/3578895183 wait complete. 2023-06-20T13:33:32.849 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-20T13:33:33.056 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.054+0000 7f4d2adff700 1 Processor -- start 2023-06-20T13:33:33.057 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.054+0000 7f4d2adff700 1 -- start start 2023-06-20T13:33:33.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.055+0000 7f4d2adff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4d240b8430 0x7f4d240cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:33.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.055+0000 7f4d2adff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d240d3730 0x7f4d240cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:33.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.055+0000 7f4d2adff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4d240cfa90 0x7f4d2415feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:33.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.055+0000 7f4d2adff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d240b8800 con 0x7f4d240b8430 2023-06-20T13:33:33.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.055+0000 7f4d2adff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d240d0b20 con 0x7f4d240cfa90 2023-06-20T13:33:33.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.055+0000 7f4d2adff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d240cfeb0 con 0x7f4d240d3730 2023-06-20T13:33:33.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.056+0000 7f4d28b9b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4d240b8430 0x7f4d240cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:33.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.056+0000 7f4d28b9b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4d240b8430 0x7f4d240cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34960/0 (socket says 172.21.15.32:34960) 2023-06-20T13:33:33.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.056+0000 7f4d28b9b700 1 -- 172.21.15.32:0/990031958 learned_addr learned my addr 172.21.15.32:0/990031958 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:33.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.056+0000 7f4d23fff700 1 --2- 172.21.15.32:0/990031958 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d240d3730 0x7f4d240cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:33.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.056+0000 7f4d2939c700 1 --2- 172.21.15.32:0/990031958 >> v2:172.21.15.115:3300/0 conn(0x7f4d240cfa90 0x7f4d2415feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:33.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.056+0000 7f4d28b9b700 1 -- 172.21.15.32:0/990031958 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d240d3730 msgr2=0x7f4d240cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:33.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.056+0000 7f4d28b9b700 1 --2- 172.21.15.32:0/990031958 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d240d3730 0x7f4d240cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:33.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.056+0000 7f4d28b9b700 1 -- 172.21.15.32:0/990031958 >> v2:172.21.15.115:3300/0 conn(0x7f4d240cfa90 msgr2=0x7f4d2415feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:33.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.056+0000 7f4d28b9b700 1 --2- 172.21.15.32:0/990031958 >> v2:172.21.15.115:3300/0 conn(0x7f4d240cfa90 0x7f4d2415feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:33.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.056+0000 7f4d28b9b700 1 -- 172.21.15.32:0/990031958 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d240b4ee0 con 0x7f4d240b8430 2023-06-20T13:33:33.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.056+0000 7f4d28b9b700 1 --2- 172.21.15.32:0/990031958 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d240b8430 0x7f4d240cd320 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4d2406c570 tx=0x7f4d18009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1365ffb4cd55dedf server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:33.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.057+0000 7f4d237fe700 1 -- 172.21.15.32:0/990031958 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1800b870 con 0x7f4d240b8430 2023-06-20T13:33:33.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.057+0000 7f4d237fe700 1 -- 172.21.15.32:0/990031958 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1800b9d0 con 0x7f4d240b8430 2023-06-20T13:33:33.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.057+0000 7f4d237fe700 1 -- 172.21.15.32:0/990031958 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1800bd60 con 0x7f4d240b8430 2023-06-20T13:33:33.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.057+0000 7f4d2adff700 1 -- 172.21.15.32:0/990031958 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d240b8430 msgr2=0x7f4d240cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:33.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.057+0000 7f4d2adff700 1 --2- 172.21.15.32:0/990031958 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d240b8430 0x7f4d240cd320 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4d2406c570 tx=0x7f4d18009bd0 comp rx=0 tx=0).stop 2023-06-20T13:33:33.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.057+0000 7f4d2adff700 1 -- 172.21.15.32:0/990031958 shutdown_connections 2023-06-20T13:33:33.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.057+0000 7f4d2adff700 1 --2- 172.21.15.32:0/990031958 >> v2:172.21.15.115:3300/0 conn(0x7f4d240cfa90 0x7f4d2415feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:33.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.057+0000 7f4d2adff700 1 --2- 172.21.15.32:0/990031958 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d240b8430 0x7f4d240cd320 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:33.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.057+0000 7f4d2adff700 1 --2- 172.21.15.32:0/990031958 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d240d3730 0x7f4d240cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:33.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.057+0000 7f4d2adff700 1 -- 172.21.15.32:0/990031958 >> 172.21.15.32:0/990031958 conn(0x7f4d2406b3f0 msgr2=0x7f4d2406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:33.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.057+0000 7f4d2adff700 1 -- 172.21.15.32:0/990031958 shutdown_connections 2023-06-20T13:33:33.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.057+0000 7f4d2adff700 1 -- 172.21.15.32:0/990031958 wait complete. 2023-06-20T13:33:33.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.059+0000 7f4d2adff700 1 Processor -- start 2023-06-20T13:33:33.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.059+0000 7f4d2adff700 1 -- start start 2023-06-20T13:33:33.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.060+0000 7f4d2adff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d240b8430 0x7f4d241498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:33.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.060+0000 7f4d2adff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d240cfa90 0x7f4d2415d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:33.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.060+0000 7f4d2adff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d240d3730 0x7f4d2415eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:33.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.060+0000 7f4d2adff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d241f2c60 con 0x7f4d240b8430 2023-06-20T13:33:33.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.060+0000 7f4d2adff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d241f1d20 con 0x7f4d240cfa90 2023-06-20T13:33:33.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.060+0000 7f4d2adff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d241f1fe0 con 0x7f4d240d3730 2023-06-20T13:33:33.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.060+0000 7f4d28b9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d240b8430 0x7f4d241498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:33.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.060+0000 7f4d28b9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d240b8430 0x7f4d241498d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34974/0 (socket says 172.21.15.32:34974) 2023-06-20T13:33:33.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.060+0000 7f4d28b9b700 1 -- 172.21.15.32:0/3881623313 learned_addr learned my addr 172.21.15.32:0/3881623313 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:33.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.060+0000 7f4d23fff700 1 --2- 172.21.15.32:0/3881623313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d240cfa90 0x7f4d2415d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:33.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.061+0000 7f4d2939c700 1 --2- 172.21.15.32:0/3881623313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d240d3730 0x7f4d2415eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:33.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.061+0000 7f4d28b9b700 1 -- 172.21.15.32:0/3881623313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d240d3730 msgr2=0x7f4d2415eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:33.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.061+0000 7f4d28b9b700 1 --2- 172.21.15.32:0/3881623313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d240d3730 0x7f4d2415eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:33.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.061+0000 7f4d28b9b700 1 -- 172.21.15.32:0/3881623313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d240cfa90 msgr2=0x7f4d2415d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:33.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.061+0000 7f4d28b9b700 1 --2- 172.21.15.32:0/3881623313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d240cfa90 0x7f4d2415d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:33.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.061+0000 7f4d28b9b700 1 -- 172.21.15.32:0/3881623313 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d18009550 con 0x7f4d240b8430 2023-06-20T13:33:33.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.061+0000 7f4d2939c700 1 --2- 172.21.15.32:0/3881623313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d240d3730 0x7f4d2415eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:33.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.061+0000 7f4d23fff700 1 --2- 172.21.15.32:0/3881623313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d240cfa90 0x7f4d2415d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:33.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.061+0000 7f4d28b9b700 1 --2- 172.21.15.32:0/3881623313 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d240b8430 0x7f4d241498d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4d18000c00 tx=0x7f4d18004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:33.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.061+0000 7f4d217fa700 1 -- 172.21.15.32:0/3881623313 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d18004520 con 0x7f4d240b8430 2023-06-20T13:33:33.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.061+0000 7f4d217fa700 1 -- 172.21.15.32:0/3881623313 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1801e070 con 0x7f4d240b8430 2023-06-20T13:33:33.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.061+0000 7f4d217fa700 1 -- 172.21.15.32:0/3881623313 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d180038c0 con 0x7f4d240b8430 2023-06-20T13:33:33.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.061+0000 7f4d2adff700 1 -- 172.21.15.32:0/3881623313 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d241f22c0 con 0x7f4d240b8430 2023-06-20T13:33:33.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.062+0000 7f4d2adff700 1 -- 172.21.15.32:0/3881623313 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d241f2880 con 0x7f4d240b8430 2023-06-20T13:33:33.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.063+0000 7f4d2adff700 1 -- 172.21.15.32:0/3881623313 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d2404ea60 con 0x7f4d240b8430 2023-06-20T13:33:33.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.063+0000 7f4d217fa700 1 -- 172.21.15.32:0/3881623313 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4d18003a20 con 0x7f4d240b8430 2023-06-20T13:33:33.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.064+0000 7f4d217fa700 1 --2- 172.21.15.32:0/3881623313 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4d0806ace0 0x7f4d0806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:33.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.065+0000 7f4d217fa700 1 -- 172.21.15.32:0/3881623313 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4d18020070 con 0x7f4d240b8430 2023-06-20T13:33:33.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.065+0000 7f4d23fff700 1 --2- 172.21.15.32:0/3881623313 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4d0806ace0 0x7f4d0806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:33.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.065+0000 7f4d23fff700 1 --2- 172.21.15.32:0/3881623313 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4d0806ace0 0x7f4d0806d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4d10009970 tx=0x7f4d10008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:33.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.069+0000 7f4d217fa700 1 -- 172.21.15.32:0/3881623313 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4d18055af0 con 0x7f4d240b8430 2023-06-20T13:33:33.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.275+0000 7f4d2adff700 1 -- 172.21.15.32:0/3881623313 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4d2415b5d0 con 0x7f4d240b8430 2023-06-20T13:33:33.278 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.276+0000 7f4d217fa700 1 -- 172.21.15.32:0/3881623313 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4d18059110 con 0x7f4d240b8430 2023-06-20T13:33:33.279 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-06-20T13:33:33.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.278+0000 7f4d2adff700 1 -- 172.21.15.32:0/3881623313 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4d0806ace0 msgr2=0x7f4d0806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:33.281 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.278+0000 7f4d2adff700 1 --2- 172.21.15.32:0/3881623313 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4d0806ace0 0x7f4d0806d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4d10009970 tx=0x7f4d10008040 comp rx=0 tx=0).stop 2023-06-20T13:33:33.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.278+0000 7f4d2adff700 1 -- 172.21.15.32:0/3881623313 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d240b8430 msgr2=0x7f4d241498d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:33.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.278+0000 7f4d2adff700 1 --2- 172.21.15.32:0/3881623313 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d240b8430 0x7f4d241498d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4d18000c00 tx=0x7f4d18004750 comp rx=0 tx=0).stop 2023-06-20T13:33:33.282 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.278+0000 7f4d2adff700 1 -- 172.21.15.32:0/3881623313 shutdown_connections 2023-06-20T13:33:33.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.278+0000 7f4d2adff700 1 --2- 172.21.15.32:0/3881623313 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4d0806ace0 0x7f4d0806d190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:33.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.278+0000 7f4d2adff700 1 --2- 172.21.15.32:0/3881623313 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4d240d3730 0x7f4d2415eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:33.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.278+0000 7f4d2adff700 1 --2- 172.21.15.32:0/3881623313 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4d240b8430 0x7f4d241498d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:33.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.278+0000 7f4d2adff700 1 --2- 172.21.15.32:0/3881623313 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4d240cfa90 0x7f4d2415d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:33.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.278+0000 7f4d2adff700 1 -- 172.21.15.32:0/3881623313 >> 172.21.15.32:0/3881623313 conn(0x7f4d2406b3f0 msgr2=0x7f4d240b62a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:33.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.278+0000 7f4d2adff700 1 -- 172.21.15.32:0/3881623313 shutdown_connections 2023-06-20T13:33:33.284 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.279+0000 7f4d2adff700 1 -- 172.21.15.32:0/3881623313 wait complete. 2023-06-20T13:33:33.299 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-20T13:33:33.502 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.500+0000 7ff90fdff700 1 Processor -- start 2023-06-20T13:33:33.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.500+0000 7ff90fdff700 1 -- start start 2023-06-20T13:33:33.503 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.501+0000 7ff90fdff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff9080d3730 0x7ff9080cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:33.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.501+0000 7ff90fdff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff9080cfa90 0x7ff9080d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:33.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.501+0000 7ff90fdff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9080d0b20 con 0x7ff9080b8430 2023-06-20T13:33:33.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.501+0000 7ff90fdff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9080cda30 con 0x7ff9080cfa90 2023-06-20T13:33:33.504 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.501+0000 7ff90fdff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9080b8800 con 0x7ff9080d3730 2023-06-20T13:33:33.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.502+0000 7ff90e39c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff9080cfa90 0x7ff9080d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:33.505 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.502+0000 7ff90e39c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff9080cfa90 0x7ff9080d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:34990/0 (socket says 172.21.15.32:34990) 2023-06-20T13:33:33.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.502+0000 7ff90e39c700 1 -- 172.21.15.32:0/2188623232 learned_addr learned my addr 172.21.15.32:0/2188623232 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:33.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.502+0000 7ff90d39a700 1 --2- 172.21.15.32:0/2188623232 >> v2:172.21.15.115:3300/0 conn(0x7ff9080d3730 0x7ff9080cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:33.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.502+0000 7ff90e39c700 1 -- 172.21.15.32:0/2188623232 >> v2:172.21.15.115:3300/0 conn(0x7ff9080d3730 msgr2=0x7ff9080cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:33.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.502+0000 7ff90e39c700 1 --2- 172.21.15.32:0/2188623232 >> v2:172.21.15.115:3300/0 conn(0x7ff9080d3730 0x7ff9080cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:33.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.502+0000 7ff90e39c700 1 -- 172.21.15.32:0/2188623232 >> v1:172.21.15.115:6789/0 conn(0x7ff9080b8430 legacy=0x7ff9080cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:33.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.502+0000 7ff90e39c700 1 -- 172.21.15.32:0/2188623232 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9080cfe90 con 0x7ff9080cfa90 2023-06-20T13:33:33.506 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.502+0000 7ff90e39c700 1 --2- 172.21.15.32:0/2188623232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9080cfa90 0x7ff9080d0fb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff908160f50 tx=0x7ff90000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea5e67760e57ec9 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:33.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.503+0000 7ff90cb99700 1 -- 172.21.15.32:0/2188623232 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90000e070 con 0x7ff9080cfa90 2023-06-20T13:33:33.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.503+0000 7ff90cb99700 1 -- 172.21.15.32:0/2188623232 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90000b9c0 con 0x7ff9080cfa90 2023-06-20T13:33:33.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.503+0000 7ff90cb99700 1 -- 172.21.15.32:0/2188623232 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90000bd70 con 0x7ff9080cfa90 2023-06-20T13:33:33.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.503+0000 7ff90fdff700 1 -- 172.21.15.32:0/2188623232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9080cfa90 msgr2=0x7ff9080d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:33.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.503+0000 7ff90fdff700 1 --2- 172.21.15.32:0/2188623232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9080cfa90 0x7ff9080d0fb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff908160f50 tx=0x7ff90000b330 comp rx=0 tx=0).stop 2023-06-20T13:33:33.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.503+0000 7ff90fdff700 1 -- 172.21.15.32:0/2188623232 shutdown_connections 2023-06-20T13:33:33.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.503+0000 7ff90fdff700 1 --2- 172.21.15.32:0/2188623232 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9080cfa90 0x7ff9080d0fb0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:33.507 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.503+0000 7ff90fdff700 1 --2- 172.21.15.32:0/2188623232 >> v2:172.21.15.115:3300/0 conn(0x7ff9080d3730 0x7ff9080cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:33.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.503+0000 7ff90fdff700 1 -- 172.21.15.32:0/2188623232 >> 172.21.15.32:0/2188623232 conn(0x7ff90806b3f0 msgr2=0x7ff90806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:33.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.503+0000 7ff90fdff700 1 -- 172.21.15.32:0/2188623232 shutdown_connections 2023-06-20T13:33:33.508 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.503+0000 7ff90fdff700 1 -- 172.21.15.32:0/2188623232 wait complete. 2023-06-20T13:33:33.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.505+0000 7ff90fdff700 1 Processor -- start 2023-06-20T13:33:33.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.505+0000 7ff90fdff700 1 -- start start 2023-06-20T13:33:33.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.506+0000 7ff90fdff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9080b8430 0x7ff90815b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:33.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.506+0000 7ff90fdff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9080cfa90 0x7ff9080c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:33.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.506+0000 7ff90fdff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9080d3730 0x7ff9080b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:33.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.506+0000 7ff90fdff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90815d390 con 0x7ff9080cfa90 2023-06-20T13:33:33.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.506+0000 7ff90fdff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90815b7c0 con 0x7ff9080b8430 2023-06-20T13:33:33.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.506+0000 7ff90fdff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9080c6fe0 con 0x7ff9080d3730 2023-06-20T13:33:33.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.506+0000 7ff90d39a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9080cfa90 0x7ff9080c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:33.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.506+0000 7ff90d39a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9080cfa90 0x7ff9080c6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35000/0 (socket says 172.21.15.32:35000) 2023-06-20T13:33:33.510 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.506+0000 7ff90d39a700 1 -- 172.21.15.32:0/2243723406 learned_addr learned my addr 172.21.15.32:0/2243723406 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:33.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.507+0000 7ff90db9b700 1 --2- 172.21.15.32:0/2243723406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9080b8430 0x7ff90815b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:33.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.507+0000 7ff90e39c700 1 --2- 172.21.15.32:0/2243723406 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9080d3730 0x7ff9080b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:33.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.507+0000 7ff90d39a700 1 -- 172.21.15.32:0/2243723406 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9080d3730 msgr2=0x7ff9080b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:33.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.507+0000 7ff90d39a700 1 --2- 172.21.15.32:0/2243723406 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9080d3730 0x7ff9080b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:33.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.507+0000 7ff90d39a700 1 -- 172.21.15.32:0/2243723406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9080b8430 msgr2=0x7ff90815b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:33.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.507+0000 7ff90d39a700 1 --2- 172.21.15.32:0/2243723406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9080b8430 0x7ff90815b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:33.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.507+0000 7ff90d39a700 1 -- 172.21.15.32:0/2243723406 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff900009b30 con 0x7ff9080cfa90 2023-06-20T13:33:33.511 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.507+0000 7ff90d39a700 1 --2- 172.21.15.32:0/2243723406 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9080cfa90 0x7ff9080c6670 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff8f800d830 tx=0x7ff8f800db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:33.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.507+0000 7ff8fe7fc700 1 -- 172.21.15.32:0/2243723406 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f80125f0 con 0x7ff9080cfa90 2023-06-20T13:33:33.512 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.508+0000 7ff8fe7fc700 1 -- 172.21.15.32:0/2243723406 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f8012750 con 0x7ff9080cfa90 2023-06-20T13:33:33.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.508+0000 7ff90fdff700 1 -- 172.21.15.32:0/2243723406 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff90815ca60 con 0x7ff9080cfa90 2023-06-20T13:33:33.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.508+0000 7ff8fe7fc700 1 -- 172.21.15.32:0/2243723406 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8012b00 con 0x7ff9080cfa90 2023-06-20T13:33:33.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.508+0000 7ff90fdff700 1 -- 172.21.15.32:0/2243723406 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff90815d020 con 0x7ff9080cfa90 2023-06-20T13:33:33.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.509+0000 7ff90fdff700 1 -- 172.21.15.32:0/2243723406 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff90804ea60 con 0x7ff9080cfa90 2023-06-20T13:33:33.513 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.510+0000 7ff8fe7fc700 1 -- 172.21.15.32:0/2243723406 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff8f8012c60 con 0x7ff9080cfa90 2023-06-20T13:33:33.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.511+0000 7ff8fe7fc700 1 --2- 172.21.15.32:0/2243723406 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff8ec06ace0 0x7ff8ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:33.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.511+0000 7ff8fe7fc700 1 -- 172.21.15.32:0/2243723406 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff8f8089820 con 0x7ff9080cfa90 2023-06-20T13:33:33.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.511+0000 7ff90db9b700 1 --2- 172.21.15.32:0/2243723406 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff8ec06ace0 0x7ff8ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:33.514 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.511+0000 7ff90db9b700 1 --2- 172.21.15.32:0/2243723406 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff8ec06ace0 0x7ff8ec06d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff904007fd0 tx=0x7ff904009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:33.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.515+0000 7ff8fe7fc700 1 -- 172.21.15.32:0/2243723406 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff8f8054640 con 0x7ff9080cfa90 2023-06-20T13:33:33.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.719+0000 7ff90fdff700 1 -- 172.21.15.32:0/2243723406 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff9080d1f20 con 0x7ff9080cfa90 2023-06-20T13:33:33.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.719+0000 7ff8fe7fc700 1 -- 172.21.15.32:0/2243723406 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff8f8057c60 con 0x7ff9080cfa90 2023-06-20T13:33:33.722 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-06-20T13:33:33.724 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.722+0000 7ff90fdff700 1 -- 172.21.15.32:0/2243723406 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff8ec06ace0 msgr2=0x7ff8ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:33.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.722+0000 7ff90fdff700 1 --2- 172.21.15.32:0/2243723406 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff8ec06ace0 0x7ff8ec06d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff904007fd0 tx=0x7ff904009040 comp rx=0 tx=0).stop 2023-06-20T13:33:33.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.722+0000 7ff90fdff700 1 -- 172.21.15.32:0/2243723406 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9080cfa90 msgr2=0x7ff9080c6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:33.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.722+0000 7ff90fdff700 1 --2- 172.21.15.32:0/2243723406 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9080cfa90 0x7ff9080c6670 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff8f800d830 tx=0x7ff8f800db40 comp rx=0 tx=0).stop 2023-06-20T13:33:33.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.722+0000 7ff90fdff700 1 -- 172.21.15.32:0/2243723406 shutdown_connections 2023-06-20T13:33:33.725 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.722+0000 7ff90fdff700 1 --2- 172.21.15.32:0/2243723406 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff8ec06ace0 0x7ff8ec06d190 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:33.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.722+0000 7ff90fdff700 1 --2- 172.21.15.32:0/2243723406 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9080d3730 0x7ff9080b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:33.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.722+0000 7ff90fdff700 1 --2- 172.21.15.32:0/2243723406 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9080b8430 0x7ff90815b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:33.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.722+0000 7ff90fdff700 1 --2- 172.21.15.32:0/2243723406 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff9080cfa90 0x7ff9080c6670 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:33.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.722+0000 7ff90fdff700 1 -- 172.21.15.32:0/2243723406 >> 172.21.15.32:0/2243723406 conn(0x7ff90806b3f0 msgr2=0x7ff9080b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:33.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.722+0000 7ff90fdff700 1 -- 172.21.15.32:0/2243723406 shutdown_connections 2023-06-20T13:33:33.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.722+0000 7ff90fdff700 1 -- 172.21.15.32:0/2243723406 wait complete. 2023-06-20T13:33:33.743 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-20T13:33:33.945 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.943+0000 7f10c11ff700 1 Processor -- start 2023-06-20T13:33:33.946 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.943+0000 7f10c11ff700 1 -- start start 2023-06-20T13:33:33.947 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.944+0000 7f10c11ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10bc071160 0x7f10bc06a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:33.947 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.944+0000 7f10c11ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10bc15e210 con 0x7f10bc070340 2023-06-20T13:33:33.947 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.944+0000 7f10c11ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10bc15dee0 con 0x7f10bc157f10 2023-06-20T13:33:33.947 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.944+0000 7f10c11ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc06d900 con 0x7f10bc071160 2023-06-20T13:33:33.947 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.945+0000 7f10ba59c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f10bc070340 0x7f10bc070a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43710/0 (socket says 172.21.15.32:43710) 2023-06-20T13:33:33.947 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.945+0000 7f10ba59c700 1 -- 172.21.15.32:0/423367858 learned_addr learned my addr 172.21.15.32:0/423367858 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:33.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.945+0000 7f10bb59e700 1 --2- 172.21.15.32:0/423367858 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10bc071160 0x7f10bc06a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:33.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.945+0000 7f10b9d9b700 1 -- 172.21.15.32:0/423367858 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3182168641 0 0) 0x7f10bc15e210 con 0x7f10bc070340 2023-06-20T13:33:33.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.945+0000 7f10b9d9b700 1 -- 172.21.15.32:0/423367858 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10a40035b0 con 0x7f10bc070340 2023-06-20T13:33:33.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.945+0000 7f10b9d9b700 1 -- 172.21.15.32:0/423367858 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2218068179 0 0) 0x7f10bc15dee0 con 0x7f10bc157f10 2023-06-20T13:33:33.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.945+0000 7f10b9d9b700 1 -- 172.21.15.32:0/423367858 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10bc15e210 con 0x7f10bc157f10 2023-06-20T13:33:33.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.945+0000 7f10bb59e700 1 -- 172.21.15.32:0/423367858 >> v1:172.21.15.115:6789/0 conn(0x7f10bc157f10 legacy=0x7f10bc15e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:33.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.945+0000 7f10bb59e700 1 -- 172.21.15.32:0/423367858 >> v1:172.21.15.32:6789/0 conn(0x7f10bc070340 legacy=0x7f10bc070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:33.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.945+0000 7f10bb59e700 1 -- 172.21.15.32:0/423367858 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10bc0c8f40 con 0x7f10bc071160 2023-06-20T13:33:33.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.946+0000 7f10bb59e700 1 --2- 172.21.15.32:0/423367858 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10bc071160 0x7f10bc06a940 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f10bc158320 tx=0x7f10b400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7819f506ffe52c76 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:33.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.946+0000 7f10b9d9b700 1 -- 172.21.15.32:0/423367858 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b4016070 con 0x7f10bc071160 2023-06-20T13:33:33.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.946+0000 7f10b9d9b700 1 -- 172.21.15.32:0/423367858 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b400bb20 con 0x7f10bc071160 2023-06-20T13:33:33.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.946+0000 7f10b9d9b700 1 -- 172.21.15.32:0/423367858 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b400e070 con 0x7f10bc071160 2023-06-20T13:33:33.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.946+0000 7f10c11ff700 1 -- 172.21.15.32:0/423367858 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10bc071160 msgr2=0x7f10bc06a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:33.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.946+0000 7f10c11ff700 1 --2- 172.21.15.32:0/423367858 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10bc071160 0x7f10bc06a940 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f10bc158320 tx=0x7f10b400b330 comp rx=0 tx=0).stop 2023-06-20T13:33:33.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.947+0000 7f10c11ff700 1 -- 172.21.15.32:0/423367858 shutdown_connections 2023-06-20T13:33:33.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.947+0000 7f10c11ff700 1 --2- 172.21.15.32:0/423367858 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10bc071160 0x7f10bc06a940 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:33.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.947+0000 7f10c11ff700 1 -- 172.21.15.32:0/423367858 >> 172.21.15.32:0/423367858 conn(0x7f10bc0b0390 msgr2=0x7f10bc0b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:33.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.947+0000 7f10c11ff700 1 -- 172.21.15.32:0/423367858 shutdown_connections 2023-06-20T13:33:33.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.947+0000 7f10c11ff700 1 -- 172.21.15.32:0/423367858 wait complete. 2023-06-20T13:33:33.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.948+0000 7f10c11ff700 1 Processor -- start 2023-06-20T13:33:33.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.949+0000 7f10c11ff700 1 -- start start 2023-06-20T13:33:33.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.949+0000 7f10c11ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10bc070340 0x7f10bc0b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:33.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.949+0000 7f10c11ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10bc071160 0x7f10bc151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:33.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.949+0000 7f10c11ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10bc157f10 0x7f10bc0ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:33.953 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.949+0000 7f10c11ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc15bb90 con 0x7f10bc070340 2023-06-20T13:33:33.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.949+0000 7f10c11ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc15be00 con 0x7f10bc157f10 2023-06-20T13:33:33.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.949+0000 7f10c11ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc15c0e0 con 0x7f10bc071160 2023-06-20T13:33:33.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.950+0000 7f10bad9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10bc070340 0x7f10bc0b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:33.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.950+0000 7f10bad9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10bc070340 0x7f10bc0b1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35006/0 (socket says 172.21.15.32:35006) 2023-06-20T13:33:33.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.950+0000 7f10bad9d700 1 -- 172.21.15.32:0/370734213 learned_addr learned my addr 172.21.15.32:0/370734213 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:33.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.950+0000 7f10ba59c700 1 --2- 172.21.15.32:0/370734213 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10bc071160 0x7f10bc151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:33.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.950+0000 7f10bb59e700 1 --2- 172.21.15.32:0/370734213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10bc157f10 0x7f10bc0ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:33.954 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.950+0000 7f10bad9d700 1 -- 172.21.15.32:0/370734213 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10bc071160 msgr2=0x7f10bc151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:33.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.950+0000 7f10bad9d700 1 --2- 172.21.15.32:0/370734213 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10bc071160 0x7f10bc151fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:33.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.950+0000 7f10bad9d700 1 -- 172.21.15.32:0/370734213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10bc157f10 msgr2=0x7f10bc0ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:33.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.950+0000 7f10bad9d700 1 --2- 172.21.15.32:0/370734213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10bc157f10 0x7f10bc0ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:33.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.950+0000 7f10bad9d700 1 -- 172.21.15.32:0/370734213 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b4009a70 con 0x7f10bc070340 2023-06-20T13:33:33.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.951+0000 7f10bad9d700 1 --2- 172.21.15.32:0/370734213 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10bc070340 0x7f10bc0b1690 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f10ac00c500 tx=0x7f10ac00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:33.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.951+0000 7f10a37fe700 1 -- 172.21.15.32:0/370734213 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac0052d0 con 0x7f10bc070340 2023-06-20T13:33:33.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.951+0000 7f10a37fe700 1 -- 172.21.15.32:0/370734213 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ac005450 con 0x7f10bc070340 2023-06-20T13:33:33.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.951+0000 7f10c11ff700 1 -- 172.21.15.32:0/370734213 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10bc15c3c0 con 0x7f10bc070340 2023-06-20T13:33:33.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.951+0000 7f10a37fe700 1 -- 172.21.15.32:0/370734213 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac0038c0 con 0x7f10bc070340 2023-06-20T13:33:33.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.951+0000 7f10c11ff700 1 -- 172.21.15.32:0/370734213 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10bc1524f0 con 0x7f10bc070340 2023-06-20T13:33:33.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.952+0000 7f10c11ff700 1 -- 172.21.15.32:0/370734213 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10bc04ea60 con 0x7f10bc070340 2023-06-20T13:33:33.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.953+0000 7f10a37fe700 1 -- 172.21.15.32:0/370734213 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f10ac003a20 con 0x7f10bc070340 2023-06-20T13:33:33.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.954+0000 7f10a37fe700 1 --2- 172.21.15.32:0/370734213 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f10a806ace0 0x7f10a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:33.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.954+0000 7f10a37fe700 1 -- 172.21.15.32:0/370734213 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f10ac088be0 con 0x7f10bc070340 2023-06-20T13:33:33.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.954+0000 7f10ba59c700 1 --2- 172.21.15.32:0/370734213 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f10a806ace0 0x7f10a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:33.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.955+0000 7f10ba59c700 1 --2- 172.21.15.32:0/370734213 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f10a806ace0 0x7f10a806d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f10bc06ff00 tx=0x7f10b0007dc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:33.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:33.958+0000 7f10a37fe700 1 -- 172.21.15.32:0/370734213 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f10ac0538c0 con 0x7f10bc070340 2023-06-20T13:33:34.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.183+0000 7f10c11ff700 1 -- 172.21.15.32:0/370734213 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f10bc0c20d0 con 0x7f10bc070340 2023-06-20T13:33:34.185 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.183+0000 7f10a37fe700 1 -- 172.21.15.32:0/370734213 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f10ac056ee0 con 0x7f10bc070340 2023-06-20T13:33:34.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.186+0000 7f10c11ff700 1 -- 172.21.15.32:0/370734213 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f10a806ace0 msgr2=0x7f10a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:34.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.186+0000 7f10c11ff700 1 --2- 172.21.15.32:0/370734213 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f10a806ace0 0x7f10a806d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f10bc06ff00 tx=0x7f10b0007dc0 comp rx=0 tx=0).stop 2023-06-20T13:33:34.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.186+0000 7f10c11ff700 1 -- 172.21.15.32:0/370734213 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10bc070340 msgr2=0x7f10bc0b1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:34.188 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.186+0000 7f10c11ff700 1 --2- 172.21.15.32:0/370734213 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10bc070340 0x7f10bc0b1690 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f10ac00c500 tx=0x7f10ac00c810 comp rx=0 tx=0).stop 2023-06-20T13:33:34.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.186+0000 7f10c11ff700 1 -- 172.21.15.32:0/370734213 shutdown_connections 2023-06-20T13:33:34.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.186+0000 7f10c11ff700 1 --2- 172.21.15.32:0/370734213 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f10a806ace0 0x7f10a806d190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:34.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.186+0000 7f10c11ff700 1 --2- 172.21.15.32:0/370734213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f10bc157f10 0x7f10bc0ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:34.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.186+0000 7f10c11ff700 1 --2- 172.21.15.32:0/370734213 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f10bc070340 0x7f10bc0b1690 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:34.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.186+0000 7f10c11ff700 1 --2- 172.21.15.32:0/370734213 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f10bc071160 0x7f10bc151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:34.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.186+0000 7f10c11ff700 1 -- 172.21.15.32:0/370734213 >> 172.21.15.32:0/370734213 conn(0x7f10bc0b0390 msgr2=0x7f10bc0b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:34.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.186+0000 7f10c11ff700 1 -- 172.21.15.32:0/370734213 shutdown_connections 2023-06-20T13:33:34.189 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.186+0000 7f10c11ff700 1 -- 172.21.15.32:0/370734213 wait complete. 2023-06-20T13:33:34.190 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2023-06-20T13:33:34.206 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-06-20T13:33:34.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:34.207 DEBUG:teuthology.orchestra.run.smithi032:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-06-20T13:33:34.290 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2023-06-20T13:33:34.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:34.291 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-20T13:33:34.337 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:33:34.337 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-20T13:33:34.388 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:33:34.388 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-20T13:33:34.436 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:33:34.436 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-20T13:33:34.482 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:33:34.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.682+0000 7f75cf9ff700 1 Processor -- start 2023-06-20T13:33:34.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.682+0000 7f75cf9ff700 1 -- start start 2023-06-20T13:33:34.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.683+0000 7f75cf9ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75c80d2640 0x7f75c80b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:34.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.683+0000 7f75cf9ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c80d1790 con 0x7f75c80cf8f0 2023-06-20T13:33:34.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.683+0000 7f75cf9ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c80cd950 con 0x7f75c815c460 2023-06-20T13:33:34.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.683+0000 7f75cf9ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c80cedd0 con 0x7f75c80d2640 2023-06-20T13:33:34.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.683+0000 7f75cdf9c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f75c80cf8f0 0x7f75c815fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43712/0 (socket says 172.21.15.32:43712) 2023-06-20T13:33:34.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.683+0000 7f75cdf9c700 1 -- 172.21.15.32:0/922370714 learned_addr learned my addr 172.21.15.32:0/922370714 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:34.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.683+0000 7f75ccf9a700 1 --2- 172.21.15.32:0/922370714 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75c80d2640 0x7f75c80b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:34.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.684+0000 7f75bffff700 1 -- 172.21.15.32:0/922370714 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1693473242 0 0) 0x7f75c80d1790 con 0x7f75c80cf8f0 2023-06-20T13:33:34.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.684+0000 7f75bffff700 1 -- 172.21.15.32:0/922370714 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75b40035b0 con 0x7f75c80cf8f0 2023-06-20T13:33:34.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.684+0000 7f75bffff700 1 -- 172.21.15.32:0/922370714 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764754307 0 0) 0x7f75c80cd950 con 0x7f75c815c460 2023-06-20T13:33:34.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.684+0000 7f75bffff700 1 -- 172.21.15.32:0/922370714 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75c80d1790 con 0x7f75c815c460 2023-06-20T13:33:34.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.684+0000 7f75ccf9a700 1 -- 172.21.15.32:0/922370714 >> v1:172.21.15.115:6789/0 conn(0x7f75c815c460 legacy=0x7f75c80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:34.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.684+0000 7f75ccf9a700 1 -- 172.21.15.32:0/922370714 >> v1:172.21.15.32:6789/0 conn(0x7f75c80cf8f0 legacy=0x7f75c815fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:34.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.684+0000 7f75ccf9a700 1 -- 172.21.15.32:0/922370714 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c80d14b0 con 0x7f75c80d2640 2023-06-20T13:33:34.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.684+0000 7f75ccf9a700 1 --2- 172.21.15.32:0/922370714 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75c80d2640 0x7f75c80b59d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f75b8009870 tx=0x7f75b8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b6252251a770836 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:34.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.685+0000 7f75bffff700 1 -- 172.21.15.32:0/922370714 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b8011830 con 0x7f75c80d2640 2023-06-20T13:33:34.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.685+0000 7f75bffff700 1 -- 172.21.15.32:0/922370714 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b8011990 con 0x7f75c80d2640 2023-06-20T13:33:34.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.685+0000 7f75bffff700 1 -- 172.21.15.32:0/922370714 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b8011d20 con 0x7f75c80d2640 2023-06-20T13:33:34.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.685+0000 7f75cf9ff700 1 -- 172.21.15.32:0/922370714 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75c80d2640 msgr2=0x7f75c80b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:34.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.685+0000 7f75cf9ff700 1 --2- 172.21.15.32:0/922370714 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75c80d2640 0x7f75c80b59d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f75b8009870 tx=0x7f75b8009b80 comp rx=0 tx=0).stop 2023-06-20T13:33:34.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.685+0000 7f75cf9ff700 1 -- 172.21.15.32:0/922370714 shutdown_connections 2023-06-20T13:33:34.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.685+0000 7f75cf9ff700 1 --2- 172.21.15.32:0/922370714 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75c80d2640 0x7f75c80b59d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:34.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.685+0000 7f75cf9ff700 1 -- 172.21.15.32:0/922370714 >> 172.21.15.32:0/922370714 conn(0x7f75c8071660 msgr2=0x7f75c8071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:34.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.685+0000 7f75cf9ff700 1 -- 172.21.15.32:0/922370714 shutdown_connections 2023-06-20T13:33:34.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.685+0000 7f75cf9ff700 1 -- 172.21.15.32:0/922370714 wait complete. 2023-06-20T13:33:34.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.687+0000 7f75cf9ff700 1 Processor -- start 2023-06-20T13:33:34.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.687+0000 7f75cf9ff700 1 -- start start 2023-06-20T13:33:34.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.688+0000 7f75cf9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75c80cf8f0 0x7f75c80c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:34.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.688+0000 7f75cf9ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75c80d2640 0x7f75c814e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:34.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.688+0000 7f75cf9ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75c815c460 0x7f75c80c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:34.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.688+0000 7f75cf9ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c80c7df0 con 0x7f75c80d2640 2023-06-20T13:33:34.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.688+0000 7f75cf9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c80c8020 con 0x7f75c80cf8f0 2023-06-20T13:33:34.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.688+0000 7f75cf9ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c80c8300 con 0x7f75c815c460 2023-06-20T13:33:34.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.688+0000 7f75ccf9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75c80d2640 0x7f75c814e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:34.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.688+0000 7f75ccf9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75c80d2640 0x7f75c814e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35020/0 (socket says 172.21.15.32:35020) 2023-06-20T13:33:34.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.688+0000 7f75ccf9a700 1 -- 172.21.15.32:0/480122166 learned_addr learned my addr 172.21.15.32:0/480122166 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:34.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.689+0000 7f75cd79b700 1 --2- 172.21.15.32:0/480122166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75c80cf8f0 0x7f75c80c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:34.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.689+0000 7f75cdf9c700 1 --2- 172.21.15.32:0/480122166 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75c815c460 0x7f75c80c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:34.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.689+0000 7f75ccf9a700 1 -- 172.21.15.32:0/480122166 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75c815c460 msgr2=0x7f75c80c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:34.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.689+0000 7f75ccf9a700 1 --2- 172.21.15.32:0/480122166 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75c815c460 0x7f75c80c78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:34.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.689+0000 7f75ccf9a700 1 -- 172.21.15.32:0/480122166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75c80cf8f0 msgr2=0x7f75c80c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:34.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.689+0000 7f75ccf9a700 1 --2- 172.21.15.32:0/480122166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75c80cf8f0 0x7f75c80c90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:34.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.689+0000 7f75ccf9a700 1 -- 172.21.15.32:0/480122166 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b80094a0 con 0x7f75c80d2640 2023-06-20T13:33:34.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.689+0000 7f75cdf9c700 1 --2- 172.21.15.32:0/480122166 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75c815c460 0x7f75c80c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:34.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.689+0000 7f75cd79b700 1 --2- 172.21.15.32:0/480122166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75c80cf8f0 0x7f75c80c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:34.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.689+0000 7f75ccf9a700 1 --2- 172.21.15.32:0/480122166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75c80d2640 0x7f75c814e370 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f75b80090b0 tx=0x7f75b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:34.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.689+0000 7f75bdffb700 1 -- 172.21.15.32:0/480122166 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b801a860 con 0x7f75c80d2640 2023-06-20T13:33:34.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.689+0000 7f75cf9ff700 1 -- 172.21.15.32:0/480122166 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c80c85e0 con 0x7f75c80d2640 2023-06-20T13:33:34.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.689+0000 7f75bdffb700 1 -- 172.21.15.32:0/480122166 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b801a9c0 con 0x7f75c80d2640 2023-06-20T13:33:34.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.689+0000 7f75bdffb700 1 -- 172.21.15.32:0/480122166 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b801ad30 con 0x7f75c80d2640 2023-06-20T13:33:34.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.690+0000 7f75cf9ff700 1 -- 172.21.15.32:0/480122166 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c80c8ba0 con 0x7f75c80d2640 2023-06-20T13:33:34.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.691+0000 7f75cf9ff700 1 -- 172.21.15.32:0/480122166 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c804ea60 con 0x7f75c80d2640 2023-06-20T13:33:34.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.691+0000 7f75bdffb700 1 -- 172.21.15.32:0/480122166 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f75b8022070 con 0x7f75c80d2640 2023-06-20T13:33:34.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.693+0000 7f75bdffb700 1 --2- 172.21.15.32:0/480122166 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f75ac06ace0 0x7f75ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:34.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.693+0000 7f75bdffb700 1 -- 172.21.15.32:0/480122166 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f75b808a480 con 0x7f75c80d2640 2023-06-20T13:33:34.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.693+0000 7f75cd79b700 1 --2- 172.21.15.32:0/480122166 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f75ac06ace0 0x7f75ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:34.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.694+0000 7f75cd79b700 1 --2- 172.21.15.32:0/480122166 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f75ac06ace0 0x7f75ac06d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f75c40011e0 tx=0x7f75c4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:34.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.698+0000 7f75bdffb700 1 -- 172.21.15.32:0/480122166 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f75b8055220 con 0x7f75c80d2640 2023-06-20T13:33:34.906 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.904+0000 7f75cf9ff700 1 -- 172.21.15.32:0/480122166 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75c80b4fa0 con 0x7f75c80d2640 2023-06-20T13:33:34.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.906+0000 7f75bdffb700 1 -- 172.21.15.32:0/480122166 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20191 (secure 0 0 0) 0x7f75b8058840 con 0x7f75c80d2640 2023-06-20T13:33:34.908 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:33:34.909 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":29,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:33:00.976862+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-20T13:32:18.120021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-20T13:32:19.503624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-20T13:32:23.074912+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:33:34.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.908+0000 7f75cf9ff700 1 -- 172.21.15.32:0/480122166 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f75ac06ace0 msgr2=0x7f75ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:34.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.908+0000 7f75cf9ff700 1 --2- 172.21.15.32:0/480122166 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f75ac06ace0 0x7f75ac06d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f75c40011e0 tx=0x7f75c4009040 comp rx=0 tx=0).stop 2023-06-20T13:33:34.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.908+0000 7f75cf9ff700 1 -- 172.21.15.32:0/480122166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75c80d2640 msgr2=0x7f75c814e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:34.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.908+0000 7f75cf9ff700 1 --2- 172.21.15.32:0/480122166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75c80d2640 0x7f75c814e370 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f75b80090b0 tx=0x7f75b8004750 comp rx=0 tx=0).stop 2023-06-20T13:33:34.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.908+0000 7f75cf9ff700 1 -- 172.21.15.32:0/480122166 shutdown_connections 2023-06-20T13:33:34.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.908+0000 7f75cf9ff700 1 --2- 172.21.15.32:0/480122166 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f75ac06ace0 0x7f75ac06d190 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:34.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.908+0000 7f75cf9ff700 1 --2- 172.21.15.32:0/480122166 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f75c815c460 0x7f75c80c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:34.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.908+0000 7f75cf9ff700 1 --2- 172.21.15.32:0/480122166 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f75c80cf8f0 0x7f75c80c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:34.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.908+0000 7f75cf9ff700 1 --2- 172.21.15.32:0/480122166 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f75c80d2640 0x7f75c814e370 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:34.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.908+0000 7f75cf9ff700 1 -- 172.21.15.32:0/480122166 >> 172.21.15.32:0/480122166 conn(0x7f75c8071660 msgr2=0x7f75c8156480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:34.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.909+0000 7f75cf9ff700 1 -- 172.21.15.32:0/480122166 shutdown_connections 2023-06-20T13:33:34.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:34.909+0000 7f75cf9ff700 1 -- 172.21.15.32:0/480122166 wait complete. 2023-06-20T13:33:34.929 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-20T13:32:05.308022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-20T13:32:12.857161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-20T13:32:18.120021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-20T13:32:19.503624+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-20T13:32:23.074912+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-20T13:33:34.929 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-20T13:33:35.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.131+0000 7fcbb1bff700 1 Processor -- start 2023-06-20T13:33:35.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.131+0000 7fcbb1bff700 1 -- start start 2023-06-20T13:33:35.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.132+0000 7fcbb1bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcbac0b8430 0x7fcbac0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:35.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.132+0000 7fcbb1bff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbac0d0b20 con 0x7fcbac0d3730 2023-06-20T13:33:35.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.132+0000 7fcbb1bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbac0b4ee0 con 0x7fcbac0cfc60 2023-06-20T13:33:35.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.132+0000 7fcbb1bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbac0b8800 con 0x7fcbac0b8430 2023-06-20T13:33:35.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.133+0000 7fcbaaffd700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fcbac0d3730 0x7fcbac0cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43724/0 (socket says 172.21.15.32:43724) 2023-06-20T13:33:35.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.133+0000 7fcbaaffd700 1 -- 172.21.15.32:0/2812190916 learned_addr learned my addr 172.21.15.32:0/2812190916 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:35.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.133+0000 7fcbab7fe700 1 --2- 172.21.15.32:0/2812190916 >> v2:172.21.15.115:3300/0 conn(0x7fcbac0b8430 0x7fcbac0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:35.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.133+0000 7fcbab7fe700 1 -- 172.21.15.32:0/2812190916 >> v1:172.21.15.115:6789/0 conn(0x7fcbac0cfc60 legacy=0x7fcbac0d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:35.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.133+0000 7fcbab7fe700 1 -- 172.21.15.32:0/2812190916 >> v1:172.21.15.32:6789/0 conn(0x7fcbac0d3730 legacy=0x7fcbac0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:35.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.133+0000 7fcbab7fe700 1 -- 172.21.15.32:0/2812190916 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac0b51c0 con 0x7fcbac0b8430 2023-06-20T13:33:35.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.133+0000 7fcbab7fe700 1 --2- 172.21.15.32:0/2812190916 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbac0b8430 0x7fcbac0cd320 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c009840 tx=0x7fcb9c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99337d9f222d574c server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:35.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.135+0000 7fcbaa7fc700 1 -- 172.21.15.32:0/2812190916 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c011830 con 0x7fcbac0b8430 2023-06-20T13:33:35.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.135+0000 7fcbaa7fc700 1 -- 172.21.15.32:0/2812190916 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9c011990 con 0x7fcbac0b8430 2023-06-20T13:33:35.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.135+0000 7fcbaa7fc700 1 -- 172.21.15.32:0/2812190916 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c011d20 con 0x7fcbac0b8430 2023-06-20T13:33:35.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.135+0000 7fcbb1bff700 1 -- 172.21.15.32:0/2812190916 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbac0b8430 msgr2=0x7fcbac0cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:35.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.135+0000 7fcbb1bff700 1 --2- 172.21.15.32:0/2812190916 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbac0b8430 0x7fcbac0cd320 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c009840 tx=0x7fcb9c009b50 comp rx=0 tx=0).stop 2023-06-20T13:33:35.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.136+0000 7fcbb1bff700 1 -- 172.21.15.32:0/2812190916 shutdown_connections 2023-06-20T13:33:35.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.136+0000 7fcbb1bff700 1 --2- 172.21.15.32:0/2812190916 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbac0b8430 0x7fcbac0cd320 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:35.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.136+0000 7fcbb1bff700 1 -- 172.21.15.32:0/2812190916 >> 172.21.15.32:0/2812190916 conn(0x7fcbac06b3f0 msgr2=0x7fcbac06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:35.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.136+0000 7fcbb1bff700 1 -- 172.21.15.32:0/2812190916 shutdown_connections 2023-06-20T13:33:35.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.136+0000 7fcbb1bff700 1 -- 172.21.15.32:0/2812190916 wait complete. 2023-06-20T13:33:35.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.137+0000 7fcbb1bff700 1 Processor -- start 2023-06-20T13:33:35.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.138+0000 7fcbb1bff700 1 -- start start 2023-06-20T13:33:35.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.138+0000 7fcbb1bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbac0b8430 0x7fcbac0cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:35.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.139+0000 7fcbb1bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbac0cfc60 0x7fcbac1f1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:35.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.139+0000 7fcbb1bff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbac0d3730 0x7fcbac0d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:35.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.139+0000 7fcbb1bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac1f2ea0 con 0x7fcbac0b8430 2023-06-20T13:33:35.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.139+0000 7fcbb1bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac1f35b0 con 0x7fcbac0cfc60 2023-06-20T13:33:35.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.139+0000 7fcbb1bff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac1f2370 con 0x7fcbac0d3730 2023-06-20T13:33:35.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.139+0000 7fcbab7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbac0b8430 0x7fcbac0cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:35.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.139+0000 7fcbab7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbac0b8430 0x7fcbac0cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35034/0 (socket says 172.21.15.32:35034) 2023-06-20T13:33:35.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.139+0000 7fcbab7fe700 1 -- 172.21.15.32:0/1341089986 learned_addr learned my addr 172.21.15.32:0/1341089986 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:35.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.139+0000 7fcbaaffd700 1 --2- 172.21.15.32:0/1341089986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbac0cfc60 0x7fcbac1f1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:35.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.139+0000 7fcbabfff700 1 --2- 172.21.15.32:0/1341089986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbac0d3730 0x7fcbac0d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:35.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.139+0000 7fcbab7fe700 1 -- 172.21.15.32:0/1341089986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbac0d3730 msgr2=0x7fcbac0d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:35.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.139+0000 7fcbab7fe700 1 --2- 172.21.15.32:0/1341089986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbac0d3730 0x7fcbac0d19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:35.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.139+0000 7fcbab7fe700 1 -- 172.21.15.32:0/1341089986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbac0cfc60 msgr2=0x7fcbac1f1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:35.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.139+0000 7fcbab7fe700 1 --2- 172.21.15.32:0/1341089986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbac0cfc60 0x7fcbac1f1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:35.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.139+0000 7fcbab7fe700 1 -- 172.21.15.32:0/1341089986 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9c0094a0 con 0x7fcbac0b8430 2023-06-20T13:33:35.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.139+0000 7fcbaaffd700 1 --2- 172.21.15.32:0/1341089986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbac0cfc60 0x7fcbac1f1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:35.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.139+0000 7fcbab7fe700 1 --2- 172.21.15.32:0/1341089986 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbac0b8430 0x7fcbac0cc650 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0090b0 tx=0x7fcb9c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:35.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.140+0000 7fcb93fff700 1 -- 172.21.15.32:0/1341089986 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c0038a0 con 0x7fcbac0b8430 2023-06-20T13:33:35.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.140+0000 7fcb93fff700 1 -- 172.21.15.32:0/1341089986 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9c01f070 con 0x7fcbac0b8430 2023-06-20T13:33:35.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.140+0000 7fcb93fff700 1 -- 172.21.15.32:0/1341089986 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c003c60 con 0x7fcbac0b8430 2023-06-20T13:33:35.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.140+0000 7fcbb1bff700 1 -- 172.21.15.32:0/1341089986 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbac1f2600 con 0x7fcbac0b8430 2023-06-20T13:33:35.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.140+0000 7fcbb1bff700 1 -- 172.21.15.32:0/1341089986 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbac1f2bc0 con 0x7fcbac0b8430 2023-06-20T13:33:35.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.141+0000 7fcbb1bff700 1 -- 172.21.15.32:0/1341089986 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbac1f3380 con 0x7fcbac0b8430 2023-06-20T13:33:35.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.142+0000 7fcb93fff700 1 -- 172.21.15.32:0/1341089986 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcb9c01a430 con 0x7fcbac0b8430 2023-06-20T13:33:35.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.143+0000 7fcb93fff700 1 --2- 172.21.15.32:0/1341089986 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcb9806ace0 0x7fcb9806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:35.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.143+0000 7fcb93fff700 1 -- 172.21.15.32:0/1341089986 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcb9c021070 con 0x7fcbac0b8430 2023-06-20T13:33:35.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.143+0000 7fcbaaffd700 1 --2- 172.21.15.32:0/1341089986 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcb9806ace0 0x7fcb9806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:35.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.143+0000 7fcbaaffd700 1 --2- 172.21.15.32:0/1341089986 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcb9806ace0 0x7fcb9806d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcba0007fd0 tx=0x7fcba0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:35.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.147+0000 7fcb93fff700 1 -- 172.21.15.32:0/1341089986 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcbac1f3380 con 0x7fcbac0b8430 2023-06-20T13:33:35.355 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.353+0000 7fcbb1bff700 1 -- 172.21.15.32:0/1341089986 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcbac1f3380 con 0x7fcbac0b8430 2023-06-20T13:33:35.356 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.353+0000 7fcb93fff700 1 -- 172.21.15.32:0/1341089986 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcbac1f3380 con 0x7fcbac0b8430 2023-06-20T13:33:35.356 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-06-20T13:33:35.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.356+0000 7fcbb1bff700 1 -- 172.21.15.32:0/1341089986 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcb9806ace0 msgr2=0x7fcb9806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:35.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.356+0000 7fcbb1bff700 1 --2- 172.21.15.32:0/1341089986 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcb9806ace0 0x7fcb9806d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcba0007fd0 tx=0x7fcba0009040 comp rx=0 tx=0).stop 2023-06-20T13:33:35.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.356+0000 7fcbb1bff700 1 -- 172.21.15.32:0/1341089986 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbac0b8430 msgr2=0x7fcbac0cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:35.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.356+0000 7fcbb1bff700 1 --2- 172.21.15.32:0/1341089986 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbac0b8430 0x7fcbac0cc650 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0090b0 tx=0x7fcb9c004750 comp rx=0 tx=0).stop 2023-06-20T13:33:35.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.356+0000 7fcbb1bff700 1 -- 172.21.15.32:0/1341089986 shutdown_connections 2023-06-20T13:33:35.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.356+0000 7fcbb1bff700 1 --2- 172.21.15.32:0/1341089986 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcb9806ace0 0x7fcb9806d190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:35.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.356+0000 7fcbb1bff700 1 --2- 172.21.15.32:0/1341089986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcbac0d3730 0x7fcbac0d19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:35.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.356+0000 7fcbb1bff700 1 --2- 172.21.15.32:0/1341089986 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcbac0b8430 0x7fcbac0cc650 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:35.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.356+0000 7fcbb1bff700 1 --2- 172.21.15.32:0/1341089986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcbac0cfc60 0x7fcbac1f1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:35.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.356+0000 7fcbb1bff700 1 -- 172.21.15.32:0/1341089986 >> 172.21.15.32:0/1341089986 conn(0x7fcbac06b3f0 msgr2=0x7fcbac0d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:35.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.356+0000 7fcbb1bff700 1 -- 172.21.15.32:0/1341089986 shutdown_connections 2023-06-20T13:33:35.359 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.356+0000 7fcbb1bff700 1 -- 172.21.15.32:0/1341089986 wait complete. 2023-06-20T13:33:35.376 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-20T13:33:35.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.578+0000 7fe6857ff700 1 Processor -- start 2023-06-20T13:33:35.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.578+0000 7fe6857ff700 1 -- start start 2023-06-20T13:33:35.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.579+0000 7fe6857ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe6800afca0 0x7fe680160a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:35.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.579+0000 7fe6857ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe68006e0a0 0x7fe68006bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:35.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.579+0000 7fe6857ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6800b0070 con 0x7fe68006c300 2023-06-20T13:33:35.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.579+0000 7fe6857ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe68006e880 con 0x7fe6800afca0 2023-06-20T13:33:35.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.579+0000 7fe6857ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68006eb60 con 0x7fe68006e0a0 2023-06-20T13:33:35.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.579+0000 7fe67f7fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe68006c300 0x7fe6800caee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43732/0 (socket says 172.21.15.32:43732) 2023-06-20T13:33:35.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.579+0000 7fe67f7fe700 1 -- 172.21.15.32:0/2118969932 learned_addr learned my addr 172.21.15.32:0/2118969932 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:35.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.579+0000 7fe677fff700 1 --2- 172.21.15.32:0/2118969932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe68006e0a0 0x7fe68006bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:35.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.579+0000 7fe67effd700 1 --2- 172.21.15.32:0/2118969932 >> v2:172.21.15.115:3300/0 conn(0x7fe6800afca0 0x7fe680160a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:35.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.580+0000 7fe67e7fc700 1 -- 172.21.15.32:0/2118969932 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 450969239 0 0) 0x7fe6800b0070 con 0x7fe68006c300 2023-06-20T13:33:35.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.580+0000 7fe67e7fc700 1 -- 172.21.15.32:0/2118969932 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe66c0035b0 con 0x7fe68006c300 2023-06-20T13:33:35.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.580+0000 7fe677fff700 1 -- 172.21.15.32:0/2118969932 >> v2:172.21.15.115:3300/0 conn(0x7fe6800afca0 msgr2=0x7fe680160a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:35.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.580+0000 7fe677fff700 1 --2- 172.21.15.32:0/2118969932 >> v2:172.21.15.115:3300/0 conn(0x7fe6800afca0 0x7fe680160a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:35.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.580+0000 7fe677fff700 1 -- 172.21.15.32:0/2118969932 >> v1:172.21.15.32:6789/0 conn(0x7fe68006c300 legacy=0x7fe6800caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:35.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.580+0000 7fe677fff700 1 -- 172.21.15.32:0/2118969932 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe68006b5c0 con 0x7fe68006e0a0 2023-06-20T13:33:35.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.580+0000 7fe677fff700 1 --2- 172.21.15.32:0/2118969932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe68006e0a0 0x7fe68006bdc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe668009820 tx=0x7fe668009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cae3d93abe091b03 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:35.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.580+0000 7fe67e7fc700 1 -- 172.21.15.32:0/2118969932 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe668005e30 con 0x7fe68006e0a0 2023-06-20T13:33:35.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.580+0000 7fe67e7fc700 1 -- 172.21.15.32:0/2118969932 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe668006030 con 0x7fe68006e0a0 2023-06-20T13:33:35.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.580+0000 7fe67e7fc700 1 -- 172.21.15.32:0/2118969932 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6680063c0 con 0x7fe68006e0a0 2023-06-20T13:33:35.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.581+0000 7fe6857ff700 1 -- 172.21.15.32:0/2118969932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe68006e0a0 msgr2=0x7fe68006bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:35.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.581+0000 7fe6857ff700 1 --2- 172.21.15.32:0/2118969932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe68006e0a0 0x7fe68006bdc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe668009820 tx=0x7fe668009b30 comp rx=0 tx=0).stop 2023-06-20T13:33:35.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.581+0000 7fe6857ff700 1 -- 172.21.15.32:0/2118969932 shutdown_connections 2023-06-20T13:33:35.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.581+0000 7fe6857ff700 1 --2- 172.21.15.32:0/2118969932 >> v2:172.21.15.115:3300/0 conn(0x7fe6800afca0 0x7fe680160a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:35.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.581+0000 7fe6857ff700 1 --2- 172.21.15.32:0/2118969932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe68006e0a0 0x7fe68006bdc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:35.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.581+0000 7fe6857ff700 1 -- 172.21.15.32:0/2118969932 >> 172.21.15.32:0/2118969932 conn(0x7fe68008a3b0 msgr2=0x7fe68006a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:35.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.581+0000 7fe6857ff700 1 -- 172.21.15.32:0/2118969932 shutdown_connections 2023-06-20T13:33:35.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.581+0000 7fe6857ff700 1 -- 172.21.15.32:0/2118969932 wait complete. 2023-06-20T13:33:35.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.583+0000 7fe6857ff700 1 Processor -- start 2023-06-20T13:33:35.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.583+0000 7fe6857ff700 1 -- start start 2023-06-20T13:33:35.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.584+0000 7fe6857ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe68006c300 0x7fe6800b3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:35.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.584+0000 7fe6857ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe68006e0a0 0x7fe6801f1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:35.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.584+0000 7fe6857ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6800afca0 0x7fe6801474b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:35.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.584+0000 7fe6857ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68015ea20 con 0x7fe68006c300 2023-06-20T13:33:35.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.584+0000 7fe6857ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68015e180 con 0x7fe6800afca0 2023-06-20T13:33:35.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.584+0000 7fe6857ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6800b3c90 con 0x7fe68006e0a0 2023-06-20T13:33:35.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.584+0000 7fe67effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe68006c300 0x7fe6800b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:35.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.584+0000 7fe67effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe68006c300 0x7fe6800b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35048/0 (socket says 172.21.15.32:35048) 2023-06-20T13:33:35.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.584+0000 7fe67effd700 1 -- 172.21.15.32:0/1802991856 learned_addr learned my addr 172.21.15.32:0/1802991856 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:35.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.585+0000 7fe677fff700 1 --2- 172.21.15.32:0/1802991856 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe68006e0a0 0x7fe6801f1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:35.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.585+0000 7fe67f7fe700 1 --2- 172.21.15.32:0/1802991856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6800afca0 0x7fe6801474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:35.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.585+0000 7fe67effd700 1 -- 172.21.15.32:0/1802991856 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe68006e0a0 msgr2=0x7fe6801f1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:35.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.585+0000 7fe67effd700 1 --2- 172.21.15.32:0/1802991856 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe68006e0a0 0x7fe6801f1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:35.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.585+0000 7fe67effd700 1 -- 172.21.15.32:0/1802991856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6800afca0 msgr2=0x7fe6801474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:35.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.585+0000 7fe67effd700 1 --2- 172.21.15.32:0/1802991856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6800afca0 0x7fe6801474b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:35.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.585+0000 7fe67effd700 1 -- 172.21.15.32:0/1802991856 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe668009430 con 0x7fe68006c300 2023-06-20T13:33:35.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.585+0000 7fe67f7fe700 1 --2- 172.21.15.32:0/1802991856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6800afca0 0x7fe6801474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:35.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.585+0000 7fe67effd700 1 --2- 172.21.15.32:0/1802991856 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe68006c300 0x7fe6800b3750 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe67000e900 tx=0x7fe67000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:35.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.585+0000 7fe6777fe700 1 -- 172.21.15.32:0/1802991856 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe670009650 con 0x7fe68006c300 2023-06-20T13:33:35.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.585+0000 7fe6777fe700 1 -- 172.21.15.32:0/1802991856 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67000ee50 con 0x7fe68006c300 2023-06-20T13:33:35.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.585+0000 7fe6777fe700 1 -- 172.21.15.32:0/1802991856 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67000ca50 con 0x7fe68006c300 2023-06-20T13:33:35.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.585+0000 7fe6857ff700 1 -- 172.21.15.32:0/1802991856 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6800b6610 con 0x7fe68006c300 2023-06-20T13:33:35.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.586+0000 7fe6857ff700 1 -- 172.21.15.32:0/1802991856 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe68015e6b0 con 0x7fe68006c300 2023-06-20T13:33:35.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.586+0000 7fe6857ff700 1 -- 172.21.15.32:0/1802991856 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe68015ed00 con 0x7fe68006c300 2023-06-20T13:33:35.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.587+0000 7fe6777fe700 1 -- 172.21.15.32:0/1802991856 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe67000cbb0 con 0x7fe68006c300 2023-06-20T13:33:35.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.588+0000 7fe6777fe700 1 --2- 172.21.15.32:0/1802991856 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe66006ace0 0x7fe66006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:35.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.588+0000 7fe6777fe700 1 -- 172.21.15.32:0/1802991856 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe670089bb0 con 0x7fe68006c300 2023-06-20T13:33:35.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.589+0000 7fe677fff700 1 --2- 172.21.15.32:0/1802991856 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe66006ace0 0x7fe66006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:35.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.589+0000 7fe677fff700 1 --2- 172.21.15.32:0/1802991856 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe66006ace0 0x7fe66006d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe668000c00 tx=0x7fe668008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:35.594 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.592+0000 7fe6777fe700 1 -- 172.21.15.32:0/1802991856 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe6700583b0 con 0x7fe68006c300 2023-06-20T13:33:35.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.797+0000 7fe6857ff700 1 -- 172.21.15.32:0/1802991856 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe68004ea60 con 0x7fe68006c300 2023-06-20T13:33:35.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.797+0000 7fe6777fe700 1 -- 172.21.15.32:0/1802991856 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe670017020 con 0x7fe68006c300 2023-06-20T13:33:35.800 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 8 2023-06-20T13:33:35.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.799+0000 7fe6857ff700 1 -- 172.21.15.32:0/1802991856 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe66006ace0 msgr2=0x7fe66006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:35.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.799+0000 7fe6857ff700 1 --2- 172.21.15.32:0/1802991856 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe66006ace0 0x7fe66006d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe668000c00 tx=0x7fe668008070 comp rx=0 tx=0).stop 2023-06-20T13:33:35.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.799+0000 7fe6857ff700 1 -- 172.21.15.32:0/1802991856 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe68006c300 msgr2=0x7fe6800b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:35.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.799+0000 7fe6857ff700 1 --2- 172.21.15.32:0/1802991856 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe68006c300 0x7fe6800b3750 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe67000e900 tx=0x7fe67000ec10 comp rx=0 tx=0).stop 2023-06-20T13:33:35.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.799+0000 7fe6857ff700 1 -- 172.21.15.32:0/1802991856 shutdown_connections 2023-06-20T13:33:35.802 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.799+0000 7fe6857ff700 1 --2- 172.21.15.32:0/1802991856 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe66006ace0 0x7fe66006d190 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:35.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.800+0000 7fe6857ff700 1 --2- 172.21.15.32:0/1802991856 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6800afca0 0x7fe6801474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:35.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.800+0000 7fe6857ff700 1 --2- 172.21.15.32:0/1802991856 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe68006c300 0x7fe6800b3750 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:35.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.800+0000 7fe6857ff700 1 --2- 172.21.15.32:0/1802991856 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe68006e0a0 0x7fe6801f1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:35.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.800+0000 7fe6857ff700 1 -- 172.21.15.32:0/1802991856 >> 172.21.15.32:0/1802991856 conn(0x7fe68008a3b0 msgr2=0x7fe6800cd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:35.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.800+0000 7fe6857ff700 1 -- 172.21.15.32:0/1802991856 shutdown_connections 2023-06-20T13:33:35.803 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:35.800+0000 7fe6857ff700 1 -- 172.21.15.32:0/1802991856 wait complete. 2023-06-20T13:33:35.819 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-20T13:33:36.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.021+0000 7f48531ff700 1 Processor -- start 2023-06-20T13:33:36.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.021+0000 7f48531ff700 1 -- start start 2023-06-20T13:33:36.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.022+0000 7f48531ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f484c0d3730 0x7f484c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:36.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.022+0000 7f48531ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f484c0d0b20 con 0x7f484c0cfa90 2023-06-20T13:33:36.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.022+0000 7f48531ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f484c0cfeb0 con 0x7f484c0b8430 2023-06-20T13:33:36.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.022+0000 7f48531ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484c0cda30 con 0x7f484c0d3730 2023-06-20T13:33:36.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.022+0000 7f485179c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f484c0cfa90 0x7f484c0d0fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43746/0 (socket says 172.21.15.32:43746) 2023-06-20T13:33:36.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.022+0000 7f485179c700 1 -- 172.21.15.32:0/17813297 learned_addr learned my addr 172.21.15.32:0/17813297 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:36.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.023+0000 7f484bfff700 1 --2- 172.21.15.32:0/17813297 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f484c0d3730 0x7f484c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:36.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.023+0000 7f484b7fe700 1 -- 172.21.15.32:0/17813297 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2071318037 0 0) 0x7f484c0d0b20 con 0x7f484c0cfa90 2023-06-20T13:33:36.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.023+0000 7f484b7fe700 1 -- 172.21.15.32:0/17813297 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f483c0035b0 con 0x7f484c0cfa90 2023-06-20T13:33:36.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.023+0000 7f484b7fe700 1 -- 172.21.15.32:0/17813297 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2770436970 0 0) 0x7f484c0cfeb0 con 0x7f484c0b8430 2023-06-20T13:33:36.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.023+0000 7f484b7fe700 1 -- 172.21.15.32:0/17813297 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f484c0d0b20 con 0x7f484c0b8430 2023-06-20T13:33:36.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.023+0000 7f484b7fe700 1 -- 172.21.15.32:0/17813297 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2061025603 0 0) 0x7f483c0035b0 con 0x7f484c0cfa90 2023-06-20T13:33:36.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.023+0000 7f484bfff700 1 -- 172.21.15.32:0/17813297 >> v1:172.21.15.115:6789/0 conn(0x7f484c0b8430 legacy=0x7f484c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:36.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.023+0000 7f484bfff700 1 -- 172.21.15.32:0/17813297 >> v1:172.21.15.32:6789/0 conn(0x7f484c0cfa90 legacy=0x7f484c0d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:36.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.023+0000 7f484bfff700 1 -- 172.21.15.32:0/17813297 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484c0b4ee0 con 0x7f484c0d3730 2023-06-20T13:33:36.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.023+0000 7f484bfff700 1 --2- 172.21.15.32:0/17813297 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f484c0d3730 0x7f484c0cf550 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4838009870 tx=0x7f4838009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f0bd707c879dd1 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:36.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.024+0000 7f484b7fe700 1 -- 172.21.15.32:0/17813297 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48440019f0 con 0x7f484c0d3730 2023-06-20T13:33:36.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.024+0000 7f484b7fe700 1 -- 172.21.15.32:0/17813297 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4838004030 con 0x7f484c0d3730 2023-06-20T13:33:36.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.024+0000 7f484b7fe700 1 -- 172.21.15.32:0/17813297 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48380043c0 con 0x7f484c0d3730 2023-06-20T13:33:36.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.024+0000 7f48531ff700 1 -- 172.21.15.32:0/17813297 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f484c0d3730 msgr2=0x7f484c0cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:36.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.024+0000 7f48531ff700 1 --2- 172.21.15.32:0/17813297 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f484c0d3730 0x7f484c0cf550 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4838009870 tx=0x7f4838009b80 comp rx=0 tx=0).stop 2023-06-20T13:33:36.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.024+0000 7f48531ff700 1 -- 172.21.15.32:0/17813297 shutdown_connections 2023-06-20T13:33:36.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.024+0000 7f48531ff700 1 --2- 172.21.15.32:0/17813297 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f484c0d3730 0x7f484c0cf550 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:36.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.024+0000 7f48531ff700 1 -- 172.21.15.32:0/17813297 >> 172.21.15.32:0/17813297 conn(0x7f484c06b3f0 msgr2=0x7f484c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:36.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.024+0000 7f48531ff700 1 -- 172.21.15.32:0/17813297 shutdown_connections 2023-06-20T13:33:36.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.025+0000 7f48531ff700 1 -- 172.21.15.32:0/17813297 wait complete. 2023-06-20T13:33:36.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.026+0000 7f48531ff700 1 Processor -- start 2023-06-20T13:33:36.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.026+0000 7f48531ff700 1 -- start start 2023-06-20T13:33:36.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.027+0000 7f48531ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f484c0b8430 0x7f484c0cc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:36.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.027+0000 7f48531ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f484c0cfa90 0x7f484c15d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:36.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.027+0000 7f48531ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f484c0d3730 0x7f484c1f56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:36.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.027+0000 7f48531ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484c1f38f0 con 0x7f484c0b8430 2023-06-20T13:33:36.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.027+0000 7f48531ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484c15df90 con 0x7f484c0cfa90 2023-06-20T13:33:36.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.027+0000 7f48531ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484c1f32a0 con 0x7f484c0d3730 2023-06-20T13:33:36.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.027+0000 7f4850f9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f484c0b8430 0x7f484c0cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:36.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.028+0000 7f4850f9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f484c0b8430 0x7f484c0cc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35050/0 (socket says 172.21.15.32:35050) 2023-06-20T13:33:36.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.028+0000 7f4850f9b700 1 -- 172.21.15.32:0/1042407650 learned_addr learned my addr 172.21.15.32:0/1042407650 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:36.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.028+0000 7f484bfff700 1 --2- 172.21.15.32:0/1042407650 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f484c0cfa90 0x7f484c15d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:36.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.028+0000 7f485179c700 1 --2- 172.21.15.32:0/1042407650 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f484c0d3730 0x7f484c1f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:36.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.028+0000 7f4850f9b700 1 -- 172.21.15.32:0/1042407650 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f484c0d3730 msgr2=0x7f484c1f56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:36.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.028+0000 7f4850f9b700 1 --2- 172.21.15.32:0/1042407650 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f484c0d3730 0x7f484c1f56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:36.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.028+0000 7f4850f9b700 1 -- 172.21.15.32:0/1042407650 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f484c0cfa90 msgr2=0x7f484c15d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:36.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.028+0000 7f4850f9b700 1 --2- 172.21.15.32:0/1042407650 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f484c0cfa90 0x7f484c15d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:36.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.028+0000 7f4850f9b700 1 -- 172.21.15.32:0/1042407650 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48380094a0 con 0x7f484c0b8430 2023-06-20T13:33:36.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.028+0000 7f484bfff700 1 --2- 172.21.15.32:0/1042407650 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f484c0cfa90 0x7f484c15d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:36.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.028+0000 7f4850f9b700 1 --2- 172.21.15.32:0/1042407650 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f484c0b8430 0x7f484c0cc770 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f484000c520 tx=0x7f484000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:36.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.028+0000 7f48497fa700 1 -- 172.21.15.32:0/1042407650 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48400052d0 con 0x7f484c0b8430 2023-06-20T13:33:36.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.029+0000 7f48497fa700 1 -- 172.21.15.32:0/1042407650 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4840005430 con 0x7f484c0b8430 2023-06-20T13:33:36.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.029+0000 7f48497fa700 1 -- 172.21.15.32:0/1042407650 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48400038c0 con 0x7f484c0b8430 2023-06-20T13:33:36.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.029+0000 7f48531ff700 1 -- 172.21.15.32:0/1042407650 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f484c1f3580 con 0x7f484c0b8430 2023-06-20T13:33:36.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.029+0000 7f48531ff700 1 -- 172.21.15.32:0/1042407650 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f484c15dc80 con 0x7f484c0b8430 2023-06-20T13:33:36.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.030+0000 7f48531ff700 1 -- 172.21.15.32:0/1042407650 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f484c04ea60 con 0x7f484c0b8430 2023-06-20T13:33:36.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.031+0000 7f48497fa700 1 -- 172.21.15.32:0/1042407650 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4840003a20 con 0x7f484c0b8430 2023-06-20T13:33:36.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.032+0000 7f48497fa700 1 --2- 172.21.15.32:0/1042407650 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f483006ace0 0x7f483006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:36.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.032+0000 7f48497fa700 1 -- 172.21.15.32:0/1042407650 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4840088cc0 con 0x7f484c0b8430 2023-06-20T13:33:36.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.032+0000 7f484bfff700 1 --2- 172.21.15.32:0/1042407650 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f483006ace0 0x7f483006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:36.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.033+0000 7f484bfff700 1 --2- 172.21.15.32:0/1042407650 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f483006ace0 0x7f483006d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f48380090b0 tx=0x7f4838013040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:36.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.036+0000 7f48497fa700 1 -- 172.21.15.32:0/1042407650 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4840053ad0 con 0x7f484c0b8430 2023-06-20T13:33:36.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.241+0000 7f48531ff700 1 -- 172.21.15.32:0/1042407650 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f484c0b65b0 con 0x7f484c0b8430 2023-06-20T13:33:36.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.241+0000 7f48497fa700 1 -- 172.21.15.32:0/1042407650 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f48400570f0 con 0x7f484c0b8430 2023-06-20T13:33:36.243 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-06-20T13:33:36.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.243+0000 7f48531ff700 1 -- 172.21.15.32:0/1042407650 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f483006ace0 msgr2=0x7f483006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:36.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.244+0000 7f48531ff700 1 --2- 172.21.15.32:0/1042407650 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f483006ace0 0x7f483006d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f48380090b0 tx=0x7f4838013040 comp rx=0 tx=0).stop 2023-06-20T13:33:36.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.244+0000 7f48531ff700 1 -- 172.21.15.32:0/1042407650 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f484c0b8430 msgr2=0x7f484c0cc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:36.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.244+0000 7f48531ff700 1 --2- 172.21.15.32:0/1042407650 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f484c0b8430 0x7f484c0cc770 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f484000c520 tx=0x7f484000c8e0 comp rx=0 tx=0).stop 2023-06-20T13:33:36.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.244+0000 7f48531ff700 1 -- 172.21.15.32:0/1042407650 shutdown_connections 2023-06-20T13:33:36.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.244+0000 7f48531ff700 1 --2- 172.21.15.32:0/1042407650 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f483006ace0 0x7f483006d190 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:36.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.244+0000 7f48531ff700 1 --2- 172.21.15.32:0/1042407650 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f484c0d3730 0x7f484c1f56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:36.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.244+0000 7f48531ff700 1 --2- 172.21.15.32:0/1042407650 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f484c0b8430 0x7f484c0cc770 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:36.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.244+0000 7f48531ff700 1 --2- 172.21.15.32:0/1042407650 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f484c0cfa90 0x7f484c15d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:36.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.244+0000 7f48531ff700 1 -- 172.21.15.32:0/1042407650 >> 172.21.15.32:0/1042407650 conn(0x7f484c06b3f0 msgr2=0x7f484c0d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:36.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.244+0000 7f48531ff700 1 -- 172.21.15.32:0/1042407650 shutdown_connections 2023-06-20T13:33:36.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.244+0000 7f48531ff700 1 -- 172.21.15.32:0/1042407650 wait complete. 2023-06-20T13:33:36.264 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-20T13:33:36.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.465+0000 7f12ddfff700 1 Processor -- start 2023-06-20T13:33:36.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.465+0000 7f12ddfff700 1 -- start start 2023-06-20T13:33:36.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.466+0000 7f12ddfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12d80caee0 0x7f12d80cb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:36.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.466+0000 7f12ddfff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d80b0070 con 0x7f12d80afca0 2023-06-20T13:33:36.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.466+0000 7f12ddfff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d806e880 con 0x7f12d8160a40 2023-06-20T13:33:36.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.466+0000 7f12ddfff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d80cb8a0 con 0x7f12d80caee0 2023-06-20T13:33:36.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.466+0000 7f12d77fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f12d80afca0 0x7f12d806e0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43750/0 (socket says 172.21.15.32:43750) 2023-06-20T13:33:36.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.466+0000 7f12d77fe700 1 -- 172.21.15.32:0/2531165766 learned_addr learned my addr 172.21.15.32:0/2531165766 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:36.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.467+0000 7f12d7fff700 1 --2- 172.21.15.32:0/2531165766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12d80caee0 0x7f12d80cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:36.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.467+0000 7f12d67fc700 1 -- 172.21.15.32:0/2531165766 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2616425006 0 0) 0x7f12d80b0070 con 0x7f12d80afca0 2023-06-20T13:33:36.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.467+0000 7f12d67fc700 1 -- 172.21.15.32:0/2531165766 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12c00035b0 con 0x7f12d80afca0 2023-06-20T13:33:36.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.467+0000 7f12d67fc700 1 -- 172.21.15.32:0/2531165766 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1372618803 0 0) 0x7f12d806e880 con 0x7f12d8160a40 2023-06-20T13:33:36.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.467+0000 7f12d67fc700 1 -- 172.21.15.32:0/2531165766 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12d80b0070 con 0x7f12d8160a40 2023-06-20T13:33:36.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.467+0000 7f12d67fc700 1 -- 172.21.15.32:0/2531165766 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1008926544 0 0) 0x7f12c00035b0 con 0x7f12d80afca0 2023-06-20T13:33:36.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.467+0000 7f12d67fc700 1 -- 172.21.15.32:0/2531165766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12d80caee0 msgr2=0x7f12d80cb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:36.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.467+0000 7f12d67fc700 1 --2- 172.21.15.32:0/2531165766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12d80caee0 0x7f12d80cb360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:36.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.467+0000 7f12d67fc700 1 -- 172.21.15.32:0/2531165766 >> v1:172.21.15.115:6789/0 conn(0x7f12d8160a40 legacy=0x7f12d806bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:36.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.467+0000 7f12d67fc700 1 -- 172.21.15.32:0/2531165766 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d806eb60 con 0x7f12d80afca0 2023-06-20T13:33:36.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.467+0000 7f12d67fc700 1 -- 172.21.15.32:0/2531165766 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3380058562 0 0) 0x7f12c8005120 con 0x7f12d80afca0 2023-06-20T13:33:36.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.467+0000 7f12d67fc700 1 -- 172.21.15.32:0/2531165766 >> v1:172.21.15.32:6789/0 conn(0x7f12d80afca0 legacy=0x7f12d806e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:36.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.467+0000 7f12d67fc700 1 --2- 172.21.15.32:0/2531165766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12d80caee0 0x7f12c0003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:36.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.467+0000 7f12d67fc700 1 --2- 172.21.15.32:0/2531165766 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12c0004120 0x7f12c0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:36.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.467+0000 7f12d67fc700 1 --2- 172.21.15.32:0/2531165766 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c0004d90 0x7f12c0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:36.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.467+0000 7f12d67fc700 1 -- 172.21.15.32:0/2531165766 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d80cb8a0 con 0x7f12c0004120 2023-06-20T13:33:36.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.467+0000 7f12d67fc700 1 -- 172.21.15.32:0/2531165766 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c000bac0 con 0x7f12c0004d90 2023-06-20T13:33:36.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.467+0000 7f12d67fc700 1 -- 172.21.15.32:0/2531165766 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c000bc80 con 0x7f12d80caee0 2023-06-20T13:33:36.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.468+0000 7f12d6ffd700 1 --2- 172.21.15.32:0/2531165766 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12c0004120 0x7f12c0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:36.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.468+0000 7f12d77fe700 1 --2- 172.21.15.32:0/2531165766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12d80caee0 0x7f12c0003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:36.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.468+0000 7f12d7fff700 1 --2- 172.21.15.32:0/2531165766 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c0004d90 0x7f12c0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:36.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.468+0000 7f12d6ffd700 1 -- 172.21.15.32:0/2531165766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12d80caee0 msgr2=0x7f12c0003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:36.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.468+0000 7f12d6ffd700 1 --2- 172.21.15.32:0/2531165766 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12d80caee0 0x7f12c0003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:36.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.468+0000 7f12d6ffd700 1 -- 172.21.15.32:0/2531165766 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c0004d90 msgr2=0x7f12c0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:36.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.468+0000 7f12d6ffd700 1 --2- 172.21.15.32:0/2531165766 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c0004d90 0x7f12c0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:36.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.468+0000 7f12d6ffd700 1 -- 172.21.15.32:0/2531165766 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c00035b0 con 0x7f12c0004120 2023-06-20T13:33:36.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.468+0000 7f12d6ffd700 1 --2- 172.21.15.32:0/2531165766 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12c0004120 0x7f12c0004850 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f12cc001970 tx=0x7f12c0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a1e63e059fa44e server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:36.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.468+0000 7f12d67fc700 1 -- 172.21.15.32:0/2531165766 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc001460 con 0x7f12c0004120 2023-06-20T13:33:36.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.469+0000 7f12d67fc700 1 -- 172.21.15.32:0/2531165766 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12cc0052d0 con 0x7f12c0004120 2023-06-20T13:33:36.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.469+0000 7f12d67fc700 1 -- 172.21.15.32:0/2531165766 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc001da0 con 0x7f12c0004120 2023-06-20T13:33:36.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.469+0000 7f12ddfff700 1 -- 172.21.15.32:0/2531165766 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12c0004120 msgr2=0x7f12c0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:36.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.469+0000 7f12ddfff700 1 --2- 172.21.15.32:0/2531165766 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12c0004120 0x7f12c0004850 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f12cc001970 tx=0x7f12c0005880 comp rx=0 tx=0).stop 2023-06-20T13:33:36.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.469+0000 7f12d7fff700 1 -- 172.21.15.32:0/2531165766 reap_dead start 2023-06-20T13:33:36.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.469+0000 7f12ddfff700 1 -- 172.21.15.32:0/2531165766 shutdown_connections 2023-06-20T13:33:36.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.469+0000 7f12ddfff700 1 -- 172.21.15.32:0/2531165766 >> 172.21.15.32:0/2531165766 conn(0x7f12d808a3b0 msgr2=0x7f12d806a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:36.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.469+0000 7f12ddfff700 1 -- 172.21.15.32:0/2531165766 shutdown_connections 2023-06-20T13:33:36.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.469+0000 7f12ddfff700 1 -- 172.21.15.32:0/2531165766 wait complete. 2023-06-20T13:33:36.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.471+0000 7f12ddfff700 1 Processor -- start 2023-06-20T13:33:36.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.471+0000 7f12ddfff700 1 -- start start 2023-06-20T13:33:36.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.472+0000 7f12ddfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c0004120 0x7f12d80c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:36.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.472+0000 7f12ddfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12d814f0c0 0x7f12d80ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:36.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.472+0000 7f12ddfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12d80ae720 0x7f12d80aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:36.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.472+0000 7f12ddfff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d80af100 con 0x7f12d814f0c0 2023-06-20T13:33:36.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.472+0000 7f12ddfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d81f1be0 con 0x7f12c0004120 2023-06-20T13:33:36.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.472+0000 7f12ddfff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d81f60c0 con 0x7f12d80ae720 2023-06-20T13:33:36.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.472+0000 7f12d6ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12d814f0c0 0x7f12d80ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:36.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.472+0000 7f12d6ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12d814f0c0 0x7f12d80ca200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35078/0 (socket says 172.21.15.32:35078) 2023-06-20T13:33:36.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.472+0000 7f12d6ffd700 1 -- 172.21.15.32:0/1270053750 learned_addr learned my addr 172.21.15.32:0/1270053750 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:36.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.472+0000 7f12d77fe700 1 --2- 172.21.15.32:0/1270053750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c0004120 0x7f12d80c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:36.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.472+0000 7f12d7fff700 1 --2- 172.21.15.32:0/1270053750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12d80ae720 0x7f12d80aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:36.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.473+0000 7f12d6ffd700 1 -- 172.21.15.32:0/1270053750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12d80ae720 msgr2=0x7f12d80aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:36.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.473+0000 7f12d6ffd700 1 --2- 172.21.15.32:0/1270053750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12d80ae720 0x7f12d80aebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:36.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.473+0000 7f12d6ffd700 1 -- 172.21.15.32:0/1270053750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c0004120 msgr2=0x7f12d80c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:36.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.473+0000 7f12d6ffd700 1 --2- 172.21.15.32:0/1270053750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c0004120 0x7f12d80c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:36.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.473+0000 7f12d6ffd700 1 -- 172.21.15.32:0/1270053750 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d81f1ea0 con 0x7f12d814f0c0 2023-06-20T13:33:36.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.473+0000 7f12d6ffd700 1 --2- 172.21.15.32:0/1270053750 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12d814f0c0 0x7f12d80ca200 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f12c00047d0 tx=0x7f12cc001320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:36.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.473+0000 7f12bffff700 1 -- 172.21.15.32:0/1270053750 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc001da0 con 0x7f12d814f0c0 2023-06-20T13:33:36.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.473+0000 7f12bffff700 1 -- 172.21.15.32:0/1270053750 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12cc0050d0 con 0x7f12d814f0c0 2023-06-20T13:33:36.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.473+0000 7f12ddfff700 1 -- 172.21.15.32:0/1270053750 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d81f2180 con 0x7f12d814f0c0 2023-06-20T13:33:36.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.473+0000 7f12bffff700 1 -- 172.21.15.32:0/1270053750 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc007040 con 0x7f12d814f0c0 2023-06-20T13:33:36.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.473+0000 7f12ddfff700 1 -- 172.21.15.32:0/1270053750 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d81f2740 con 0x7f12d814f0c0 2023-06-20T13:33:36.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.475+0000 7f12ddfff700 1 -- 172.21.15.32:0/1270053750 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d804ea60 con 0x7f12d814f0c0 2023-06-20T13:33:36.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.476+0000 7f12bffff700 1 -- 172.21.15.32:0/1270053750 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f12cc0071a0 con 0x7f12d814f0c0 2023-06-20T13:33:36.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.477+0000 7f12bffff700 1 --2- 172.21.15.32:0/1270053750 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f12c406ace0 0x7f12c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:36.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.477+0000 7f12bffff700 1 -- 172.21.15.32:0/1270053750 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f12cc08a270 con 0x7f12d814f0c0 2023-06-20T13:33:36.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.477+0000 7f12d77fe700 1 --2- 172.21.15.32:0/1270053750 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f12c406ace0 0x7f12c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:36.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.478+0000 7f12d77fe700 1 --2- 172.21.15.32:0/1270053750 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f12c406ace0 0x7f12c406d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f12d80cf570 tx=0x7f12c8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:36.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.481+0000 7f12bffff700 1 -- 172.21.15.32:0/1270053750 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f12cc0551b0 con 0x7f12d814f0c0 2023-06-20T13:33:36.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.686+0000 7f12ddfff700 1 -- 172.21.15.32:0/1270053750 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f12d809a0e0 con 0x7f12d814f0c0 2023-06-20T13:33:36.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.687+0000 7f12bffff700 1 -- 172.21.15.32:0/1270053750 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f12cc0587d0 con 0x7f12d814f0c0 2023-06-20T13:33:36.690 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-06-20T13:33:36.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.689+0000 7f12ddfff700 1 -- 172.21.15.32:0/1270053750 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f12c406ace0 msgr2=0x7f12c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:36.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.689+0000 7f12ddfff700 1 --2- 172.21.15.32:0/1270053750 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f12c406ace0 0x7f12c406d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f12d80cf570 tx=0x7f12c8009040 comp rx=0 tx=0).stop 2023-06-20T13:33:36.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.689+0000 7f12ddfff700 1 -- 172.21.15.32:0/1270053750 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12d814f0c0 msgr2=0x7f12d80ca200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:36.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.689+0000 7f12ddfff700 1 --2- 172.21.15.32:0/1270053750 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12d814f0c0 0x7f12d80ca200 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f12c00047d0 tx=0x7f12cc001320 comp rx=0 tx=0).stop 2023-06-20T13:33:36.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.690+0000 7f12ddfff700 1 -- 172.21.15.32:0/1270053750 shutdown_connections 2023-06-20T13:33:36.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.690+0000 7f12ddfff700 1 --2- 172.21.15.32:0/1270053750 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f12c406ace0 0x7f12c406d190 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:36.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.690+0000 7f12ddfff700 1 --2- 172.21.15.32:0/1270053750 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12d80ae720 0x7f12d80aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:36.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.690+0000 7f12ddfff700 1 --2- 172.21.15.32:0/1270053750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f12c0004120 0x7f12d80c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:36.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.690+0000 7f12ddfff700 1 --2- 172.21.15.32:0/1270053750 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12d814f0c0 0x7f12d80ca200 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:36.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.690+0000 7f12ddfff700 1 -- 172.21.15.32:0/1270053750 >> 172.21.15.32:0/1270053750 conn(0x7f12d808a3b0 msgr2=0x7f12d806a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:36.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.690+0000 7f12ddfff700 1 -- 172.21.15.32:0/1270053750 shutdown_connections 2023-06-20T13:33:36.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.690+0000 7f12ddfff700 1 -- 172.21.15.32:0/1270053750 wait complete. 2023-06-20T13:33:36.709 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-20T13:33:36.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.910+0000 7f34ecfff700 1 Processor -- start 2023-06-20T13:33:36.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.910+0000 7f34ecfff700 1 -- start start 2023-06-20T13:33:36.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.911+0000 7f34ecfff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f34e80cc700 0x7f34e806cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:36.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.911+0000 7f34ecfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f34e815fd70 0x7f34e81601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:36.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.911+0000 7f34ecfff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e80ce530 con 0x7f34e80afdb0 2023-06-20T13:33:36.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.911+0000 7f34ecfff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e815c6f0 con 0x7f34e80cc700 2023-06-20T13:33:36.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.911+0000 7f34ecfff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e8070ce0 con 0x7f34e815fd70 2023-06-20T13:33:36.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.911+0000 7f34e659c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f34e80cc700 0x7f34e806cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:36.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.912+0000 7f34e659c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f34e80cc700 0x7f34e806cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35092/0 (socket says 172.21.15.32:35092) 2023-06-20T13:33:36.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.912+0000 7f34e659c700 1 -- 172.21.15.32:0/3045046893 learned_addr learned my addr 172.21.15.32:0/3045046893 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:36.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.912+0000 7f34e6d9d700 1 --2- 172.21.15.32:0/3045046893 >> v2:172.21.15.115:3300/0 conn(0x7f34e815fd70 0x7f34e81601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:36.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.912+0000 7f34e659c700 1 -- 172.21.15.32:0/3045046893 >> v2:172.21.15.115:3300/0 conn(0x7f34e815fd70 msgr2=0x7f34e81601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:36.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.912+0000 7f34e659c700 1 --2- 172.21.15.32:0/3045046893 >> v2:172.21.15.115:3300/0 conn(0x7f34e815fd70 0x7f34e81601d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:36.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.912+0000 7f34e659c700 1 -- 172.21.15.32:0/3045046893 >> v1:172.21.15.115:6789/0 conn(0x7f34e80afdb0 legacy=0x7f34e80cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:36.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.912+0000 7f34e659c700 1 -- 172.21.15.32:0/3045046893 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e8070f80 con 0x7f34e80cc700 2023-06-20T13:33:36.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.912+0000 7f34e659c700 1 --2- 172.21.15.32:0/3045046893 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34e80cc700 0x7f34e806cce0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f34e806f5f0 tx=0x7f34d8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cab3759e6d273ab server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:36.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.912+0000 7f34e559a700 1 -- 172.21.15.32:0/3045046893 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d8011830 con 0x7f34e80cc700 2023-06-20T13:33:36.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.913+0000 7f34e559a700 1 -- 172.21.15.32:0/3045046893 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d8011990 con 0x7f34e80cc700 2023-06-20T13:33:36.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.913+0000 7f34e559a700 1 -- 172.21.15.32:0/3045046893 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d8011d20 con 0x7f34e80cc700 2023-06-20T13:33:36.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.913+0000 7f34ecfff700 1 -- 172.21.15.32:0/3045046893 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34e80cc700 msgr2=0x7f34e806cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:36.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.913+0000 7f34ecfff700 1 --2- 172.21.15.32:0/3045046893 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34e80cc700 0x7f34e806cce0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f34e806f5f0 tx=0x7f34d8009bd0 comp rx=0 tx=0).stop 2023-06-20T13:33:36.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.913+0000 7f34ecfff700 1 -- 172.21.15.32:0/3045046893 shutdown_connections 2023-06-20T13:33:36.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.913+0000 7f34ecfff700 1 --2- 172.21.15.32:0/3045046893 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34e80cc700 0x7f34e806cce0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:36.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.913+0000 7f34ecfff700 1 --2- 172.21.15.32:0/3045046893 >> v2:172.21.15.115:3300/0 conn(0x7f34e815fd70 0x7f34e81601d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:36.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.913+0000 7f34ecfff700 1 -- 172.21.15.32:0/3045046893 >> 172.21.15.32:0/3045046893 conn(0x7f34e806e5c0 msgr2=0x7f34e806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:36.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.913+0000 7f34ecfff700 1 -- 172.21.15.32:0/3045046893 shutdown_connections 2023-06-20T13:33:36.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.913+0000 7f34ecfff700 1 -- 172.21.15.32:0/3045046893 wait complete. 2023-06-20T13:33:36.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.915+0000 7f34ecfff700 1 Processor -- start 2023-06-20T13:33:36.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.915+0000 7f34ecfff700 1 -- start start 2023-06-20T13:33:36.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.916+0000 7f34ecfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34e80afdb0 0x7f34e814ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:36.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.916+0000 7f34ecfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f34e80cc700 0x7f34e806e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:36.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.916+0000 7f34ecfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34e815fd70 0x7f34e806eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:36.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.916+0000 7f34ecfff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e814d370 con 0x7f34e80afdb0 2023-06-20T13:33:36.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.916+0000 7f34ecfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e80b5290 con 0x7f34e815fd70 2023-06-20T13:33:36.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.916+0000 7f34ecfff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e80b4680 con 0x7f34e80cc700 2023-06-20T13:33:36.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.916+0000 7f34e659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34e80afdb0 0x7f34e814ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:36.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.916+0000 7f34e659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34e80afdb0 0x7f34e814ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35108/0 (socket says 172.21.15.32:35108) 2023-06-20T13:33:36.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.916+0000 7f34e659c700 1 -- 172.21.15.32:0/848283136 learned_addr learned my addr 172.21.15.32:0/848283136 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:36.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.916+0000 7f34e5d9b700 1 --2- 172.21.15.32:0/848283136 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f34e80cc700 0x7f34e806e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:36.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.916+0000 7f34e6d9d700 1 --2- 172.21.15.32:0/848283136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34e815fd70 0x7f34e806eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:36.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.917+0000 7f34e659c700 1 -- 172.21.15.32:0/848283136 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f34e80cc700 msgr2=0x7f34e806e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:36.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.917+0000 7f34e659c700 1 --2- 172.21.15.32:0/848283136 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f34e80cc700 0x7f34e806e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:36.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.917+0000 7f34e659c700 1 -- 172.21.15.32:0/848283136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34e815fd70 msgr2=0x7f34e806eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:36.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.917+0000 7f34e659c700 1 --2- 172.21.15.32:0/848283136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34e815fd70 0x7f34e806eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:36.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.917+0000 7f34e659c700 1 -- 172.21.15.32:0/848283136 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d8009550 con 0x7f34e80afdb0 2023-06-20T13:33:36.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.917+0000 7f34e659c700 1 --2- 172.21.15.32:0/848283136 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34e80afdb0 0x7f34e814ce30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f34d8000c00 tx=0x7f34d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:36.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.917+0000 7f34d6ffd700 1 -- 172.21.15.32:0/848283136 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d8004380 con 0x7f34e80afdb0 2023-06-20T13:33:36.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.917+0000 7f34d6ffd700 1 -- 172.21.15.32:0/848283136 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d801f070 con 0x7f34e80afdb0 2023-06-20T13:33:36.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.917+0000 7f34ecfff700 1 -- 172.21.15.32:0/848283136 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e80b4960 con 0x7f34e80afdb0 2023-06-20T13:33:36.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.917+0000 7f34d6ffd700 1 -- 172.21.15.32:0/848283136 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d80036a0 con 0x7f34e80afdb0 2023-06-20T13:33:36.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.917+0000 7f34ecfff700 1 -- 172.21.15.32:0/848283136 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e80b4f20 con 0x7f34e80afdb0 2023-06-20T13:33:36.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.919+0000 7f34ecfff700 1 -- 172.21.15.32:0/848283136 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e804ea60 con 0x7f34e80afdb0 2023-06-20T13:33:36.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.919+0000 7f34d6ffd700 1 -- 172.21.15.32:0/848283136 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f34d8021030 con 0x7f34e80afdb0 2023-06-20T13:33:36.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.921+0000 7f34d6ffd700 1 --2- 172.21.15.32:0/848283136 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f34c806ace0 0x7f34c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:36.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.921+0000 7f34d6ffd700 1 -- 172.21.15.32:0/848283136 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f34d808aab0 con 0x7f34e80afdb0 2023-06-20T13:33:36.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.921+0000 7f34e5d9b700 1 --2- 172.21.15.32:0/848283136 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f34c806ace0 0x7f34c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:36.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.922+0000 7f34e5d9b700 1 --2- 172.21.15.32:0/848283136 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f34c806ace0 0x7f34c806d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f34e81603d0 tx=0x7f34dc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:36.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:36.925+0000 7f34d6ffd700 1 -- 172.21.15.32:0/848283136 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f34d8055840 con 0x7f34e80afdb0 2023-06-20T13:33:37.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.135+0000 7f34ecfff700 1 -- 172.21.15.32:0/848283136 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f34e80706f0 con 0x7f34e80afdb0 2023-06-20T13:33:37.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.135+0000 7f34d6ffd700 1 -- 172.21.15.32:0/848283136 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f34d8058e60 con 0x7f34e80afdb0 2023-06-20T13:33:37.138 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-06-20T13:33:37.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.138+0000 7f34ecfff700 1 -- 172.21.15.32:0/848283136 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f34c806ace0 msgr2=0x7f34c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:37.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.138+0000 7f34ecfff700 1 --2- 172.21.15.32:0/848283136 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f34c806ace0 0x7f34c806d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f34e81603d0 tx=0x7f34dc009040 comp rx=0 tx=0).stop 2023-06-20T13:33:37.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.138+0000 7f34ecfff700 1 -- 172.21.15.32:0/848283136 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34e80afdb0 msgr2=0x7f34e814ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:37.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.138+0000 7f34ecfff700 1 --2- 172.21.15.32:0/848283136 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34e80afdb0 0x7f34e814ce30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f34d8000c00 tx=0x7f34d8004750 comp rx=0 tx=0).stop 2023-06-20T13:33:37.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.138+0000 7f34ecfff700 1 -- 172.21.15.32:0/848283136 shutdown_connections 2023-06-20T13:33:37.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.138+0000 7f34ecfff700 1 --2- 172.21.15.32:0/848283136 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f34c806ace0 0x7f34c806d190 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:37.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.138+0000 7f34ecfff700 1 --2- 172.21.15.32:0/848283136 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f34e815fd70 0x7f34e806eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:37.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.138+0000 7f34ecfff700 1 --2- 172.21.15.32:0/848283136 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f34e80afdb0 0x7f34e814ce30 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:37.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.138+0000 7f34ecfff700 1 --2- 172.21.15.32:0/848283136 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f34e80cc700 0x7f34e806e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:37.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.138+0000 7f34ecfff700 1 -- 172.21.15.32:0/848283136 >> 172.21.15.32:0/848283136 conn(0x7f34e806e5c0 msgr2=0x7f34e80b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:37.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.138+0000 7f34ecfff700 1 -- 172.21.15.32:0/848283136 shutdown_connections 2023-06-20T13:33:37.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.138+0000 7f34ecfff700 1 -- 172.21.15.32:0/848283136 wait complete. 2023-06-20T13:33:37.158 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-20T13:33:37.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.358+0000 7fc390dff700 1 Processor -- start 2023-06-20T13:33:37.360 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.358+0000 7fc390dff700 1 -- start start 2023-06-20T13:33:37.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.359+0000 7fc390dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc38c15c460 0x7fc38c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:37.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.359+0000 7fc390dff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc38c0d1790 con 0x7fc38c0cf8f0 2023-06-20T13:33:37.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.359+0000 7fc390dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc38c0cd950 con 0x7fc38c0d2640 2023-06-20T13:33:37.362 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.359+0000 7fc390dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc38c0cedd0 con 0x7fc38c15c460 2023-06-20T13:33:37.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.359+0000 7fc38ad9d700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc38c0cf8f0 0x7fc38c15fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43758/0 (socket says 172.21.15.32:43758) 2023-06-20T13:33:37.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.359+0000 7fc38ad9d700 1 -- 172.21.15.32:0/1324593931 learned_addr learned my addr 172.21.15.32:0/1324593931 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:37.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.360+0000 7fc38a59c700 1 --2- 172.21.15.32:0/1324593931 >> v2:172.21.15.115:3300/0 conn(0x7fc38c15c460 0x7fc38c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:37.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.360+0000 7fc38959a700 1 -- 172.21.15.32:0/1324593931 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1649469648 0 0) 0x7fc38c0d1790 con 0x7fc38c0cf8f0 2023-06-20T13:33:37.363 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.360+0000 7fc38959a700 1 -- 172.21.15.32:0/1324593931 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3740035b0 con 0x7fc38c0cf8f0 2023-06-20T13:33:37.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.360+0000 7fc38959a700 1 -- 172.21.15.32:0/1324593931 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 753365774 0 0) 0x7fc38c0cd950 con 0x7fc38c0d2640 2023-06-20T13:33:37.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.360+0000 7fc38959a700 1 -- 172.21.15.32:0/1324593931 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc38c0d1790 con 0x7fc38c0d2640 2023-06-20T13:33:37.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.360+0000 7fc38a59c700 1 -- 172.21.15.32:0/1324593931 >> v1:172.21.15.115:6789/0 conn(0x7fc38c0d2640 legacy=0x7fc38c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:37.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.360+0000 7fc38a59c700 1 -- 172.21.15.32:0/1324593931 >> v1:172.21.15.32:6789/0 conn(0x7fc38c0cf8f0 legacy=0x7fc38c15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:37.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.360+0000 7fc38a59c700 1 -- 172.21.15.32:0/1324593931 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc38c0d14b0 con 0x7fc38c15c460 2023-06-20T13:33:37.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.360+0000 7fc38a59c700 1 --2- 172.21.15.32:0/1324593931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc38c15c460 0x7fc38c0b59d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc37c009840 tx=0x7fc37c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d15de7ac12b562f7 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:37.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.361+0000 7fc38959a700 1 -- 172.21.15.32:0/1324593931 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c011830 con 0x7fc38c15c460 2023-06-20T13:33:37.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.361+0000 7fc38959a700 1 -- 172.21.15.32:0/1324593931 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37c011990 con 0x7fc38c15c460 2023-06-20T13:33:37.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.361+0000 7fc38959a700 1 -- 172.21.15.32:0/1324593931 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c011d00 con 0x7fc38c15c460 2023-06-20T13:33:37.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.361+0000 7fc390dff700 1 -- 172.21.15.32:0/1324593931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc38c15c460 msgr2=0x7fc38c0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:37.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.361+0000 7fc390dff700 1 --2- 172.21.15.32:0/1324593931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc38c15c460 0x7fc38c0b59d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc37c009840 tx=0x7fc37c009b50 comp rx=0 tx=0).stop 2023-06-20T13:33:37.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.361+0000 7fc390dff700 1 -- 172.21.15.32:0/1324593931 shutdown_connections 2023-06-20T13:33:37.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.361+0000 7fc390dff700 1 --2- 172.21.15.32:0/1324593931 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc38c15c460 0x7fc38c0b59d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:37.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.361+0000 7fc390dff700 1 -- 172.21.15.32:0/1324593931 >> 172.21.15.32:0/1324593931 conn(0x7fc38c071660 msgr2=0x7fc38c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:37.366 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.361+0000 7fc390dff700 1 -- 172.21.15.32:0/1324593931 shutdown_connections 2023-06-20T13:33:37.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.361+0000 7fc390dff700 1 -- 172.21.15.32:0/1324593931 wait complete. 2023-06-20T13:33:37.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.363+0000 7fc390dff700 1 Processor -- start 2023-06-20T13:33:37.367 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.363+0000 7fc390dff700 1 -- start start 2023-06-20T13:33:37.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.364+0000 7fc390dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc38c0cf8f0 0x7fc38c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:37.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.364+0000 7fc390dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc38c0d2640 0x7fc38c1f13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:37.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.364+0000 7fc390dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc38c15c460 0x7fc38c0b6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:37.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.364+0000 7fc390dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c15daa0 con 0x7fc38c0d2640 2023-06-20T13:33:37.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.364+0000 7fc390dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c15c830 con 0x7fc38c0cf8f0 2023-06-20T13:33:37.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.364+0000 7fc390dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c0c7610 con 0x7fc38c15c460 2023-06-20T13:33:37.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.364+0000 7fc389d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc38c0d2640 0x7fc38c1f13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:37.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.364+0000 7fc389d9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc38c0d2640 0x7fc38c1f13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35110/0 (socket says 172.21.15.32:35110) 2023-06-20T13:33:37.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.365+0000 7fc389d9b700 1 -- 172.21.15.32:0/1831919884 learned_addr learned my addr 172.21.15.32:0/1831919884 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:37.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.365+0000 7fc38a59c700 1 --2- 172.21.15.32:0/1831919884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc38c0cf8f0 0x7fc38c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:37.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.365+0000 7fc38ad9d700 1 --2- 172.21.15.32:0/1831919884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc38c15c460 0x7fc38c0b6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:37.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.365+0000 7fc389d9b700 1 -- 172.21.15.32:0/1831919884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc38c15c460 msgr2=0x7fc38c0b6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:37.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.365+0000 7fc389d9b700 1 --2- 172.21.15.32:0/1831919884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc38c15c460 0x7fc38c0b6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:37.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.365+0000 7fc389d9b700 1 -- 172.21.15.32:0/1831919884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc38c0cf8f0 msgr2=0x7fc38c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:37.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.365+0000 7fc389d9b700 1 --2- 172.21.15.32:0/1831919884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc38c0cf8f0 0x7fc38c15d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:37.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.365+0000 7fc389d9b700 1 -- 172.21.15.32:0/1831919884 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c0094a0 con 0x7fc38c0d2640 2023-06-20T13:33:37.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.365+0000 7fc38ad9d700 1 --2- 172.21.15.32:0/1831919884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc38c15c460 0x7fc38c0b6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:37.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.365+0000 7fc389d9b700 1 --2- 172.21.15.32:0/1831919884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc38c0d2640 0x7fc38c1f13b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc38000c520 tx=0x7fc38000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:37.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.365+0000 7fc37affd700 1 -- 172.21.15.32:0/1831919884 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3800052d0 con 0x7fc38c0d2640 2023-06-20T13:33:37.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.365+0000 7fc37affd700 1 -- 172.21.15.32:0/1831919884 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc380005430 con 0x7fc38c0d2640 2023-06-20T13:33:37.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.365+0000 7fc390dff700 1 -- 172.21.15.32:0/1831919884 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc38c15ca80 con 0x7fc38c0d2640 2023-06-20T13:33:37.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.365+0000 7fc37affd700 1 -- 172.21.15.32:0/1831919884 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3800038a0 con 0x7fc38c0d2640 2023-06-20T13:33:37.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.366+0000 7fc390dff700 1 -- 172.21.15.32:0/1831919884 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc38c15d040 con 0x7fc38c0d2640 2023-06-20T13:33:37.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.367+0000 7fc390dff700 1 -- 172.21.15.32:0/1831919884 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc38c04ea60 con 0x7fc38c0d2640 2023-06-20T13:33:37.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.368+0000 7fc37affd700 1 -- 172.21.15.32:0/1831919884 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc380003a00 con 0x7fc38c0d2640 2023-06-20T13:33:37.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.369+0000 7fc37affd700 1 --2- 172.21.15.32:0/1831919884 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fc36c06ace0 0x7fc36c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:37.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.369+0000 7fc37affd700 1 -- 172.21.15.32:0/1831919884 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc380088c50 con 0x7fc38c0d2640 2023-06-20T13:33:37.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.369+0000 7fc38a59c700 1 --2- 172.21.15.32:0/1831919884 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fc36c06ace0 0x7fc36c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:37.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.370+0000 7fc38a59c700 1 --2- 172.21.15.32:0/1831919884 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fc36c06ace0 0x7fc36c06d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc37c0090b0 tx=0x7fc37c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:37.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.373+0000 7fc37affd700 1 -- 172.21.15.32:0/1831919884 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc38008e020 con 0x7fc38c0d2640 2023-06-20T13:33:37.595 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.593+0000 7fc390dff700 1 -- 172.21.15.32:0/1831919884 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc38c0b4fa0 con 0x7fc38c0d2640 2023-06-20T13:33:37.596 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.593+0000 7fc37affd700 1 -- 172.21.15.32:0/1831919884 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc380053a60 con 0x7fc38c0d2640 2023-06-20T13:33:37.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.596+0000 7fc390dff700 1 -- 172.21.15.32:0/1831919884 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fc36c06ace0 msgr2=0x7fc36c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:37.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.596+0000 7fc390dff700 1 --2- 172.21.15.32:0/1831919884 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fc36c06ace0 0x7fc36c06d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc37c0090b0 tx=0x7fc37c008030 comp rx=0 tx=0).stop 2023-06-20T13:33:37.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.596+0000 7fc390dff700 1 -- 172.21.15.32:0/1831919884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc38c0d2640 msgr2=0x7fc38c1f13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:37.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.596+0000 7fc390dff700 1 --2- 172.21.15.32:0/1831919884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc38c0d2640 0x7fc38c1f13b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc38000c520 tx=0x7fc38000c830 comp rx=0 tx=0).stop 2023-06-20T13:33:37.598 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.596+0000 7fc390dff700 1 -- 172.21.15.32:0/1831919884 shutdown_connections 2023-06-20T13:33:37.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.596+0000 7fc390dff700 1 --2- 172.21.15.32:0/1831919884 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fc36c06ace0 0x7fc36c06d190 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:37.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.596+0000 7fc390dff700 1 --2- 172.21.15.32:0/1831919884 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc38c15c460 0x7fc38c0b6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:37.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.596+0000 7fc390dff700 1 --2- 172.21.15.32:0/1831919884 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc38c0cf8f0 0x7fc38c15d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:37.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.596+0000 7fc390dff700 1 --2- 172.21.15.32:0/1831919884 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc38c0d2640 0x7fc38c1f13b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:37.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.596+0000 7fc390dff700 1 -- 172.21.15.32:0/1831919884 >> 172.21.15.32:0/1831919884 conn(0x7fc38c071660 msgr2=0x7fc38c0cf070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:37.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.596+0000 7fc390dff700 1 -- 172.21.15.32:0/1831919884 shutdown_connections 2023-06-20T13:33:37.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:37.596+0000 7fc390dff700 1 -- 172.21.15.32:0/1831919884 wait complete. 2023-06-20T13:33:37.600 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2023-06-20T13:33:37.615 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-06-20T13:33:37.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:37.616 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-06-20T13:33:37.713 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-06-20T13:33:37.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:37.715 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-20T13:33:37.770 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:33:37.770 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-20T13:33:37.816 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:33:37.817 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-20T13:33:37.901 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:33:37.901 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-20T13:33:37.986 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:33:38.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.227+0000 7f59257ff700 1 Processor -- start 2023-06-20T13:33:38.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.227+0000 7f59257ff700 1 -- start start 2023-06-20T13:33:38.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.228+0000 7f59257ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f592015c460 0x7f59200b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:38.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.228+0000 7f59257ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59200d2640 0x7f59200cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:38.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.228+0000 7f59257ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59200d1790 con 0x7f59200cf720 2023-06-20T13:33:38.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.228+0000 7f59257ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59200cedd0 con 0x7f592015c460 2023-06-20T13:33:38.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.228+0000 7f59257ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59200cd950 con 0x7f59200d2640 2023-06-20T13:33:38.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.228+0000 7f591effd700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f592015c460 0x7f59200b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:38.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.228+0000 7f5917fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59200d2640 0x7f59200cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:38.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.228+0000 7f591f7fe700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f59200cf720 0x7f59200d2b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.32:41954/0 (socket says 172.21.15.32:41954) 2023-06-20T13:33:38.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.230+0000 7f591f7fe700 1 -- 172.21.15.32:0/2133408220 learned_addr learned my addr 172.21.15.32:0/2133408220 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:38.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.230+0000 7f591e7fc700 1 -- 172.21.15.32:0/2133408220 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3703683150 0 0) 0x7f59200d1790 con 0x7f59200cf720 2023-06-20T13:33:38.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.230+0000 7f591e7fc700 1 -- 172.21.15.32:0/2133408220 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f590c0035b0 con 0x7f59200cf720 2023-06-20T13:33:38.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.230+0000 7f5917fff700 1 -- 172.21.15.32:0/2133408220 >> v2:172.21.15.115:3300/0 conn(0x7f592015c460 msgr2=0x7f59200b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:38.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.230+0000 7f5917fff700 1 --2- 172.21.15.32:0/2133408220 >> v2:172.21.15.115:3300/0 conn(0x7f592015c460 0x7f59200b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:38.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.230+0000 7f5917fff700 1 -- 172.21.15.32:0/2133408220 >> v1:172.21.15.115:6789/0 conn(0x7f59200cf720 legacy=0x7f59200d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:38.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.230+0000 7f5917fff700 1 -- 172.21.15.32:0/2133408220 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59200d14b0 con 0x7f59200d2640 2023-06-20T13:33:38.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.230+0000 7f591effd700 1 --2- 172.21.15.32:0/2133408220 >> v2:172.21.15.115:3300/0 conn(0x7f592015c460 0x7f59200b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:33:38.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.230+0000 7f5917fff700 1 --2- 172.21.15.32:0/2133408220 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59200d2640 0x7f59200cf1e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5908009840 tx=0x7f5908009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50d6cdfd4981df0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:38.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.230+0000 7f591e7fc700 1 -- 172.21.15.32:0/2133408220 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5908011830 con 0x7f59200d2640 2023-06-20T13:33:38.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.230+0000 7f591e7fc700 1 -- 172.21.15.32:0/2133408220 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5908011990 con 0x7f59200d2640 2023-06-20T13:33:38.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.230+0000 7f591e7fc700 1 -- 172.21.15.32:0/2133408220 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5908011d20 con 0x7f59200d2640 2023-06-20T13:33:38.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.230+0000 7f59257ff700 1 -- 172.21.15.32:0/2133408220 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59200d2640 msgr2=0x7f59200cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:38.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.230+0000 7f59257ff700 1 --2- 172.21.15.32:0/2133408220 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59200d2640 0x7f59200cf1e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5908009840 tx=0x7f5908009b50 comp rx=0 tx=0).stop 2023-06-20T13:33:38.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.230+0000 7f59257ff700 1 -- 172.21.15.32:0/2133408220 shutdown_connections 2023-06-20T13:33:38.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.230+0000 7f59257ff700 1 --2- 172.21.15.32:0/2133408220 >> v2:172.21.15.115:3300/0 conn(0x7f592015c460 0x7f59200b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:38.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.230+0000 7f59257ff700 1 --2- 172.21.15.32:0/2133408220 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59200d2640 0x7f59200cf1e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:38.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.230+0000 7f59257ff700 1 -- 172.21.15.32:0/2133408220 >> 172.21.15.32:0/2133408220 conn(0x7f5920071660 msgr2=0x7f5920071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:38.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.231+0000 7f59257ff700 1 -- 172.21.15.32:0/2133408220 shutdown_connections 2023-06-20T13:33:38.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.231+0000 7f59257ff700 1 -- 172.21.15.32:0/2133408220 wait complete. 2023-06-20T13:33:38.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.233+0000 7f59257ff700 1 Processor -- start 2023-06-20T13:33:38.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.233+0000 7f59257ff700 1 -- start start 2023-06-20T13:33:38.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.233+0000 7f59257ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59200cf720 0x7f59200c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:38.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.233+0000 7f59257ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59200d2640 0x7f59201e7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:38.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.234+0000 7f59257ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f592015c460 0x7f59200c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:38.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.234+0000 7f59257ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59201e8640 con 0x7f592015c460 2023-06-20T13:33:38.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.234+0000 7f59257ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59201e7b80 con 0x7f59200d2640 2023-06-20T13:33:38.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.234+0000 7f59257ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59201e7da0 con 0x7f59200cf720 2023-06-20T13:33:38.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.234+0000 7f591f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f592015c460 0x7f59200c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:38.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.234+0000 7f591f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f592015c460 0x7f59200c9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35122/0 (socket says 172.21.15.32:35122) 2023-06-20T13:33:38.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.234+0000 7f591f7fe700 1 -- 172.21.15.32:0/4011838371 learned_addr learned my addr 172.21.15.32:0/4011838371 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:38.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.234+0000 7f591effd700 1 --2- 172.21.15.32:0/4011838371 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59200cf720 0x7f59200c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:38.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.234+0000 7f5917fff700 1 --2- 172.21.15.32:0/4011838371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59200d2640 0x7f59201e7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:38.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.234+0000 7f5917fff700 1 -- 172.21.15.32:0/4011838371 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59200cf720 msgr2=0x7f59200c5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:38.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.234+0000 7f5917fff700 1 --2- 172.21.15.32:0/4011838371 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59200cf720 0x7f59200c5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:38.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.234+0000 7f5917fff700 1 -- 172.21.15.32:0/4011838371 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f592015c460 msgr2=0x7f59200c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:38.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.234+0000 7f5917fff700 1 --2- 172.21.15.32:0/4011838371 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f592015c460 0x7f59200c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:38.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.234+0000 7f5917fff700 1 -- 172.21.15.32:0/4011838371 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59100094a0 con 0x7f59200d2640 2023-06-20T13:33:38.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.234+0000 7f591f7fe700 1 --2- 172.21.15.32:0/4011838371 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f592015c460 0x7f59200c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:33:38.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.235+0000 7f5917fff700 1 --2- 172.21.15.32:0/4011838371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59200d2640 0x7f59201e7640 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5908016000 tx=0x7f5908004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:38.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.235+0000 7f59177fe700 1 -- 172.21.15.32:0/4011838371 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59080036a0 con 0x7f59200d2640 2023-06-20T13:33:38.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.235+0000 7f59177fe700 1 -- 172.21.15.32:0/4011838371 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590801e070 con 0x7f59200d2640 2023-06-20T13:33:38.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.235+0000 7f59257ff700 1 -- 172.21.15.32:0/4011838371 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59080094a0 con 0x7f59200d2640 2023-06-20T13:33:38.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.235+0000 7f59177fe700 1 -- 172.21.15.32:0/4011838371 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5908003a60 con 0x7f59200d2640 2023-06-20T13:33:38.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.235+0000 7f59257ff700 1 -- 172.21.15.32:0/4011838371 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59201e8360 con 0x7f59200d2640 2023-06-20T13:33:38.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.236+0000 7f59257ff700 1 -- 172.21.15.32:0/4011838371 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f592004ea60 con 0x7f59200d2640 2023-06-20T13:33:38.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.237+0000 7f59177fe700 1 -- 172.21.15.32:0/4011838371 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5908003bc0 con 0x7f59200d2640 2023-06-20T13:33:38.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.238+0000 7f59177fe700 1 --2- 172.21.15.32:0/4011838371 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f590006ace0 0x7f590006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:38.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.238+0000 7f59177fe700 1 -- 172.21.15.32:0/4011838371 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f590808aac0 con 0x7f59200d2640 2023-06-20T13:33:38.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.238+0000 7f591effd700 1 --2- 172.21.15.32:0/4011838371 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f590006ace0 0x7f590006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:38.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.239+0000 7f591effd700 1 --2- 172.21.15.32:0/4011838371 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f590006ace0 0x7f590006d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5910009d70 tx=0x7f5910009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:38.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.242+0000 7f59177fe700 1 -- 172.21.15.32:0/4011838371 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f59080558b0 con 0x7f59200d2640 2023-06-20T13:33:38.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.451+0000 7f59257ff700 1 -- 172.21.15.32:0/4011838371 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59200b4fa0 con 0x7f59200d2640 2023-06-20T13:33:38.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.453+0000 7f59177fe700 1 -- 172.21.15.32:0/4011838371 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20191 (secure 0 0 0) 0x7f5908058ed0 con 0x7f59200d2640 2023-06-20T13:33:38.455 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:33:38.455 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":29,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:33:00.976862+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-20T13:32:18.120021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-20T13:32:19.503624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-20T13:32:23.074912+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:33:38.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.456+0000 7f59257ff700 1 -- 172.21.15.32:0/4011838371 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f590006ace0 msgr2=0x7f590006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:38.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.456+0000 7f59257ff700 1 --2- 172.21.15.32:0/4011838371 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f590006ace0 0x7f590006d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5910009d70 tx=0x7f5910009210 comp rx=0 tx=0).stop 2023-06-20T13:33:38.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.456+0000 7f59257ff700 1 -- 172.21.15.32:0/4011838371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59200d2640 msgr2=0x7f59201e7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:38.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.456+0000 7f59257ff700 1 --2- 172.21.15.32:0/4011838371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59200d2640 0x7f59201e7640 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5908016000 tx=0x7f5908004750 comp rx=0 tx=0).stop 2023-06-20T13:33:38.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.456+0000 7f59257ff700 1 -- 172.21.15.32:0/4011838371 shutdown_connections 2023-06-20T13:33:38.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.456+0000 7f59257ff700 1 --2- 172.21.15.32:0/4011838371 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f590006ace0 0x7f590006d190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:38.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.456+0000 7f59257ff700 1 --2- 172.21.15.32:0/4011838371 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f592015c460 0x7f59200c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:38.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.456+0000 7f59257ff700 1 --2- 172.21.15.32:0/4011838371 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59200cf720 0x7f59200c5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:38.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.456+0000 7f59257ff700 1 --2- 172.21.15.32:0/4011838371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f59200d2640 0x7f59201e7640 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:38.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.456+0000 7f59257ff700 1 -- 172.21.15.32:0/4011838371 >> 172.21.15.32:0/4011838371 conn(0x7f5920071660 msgr2=0x7f59200b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:38.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.456+0000 7f59257ff700 1 -- 172.21.15.32:0/4011838371 shutdown_connections 2023-06-20T13:33:38.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.456+0000 7f59257ff700 1 -- 172.21.15.32:0/4011838371 wait complete. 2023-06-20T13:33:38.475 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-20T13:32:05.308022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-20T13:32:12.857161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-20T13:32:18.120021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-20T13:32:19.503624+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-20T13:32:23.074912+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-20T13:33:38.476 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-20T13:33:38.497 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:33:38.526 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:33:38.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.680+0000 7fe15e7ff700 1 Processor -- start 2023-06-20T13:33:38.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.681+0000 7fe15e7ff700 1 -- start start 2023-06-20T13:33:38.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.682+0000 7fe15e7ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1580b8430 0x7fe1580cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:38.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.682+0000 7fe15e7ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe1580cfc60 0x7fe1580d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:38.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.682+0000 7fe15e7ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1580d0b20 con 0x7fe1580d3730 2023-06-20T13:33:38.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.682+0000 7fe15e7ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1580b8800 con 0x7fe1580cfc60 2023-06-20T13:33:38.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.682+0000 7fe15e7ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1580b4ee0 con 0x7fe1580b8430 2023-06-20T13:33:38.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.682+0000 7fe1577fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe1580d3730 0x7fe1580cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43764/0 (socket says 172.21.15.32:43764) 2023-06-20T13:33:38.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.682+0000 7fe15cd9c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe1580cfc60 0x7fe1580d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:38.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.682+0000 7fe1577fe700 1 -- 172.21.15.32:0/2616204734 learned_addr learned my addr 172.21.15.32:0/2616204734 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:38.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.682+0000 7fe157fff700 1 --2- 172.21.15.32:0/2616204734 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1580b8430 0x7fe1580cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:38.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.683+0000 7fe15cd9c700 1 -- 172.21.15.32:0/2616204734 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1580b8430 msgr2=0x7fe1580cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:38.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.683+0000 7fe15cd9c700 1 --2- 172.21.15.32:0/2616204734 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1580b8430 0x7fe1580cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:38.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.683+0000 7fe15cd9c700 1 -- 172.21.15.32:0/2616204734 >> v1:172.21.15.32:6789/0 conn(0x7fe1580d3730 legacy=0x7fe1580cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:38.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.683+0000 7fe15cd9c700 1 -- 172.21.15.32:0/2616204734 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1580b51c0 con 0x7fe1580cfc60 2023-06-20T13:33:38.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.683+0000 7fe15cd9c700 1 --2- 172.21.15.32:0/2616204734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1580cfc60 0x7fe1580d0fb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe150009d90 tx=0x7fe15000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acddec1787f903cd server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:38.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.683+0000 7fe156ffd700 1 -- 172.21.15.32:0/2616204734 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15000e070 con 0x7fe1580cfc60 2023-06-20T13:33:38.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.683+0000 7fe156ffd700 1 -- 172.21.15.32:0/2616204734 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15000bb20 con 0x7fe1580cfc60 2023-06-20T13:33:38.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.683+0000 7fe156ffd700 1 -- 172.21.15.32:0/2616204734 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe150012430 con 0x7fe1580cfc60 2023-06-20T13:33:38.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.684+0000 7fe15e7ff700 1 -- 172.21.15.32:0/2616204734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1580cfc60 msgr2=0x7fe1580d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:38.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.684+0000 7fe15e7ff700 1 --2- 172.21.15.32:0/2616204734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1580cfc60 0x7fe1580d0fb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe150009d90 tx=0x7fe15000b330 comp rx=0 tx=0).stop 2023-06-20T13:33:38.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.684+0000 7fe15e7ff700 1 -- 172.21.15.32:0/2616204734 shutdown_connections 2023-06-20T13:33:38.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.684+0000 7fe15e7ff700 1 --2- 172.21.15.32:0/2616204734 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1580cfc60 0x7fe1580d0fb0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:38.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.684+0000 7fe15e7ff700 1 --2- 172.21.15.32:0/2616204734 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1580b8430 0x7fe1580cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:38.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.684+0000 7fe15e7ff700 1 -- 172.21.15.32:0/2616204734 >> 172.21.15.32:0/2616204734 conn(0x7fe15806b3f0 msgr2=0x7fe15806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:38.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.684+0000 7fe15e7ff700 1 -- 172.21.15.32:0/2616204734 shutdown_connections 2023-06-20T13:33:38.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.684+0000 7fe15e7ff700 1 -- 172.21.15.32:0/2616204734 wait complete. 2023-06-20T13:33:38.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.686+0000 7fe15e7ff700 1 Processor -- start 2023-06-20T13:33:38.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.686+0000 7fe15e7ff700 1 -- start start 2023-06-20T13:33:38.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.687+0000 7fe15e7ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1580b8430 0x7fe15815c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:38.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.687+0000 7fe15e7ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1580cfc60 0x7fe15815cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:38.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.687+0000 7fe15e7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1580d3730 0x7fe15815dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:38.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.687+0000 7fe15e7ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15815d9c0 con 0x7fe1580cfc60 2023-06-20T13:33:38.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.687+0000 7fe15e7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1581e6200 con 0x7fe1580d3730 2023-06-20T13:33:38.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.687+0000 7fe15e7ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1580c9720 con 0x7fe1580b8430 2023-06-20T13:33:38.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.687+0000 7fe1577fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1580cfc60 0x7fe15815cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:38.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.687+0000 7fe1577fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1580cfc60 0x7fe15815cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35132/0 (socket says 172.21.15.32:35132) 2023-06-20T13:33:38.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.687+0000 7fe1577fe700 1 -- 172.21.15.32:0/1493414322 learned_addr learned my addr 172.21.15.32:0/1493414322 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:38.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.687+0000 7fe157fff700 1 --2- 172.21.15.32:0/1493414322 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1580b8430 0x7fe15815c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:38.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.687+0000 7fe15cd9c700 1 --2- 172.21.15.32:0/1493414322 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1580d3730 0x7fe15815dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:38.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.688+0000 7fe1577fe700 1 -- 172.21.15.32:0/1493414322 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1580b8430 msgr2=0x7fe15815c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:38.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.688+0000 7fe1577fe700 1 --2- 172.21.15.32:0/1493414322 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1580b8430 0x7fe15815c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:38.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.688+0000 7fe1577fe700 1 -- 172.21.15.32:0/1493414322 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1580d3730 msgr2=0x7fe15815dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:38.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.688+0000 7fe1577fe700 1 --2- 172.21.15.32:0/1493414322 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1580d3730 0x7fe15815dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:38.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.688+0000 7fe1577fe700 1 -- 172.21.15.32:0/1493414322 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe150009a70 con 0x7fe1580cfc60 2023-06-20T13:33:38.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.688+0000 7fe1577fe700 1 --2- 172.21.15.32:0/1493414322 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1580cfc60 0x7fe15815cdd0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe14c00c480 tx=0x7fe14c00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:38.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.688+0000 7fe154ff9700 1 -- 172.21.15.32:0/1493414322 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c005d70 con 0x7fe1580cfc60 2023-06-20T13:33:38.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.688+0000 7fe154ff9700 1 -- 172.21.15.32:0/1493414322 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c00ce90 con 0x7fe1580cfc60 2023-06-20T13:33:38.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.688+0000 7fe154ff9700 1 -- 172.21.15.32:0/1493414322 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c0072d0 con 0x7fe1580cfc60 2023-06-20T13:33:38.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.688+0000 7fe15e7ff700 1 -- 172.21.15.32:0/1493414322 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe15815d400 con 0x7fe1580cfc60 2023-06-20T13:33:38.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.688+0000 7fe15e7ff700 1 -- 172.21.15.32:0/1493414322 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1581e5e90 con 0x7fe1580cfc60 2023-06-20T13:33:38.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.689+0000 7fe15e7ff700 1 -- 172.21.15.32:0/1493414322 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1581e5cf0 con 0x7fe1580cfc60 2023-06-20T13:33:38.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.690+0000 7fe154ff9700 1 -- 172.21.15.32:0/1493414322 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe14c007430 con 0x7fe1580cfc60 2023-06-20T13:33:38.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.691+0000 7fe154ff9700 1 --2- 172.21.15.32:0/1493414322 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe14406ace0 0x7fe14406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:38.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.691+0000 7fe154ff9700 1 -- 172.21.15.32:0/1493414322 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe14c0889d0 con 0x7fe1580cfc60 2023-06-20T13:33:38.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.691+0000 7fe157fff700 1 --2- 172.21.15.32:0/1493414322 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe14406ace0 0x7fe14406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:38.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.692+0000 7fe157fff700 1 --2- 172.21.15.32:0/1493414322 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe14406ace0 0x7fe14406d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe1581e8ab0 tx=0x7fe148009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:38.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.696+0000 7fe154ff9700 1 -- 172.21.15.32:0/1493414322 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe1581e5cf0 con 0x7fe1580cfc60 2023-06-20T13:33:38.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.899+0000 7fe15e7ff700 1 -- 172.21.15.32:0/1493414322 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe1581e5cf0 con 0x7fe1580cfc60 2023-06-20T13:33:38.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.899+0000 7fe154ff9700 1 -- 172.21.15.32:0/1493414322 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1581e5cf0 con 0x7fe1580cfc60 2023-06-20T13:33:38.901 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-06-20T13:33:38.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.902+0000 7fe15e7ff700 1 -- 172.21.15.32:0/1493414322 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe14406ace0 msgr2=0x7fe14406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:38.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.902+0000 7fe15e7ff700 1 --2- 172.21.15.32:0/1493414322 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe14406ace0 0x7fe14406d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe1581e8ab0 tx=0x7fe148009210 comp rx=0 tx=0).stop 2023-06-20T13:33:38.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.902+0000 7fe15e7ff700 1 -- 172.21.15.32:0/1493414322 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1580cfc60 msgr2=0x7fe15815cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:38.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.902+0000 7fe15e7ff700 1 --2- 172.21.15.32:0/1493414322 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1580cfc60 0x7fe15815cdd0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe14c00c480 tx=0x7fe14c00c790 comp rx=0 tx=0).stop 2023-06-20T13:33:38.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.902+0000 7fe15e7ff700 1 -- 172.21.15.32:0/1493414322 shutdown_connections 2023-06-20T13:33:38.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.902+0000 7fe15e7ff700 1 --2- 172.21.15.32:0/1493414322 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe14406ace0 0x7fe14406d190 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:38.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.902+0000 7fe15e7ff700 1 --2- 172.21.15.32:0/1493414322 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1580d3730 0x7fe15815dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:38.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.902+0000 7fe15e7ff700 1 --2- 172.21.15.32:0/1493414322 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1580b8430 0x7fe15815c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:38.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.902+0000 7fe15e7ff700 1 --2- 172.21.15.32:0/1493414322 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1580cfc60 0x7fe15815cdd0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:38.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.902+0000 7fe15e7ff700 1 -- 172.21.15.32:0/1493414322 >> 172.21.15.32:0/1493414322 conn(0x7fe15806b3f0 msgr2=0x7fe15815fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:38.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.902+0000 7fe15e7ff700 1 -- 172.21.15.32:0/1493414322 shutdown_connections 2023-06-20T13:33:38.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:38.902+0000 7fe15e7ff700 1 -- 172.21.15.32:0/1493414322 wait complete. 2023-06-20T13:33:38.921 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-20T13:33:39.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.125+0000 7fd0ae9ff700 1 Processor -- start 2023-06-20T13:33:39.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.125+0000 7fd0ae9ff700 1 -- start start 2023-06-20T13:33:39.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.126+0000 7fd0ae9ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd0a80d3730 0x7fd0a80cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:39.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.126+0000 7fd0ae9ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a80d0b20 con 0x7fd0a80b8430 2023-06-20T13:33:39.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.126+0000 7fd0ae9ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a80cfe90 con 0x7fd0a80cfa90 2023-06-20T13:33:39.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.126+0000 7fd0ae9ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a80cda30 con 0x7fd0a80d3730 2023-06-20T13:33:39.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.126+0000 7fd0a7fff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd0a80b8430 0x7fd0a80cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43778/0 (socket says 172.21.15.32:43778) 2023-06-20T13:33:39.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.126+0000 7fd0a7fff700 1 -- 172.21.15.32:0/1571674905 learned_addr learned my addr 172.21.15.32:0/1571674905 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:39.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.127+0000 7fd0a77fe700 1 --2- 172.21.15.32:0/1571674905 >> v2:172.21.15.32:3300/0 conn(0x7fd0a80d3730 0x7fd0a80cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:39.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.127+0000 7fd0a6ffd700 1 -- 172.21.15.32:0/1571674905 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2722022751 0 0) 0x7fd0a80d0b20 con 0x7fd0a80b8430 2023-06-20T13:33:39.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.127+0000 7fd0a6ffd700 1 -- 172.21.15.32:0/1571674905 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0900035b0 con 0x7fd0a80b8430 2023-06-20T13:33:39.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.127+0000 7fd0a77fe700 1 -- 172.21.15.32:0/1571674905 >> v1:172.21.15.115:6789/0 conn(0x7fd0a80cfa90 legacy=0x7fd0a80d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:39.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.127+0000 7fd0a77fe700 1 -- 172.21.15.32:0/1571674905 >> v1:172.21.15.32:6789/0 conn(0x7fd0a80b8430 legacy=0x7fd0a80cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:39.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.127+0000 7fd0a77fe700 1 -- 172.21.15.32:0/1571674905 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a80b4ee0 con 0x7fd0a80d3730 2023-06-20T13:33:39.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.127+0000 7fd0a77fe700 1 --2- 172.21.15.32:0/1571674905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0a80d3730 0x7fd0a80cf550 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd09c009840 tx=0x7fd09c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97290deeb401baaf server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:39.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.128+0000 7fd0a6ffd700 1 -- 172.21.15.32:0/1571674905 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c011830 con 0x7fd0a80d3730 2023-06-20T13:33:39.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.128+0000 7fd0a6ffd700 1 -- 172.21.15.32:0/1571674905 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09c011990 con 0x7fd0a80d3730 2023-06-20T13:33:39.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.128+0000 7fd0a6ffd700 1 -- 172.21.15.32:0/1571674905 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c011d20 con 0x7fd0a80d3730 2023-06-20T13:33:39.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.128+0000 7fd0ae9ff700 1 -- 172.21.15.32:0/1571674905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0a80d3730 msgr2=0x7fd0a80cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:39.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.128+0000 7fd0ae9ff700 1 --2- 172.21.15.32:0/1571674905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0a80d3730 0x7fd0a80cf550 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd09c009840 tx=0x7fd09c009b50 comp rx=0 tx=0).stop 2023-06-20T13:33:39.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.128+0000 7fd0ae9ff700 1 -- 172.21.15.32:0/1571674905 shutdown_connections 2023-06-20T13:33:39.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.128+0000 7fd0ae9ff700 1 --2- 172.21.15.32:0/1571674905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0a80d3730 0x7fd0a80cf550 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:39.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.128+0000 7fd0ae9ff700 1 -- 172.21.15.32:0/1571674905 >> 172.21.15.32:0/1571674905 conn(0x7fd0a806b3f0 msgr2=0x7fd0a806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:39.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.128+0000 7fd0ae9ff700 1 -- 172.21.15.32:0/1571674905 shutdown_connections 2023-06-20T13:33:39.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.128+0000 7fd0ae9ff700 1 -- 172.21.15.32:0/1571674905 wait complete. 2023-06-20T13:33:39.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.130+0000 7fd0ae9ff700 1 Processor -- start 2023-06-20T13:33:39.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.130+0000 7fd0ae9ff700 1 -- start start 2023-06-20T13:33:39.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.131+0000 7fd0ae9ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0a80b8430 0x7fd0a8154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:39.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.131+0000 7fd0ae9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0a80cfa90 0x7fd0a80c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:39.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.131+0000 7fd0ae9ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a80d3730 0x7fd0a815cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:39.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.131+0000 7fd0ae9ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a80cb140 con 0x7fd0a80b8430 2023-06-20T13:33:39.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.131+0000 7fd0ae9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a80ccdd0 con 0x7fd0a80cfa90 2023-06-20T13:33:39.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.131+0000 7fd0ae9ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a80cc810 con 0x7fd0a80d3730 2023-06-20T13:33:39.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.131+0000 7fd0a7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0a80b8430 0x7fd0a8154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:39.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.131+0000 7fd0a7fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0a80b8430 0x7fd0a8154e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35150/0 (socket says 172.21.15.32:35150) 2023-06-20T13:33:39.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.131+0000 7fd0a7fff700 1 -- 172.21.15.32:0/1528057611 learned_addr learned my addr 172.21.15.32:0/1528057611 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:39.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.131+0000 7fd0a77fe700 1 --2- 172.21.15.32:0/1528057611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0a80cfa90 0x7fd0a80c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:39.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.132+0000 7fd0acf9c700 1 --2- 172.21.15.32:0/1528057611 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a80d3730 0x7fd0a815cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:39.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.132+0000 7fd0a7fff700 1 -- 172.21.15.32:0/1528057611 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a80d3730 msgr2=0x7fd0a815cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:39.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.132+0000 7fd0a7fff700 1 --2- 172.21.15.32:0/1528057611 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a80d3730 0x7fd0a815cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:39.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.132+0000 7fd0a7fff700 1 -- 172.21.15.32:0/1528057611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0a80cfa90 msgr2=0x7fd0a80c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:39.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.132+0000 7fd0a7fff700 1 --2- 172.21.15.32:0/1528057611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0a80cfa90 0x7fd0a80c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:39.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.132+0000 7fd0a7fff700 1 -- 172.21.15.32:0/1528057611 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09c0094a0 con 0x7fd0a80b8430 2023-06-20T13:33:39.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.132+0000 7fd0a7fff700 1 --2- 172.21.15.32:0/1528057611 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0a80b8430 0x7fd0a8154e40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd09800c700 tx=0x7fd09800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:39.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.132+0000 7fd0a4ff9700 1 -- 172.21.15.32:0/1528057611 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd098005d70 con 0x7fd0a80b8430 2023-06-20T13:33:39.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.132+0000 7fd0a4ff9700 1 -- 172.21.15.32:0/1528057611 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0980070d0 con 0x7fd0a80b8430 2023-06-20T13:33:39.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.132+0000 7fd0a4ff9700 1 -- 172.21.15.32:0/1528057611 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd098007460 con 0x7fd0a80b8430 2023-06-20T13:33:39.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.132+0000 7fd0ae9ff700 1 -- 172.21.15.32:0/1528057611 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a80ccaf0 con 0x7fd0a80b8430 2023-06-20T13:33:39.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.132+0000 7fd0ae9ff700 1 -- 172.21.15.32:0/1528057611 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a80c9320 con 0x7fd0a80b8430 2023-06-20T13:33:39.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.133+0000 7fd0ae9ff700 1 -- 172.21.15.32:0/1528057611 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a80ccf40 con 0x7fd0a80b8430 2023-06-20T13:33:39.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.134+0000 7fd0a4ff9700 1 -- 172.21.15.32:0/1528057611 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd0980075c0 con 0x7fd0a80b8430 2023-06-20T13:33:39.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.135+0000 7fd0a4ff9700 1 --2- 172.21.15.32:0/1528057611 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd09406ace0 0x7fd09406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:39.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.135+0000 7fd0a4ff9700 1 -- 172.21.15.32:0/1528057611 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd098088d80 con 0x7fd0a80b8430 2023-06-20T13:33:39.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.136+0000 7fd0a77fe700 1 --2- 172.21.15.32:0/1528057611 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd09406ace0 0x7fd09406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:39.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.136+0000 7fd0a77fe700 1 --2- 172.21.15.32:0/1528057611 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd09406ace0 0x7fd09406d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0090b0 tx=0x7fd09c01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:39.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.140+0000 7fd0a4ff9700 1 -- 172.21.15.32:0/1528057611 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd098053af0 con 0x7fd0a80b8430 2023-06-20T13:33:39.346 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.345+0000 7fd0ae9ff700 1 -- 172.21.15.32:0/1528057611 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd0a80d0220 con 0x7fd0a80b8430 2023-06-20T13:33:39.347 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.346+0000 7fd0a4ff9700 1 -- 172.21.15.32:0/1528057611 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd098057110 con 0x7fd0a80b8430 2023-06-20T13:33:39.347 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 8 2023-06-20T13:33:39.350 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.348+0000 7fd0ae9ff700 1 -- 172.21.15.32:0/1528057611 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd09406ace0 msgr2=0x7fd09406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:39.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.348+0000 7fd0ae9ff700 1 --2- 172.21.15.32:0/1528057611 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd09406ace0 0x7fd09406d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0090b0 tx=0x7fd09c01c040 comp rx=0 tx=0).stop 2023-06-20T13:33:39.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.348+0000 7fd0ae9ff700 1 -- 172.21.15.32:0/1528057611 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0a80b8430 msgr2=0x7fd0a8154e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:39.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.348+0000 7fd0ae9ff700 1 --2- 172.21.15.32:0/1528057611 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0a80b8430 0x7fd0a8154e40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd09800c700 tx=0x7fd09800ca10 comp rx=0 tx=0).stop 2023-06-20T13:33:39.351 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.348+0000 7fd0ae9ff700 1 -- 172.21.15.32:0/1528057611 shutdown_connections 2023-06-20T13:33:39.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.348+0000 7fd0ae9ff700 1 --2- 172.21.15.32:0/1528057611 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd09406ace0 0x7fd09406d190 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:39.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.348+0000 7fd0ae9ff700 1 --2- 172.21.15.32:0/1528057611 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd0a80d3730 0x7fd0a815cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:39.352 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.348+0000 7fd0ae9ff700 1 --2- 172.21.15.32:0/1528057611 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd0a80b8430 0x7fd0a8154e40 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:39.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.348+0000 7fd0ae9ff700 1 --2- 172.21.15.32:0/1528057611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd0a80cfa90 0x7fd0a80c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:39.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.348+0000 7fd0ae9ff700 1 -- 172.21.15.32:0/1528057611 >> 172.21.15.32:0/1528057611 conn(0x7fd0a806b3f0 msgr2=0x7fd0a80d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:39.353 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.348+0000 7fd0ae9ff700 1 -- 172.21.15.32:0/1528057611 shutdown_connections 2023-06-20T13:33:39.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.349+0000 7fd0ae9ff700 1 -- 172.21.15.32:0/1528057611 wait complete. 2023-06-20T13:33:39.368 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-20T13:33:39.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.570+0000 7fcc449ff700 1 Processor -- start 2023-06-20T13:33:39.572 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.570+0000 7fcc449ff700 1 -- start start 2023-06-20T13:33:39.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.572+0000 7fcc449ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc400b8430 0x7fcc400cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:39.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.572+0000 7fcc449ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcc400d3730 0x7fcc400cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:39.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.572+0000 7fcc449ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcc400cfa90 0x7fcc4015feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:39.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.572+0000 7fcc449ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc400b8800 con 0x7fcc400cfa90 2023-06-20T13:33:39.573 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.572+0000 7fcc449ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc400d0b20 con 0x7fcc400d3730 2023-06-20T13:33:39.574 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.572+0000 7fcc449ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc400cfeb0 con 0x7fcc400b8430 2023-06-20T13:33:39.575 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.572+0000 7fcc3ed9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcc400cfa90 0x7fcc4015feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:39.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.572+0000 7fcc3e59c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc400b8430 0x7fcc400cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:39.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.572+0000 7fcc3ed9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcc400cfa90 0x7fcc4015feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35156/0 (socket says 172.21.15.32:35156) 2023-06-20T13:33:39.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.572+0000 7fcc3ed9d700 1 -- 172.21.15.32:0/3066184335 learned_addr learned my addr 172.21.15.32:0/3066184335 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:39.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.572+0000 7fcc37fff700 1 --2- 172.21.15.32:0/3066184335 >> v2:172.21.15.115:3300/0 conn(0x7fcc400d3730 0x7fcc400cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:39.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.573+0000 7fcc3ed9d700 1 -- 172.21.15.32:0/3066184335 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc400b8430 msgr2=0x7fcc400cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:39.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.573+0000 7fcc3ed9d700 1 --2- 172.21.15.32:0/3066184335 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc400b8430 0x7fcc400cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:39.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.573+0000 7fcc3ed9d700 1 -- 172.21.15.32:0/3066184335 >> v2:172.21.15.115:3300/0 conn(0x7fcc400d3730 msgr2=0x7fcc400cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:39.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.573+0000 7fcc3ed9d700 1 --2- 172.21.15.32:0/3066184335 >> v2:172.21.15.115:3300/0 conn(0x7fcc400d3730 0x7fcc400cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:39.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.573+0000 7fcc3ed9d700 1 -- 172.21.15.32:0/3066184335 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc400b4ee0 con 0x7fcc400cfa90 2023-06-20T13:33:39.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.573+0000 7fcc3ed9d700 1 --2- 172.21.15.32:0/3066184335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc400cfa90 0x7fcc4015feb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcc4006c5c0 tx=0x7fcc3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a599228d3af4dacf server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:39.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.573+0000 7fcc3dd9b700 1 -- 172.21.15.32:0/3066184335 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3800e070 con 0x7fcc400cfa90 2023-06-20T13:33:39.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.573+0000 7fcc3dd9b700 1 -- 172.21.15.32:0/3066184335 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3800b910 con 0x7fcc400cfa90 2023-06-20T13:33:39.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.573+0000 7fcc3dd9b700 1 -- 172.21.15.32:0/3066184335 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3800bcc0 con 0x7fcc400cfa90 2023-06-20T13:33:39.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.574+0000 7fcc449ff700 1 -- 172.21.15.32:0/3066184335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc400cfa90 msgr2=0x7fcc4015feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:39.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.574+0000 7fcc449ff700 1 --2- 172.21.15.32:0/3066184335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc400cfa90 0x7fcc4015feb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcc4006c5c0 tx=0x7fcc3800b330 comp rx=0 tx=0).stop 2023-06-20T13:33:39.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.574+0000 7fcc449ff700 1 -- 172.21.15.32:0/3066184335 shutdown_connections 2023-06-20T13:33:39.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.574+0000 7fcc449ff700 1 --2- 172.21.15.32:0/3066184335 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc400cfa90 0x7fcc4015feb0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:39.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.574+0000 7fcc449ff700 1 --2- 172.21.15.32:0/3066184335 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc400b8430 0x7fcc400cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:39.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.574+0000 7fcc449ff700 1 --2- 172.21.15.32:0/3066184335 >> v2:172.21.15.115:3300/0 conn(0x7fcc400d3730 0x7fcc400cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:39.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.574+0000 7fcc449ff700 1 -- 172.21.15.32:0/3066184335 >> 172.21.15.32:0/3066184335 conn(0x7fcc4006b3f0 msgr2=0x7fcc4006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:39.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.574+0000 7fcc449ff700 1 -- 172.21.15.32:0/3066184335 shutdown_connections 2023-06-20T13:33:39.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.574+0000 7fcc449ff700 1 -- 172.21.15.32:0/3066184335 wait complete. 2023-06-20T13:33:39.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.576+0000 7fcc449ff700 1 Processor -- start 2023-06-20T13:33:39.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.577+0000 7fcc449ff700 1 -- start start 2023-06-20T13:33:39.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.578+0000 7fcc449ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc400b8430 0x7fcc401f1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:39.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.578+0000 7fcc449ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc400cfa90 0x7fcc4015c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:39.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.578+0000 7fcc449ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc400d3730 0x7fcc4015d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:39.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.578+0000 7fcc449ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc401509f0 con 0x7fcc400b8430 2023-06-20T13:33:39.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.578+0000 7fcc449ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc400c8440 con 0x7fcc400cfa90 2023-06-20T13:33:39.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.578+0000 7fcc449ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc400c8720 con 0x7fcc400d3730 2023-06-20T13:33:39.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.578+0000 7fcc3e59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc400b8430 0x7fcc401f1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:39.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.578+0000 7fcc3e59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc400b8430 0x7fcc401f1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35164/0 (socket says 172.21.15.32:35164) 2023-06-20T13:33:39.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.578+0000 7fcc3e59c700 1 -- 172.21.15.32:0/1490309834 learned_addr learned my addr 172.21.15.32:0/1490309834 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:39.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.578+0000 7fcc3ed9d700 1 --2- 172.21.15.32:0/1490309834 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc400d3730 0x7fcc4015d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:39.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.578+0000 7fcc37fff700 1 --2- 172.21.15.32:0/1490309834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc400cfa90 0x7fcc4015c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:39.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.578+0000 7fcc3e59c700 1 -- 172.21.15.32:0/1490309834 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc400d3730 msgr2=0x7fcc4015d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:39.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.578+0000 7fcc3e59c700 1 --2- 172.21.15.32:0/1490309834 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc400d3730 0x7fcc4015d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:39.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.579+0000 7fcc3e59c700 1 -- 172.21.15.32:0/1490309834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc400cfa90 msgr2=0x7fcc4015c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:39.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.579+0000 7fcc3e59c700 1 --2- 172.21.15.32:0/1490309834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc400cfa90 0x7fcc4015c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:39.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.579+0000 7fcc3e59c700 1 -- 172.21.15.32:0/1490309834 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc38009b30 con 0x7fcc400b8430 2023-06-20T13:33:39.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.579+0000 7fcc37fff700 1 --2- 172.21.15.32:0/1490309834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc400cfa90 0x7fcc4015c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:39.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.579+0000 7fcc3e59c700 1 --2- 172.21.15.32:0/1490309834 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc400b8430 0x7fcc401f1240 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcc3000e870 tx=0x7fcc3000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:39.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.579+0000 7fcc36ffd700 1 -- 172.21.15.32:0/1490309834 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc30009590 con 0x7fcc400b8430 2023-06-20T13:33:39.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.579+0000 7fcc36ffd700 1 -- 172.21.15.32:0/1490309834 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3000ee70 con 0x7fcc400b8430 2023-06-20T13:33:39.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.579+0000 7fcc449ff700 1 -- 172.21.15.32:0/1490309834 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc400c8a00 con 0x7fcc400b8430 2023-06-20T13:33:39.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.579+0000 7fcc36ffd700 1 -- 172.21.15.32:0/1490309834 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3000ca50 con 0x7fcc400b8430 2023-06-20T13:33:39.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.579+0000 7fcc449ff700 1 -- 172.21.15.32:0/1490309834 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc400c8fc0 con 0x7fcc400b8430 2023-06-20T13:33:39.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.580+0000 7fcc449ff700 1 -- 172.21.15.32:0/1490309834 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc400cac30 con 0x7fcc400b8430 2023-06-20T13:33:39.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.581+0000 7fcc36ffd700 1 -- 172.21.15.32:0/1490309834 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcc3000cbb0 con 0x7fcc400b8430 2023-06-20T13:33:39.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.582+0000 7fcc36ffd700 1 --2- 172.21.15.32:0/1490309834 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcc2006ace0 0x7fcc2006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:39.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.582+0000 7fcc36ffd700 1 -- 172.21.15.32:0/1490309834 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcc30089820 con 0x7fcc400b8430 2023-06-20T13:33:39.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.582+0000 7fcc37fff700 1 --2- 172.21.15.32:0/1490309834 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcc2006ace0 0x7fcc2006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:39.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.583+0000 7fcc37fff700 1 --2- 172.21.15.32:0/1490309834 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcc2006ace0 0x7fcc2006d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcc400c94e0 tx=0x7fcc28008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:39.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.586+0000 7fcc36ffd700 1 -- 172.21.15.32:0/1490309834 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcc30057f90 con 0x7fcc400b8430 2023-06-20T13:33:39.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.791+0000 7fcc449ff700 1 -- 172.21.15.32:0/1490309834 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcc4004ea60 con 0x7fcc400b8430 2023-06-20T13:33:39.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.792+0000 7fcc36ffd700 1 -- 172.21.15.32:0/1490309834 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcc3000ce60 con 0x7fcc400b8430 2023-06-20T13:33:39.794 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-06-20T13:33:39.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.794+0000 7fcc449ff700 1 -- 172.21.15.32:0/1490309834 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcc2006ace0 msgr2=0x7fcc2006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:39.796 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.794+0000 7fcc449ff700 1 --2- 172.21.15.32:0/1490309834 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcc2006ace0 0x7fcc2006d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcc400c94e0 tx=0x7fcc28008040 comp rx=0 tx=0).stop 2023-06-20T13:33:39.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.794+0000 7fcc449ff700 1 -- 172.21.15.32:0/1490309834 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc400b8430 msgr2=0x7fcc401f1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:39.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.794+0000 7fcc449ff700 1 --2- 172.21.15.32:0/1490309834 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc400b8430 0x7fcc401f1240 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcc3000e870 tx=0x7fcc3000ec30 comp rx=0 tx=0).stop 2023-06-20T13:33:39.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.794+0000 7fcc449ff700 1 -- 172.21.15.32:0/1490309834 shutdown_connections 2023-06-20T13:33:39.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.794+0000 7fcc449ff700 1 --2- 172.21.15.32:0/1490309834 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcc2006ace0 0x7fcc2006d190 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:39.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.794+0000 7fcc449ff700 1 --2- 172.21.15.32:0/1490309834 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcc400d3730 0x7fcc4015d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:39.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.794+0000 7fcc449ff700 1 --2- 172.21.15.32:0/1490309834 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcc400b8430 0x7fcc401f1240 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:39.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.794+0000 7fcc449ff700 1 --2- 172.21.15.32:0/1490309834 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcc400cfa90 0x7fcc4015c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:39.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.794+0000 7fcc449ff700 1 -- 172.21.15.32:0/1490309834 >> 172.21.15.32:0/1490309834 conn(0x7fcc4006b3f0 msgr2=0x7fcc400b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:39.798 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.794+0000 7fcc449ff700 1 -- 172.21.15.32:0/1490309834 shutdown_connections 2023-06-20T13:33:39.799 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:39.794+0000 7fcc449ff700 1 -- 172.21.15.32:0/1490309834 wait complete. 2023-06-20T13:33:39.813 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-20T13:33:40.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.016+0000 7fa7dbbff700 1 Processor -- start 2023-06-20T13:33:40.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.016+0000 7fa7dbbff700 1 -- start start 2023-06-20T13:33:40.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.017+0000 7fa7dbbff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa7d40b8430 0x7fa7d40cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:40.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.017+0000 7fa7dbbff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d40d0b20 con 0x7fa7d40d3730 2023-06-20T13:33:40.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.017+0000 7fa7dbbff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d40b4ee0 con 0x7fa7d40cfc60 2023-06-20T13:33:40.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.017+0000 7fa7dbbff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d40b8800 con 0x7fa7d40b8430 2023-06-20T13:33:40.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.017+0000 7fa7d999b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa7d40b8430 0x7fa7d40cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:40.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.017+0000 7fa7d919a700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fa7d40d3730 0x7fa7d40cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59184/0 (socket says 172.21.15.32:59184) 2023-06-20T13:33:40.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.017+0000 7fa7d919a700 1 -- 172.21.15.32:0/3732149403 learned_addr learned my addr 172.21.15.32:0/3732149403 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:40.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.018+0000 7fa7d999b700 1 -- 172.21.15.32:0/3732149403 >> v1:172.21.15.115:6789/0 conn(0x7fa7d40cfc60 legacy=0x7fa7d40d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:40.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.018+0000 7fa7d999b700 1 -- 172.21.15.32:0/3732149403 >> v1:172.21.15.32:6789/0 conn(0x7fa7d40d3730 legacy=0x7fa7d40cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:40.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.018+0000 7fa7d999b700 1 -- 172.21.15.32:0/3732149403 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d40b51c0 con 0x7fa7d40b8430 2023-06-20T13:33:40.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.018+0000 7fa7d8999700 1 -- 172.21.15.32:0/3732149403 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238823805 0 0) 0x7fa7d40d0b20 con 0x7fa7d40d3730 2023-06-20T13:33:40.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.018+0000 7fa7d999b700 1 --2- 172.21.15.32:0/3732149403 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7d40b8430 0x7fa7d40cd320 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0009840 tx=0x7fa7d0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19532d4562360238 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:40.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.018+0000 7fa7d8999700 1 -- 172.21.15.32:0/3732149403 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0011830 con 0x7fa7d40b8430 2023-06-20T13:33:40.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.018+0000 7fa7d8999700 1 -- 172.21.15.32:0/3732149403 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d0011990 con 0x7fa7d40b8430 2023-06-20T13:33:40.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.018+0000 7fa7d8999700 1 -- 172.21.15.32:0/3732149403 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0011d20 con 0x7fa7d40b8430 2023-06-20T13:33:40.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.019+0000 7fa7dbbff700 1 -- 172.21.15.32:0/3732149403 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7d40b8430 msgr2=0x7fa7d40cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:40.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.019+0000 7fa7dbbff700 1 --2- 172.21.15.32:0/3732149403 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7d40b8430 0x7fa7d40cd320 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0009840 tx=0x7fa7d0009b50 comp rx=0 tx=0).stop 2023-06-20T13:33:40.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.019+0000 7fa7dbbff700 1 -- 172.21.15.32:0/3732149403 shutdown_connections 2023-06-20T13:33:40.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.019+0000 7fa7dbbff700 1 --2- 172.21.15.32:0/3732149403 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7d40b8430 0x7fa7d40cd320 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:40.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.019+0000 7fa7dbbff700 1 -- 172.21.15.32:0/3732149403 >> 172.21.15.32:0/3732149403 conn(0x7fa7d406b3f0 msgr2=0x7fa7d406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:40.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.019+0000 7fa7dbbff700 1 -- 172.21.15.32:0/3732149403 shutdown_connections 2023-06-20T13:33:40.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.019+0000 7fa7dbbff700 1 -- 172.21.15.32:0/3732149403 wait complete. 2023-06-20T13:33:40.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.021+0000 7fa7dbbff700 1 Processor -- start 2023-06-20T13:33:40.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.021+0000 7fa7dbbff700 1 -- start start 2023-06-20T13:33:40.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.022+0000 7fa7dbbff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d40b8430 0x7fa7d40b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:40.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.022+0000 7fa7dbbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7d40cfc60 0x7fa7d415c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:40.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.022+0000 7fa7dbbff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7d40d3730 0x7fa7d4150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:40.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.022+0000 7fa7dbbff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d415ce70 con 0x7fa7d40d3730 2023-06-20T13:33:40.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.022+0000 7fa7dbbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d40c71b0 con 0x7fa7d40cfc60 2023-06-20T13:33:40.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.022+0000 7fa7dbbff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d40c7450 con 0x7fa7d40b8430 2023-06-20T13:33:40.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.022+0000 7fa7da19c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7d40d3730 0x7fa7d4150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:40.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.022+0000 7fa7da19c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7d40d3730 0x7fa7d4150020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46300/0 (socket says 172.21.15.32:46300) 2023-06-20T13:33:40.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.022+0000 7fa7da19c700 1 -- 172.21.15.32:0/382519821 learned_addr learned my addr 172.21.15.32:0/382519821 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:40.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.023+0000 7fa7d999b700 1 --2- 172.21.15.32:0/382519821 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d40b8430 0x7fa7d40b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:40.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.023+0000 7fa7d919a700 1 --2- 172.21.15.32:0/382519821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7d40cfc60 0x7fa7d415c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:40.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.023+0000 7fa7da19c700 1 -- 172.21.15.32:0/382519821 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d40b8430 msgr2=0x7fa7d40b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:40.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.023+0000 7fa7da19c700 1 --2- 172.21.15.32:0/382519821 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d40b8430 0x7fa7d40b39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:40.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.023+0000 7fa7da19c700 1 -- 172.21.15.32:0/382519821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7d40cfc60 msgr2=0x7fa7d415c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:40.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.023+0000 7fa7da19c700 1 --2- 172.21.15.32:0/382519821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7d40cfc60 0x7fa7d415c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:40.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.023+0000 7fa7da19c700 1 -- 172.21.15.32:0/382519821 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d00094a0 con 0x7fa7d40d3730 2023-06-20T13:33:40.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.023+0000 7fa7da19c700 1 --2- 172.21.15.32:0/382519821 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7d40d3730 0x7fa7d4150020 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc00cc50 tx=0x7fa7cc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:40.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.024+0000 7fa7ca7fc700 1 -- 172.21.15.32:0/382519821 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc003c00 con 0x7fa7d40d3730 2023-06-20T13:33:40.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.024+0000 7fa7ca7fc700 1 -- 172.21.15.32:0/382519821 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7cc003d60 con 0x7fa7d40d3730 2023-06-20T13:33:40.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.024+0000 7fa7ca7fc700 1 -- 172.21.15.32:0/382519821 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc00aab0 con 0x7fa7d40d3730 2023-06-20T13:33:40.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.024+0000 7fa7dbbff700 1 -- 172.21.15.32:0/382519821 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d40c7730 con 0x7fa7d40d3730 2023-06-20T13:33:40.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.024+0000 7fa7dbbff700 1 -- 172.21.15.32:0/382519821 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d40c7cf0 con 0x7fa7d40d3730 2023-06-20T13:33:40.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.025+0000 7fa7dbbff700 1 -- 172.21.15.32:0/382519821 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d404ea60 con 0x7fa7d40d3730 2023-06-20T13:33:40.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.026+0000 7fa7ca7fc700 1 -- 172.21.15.32:0/382519821 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa7cc00ac10 con 0x7fa7d40d3730 2023-06-20T13:33:40.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.028+0000 7fa7ca7fc700 1 --2- 172.21.15.32:0/382519821 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa7b806ace0 0x7fa7b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:40.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.028+0000 7fa7ca7fc700 1 -- 172.21.15.32:0/382519821 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa7cc089700 con 0x7fa7d40d3730 2023-06-20T13:33:40.029 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.028+0000 7fa7d999b700 1 --2- 172.21.15.32:0/382519821 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa7b806ace0 0x7fa7b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:40.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.029+0000 7fa7d999b700 1 --2- 172.21.15.32:0/382519821 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa7b806ace0 0x7fa7b806d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa7d00090b0 tx=0x7fa7d001c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:40.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.032+0000 7fa7ca7fc700 1 -- 172.21.15.32:0/382519821 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa7cc054470 con 0x7fa7d40d3730 2023-06-20T13:33:40.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.238+0000 7fa7dbbff700 1 -- 172.21.15.32:0/382519821 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa7d4160b10 con 0x7fa7d40d3730 2023-06-20T13:33:40.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.239+0000 7fa7ca7fc700 1 -- 172.21.15.32:0/382519821 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa7cc057a90 con 0x7fa7d40d3730 2023-06-20T13:33:40.240 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-06-20T13:33:40.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.241+0000 7fa7dbbff700 1 -- 172.21.15.32:0/382519821 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa7b806ace0 msgr2=0x7fa7b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:40.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.241+0000 7fa7dbbff700 1 --2- 172.21.15.32:0/382519821 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa7b806ace0 0x7fa7b806d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa7d00090b0 tx=0x7fa7d001c040 comp rx=0 tx=0).stop 2023-06-20T13:33:40.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.241+0000 7fa7dbbff700 1 -- 172.21.15.32:0/382519821 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7d40d3730 msgr2=0x7fa7d4150020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:40.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.241+0000 7fa7dbbff700 1 --2- 172.21.15.32:0/382519821 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7d40d3730 0x7fa7d4150020 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc00cc50 tx=0x7fa7cc00cf60 comp rx=0 tx=0).stop 2023-06-20T13:33:40.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.241+0000 7fa7dbbff700 1 -- 172.21.15.32:0/382519821 shutdown_connections 2023-06-20T13:33:40.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.241+0000 7fa7dbbff700 1 --2- 172.21.15.32:0/382519821 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa7b806ace0 0x7fa7b806d190 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:40.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.241+0000 7fa7dbbff700 1 --2- 172.21.15.32:0/382519821 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa7d40d3730 0x7fa7d4150020 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:40.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.241+0000 7fa7dbbff700 1 --2- 172.21.15.32:0/382519821 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa7d40b8430 0x7fa7d40b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:40.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.241+0000 7fa7dbbff700 1 --2- 172.21.15.32:0/382519821 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7d40cfc60 0x7fa7d415c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:40.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.241+0000 7fa7dbbff700 1 -- 172.21.15.32:0/382519821 >> 172.21.15.32:0/382519821 conn(0x7fa7d406b3f0 msgr2=0x7fa7d415fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:40.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.241+0000 7fa7dbbff700 1 -- 172.21.15.32:0/382519821 shutdown_connections 2023-06-20T13:33:40.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.241+0000 7fa7dbbff700 1 -- 172.21.15.32:0/382519821 wait complete. 2023-06-20T13:33:40.260 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-20T13:33:40.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.463+0000 7f227edff700 1 Processor -- start 2023-06-20T13:33:40.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.463+0000 7f227edff700 1 -- start start 2023-06-20T13:33:40.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.464+0000 7f227edff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22780d3730 0x7f22780cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:40.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.464+0000 7f227edff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f22780cfa90 0x7f22780d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:40.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.464+0000 7f227edff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22780d0b20 con 0x7f22780b8430 2023-06-20T13:33:40.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.464+0000 7f227edff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22780cda30 con 0x7f22780cfa90 2023-06-20T13:33:40.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.464+0000 7f227edff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22780b8800 con 0x7f22780d3730 2023-06-20T13:33:40.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.464+0000 7f227d39c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f22780cfa90 0x7f22780d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:40.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.465+0000 7f227d39c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f22780cfa90 0x7f22780d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46314/0 (socket says 172.21.15.32:46314) 2023-06-20T13:33:40.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.465+0000 7f227d39c700 1 -- 172.21.15.32:0/3030552219 learned_addr learned my addr 172.21.15.32:0/3030552219 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:40.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.465+0000 7f2277fff700 1 --2- 172.21.15.32:0/3030552219 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22780d3730 0x7f22780cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:40.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.465+0000 7f227d39c700 1 -- 172.21.15.32:0/3030552219 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22780d3730 msgr2=0x7f22780cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:40.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.465+0000 7f227d39c700 1 --2- 172.21.15.32:0/3030552219 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22780d3730 0x7f22780cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:40.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.465+0000 7f227d39c700 1 -- 172.21.15.32:0/3030552219 >> v1:172.21.15.115:6789/0 conn(0x7f22780b8430 legacy=0x7f22780cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:40.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.465+0000 7f227d39c700 1 -- 172.21.15.32:0/3030552219 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22780cfeb0 con 0x7f22780cfa90 2023-06-20T13:33:40.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.465+0000 7f2277fff700 1 --2- 172.21.15.32:0/3030552219 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22780d3730 0x7f22780cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:40.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.465+0000 7f227d39c700 1 --2- 172.21.15.32:0/3030552219 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22780cfa90 0x7f22780d0fb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2270009e50 tx=0x7f227000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce0f4e77659a0c server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:40.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.466+0000 7f22777fe700 1 -- 172.21.15.32:0/3030552219 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227000e070 con 0x7f22780cfa90 2023-06-20T13:33:40.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.466+0000 7f22777fe700 1 -- 172.21.15.32:0/3030552219 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227000b9c0 con 0x7f22780cfa90 2023-06-20T13:33:40.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.466+0000 7f22777fe700 1 -- 172.21.15.32:0/3030552219 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227000bd70 con 0x7f22780cfa90 2023-06-20T13:33:40.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.466+0000 7f227edff700 1 -- 172.21.15.32:0/3030552219 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22780cfa90 msgr2=0x7f22780d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:40.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.466+0000 7f227edff700 1 --2- 172.21.15.32:0/3030552219 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22780cfa90 0x7f22780d0fb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2270009e50 tx=0x7f227000b330 comp rx=0 tx=0).stop 2023-06-20T13:33:40.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.466+0000 7f227edff700 1 -- 172.21.15.32:0/3030552219 shutdown_connections 2023-06-20T13:33:40.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.466+0000 7f227edff700 1 --2- 172.21.15.32:0/3030552219 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22780cfa90 0x7f22780d0fb0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:40.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.466+0000 7f227edff700 1 --2- 172.21.15.32:0/3030552219 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22780d3730 0x7f22780cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:40.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.466+0000 7f227edff700 1 -- 172.21.15.32:0/3030552219 >> 172.21.15.32:0/3030552219 conn(0x7f227806b3f0 msgr2=0x7f227806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:40.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.466+0000 7f227edff700 1 -- 172.21.15.32:0/3030552219 shutdown_connections 2023-06-20T13:33:40.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.466+0000 7f227edff700 1 -- 172.21.15.32:0/3030552219 wait complete. 2023-06-20T13:33:40.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.468+0000 7f227edff700 1 Processor -- start 2023-06-20T13:33:40.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.468+0000 7f227edff700 1 -- start start 2023-06-20T13:33:40.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.469+0000 7f227edff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22780b8430 0x7f22780c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:40.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.469+0000 7f227edff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22780cfa90 0x7f2278157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:40.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.469+0000 7f227edff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22780d3730 0x7f22781e6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:40.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.469+0000 7f227edff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22780c7860 con 0x7f22780cfa90 2023-06-20T13:33:40.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.469+0000 7f227edff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22780c6c50 con 0x7f22780d3730 2023-06-20T13:33:40.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.469+0000 7f227edff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22780c6f30 con 0x7f22780b8430 2023-06-20T13:33:40.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.469+0000 7f2277fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22780cfa90 0x7f2278157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:40.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.469+0000 7f2277fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22780cfa90 0x7f2278157e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46326/0 (socket says 172.21.15.32:46326) 2023-06-20T13:33:40.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.469+0000 7f2277fff700 1 -- 172.21.15.32:0/2862028691 learned_addr learned my addr 172.21.15.32:0/2862028691 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:40.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.469+0000 7f227cb9b700 1 --2- 172.21.15.32:0/2862028691 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22780b8430 0x7f22780c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:40.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.469+0000 7f227d39c700 1 --2- 172.21.15.32:0/2862028691 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22780d3730 0x7f22781e6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:40.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.470+0000 7f2277fff700 1 -- 172.21.15.32:0/2862028691 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22780b8430 msgr2=0x7f22780c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:40.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.470+0000 7f2277fff700 1 --2- 172.21.15.32:0/2862028691 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22780b8430 0x7f22780c6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:40.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.470+0000 7f2277fff700 1 -- 172.21.15.32:0/2862028691 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22780d3730 msgr2=0x7f22781e6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:40.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.470+0000 7f2277fff700 1 --2- 172.21.15.32:0/2862028691 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22780d3730 0x7f22781e6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:40.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.470+0000 7f2277fff700 1 -- 172.21.15.32:0/2862028691 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2270009b30 con 0x7f22780cfa90 2023-06-20T13:33:40.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.470+0000 7f227d39c700 1 --2- 172.21.15.32:0/2862028691 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22780d3730 0x7f22781e6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:40.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.470+0000 7f2277fff700 1 --2- 172.21.15.32:0/2862028691 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22780cfa90 0x7f2278157e00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f226400e760 tx=0x7f226400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:40.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.470+0000 7f22757fa700 1 -- 172.21.15.32:0/2862028691 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2264013610 con 0x7f22780cfa90 2023-06-20T13:33:40.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.470+0000 7f22757fa700 1 -- 172.21.15.32:0/2862028691 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2264013770 con 0x7f22780cfa90 2023-06-20T13:33:40.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.470+0000 7f227edff700 1 -- 172.21.15.32:0/2862028691 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22780c7210 con 0x7f22780cfa90 2023-06-20T13:33:40.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.470+0000 7f22757fa700 1 -- 172.21.15.32:0/2862028691 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2264013b20 con 0x7f22780cfa90 2023-06-20T13:33:40.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.470+0000 7f227edff700 1 -- 172.21.15.32:0/2862028691 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2278158340 con 0x7f22780cfa90 2023-06-20T13:33:40.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.471+0000 7f227edff700 1 -- 172.21.15.32:0/2862028691 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227804ea60 con 0x7f22780cfa90 2023-06-20T13:33:40.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.472+0000 7f22757fa700 1 -- 172.21.15.32:0/2862028691 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2264013c80 con 0x7f22780cfa90 2023-06-20T13:33:40.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.473+0000 7f22757fa700 1 --2- 172.21.15.32:0/2862028691 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f225c06ace0 0x7f225c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:40.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.474+0000 7f22757fa700 1 -- 172.21.15.32:0/2862028691 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2264089360 con 0x7f22780cfa90 2023-06-20T13:33:40.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.474+0000 7f227cb9b700 1 --2- 172.21.15.32:0/2862028691 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f225c06ace0 0x7f225c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:40.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.474+0000 7f227cb9b700 1 --2- 172.21.15.32:0/2862028691 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f225c06ace0 0x7f225c06d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f22781e7c10 tx=0x7f226c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:40.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.477+0000 7f22757fa700 1 -- 172.21.15.32:0/2862028691 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2264057b60 con 0x7f22780cfa90 2023-06-20T13:33:40.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.679+0000 7f227edff700 1 -- 172.21.15.32:0/2862028691 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f227815a490 con 0x7f22780cfa90 2023-06-20T13:33:40.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.680+0000 7f22757fa700 1 -- 172.21.15.32:0/2862028691 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f22640576f0 con 0x7f22780cfa90 2023-06-20T13:33:40.681 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-06-20T13:33:40.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.682+0000 7f227edff700 1 -- 172.21.15.32:0/2862028691 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f225c06ace0 msgr2=0x7f225c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:40.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.682+0000 7f227edff700 1 --2- 172.21.15.32:0/2862028691 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f225c06ace0 0x7f225c06d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f22781e7c10 tx=0x7f226c009040 comp rx=0 tx=0).stop 2023-06-20T13:33:40.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.682+0000 7f227edff700 1 -- 172.21.15.32:0/2862028691 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22780cfa90 msgr2=0x7f2278157e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:40.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.682+0000 7f227edff700 1 --2- 172.21.15.32:0/2862028691 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22780cfa90 0x7f2278157e00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f226400e760 tx=0x7f226400ea70 comp rx=0 tx=0).stop 2023-06-20T13:33:40.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.682+0000 7f227edff700 1 -- 172.21.15.32:0/2862028691 shutdown_connections 2023-06-20T13:33:40.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.682+0000 7f227edff700 1 --2- 172.21.15.32:0/2862028691 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f225c06ace0 0x7f225c06d190 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:40.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.682+0000 7f227edff700 1 --2- 172.21.15.32:0/2862028691 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22780d3730 0x7f22781e6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:40.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.682+0000 7f227edff700 1 --2- 172.21.15.32:0/2862028691 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22780b8430 0x7f22780c6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:40.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.682+0000 7f227edff700 1 --2- 172.21.15.32:0/2862028691 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f22780cfa90 0x7f2278157e00 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:40.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.682+0000 7f227edff700 1 -- 172.21.15.32:0/2862028691 >> 172.21.15.32:0/2862028691 conn(0x7f227806b3f0 msgr2=0x7f227815a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:40.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.682+0000 7f227edff700 1 -- 172.21.15.32:0/2862028691 shutdown_connections 2023-06-20T13:33:40.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.682+0000 7f227edff700 1 -- 172.21.15.32:0/2862028691 wait complete. 2023-06-20T13:33:40.701 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-20T13:33:40.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.901+0000 7fcaeddff700 1 Processor -- start 2023-06-20T13:33:40.903 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.902+0000 7fcaeddff700 1 -- start start 2023-06-20T13:33:40.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.903+0000 7fcaeddff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fcae80d2640 0x7fcae80b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:40.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.903+0000 7fcaeddff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcae80cf8f0 0x7fcae815fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:40.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.903+0000 7fcaeddff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae80d1790 con 0x7fcae815c460 2023-06-20T13:33:40.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.903+0000 7fcaeddff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae80cedd0 con 0x7fcae80cf8f0 2023-06-20T13:33:40.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.903+0000 7fcaeddff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae80cd950 con 0x7fcae80d2640 2023-06-20T13:33:40.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.903+0000 7fcae7fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcae80cf8f0 0x7fcae815fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:40.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.903+0000 7fcae7fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fcae80cf8f0 0x7fcae815fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46334/0 (socket says 172.21.15.32:46334) 2023-06-20T13:33:40.905 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.903+0000 7fcae7fff700 1 -- 172.21.15.32:0/3627848749 learned_addr learned my addr 172.21.15.32:0/3627848749 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:40.906 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.903+0000 7fcadffff700 1 --2- 172.21.15.32:0/3627848749 >> v2:172.21.15.115:3300/0 conn(0x7fcae80d2640 0x7fcae80b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:40.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.904+0000 7fcae7fff700 1 -- 172.21.15.32:0/3627848749 >> v2:172.21.15.115:3300/0 conn(0x7fcae80d2640 msgr2=0x7fcae80b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:40.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.904+0000 7fcae7fff700 1 --2- 172.21.15.32:0/3627848749 >> v2:172.21.15.115:3300/0 conn(0x7fcae80d2640 0x7fcae80b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:40.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.904+0000 7fcae7fff700 1 -- 172.21.15.32:0/3627848749 >> v1:172.21.15.115:6789/0 conn(0x7fcae815c460 legacy=0x7fcae80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:40.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.904+0000 7fcae7fff700 1 -- 172.21.15.32:0/3627848749 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae80d14b0 con 0x7fcae80cf8f0 2023-06-20T13:33:40.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.904+0000 7fcae7fff700 1 --2- 172.21.15.32:0/3627848749 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcae80cf8f0 0x7fcae815fe20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcae815fd80 tx=0x7fcae000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2202f02355f049a server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:40.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.904+0000 7fcae6ffd700 1 -- 172.21.15.32:0/3627848749 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae000e070 con 0x7fcae80cf8f0 2023-06-20T13:33:40.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.904+0000 7fcae6ffd700 1 -- 172.21.15.32:0/3627848749 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae000b9c0 con 0x7fcae80cf8f0 2023-06-20T13:33:40.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.904+0000 7fcae6ffd700 1 -- 172.21.15.32:0/3627848749 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae000bd70 con 0x7fcae80cf8f0 2023-06-20T13:33:40.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.905+0000 7fcaeddff700 1 -- 172.21.15.32:0/3627848749 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcae80cf8f0 msgr2=0x7fcae815fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:40.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.905+0000 7fcaeddff700 1 --2- 172.21.15.32:0/3627848749 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcae80cf8f0 0x7fcae815fe20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcae815fd80 tx=0x7fcae000b330 comp rx=0 tx=0).stop 2023-06-20T13:33:40.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.905+0000 7fcaeddff700 1 -- 172.21.15.32:0/3627848749 shutdown_connections 2023-06-20T13:33:40.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.905+0000 7fcaeddff700 1 --2- 172.21.15.32:0/3627848749 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcae80cf8f0 0x7fcae815fe20 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:40.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.905+0000 7fcaeddff700 1 --2- 172.21.15.32:0/3627848749 >> v2:172.21.15.115:3300/0 conn(0x7fcae80d2640 0x7fcae80b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:40.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.905+0000 7fcaeddff700 1 -- 172.21.15.32:0/3627848749 >> 172.21.15.32:0/3627848749 conn(0x7fcae8071660 msgr2=0x7fcae8071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:40.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.905+0000 7fcaeddff700 1 -- 172.21.15.32:0/3627848749 shutdown_connections 2023-06-20T13:33:40.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.905+0000 7fcaeddff700 1 -- 172.21.15.32:0/3627848749 wait complete. 2023-06-20T13:33:40.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.907+0000 7fcaeddff700 1 Processor -- start 2023-06-20T13:33:40.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.907+0000 7fcaeddff700 1 -- start start 2023-06-20T13:33:40.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.908+0000 7fcaeddff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcae80cf8f0 0x7fcae8156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:40.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.908+0000 7fcaeddff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcae80d2640 0x7fcae8157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:40.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.908+0000 7fcaeddff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcae815c460 0x7fcae8155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:40.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.908+0000 7fcaeddff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae815d9b0 con 0x7fcae80cf8f0 2023-06-20T13:33:40.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.908+0000 7fcaeddff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae815cda0 con 0x7fcae815c460 2023-06-20T13:33:40.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.908+0000 7fcaeddff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae815d080 con 0x7fcae80d2640 2023-06-20T13:33:40.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.908+0000 7fcae77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcae80cf8f0 0x7fcae8156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:40.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.908+0000 7fcae77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcae80cf8f0 0x7fcae8156b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46344/0 (socket says 172.21.15.32:46344) 2023-06-20T13:33:40.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.908+0000 7fcae77fe700 1 -- 172.21.15.32:0/3904448799 learned_addr learned my addr 172.21.15.32:0/3904448799 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:40.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.908+0000 7fcae7fff700 1 --2- 172.21.15.32:0/3904448799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcae815c460 0x7fcae8155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:40.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.908+0000 7fcadffff700 1 --2- 172.21.15.32:0/3904448799 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcae80d2640 0x7fcae8157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:40.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.909+0000 7fcae77fe700 1 -- 172.21.15.32:0/3904448799 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcae80d2640 msgr2=0x7fcae8157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:40.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.909+0000 7fcae77fe700 1 --2- 172.21.15.32:0/3904448799 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcae80d2640 0x7fcae8157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:40.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.909+0000 7fcae77fe700 1 -- 172.21.15.32:0/3904448799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcae815c460 msgr2=0x7fcae8155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:40.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.909+0000 7fcae77fe700 1 --2- 172.21.15.32:0/3904448799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcae815c460 0x7fcae8155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:40.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.909+0000 7fcae77fe700 1 -- 172.21.15.32:0/3904448799 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae0009b30 con 0x7fcae80cf8f0 2023-06-20T13:33:40.912 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.909+0000 7fcadffff700 1 --2- 172.21.15.32:0/3904448799 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcae80d2640 0x7fcae8157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:40.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.909+0000 7fcae7fff700 1 --2- 172.21.15.32:0/3904448799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcae815c460 0x7fcae8155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:40.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.909+0000 7fcae77fe700 1 --2- 172.21.15.32:0/3904448799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcae80cf8f0 0x7fcae8156b10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcad800c4e0 tx=0x7fcad800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:40.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.909+0000 7fcae4ff9700 1 -- 172.21.15.32:0/3904448799 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad80052d0 con 0x7fcae80cf8f0 2023-06-20T13:33:40.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.909+0000 7fcae4ff9700 1 -- 172.21.15.32:0/3904448799 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad8005430 con 0x7fcae80cf8f0 2023-06-20T13:33:40.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.909+0000 7fcae4ff9700 1 -- 172.21.15.32:0/3904448799 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad80038c0 con 0x7fcae80cf8f0 2023-06-20T13:33:40.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.909+0000 7fcaeddff700 1 -- 172.21.15.32:0/3904448799 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae815d360 con 0x7fcae80cf8f0 2023-06-20T13:33:40.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.909+0000 7fcaeddff700 1 -- 172.21.15.32:0/3904448799 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae815de40 con 0x7fcae80cf8f0 2023-06-20T13:33:40.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.910+0000 7fcaeddff700 1 -- 172.21.15.32:0/3904448799 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae804ea60 con 0x7fcae80cf8f0 2023-06-20T13:33:40.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.911+0000 7fcae4ff9700 1 -- 172.21.15.32:0/3904448799 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcad8003a20 con 0x7fcae80cf8f0 2023-06-20T13:33:40.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.912+0000 7fcae4ff9700 1 --2- 172.21.15.32:0/3904448799 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcac806ace0 0x7fcac806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:40.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.912+0000 7fcae4ff9700 1 -- 172.21.15.32:0/3904448799 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcad8088ca0 con 0x7fcae80cf8f0 2023-06-20T13:33:40.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.912+0000 7fcadffff700 1 --2- 172.21.15.32:0/3904448799 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcac806ace0 0x7fcac806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:40.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.913+0000 7fcadffff700 1 --2- 172.21.15.32:0/3904448799 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcac806ace0 0x7fcac806d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcae80cc020 tx=0x7fcad0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:40.917 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:40.917+0000 7fcae4ff9700 1 -- 172.21.15.32:0/3904448799 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcad8053a10 con 0x7fcae80cf8f0 2023-06-20T13:33:41.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.142+0000 7fcaeddff700 1 -- 172.21.15.32:0/3904448799 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcae80b4fa0 con 0x7fcae80cf8f0 2023-06-20T13:33:41.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.143+0000 7fcae4ff9700 1 -- 172.21.15.32:0/3904448799 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcad8057030 con 0x7fcae80cf8f0 2023-06-20T13:33:41.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.145+0000 7fcaeddff700 1 -- 172.21.15.32:0/3904448799 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcac806ace0 msgr2=0x7fcac806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:41.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.145+0000 7fcaeddff700 1 --2- 172.21.15.32:0/3904448799 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcac806ace0 0x7fcac806d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcae80cc020 tx=0x7fcad0008040 comp rx=0 tx=0).stop 2023-06-20T13:33:41.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.145+0000 7fcaeddff700 1 -- 172.21.15.32:0/3904448799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcae80cf8f0 msgr2=0x7fcae8156b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:41.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.145+0000 7fcaeddff700 1 --2- 172.21.15.32:0/3904448799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcae80cf8f0 0x7fcae8156b10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcad800c4e0 tx=0x7fcad800c8a0 comp rx=0 tx=0).stop 2023-06-20T13:33:41.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.145+0000 7fcaeddff700 1 -- 172.21.15.32:0/3904448799 shutdown_connections 2023-06-20T13:33:41.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.145+0000 7fcaeddff700 1 --2- 172.21.15.32:0/3904448799 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fcac806ace0 0x7fcac806d190 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:41.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.145+0000 7fcaeddff700 1 --2- 172.21.15.32:0/3904448799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fcae815c460 0x7fcae8155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:41.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.145+0000 7fcaeddff700 1 --2- 172.21.15.32:0/3904448799 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fcae80cf8f0 0x7fcae8156b10 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:41.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.145+0000 7fcaeddff700 1 --2- 172.21.15.32:0/3904448799 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fcae80d2640 0x7fcae8157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:41.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.145+0000 7fcaeddff700 1 -- 172.21.15.32:0/3904448799 >> 172.21.15.32:0/3904448799 conn(0x7fcae8071660 msgr2=0x7fcae80b7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:41.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.145+0000 7fcaeddff700 1 -- 172.21.15.32:0/3904448799 shutdown_connections 2023-06-20T13:33:41.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.146+0000 7fcaeddff700 1 -- 172.21.15.32:0/3904448799 wait complete. 2023-06-20T13:33:41.148 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2023-06-20T13:33:41.165 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-06-20T13:33:41.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:41.166 DEBUG:teuthology.orchestra.run.smithi032:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-06-20T13:33:41.254 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2023-06-20T13:33:41.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:41.255 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-20T13:33:41.301 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:33:41.302 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-20T13:33:41.353 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:33:41.353 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-20T13:33:41.401 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:33:41.401 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-20T13:33:41.486 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:33:41.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.687+0000 7fe0ae1ff700 1 Processor -- start 2023-06-20T13:33:41.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.687+0000 7fe0ae1ff700 1 -- start start 2023-06-20T13:33:41.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.688+0000 7fe0ae1ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a815c460 0x7fe0a80b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:41.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.688+0000 7fe0ae1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe0a80cf8f0 0x7fe0a815fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:41.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.689+0000 7fe0ae1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a80d1790 con 0x7fe0a80d2640 2023-06-20T13:33:41.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.689+0000 7fe0ae1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a80cedd0 con 0x7fe0a80cf8f0 2023-06-20T13:33:41.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.689+0000 7fe0ae1ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a80cd950 con 0x7fe0a815c460 2023-06-20T13:33:41.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.689+0000 7fe0a77fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a815c460 0x7fe0a80b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:41.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.689+0000 7fe0a7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe0a80cf8f0 0x7fe0a815fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:41.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.689+0000 7fe09ffff700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fe0a80d2640 0x7fe0a80cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.32:43264/0 (socket says 172.21.15.32:43264) 2023-06-20T13:33:41.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.689+0000 7fe0a7fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe0a80cf8f0 0x7fe0a815fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:53820/0 (socket says 172.21.15.32:53820) 2023-06-20T13:33:41.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.689+0000 7fe0a77fe700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a815c460 0x7fe0a80b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.32:40208/0 (socket says 172.21.15.32:40208) 2023-06-20T13:33:41.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.689+0000 7fe09ffff700 1 -- 172.21.15.32:0/3643109790 learned_addr learned my addr 172.21.15.32:0/3643109790 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:41.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.689+0000 7fe0a77fe700 1 -- 172.21.15.32:0/3643109790 >> v2:172.21.15.115:3300/0 conn(0x7fe0a80cf8f0 msgr2=0x7fe0a815fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:41.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.689+0000 7fe0a77fe700 1 --2- 172.21.15.32:0/3643109790 >> v2:172.21.15.115:3300/0 conn(0x7fe0a80cf8f0 0x7fe0a815fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:41.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.689+0000 7fe0a77fe700 1 -- 172.21.15.32:0/3643109790 >> v1:172.21.15.115:6789/0 conn(0x7fe0a80d2640 legacy=0x7fe0a80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:41.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.689+0000 7fe0a77fe700 1 -- 172.21.15.32:0/3643109790 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a80d14b0 con 0x7fe0a815c460 2023-06-20T13:33:41.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.689+0000 7fe0a6ffd700 1 -- 172.21.15.32:0/3643109790 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2564036410 0 0) 0x7fe0a80d1790 con 0x7fe0a80d2640 2023-06-20T13:33:41.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.690+0000 7fe0a77fe700 1 --2- 172.21.15.32:0/3643109790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a815c460 0x7fe0a80b59d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe098009840 tx=0x7fe098009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b1e8917b6fcaf79 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:41.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.690+0000 7fe0a6ffd700 1 -- 172.21.15.32:0/3643109790 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe098011830 con 0x7fe0a815c460 2023-06-20T13:33:41.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.690+0000 7fe0a6ffd700 1 -- 172.21.15.32:0/3643109790 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe098011990 con 0x7fe0a815c460 2023-06-20T13:33:41.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.690+0000 7fe0a6ffd700 1 -- 172.21.15.32:0/3643109790 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe098011d20 con 0x7fe0a815c460 2023-06-20T13:33:41.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.691+0000 7fe0ae1ff700 1 -- 172.21.15.32:0/3643109790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a815c460 msgr2=0x7fe0a80b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:41.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.691+0000 7fe0ae1ff700 1 --2- 172.21.15.32:0/3643109790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a815c460 0x7fe0a80b59d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe098009840 tx=0x7fe098009b50 comp rx=0 tx=0).stop 2023-06-20T13:33:41.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.691+0000 7fe0ae1ff700 1 -- 172.21.15.32:0/3643109790 shutdown_connections 2023-06-20T13:33:41.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.691+0000 7fe0ae1ff700 1 --2- 172.21.15.32:0/3643109790 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a815c460 0x7fe0a80b59d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:41.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.691+0000 7fe0ae1ff700 1 --2- 172.21.15.32:0/3643109790 >> v2:172.21.15.115:3300/0 conn(0x7fe0a80cf8f0 0x7fe0a815fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:41.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.691+0000 7fe0ae1ff700 1 -- 172.21.15.32:0/3643109790 >> 172.21.15.32:0/3643109790 conn(0x7fe0a8071660 msgr2=0x7fe0a8071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:41.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.691+0000 7fe0ae1ff700 1 -- 172.21.15.32:0/3643109790 shutdown_connections 2023-06-20T13:33:41.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.691+0000 7fe0ae1ff700 1 -- 172.21.15.32:0/3643109790 wait complete. 2023-06-20T13:33:41.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.693+0000 7fe0ae1ff700 1 Processor -- start 2023-06-20T13:33:41.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.693+0000 7fe0ae1ff700 1 -- start start 2023-06-20T13:33:41.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.694+0000 7fe0ae1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0a80cf8f0 0x7fe0a81e8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:41.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.694+0000 7fe0ae1ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0a80d2640 0x7fe0a81555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:41.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.694+0000 7fe0ae1ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a815c460 0x7fe0a80c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:41.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.694+0000 7fe0ae1ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a81e7780 con 0x7fe0a80d2640 2023-06-20T13:33:41.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.694+0000 7fe0ae1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a80c92c0 con 0x7fe0a80cf8f0 2023-06-20T13:33:41.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.694+0000 7fe0ae1ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a815de00 con 0x7fe0a815c460 2023-06-20T13:33:41.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.694+0000 7fe09ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0a80d2640 0x7fe0a81555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:41.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.694+0000 7fe09ffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0a80d2640 0x7fe0a81555e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46352/0 (socket says 172.21.15.32:46352) 2023-06-20T13:33:41.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.694+0000 7fe09ffff700 1 -- 172.21.15.32:0/2857763891 learned_addr learned my addr 172.21.15.32:0/2857763891 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:41.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.694+0000 7fe0a7fff700 1 --2- 172.21.15.32:0/2857763891 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a815c460 0x7fe0a80c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:41.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.694+0000 7fe0a77fe700 1 --2- 172.21.15.32:0/2857763891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0a80cf8f0 0x7fe0a81e8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:41.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.694+0000 7fe09ffff700 1 -- 172.21.15.32:0/2857763891 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a815c460 msgr2=0x7fe0a80c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:41.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.694+0000 7fe09ffff700 1 --2- 172.21.15.32:0/2857763891 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a815c460 0x7fe0a80c8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:41.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.694+0000 7fe09ffff700 1 -- 172.21.15.32:0/2857763891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0a80cf8f0 msgr2=0x7fe0a81e8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:41.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.694+0000 7fe09ffff700 1 --2- 172.21.15.32:0/2857763891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0a80cf8f0 0x7fe0a81e8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:41.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.694+0000 7fe09ffff700 1 -- 172.21.15.32:0/2857763891 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0980094a0 con 0x7fe0a80d2640 2023-06-20T13:33:41.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.695+0000 7fe09ffff700 1 --2- 172.21.15.32:0/2857763891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0a80d2640 0x7fe0a81555e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe09000c580 tx=0x7fe09000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:41.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.695+0000 7fe0a4ff9700 1 -- 172.21.15.32:0/2857763891 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe090004c80 con 0x7fe0a80d2640 2023-06-20T13:33:41.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.695+0000 7fe0a4ff9700 1 -- 172.21.15.32:0/2857763891 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe090004e00 con 0x7fe0a80d2640 2023-06-20T13:33:41.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.695+0000 7fe0a4ff9700 1 -- 172.21.15.32:0/2857763891 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe090007310 con 0x7fe0a80d2640 2023-06-20T13:33:41.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.695+0000 7fe0ae1ff700 1 -- 172.21.15.32:0/2857763891 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a81e7970 con 0x7fe0a80d2640 2023-06-20T13:33:41.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.695+0000 7fe0ae1ff700 1 -- 172.21.15.32:0/2857763891 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a81e7c10 con 0x7fe0a80d2640 2023-06-20T13:33:41.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.696+0000 7fe0ae1ff700 1 -- 172.21.15.32:0/2857763891 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a804ea60 con 0x7fe0a80d2640 2023-06-20T13:33:41.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.697+0000 7fe0a4ff9700 1 -- 172.21.15.32:0/2857763891 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe090007470 con 0x7fe0a80d2640 2023-06-20T13:33:41.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.698+0000 7fe0a4ff9700 1 --2- 172.21.15.32:0/2857763891 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe08806ace0 0x7fe08806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:41.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.698+0000 7fe0a4ff9700 1 -- 172.21.15.32:0/2857763891 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe0900894a0 con 0x7fe0a80d2640 2023-06-20T13:33:41.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.698+0000 7fe0a77fe700 1 --2- 172.21.15.32:0/2857763891 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe08806ace0 0x7fe08806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:41.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.699+0000 7fe0a77fe700 1 --2- 172.21.15.32:0/2857763891 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe08806ace0 0x7fe08806d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe098009fd0 tx=0x7fe098008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:41.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.702+0000 7fe0a4ff9700 1 -- 172.21.15.32:0/2857763891 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe090054210 con 0x7fe0a80d2640 2023-06-20T13:33:41.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.909+0000 7fe0ae1ff700 1 -- 172.21.15.32:0/2857763891 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0a80b4fa0 con 0x7fe0a80d2640 2023-06-20T13:33:41.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.911+0000 7fe0a4ff9700 1 -- 172.21.15.32:0/2857763891 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20191 (secure 0 0 0) 0x7fe090057830 con 0x7fe0a80d2640 2023-06-20T13:33:41.912 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:33:41.912 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":29,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:33:00.976862+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-20T13:32:18.120021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-20T13:32:19.503624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-20T13:32:23.074912+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:33:41.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.913+0000 7fe0ae1ff700 1 -- 172.21.15.32:0/2857763891 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe08806ace0 msgr2=0x7fe08806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:41.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.913+0000 7fe0ae1ff700 1 --2- 172.21.15.32:0/2857763891 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe08806ace0 0x7fe08806d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe098009fd0 tx=0x7fe098008030 comp rx=0 tx=0).stop 2023-06-20T13:33:41.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.913+0000 7fe0ae1ff700 1 -- 172.21.15.32:0/2857763891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0a80d2640 msgr2=0x7fe0a81555e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:41.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.913+0000 7fe0ae1ff700 1 --2- 172.21.15.32:0/2857763891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0a80d2640 0x7fe0a81555e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe09000c580 tx=0x7fe09000c940 comp rx=0 tx=0).stop 2023-06-20T13:33:41.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.913+0000 7fe0ae1ff700 1 -- 172.21.15.32:0/2857763891 shutdown_connections 2023-06-20T13:33:41.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.913+0000 7fe0ae1ff700 1 --2- 172.21.15.32:0/2857763891 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe08806ace0 0x7fe08806d190 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:41.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.913+0000 7fe0ae1ff700 1 --2- 172.21.15.32:0/2857763891 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe0a815c460 0x7fe0a80c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:41.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.913+0000 7fe0ae1ff700 1 --2- 172.21.15.32:0/2857763891 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0a80cf8f0 0x7fe0a81e8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:41.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.913+0000 7fe0ae1ff700 1 --2- 172.21.15.32:0/2857763891 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe0a80d2640 0x7fe0a81555e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:41.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.913+0000 7fe0ae1ff700 1 -- 172.21.15.32:0/2857763891 >> 172.21.15.32:0/2857763891 conn(0x7fe0a8071660 msgr2=0x7fe0a80cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:41.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.913+0000 7fe0ae1ff700 1 -- 172.21.15.32:0/2857763891 shutdown_connections 2023-06-20T13:33:41.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:41.913+0000 7fe0ae1ff700 1 -- 172.21.15.32:0/2857763891 wait complete. 2023-06-20T13:33:41.933 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-20T13:32:05.308022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-20T13:32:12.857161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-20T13:32:18.120021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-20T13:32:19.503624+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-20T13:32:23.074912+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-20T13:33:41.934 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-20T13:33:42.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.138+0000 7fc94d5ff700 1 Processor -- start 2023-06-20T13:33:42.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.138+0000 7fc94d5ff700 1 -- start start 2023-06-20T13:33:42.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.139+0000 7fc94d5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc94806e130 0x7fc9480cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:42.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.139+0000 7fc94d5ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc94806a640 0x7fc9481573f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:42.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.139+0000 7fc94d5ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9480cb000 con 0x7fc9480b3ec0 2023-06-20T13:33:42.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.139+0000 7fc94d5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9480ca8d0 con 0x7fc94806e130 2023-06-20T13:33:42.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.139+0000 7fc94d5ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94815b6c0 con 0x7fc94806a640 2023-06-20T13:33:42.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.139+0000 7fc946ffd700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fc9480b3ec0 0x7fc948069f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59190/0 (socket says 172.21.15.32:59190) 2023-06-20T13:33:42.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.139+0000 7fc946ffd700 1 -- 172.21.15.32:0/2771684207 learned_addr learned my addr 172.21.15.32:0/2771684207 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:42.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.140+0000 7fc9477fe700 1 --2- 172.21.15.32:0/2771684207 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc94806a640 0x7fc9481573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:42.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.140+0000 7fc9467fc700 1 --2- 172.21.15.32:0/2771684207 >> v2:172.21.15.115:3300/0 conn(0x7fc94806e130 0x7fc9480cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:42.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.140+0000 7fc945ffb700 1 -- 172.21.15.32:0/2771684207 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1671280747 0 0) 0x7fc9480cb000 con 0x7fc9480b3ec0 2023-06-20T13:33:42.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.140+0000 7fc945ffb700 1 -- 172.21.15.32:0/2771684207 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9300035b0 con 0x7fc9480b3ec0 2023-06-20T13:33:42.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.140+0000 7fc945ffb700 1 -- 172.21.15.32:0/2771684207 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 506559950 0 0) 0x7fc9300035b0 con 0x7fc9480b3ec0 2023-06-20T13:33:42.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.140+0000 7fc945ffb700 1 -- 172.21.15.32:0/2771684207 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc94806a640 msgr2=0x7fc9481573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:42.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.140+0000 7fc945ffb700 1 --2- 172.21.15.32:0/2771684207 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc94806a640 0x7fc9481573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:42.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.140+0000 7fc945ffb700 1 -- 172.21.15.32:0/2771684207 >> v2:172.21.15.115:3300/0 conn(0x7fc94806e130 msgr2=0x7fc9480cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:42.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.140+0000 7fc945ffb700 1 --2- 172.21.15.32:0/2771684207 >> v2:172.21.15.115:3300/0 conn(0x7fc94806e130 0x7fc9480cf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:42.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.140+0000 7fc945ffb700 1 -- 172.21.15.32:0/2771684207 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9480c9460 con 0x7fc9480b3ec0 2023-06-20T13:33:42.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.140+0000 7fc945ffb700 1 -- 172.21.15.32:0/2771684207 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3380058562 0 0) 0x7fc938001670 con 0x7fc9480b3ec0 2023-06-20T13:33:42.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.140+0000 7fc945ffb700 1 -- 172.21.15.32:0/2771684207 >> v1:172.21.15.32:6789/0 conn(0x7fc9480b3ec0 legacy=0x7fc948069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:42.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.140+0000 7fc945ffb700 1 --2- 172.21.15.32:0/2771684207 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc94806a640 0x7fc930003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:42.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.140+0000 7fc945ffb700 1 --2- 172.21.15.32:0/2771684207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc930003f80 0x7fc930004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:42.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.140+0000 7fc945ffb700 1 --2- 172.21.15.32:0/2771684207 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc930004d90 0x7fc930005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:42.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.140+0000 7fc945ffb700 1 -- 172.21.15.32:0/2771684207 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9480ca8d0 con 0x7fc930003f80 2023-06-20T13:33:42.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.140+0000 7fc945ffb700 1 -- 172.21.15.32:0/2771684207 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94815b6c0 con 0x7fc930004d90 2023-06-20T13:33:42.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.140+0000 7fc945ffb700 1 -- 172.21.15.32:0/2771684207 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93000ba10 con 0x7fc94806a640 2023-06-20T13:33:42.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.140+0000 7fc9467fc700 1 --2- 172.21.15.32:0/2771684207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc930003f80 0x7fc930004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:42.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.141+0000 7fc946ffd700 1 --2- 172.21.15.32:0/2771684207 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc94806a640 0x7fc930003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:42.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.141+0000 7fc9477fe700 1 --2- 172.21.15.32:0/2771684207 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc930004d90 0x7fc930005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:42.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.141+0000 7fc9467fc700 1 -- 172.21.15.32:0/2771684207 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc94806a640 msgr2=0x7fc930003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:42.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.141+0000 7fc9467fc700 1 --2- 172.21.15.32:0/2771684207 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc94806a640 0x7fc930003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:42.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.141+0000 7fc9467fc700 1 -- 172.21.15.32:0/2771684207 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc930004d90 msgr2=0x7fc930005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:42.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.141+0000 7fc9467fc700 1 --2- 172.21.15.32:0/2771684207 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc930004d90 0x7fc930005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:42.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.141+0000 7fc9467fc700 1 -- 172.21.15.32:0/2771684207 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9300035b0 con 0x7fc930003f80 2023-06-20T13:33:42.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.141+0000 7fc9467fc700 1 --2- 172.21.15.32:0/2771684207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc930003f80 0x7fc930004850 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009b60 tx=0x7fc930005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b0b6cbf09f47fc9 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:42.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.141+0000 7fc945ffb700 1 -- 172.21.15.32:0/2771684207 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c00e6c0 con 0x7fc930003f80 2023-06-20T13:33:42.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.141+0000 7fc945ffb700 1 -- 172.21.15.32:0/2771684207 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93c00e820 con 0x7fc930003f80 2023-06-20T13:33:42.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.141+0000 7fc945ffb700 1 -- 172.21.15.32:0/2771684207 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c00eb90 con 0x7fc930003f80 2023-06-20T13:33:42.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.142+0000 7fc94d5ff700 1 -- 172.21.15.32:0/2771684207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc930003f80 msgr2=0x7fc930004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:42.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.142+0000 7fc94d5ff700 1 --2- 172.21.15.32:0/2771684207 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc930003f80 0x7fc930004850 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009b60 tx=0x7fc930005880 comp rx=0 tx=0).stop 2023-06-20T13:33:42.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.142+0000 7fc9477fe700 1 -- 172.21.15.32:0/2771684207 reap_dead start 2023-06-20T13:33:42.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.142+0000 7fc94d5ff700 1 -- 172.21.15.32:0/2771684207 shutdown_connections 2023-06-20T13:33:42.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.142+0000 7fc94d5ff700 1 -- 172.21.15.32:0/2771684207 >> 172.21.15.32:0/2771684207 conn(0x7fc9480b0fd0 msgr2=0x7fc9480ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:42.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.142+0000 7fc94d5ff700 1 -- 172.21.15.32:0/2771684207 shutdown_connections 2023-06-20T13:33:42.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.142+0000 7fc94d5ff700 1 -- 172.21.15.32:0/2771684207 wait complete. 2023-06-20T13:33:42.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.144+0000 7fc94d5ff700 1 Processor -- start 2023-06-20T13:33:42.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.144+0000 7fc94d5ff700 1 -- start start 2023-06-20T13:33:42.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.145+0000 7fc94d5ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc930003f80 0x7fc94815d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:42.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.145+0000 7fc94d5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc948155b90 0x7fc948155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:42.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.145+0000 7fc94d5ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc94815b850 0x7fc9480aef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:42.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.145+0000 7fc94d5ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94815cdb0 con 0x7fc94815b850 2023-06-20T13:33:42.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.145+0000 7fc94d5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94815c1a0 con 0x7fc948155b90 2023-06-20T13:33:42.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.145+0000 7fc94d5ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94815c480 con 0x7fc930003f80 2023-06-20T13:33:42.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.145+0000 7fc9477fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc94815b850 0x7fc9480aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:42.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.145+0000 7fc9477fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc94815b850 0x7fc9480aef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46366/0 (socket says 172.21.15.32:46366) 2023-06-20T13:33:42.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.145+0000 7fc9477fe700 1 -- 172.21.15.32:0/3596274170 learned_addr learned my addr 172.21.15.32:0/3596274170 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:42.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.145+0000 7fc946ffd700 1 --2- 172.21.15.32:0/3596274170 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc930003f80 0x7fc94815d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:42.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.145+0000 7fc9467fc700 1 --2- 172.21.15.32:0/3596274170 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc948155b90 0x7fc948155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:42.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.146+0000 7fc9477fe700 1 -- 172.21.15.32:0/3596274170 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc930003f80 msgr2=0x7fc94815d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:42.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.146+0000 7fc9477fe700 1 --2- 172.21.15.32:0/3596274170 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc930003f80 0x7fc94815d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:42.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.146+0000 7fc9477fe700 1 -- 172.21.15.32:0/3596274170 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc948155b90 msgr2=0x7fc948155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:42.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.146+0000 7fc9477fe700 1 --2- 172.21.15.32:0/3596274170 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc948155b90 0x7fc948155200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:42.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.146+0000 7fc9477fe700 1 -- 172.21.15.32:0/3596274170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94815c760 con 0x7fc94815b850 2023-06-20T13:33:42.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.146+0000 7fc9467fc700 1 --2- 172.21.15.32:0/3596274170 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc948155b90 0x7fc948155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:42.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.146+0000 7fc9477fe700 1 --2- 172.21.15.32:0/3596274170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc94815b850 0x7fc9480aef20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc9480ae260 tx=0x7fc940011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:42.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.146+0000 7fc92f7fe700 1 -- 172.21.15.32:0/3596274170 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94000e040 con 0x7fc94815b850 2023-06-20T13:33:42.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.146+0000 7fc92f7fe700 1 -- 172.21.15.32:0/3596274170 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94000f040 con 0x7fc94815b850 2023-06-20T13:33:42.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.146+0000 7fc94d5ff700 1 -- 172.21.15.32:0/3596274170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc94815ca40 con 0x7fc94815b850 2023-06-20T13:33:42.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.146+0000 7fc92f7fe700 1 -- 172.21.15.32:0/3596274170 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94000fdb0 con 0x7fc94815b850 2023-06-20T13:33:42.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.146+0000 7fc94d5ff700 1 -- 172.21.15.32:0/3596274170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94815bcc0 con 0x7fc94815b850 2023-06-20T13:33:42.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.147+0000 7fc94d5ff700 1 -- 172.21.15.32:0/3596274170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94815d090 con 0x7fc94815b850 2023-06-20T13:33:42.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.148+0000 7fc92f7fe700 1 -- 172.21.15.32:0/3596274170 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc940022460 con 0x7fc94815b850 2023-06-20T13:33:42.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.149+0000 7fc92f7fe700 1 --2- 172.21.15.32:0/3596274170 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fc93406ace0 0x7fc93406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:42.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.149+0000 7fc92f7fe700 1 -- 172.21.15.32:0/3596274170 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc940089d60 con 0x7fc94815b850 2023-06-20T13:33:42.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.150+0000 7fc946ffd700 1 --2- 172.21.15.32:0/3596274170 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fc93406ace0 0x7fc93406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:42.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.150+0000 7fc946ffd700 1 --2- 172.21.15.32:0/3596274170 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fc93406ace0 0x7fc93406d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc938000c00 tx=0x7fc938009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:42.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.154+0000 7fc92f7fe700 1 -- 172.21.15.32:0/3596274170 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc940054a40 con 0x7fc94815b850 2023-06-20T13:33:42.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.360+0000 7fc94d5ff700 1 -- 172.21.15.32:0/3596274170 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc948066a40 con 0x7fc94815b850 2023-06-20T13:33:42.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.360+0000 7fc92f7fe700 1 -- 172.21.15.32:0/3596274170 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc940058060 con 0x7fc94815b850 2023-06-20T13:33:42.362 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-06-20T13:33:42.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.362+0000 7fc94d5ff700 1 -- 172.21.15.32:0/3596274170 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fc93406ace0 msgr2=0x7fc93406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:42.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.362+0000 7fc94d5ff700 1 --2- 172.21.15.32:0/3596274170 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fc93406ace0 0x7fc93406d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc938000c00 tx=0x7fc938009040 comp rx=0 tx=0).stop 2023-06-20T13:33:42.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.362+0000 7fc94d5ff700 1 -- 172.21.15.32:0/3596274170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc94815b850 msgr2=0x7fc9480aef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:42.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.362+0000 7fc94d5ff700 1 --2- 172.21.15.32:0/3596274170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc94815b850 0x7fc9480aef20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc9480ae260 tx=0x7fc940011f80 comp rx=0 tx=0).stop 2023-06-20T13:33:42.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.362+0000 7fc94d5ff700 1 -- 172.21.15.32:0/3596274170 shutdown_connections 2023-06-20T13:33:42.364 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.362+0000 7fc94d5ff700 1 --2- 172.21.15.32:0/3596274170 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fc93406ace0 0x7fc93406d190 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:42.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.362+0000 7fc94d5ff700 1 --2- 172.21.15.32:0/3596274170 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fc94815b850 0x7fc9480aef20 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:42.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.362+0000 7fc94d5ff700 1 --2- 172.21.15.32:0/3596274170 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc930003f80 0x7fc94815d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:42.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.362+0000 7fc94d5ff700 1 --2- 172.21.15.32:0/3596274170 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc948155b90 0x7fc948155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:42.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.362+0000 7fc94d5ff700 1 -- 172.21.15.32:0/3596274170 >> 172.21.15.32:0/3596274170 conn(0x7fc9480b0fd0 msgr2=0x7fc94806cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:42.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.363+0000 7fc94d5ff700 1 -- 172.21.15.32:0/3596274170 shutdown_connections 2023-06-20T13:33:42.365 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.363+0000 7fc94d5ff700 1 -- 172.21.15.32:0/3596274170 wait complete. 2023-06-20T13:33:42.382 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-20T13:33:42.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.585+0000 7f719efff700 1 Processor -- start 2023-06-20T13:33:42.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.585+0000 7f719efff700 1 -- start start 2023-06-20T13:33:42.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.587+0000 7f719efff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f71980b8430 0x7f71980cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:42.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.587+0000 7f719efff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f71980d3730 0x7f71980cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:42.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.587+0000 7f719efff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71980cfa90 0x7f719815feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:42.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.587+0000 7f719efff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71980b8800 con 0x7f71980d3730 2023-06-20T13:33:42.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.587+0000 7f719efff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71980d0b20 con 0x7f71980b8430 2023-06-20T13:33:42.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.587+0000 7f719efff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71980cfeb0 con 0x7f71980cfa90 2023-06-20T13:33:42.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.587+0000 7f7197fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f71980d3730 0x7f71980cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:42.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.587+0000 7f7197fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f71980d3730 0x7f71980cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46370/0 (socket says 172.21.15.32:46370) 2023-06-20T13:33:42.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.587+0000 7f7197fff700 1 -- 172.21.15.32:0/871545831 learned_addr learned my addr 172.21.15.32:0/871545831 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:42.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.587+0000 7f719d59c700 1 --2- 172.21.15.32:0/871545831 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71980cfa90 0x7f719815feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:42.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.587+0000 7f719cd9b700 1 --2- 172.21.15.32:0/871545831 >> v2:172.21.15.115:3300/0 conn(0x7f71980b8430 0x7f71980cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:42.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.587+0000 7f7197fff700 1 -- 172.21.15.32:0/871545831 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71980cfa90 msgr2=0x7f719815feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:42.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.587+0000 7f7197fff700 1 --2- 172.21.15.32:0/871545831 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71980cfa90 0x7f719815feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:42.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.587+0000 7f7197fff700 1 -- 172.21.15.32:0/871545831 >> v2:172.21.15.115:3300/0 conn(0x7f71980b8430 msgr2=0x7f71980cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:42.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.587+0000 7f7197fff700 1 --2- 172.21.15.32:0/871545831 >> v2:172.21.15.115:3300/0 conn(0x7f71980b8430 0x7f71980cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:42.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.587+0000 7f7197fff700 1 -- 172.21.15.32:0/871545831 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71980b4ee0 con 0x7f71980d3730 2023-06-20T13:33:42.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.587+0000 7f719cd9b700 1 --2- 172.21.15.32:0/871545831 >> v2:172.21.15.115:3300/0 conn(0x7f71980b8430 0x7f71980cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:42.594 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.588+0000 7f7197fff700 1 --2- 172.21.15.32:0/871545831 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71980d3730 0x7f71980cf550 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f71980cf520 tx=0x7f7184009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c56396e505042828 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:42.594 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.588+0000 7f71977fe700 1 -- 172.21.15.32:0/871545831 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718400b870 con 0x7f71980d3730 2023-06-20T13:33:42.594 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.588+0000 7f71977fe700 1 -- 172.21.15.32:0/871545831 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718400b9d0 con 0x7f71980d3730 2023-06-20T13:33:42.594 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.588+0000 7f71977fe700 1 -- 172.21.15.32:0/871545831 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718400bd60 con 0x7f71980d3730 2023-06-20T13:33:42.594 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.588+0000 7f719efff700 1 -- 172.21.15.32:0/871545831 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71980d3730 msgr2=0x7f71980cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:42.595 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.588+0000 7f719efff700 1 --2- 172.21.15.32:0/871545831 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71980d3730 0x7f71980cf550 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f71980cf520 tx=0x7f7184009bd0 comp rx=0 tx=0).stop 2023-06-20T13:33:42.595 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.588+0000 7f719efff700 1 -- 172.21.15.32:0/871545831 shutdown_connections 2023-06-20T13:33:42.595 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.588+0000 7f719efff700 1 --2- 172.21.15.32:0/871545831 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71980cfa90 0x7f719815feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:42.595 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.588+0000 7f719efff700 1 --2- 172.21.15.32:0/871545831 >> v2:172.21.15.115:3300/0 conn(0x7f71980b8430 0x7f71980cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:42.595 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.588+0000 7f719efff700 1 --2- 172.21.15.32:0/871545831 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71980d3730 0x7f71980cf550 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:42.595 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.588+0000 7f719efff700 1 -- 172.21.15.32:0/871545831 >> 172.21.15.32:0/871545831 conn(0x7f719806b3f0 msgr2=0x7f719806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:42.595 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.589+0000 7f719efff700 1 -- 172.21.15.32:0/871545831 shutdown_connections 2023-06-20T13:33:42.596 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.589+0000 7f719efff700 1 -- 172.21.15.32:0/871545831 wait complete. 2023-06-20T13:33:42.596 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.590+0000 7f719efff700 1 Processor -- start 2023-06-20T13:33:42.596 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.590+0000 7f719efff700 1 -- start start 2023-06-20T13:33:42.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.591+0000 7f719efff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71980b8430 0x7f719814d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:42.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.591+0000 7f719efff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71980cfa90 0x7f71980cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:42.599 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.591+0000 7f719efff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71980d3730 0x7f71981f23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:42.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.592+0000 7f719efff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71980ccb10 con 0x7f71980cfa90 2023-06-20T13:33:42.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.592+0000 7f719efff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719815da80 con 0x7f71980d3730 2023-06-20T13:33:42.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.592+0000 7f719efff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719815dd60 con 0x7f71980b8430 2023-06-20T13:33:42.600 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.592+0000 7f7197fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71980cfa90 0x7f71980cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:42.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.592+0000 7f7197fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71980cfa90 0x7f71980cc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46380/0 (socket says 172.21.15.32:46380) 2023-06-20T13:33:42.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.592+0000 7f7197fff700 1 -- 172.21.15.32:0/3998654221 learned_addr learned my addr 172.21.15.32:0/3998654221 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:42.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.592+0000 7f719cd9b700 1 --2- 172.21.15.32:0/3998654221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71980b8430 0x7f719814d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:42.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.592+0000 7f719d59c700 1 --2- 172.21.15.32:0/3998654221 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71980d3730 0x7f71981f23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:42.602 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.592+0000 7f7197fff700 1 -- 172.21.15.32:0/3998654221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71980b8430 msgr2=0x7f719814d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:42.602 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.592+0000 7f7197fff700 1 --2- 172.21.15.32:0/3998654221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71980b8430 0x7f719814d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:42.602 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.592+0000 7f7197fff700 1 -- 172.21.15.32:0/3998654221 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71980d3730 msgr2=0x7f71981f23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:42.602 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.592+0000 7f7197fff700 1 --2- 172.21.15.32:0/3998654221 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71980d3730 0x7f71981f23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:42.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.592+0000 7f7197fff700 1 -- 172.21.15.32:0/3998654221 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7184009550 con 0x7f71980cfa90 2023-06-20T13:33:42.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.592+0000 7f719cd9b700 1 --2- 172.21.15.32:0/3998654221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71980b8430 0x7f719814d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:42.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.592+0000 7f719d59c700 1 --2- 172.21.15.32:0/3998654221 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71980d3730 0x7f71981f23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:42.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.592+0000 7f7197fff700 1 --2- 172.21.15.32:0/3998654221 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71980cfa90 0x7f71980cc5d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7184000c00 tx=0x7f7184004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:42.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.593+0000 7f71957fa700 1 -- 172.21.15.32:0/3998654221 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7184004540 con 0x7f71980cfa90 2023-06-20T13:33:42.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.593+0000 7f71957fa700 1 -- 172.21.15.32:0/3998654221 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71840036a0 con 0x7f71980cfa90 2023-06-20T13:33:42.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.593+0000 7f71957fa700 1 -- 172.21.15.32:0/3998654221 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7184003a50 con 0x7f71980cfa90 2023-06-20T13:33:42.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.593+0000 7f719efff700 1 -- 172.21.15.32:0/3998654221 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f719815e040 con 0x7f71980cfa90 2023-06-20T13:33:42.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.593+0000 7f719efff700 1 -- 172.21.15.32:0/3998654221 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f719815e600 con 0x7f71980cfa90 2023-06-20T13:33:42.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.594+0000 7f7182ffd700 1 -- 172.21.15.32:0/3998654221 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71700052f0 con 0x7f71980cfa90 2023-06-20T13:33:42.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.595+0000 7f71957fa700 1 -- 172.21.15.32:0/3998654221 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7184021070 con 0x7f71980cfa90 2023-06-20T13:33:42.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.596+0000 7f71957fa700 1 --2- 172.21.15.32:0/3998654221 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f717c06ace0 0x7f717c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:42.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.596+0000 7f71957fa700 1 -- 172.21.15.32:0/3998654221 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f718408aef0 con 0x7f71980cfa90 2023-06-20T13:33:42.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.596+0000 7f719cd9b700 1 --2- 172.21.15.32:0/3998654221 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f717c06ace0 0x7f717c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:42.605 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.596+0000 7f719cd9b700 1 --2- 172.21.15.32:0/3998654221 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f717c06ace0 0x7f717c06d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f718c008910 tx=0x7f718c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:42.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.600+0000 7f71957fa700 1 -- 172.21.15.32:0/3998654221 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7184055c60 con 0x7f71980cfa90 2023-06-20T13:33:42.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.806+0000 7f7182ffd700 1 -- 172.21.15.32:0/3998654221 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7170005b20 con 0x7f71980cfa90 2023-06-20T13:33:42.809 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.807+0000 7f71957fa700 1 -- 172.21.15.32:0/3998654221 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f71840150a0 con 0x7f71980cfa90 2023-06-20T13:33:42.809 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 8 2023-06-20T13:33:42.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.809+0000 7f7182ffd700 1 -- 172.21.15.32:0/3998654221 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f717c06ace0 msgr2=0x7f717c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:42.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.809+0000 7f7182ffd700 1 --2- 172.21.15.32:0/3998654221 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f717c06ace0 0x7f717c06d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f718c008910 tx=0x7f718c008040 comp rx=0 tx=0).stop 2023-06-20T13:33:42.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.809+0000 7f7182ffd700 1 -- 172.21.15.32:0/3998654221 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71980cfa90 msgr2=0x7f71980cc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:42.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.809+0000 7f7182ffd700 1 --2- 172.21.15.32:0/3998654221 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71980cfa90 0x7f71980cc5d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7184000c00 tx=0x7f7184004750 comp rx=0 tx=0).stop 2023-06-20T13:33:42.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.809+0000 7f7182ffd700 1 -- 172.21.15.32:0/3998654221 shutdown_connections 2023-06-20T13:33:42.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.809+0000 7f7182ffd700 1 --2- 172.21.15.32:0/3998654221 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f717c06ace0 0x7f717c06d190 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:42.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.809+0000 7f7182ffd700 1 --2- 172.21.15.32:0/3998654221 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f71980d3730 0x7f71981f23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:42.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.809+0000 7f7182ffd700 1 --2- 172.21.15.32:0/3998654221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71980b8430 0x7f719814d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:42.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.809+0000 7f7182ffd700 1 --2- 172.21.15.32:0/3998654221 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f71980cfa90 0x7f71980cc5d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:42.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.809+0000 7f7182ffd700 1 -- 172.21.15.32:0/3998654221 >> 172.21.15.32:0/3998654221 conn(0x7f719806b3f0 msgr2=0x7f71980b5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:42.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.809+0000 7f7182ffd700 1 -- 172.21.15.32:0/3998654221 shutdown_connections 2023-06-20T13:33:42.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:42.809+0000 7f7182ffd700 1 -- 172.21.15.32:0/3998654221 wait complete. 2023-06-20T13:33:42.829 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-20T13:33:43.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.032+0000 7fd0913ff700 1 Processor -- start 2023-06-20T13:33:43.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.032+0000 7fd0913ff700 1 -- start start 2023-06-20T13:33:43.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.033+0000 7fd0913ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd08c0b8430 0x7fd08c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:43.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.033+0000 7fd0913ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd08c0cfc60 0x7fd08c0d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:43.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.033+0000 7fd0913ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd08c0d0b20 con 0x7fd08c0d3730 2023-06-20T13:33:43.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.033+0000 7fd0913ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd08c0b8800 con 0x7fd08c0b8430 2023-06-20T13:33:43.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.033+0000 7fd0913ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c0b4ee0 con 0x7fd08c0cfc60 2023-06-20T13:33:43.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.034+0000 7fd08a7fc700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd08c0d3730 0x7fd08c0cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59206/0 (socket says 172.21.15.32:59206) 2023-06-20T13:33:43.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.034+0000 7fd08a7fc700 1 -- 172.21.15.32:0/1969456290 learned_addr learned my addr 172.21.15.32:0/1969456290 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:43.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.034+0000 7fd08affd700 1 --2- 172.21.15.32:0/1969456290 >> v2:172.21.15.115:3300/0 conn(0x7fd08c0b8430 0x7fd08c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:43.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.034+0000 7fd08b7fe700 1 --2- 172.21.15.32:0/1969456290 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd08c0cfc60 0x7fd08c0d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:43.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.034+0000 7fd089ffb700 1 -- 172.21.15.32:0/1969456290 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3178142411 0 0) 0x7fd08c0d0b20 con 0x7fd08c0d3730 2023-06-20T13:33:43.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.034+0000 7fd089ffb700 1 -- 172.21.15.32:0/1969456290 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0740035b0 con 0x7fd08c0d3730 2023-06-20T13:33:43.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.034+0000 7fd08affd700 1 -- 172.21.15.32:0/1969456290 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd08c0cfc60 msgr2=0x7fd08c0d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:43.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.034+0000 7fd08affd700 1 --2- 172.21.15.32:0/1969456290 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd08c0cfc60 0x7fd08c0d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:43.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.034+0000 7fd08affd700 1 -- 172.21.15.32:0/1969456290 >> v1:172.21.15.32:6789/0 conn(0x7fd08c0d3730 legacy=0x7fd08c0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:43.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.034+0000 7fd08affd700 1 -- 172.21.15.32:0/1969456290 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08c0b51c0 con 0x7fd08c0b8430 2023-06-20T13:33:43.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.035+0000 7fd08affd700 1 --2- 172.21.15.32:0/1969456290 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd08c0b8430 0x7fd08c0cd320 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd07c009840 tx=0x7fd07c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=273ed83900d05708 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:43.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.035+0000 7fd089ffb700 1 -- 172.21.15.32:0/1969456290 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07c011830 con 0x7fd08c0b8430 2023-06-20T13:33:43.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.035+0000 7fd089ffb700 1 -- 172.21.15.32:0/1969456290 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07c011990 con 0x7fd08c0b8430 2023-06-20T13:33:43.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.035+0000 7fd089ffb700 1 -- 172.21.15.32:0/1969456290 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07c011d20 con 0x7fd08c0b8430 2023-06-20T13:33:43.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.035+0000 7fd0913ff700 1 -- 172.21.15.32:0/1969456290 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd08c0b8430 msgr2=0x7fd08c0cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:43.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.035+0000 7fd0913ff700 1 --2- 172.21.15.32:0/1969456290 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd08c0b8430 0x7fd08c0cd320 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd07c009840 tx=0x7fd07c009b50 comp rx=0 tx=0).stop 2023-06-20T13:33:43.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.035+0000 7fd0913ff700 1 -- 172.21.15.32:0/1969456290 shutdown_connections 2023-06-20T13:33:43.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.035+0000 7fd0913ff700 1 --2- 172.21.15.32:0/1969456290 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd08c0cfc60 0x7fd08c0d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:43.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.035+0000 7fd0913ff700 1 --2- 172.21.15.32:0/1969456290 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd08c0b8430 0x7fd08c0cd320 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:43.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.035+0000 7fd0913ff700 1 -- 172.21.15.32:0/1969456290 >> 172.21.15.32:0/1969456290 conn(0x7fd08c06b3f0 msgr2=0x7fd08c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:43.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.035+0000 7fd0913ff700 1 -- 172.21.15.32:0/1969456290 shutdown_connections 2023-06-20T13:33:43.039 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.035+0000 7fd0913ff700 1 -- 172.21.15.32:0/1969456290 wait complete. 2023-06-20T13:33:43.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.037+0000 7fd0913ff700 1 Processor -- start 2023-06-20T13:33:43.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.037+0000 7fd0913ff700 1 -- start start 2023-06-20T13:33:43.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.038+0000 7fd0913ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd08c0b8430 0x7fd08c0cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:43.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.038+0000 7fd0913ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd08c0cfc60 0x7fd08c148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:43.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.038+0000 7fd0913ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd08c0d3730 0x7fd08c1491f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:43.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.038+0000 7fd0913ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c149730 con 0x7fd08c0cfc60 2023-06-20T13:33:43.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.038+0000 7fd0913ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c1f1e40 con 0x7fd08c0b8430 2023-06-20T13:33:43.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.038+0000 7fd0913ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c1f2120 con 0x7fd08c0d3730 2023-06-20T13:33:43.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.038+0000 7fd08a7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd08c0cfc60 0x7fd08c148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:43.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.039+0000 7fd08a7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd08c0cfc60 0x7fd08c148cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46394/0 (socket says 172.21.15.32:46394) 2023-06-20T13:33:43.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.039+0000 7fd08a7fc700 1 -- 172.21.15.32:0/2095966142 learned_addr learned my addr 172.21.15.32:0/2095966142 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:43.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.039+0000 7fd08b7fe700 1 --2- 172.21.15.32:0/2095966142 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd08c0d3730 0x7fd08c1491f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:43.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.039+0000 7fd08affd700 1 --2- 172.21.15.32:0/2095966142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd08c0b8430 0x7fd08c0cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:43.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.039+0000 7fd08a7fc700 1 -- 172.21.15.32:0/2095966142 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd08c0d3730 msgr2=0x7fd08c1491f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:43.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.039+0000 7fd08a7fc700 1 --2- 172.21.15.32:0/2095966142 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd08c0d3730 0x7fd08c1491f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:43.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.039+0000 7fd08a7fc700 1 -- 172.21.15.32:0/2095966142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd08c0b8430 msgr2=0x7fd08c0cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:43.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.039+0000 7fd08a7fc700 1 --2- 172.21.15.32:0/2095966142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd08c0b8430 0x7fd08c0cbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:43.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.039+0000 7fd08a7fc700 1 -- 172.21.15.32:0/2095966142 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd07c0094a0 con 0x7fd08c0cfc60 2023-06-20T13:33:43.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.039+0000 7fd08a7fc700 1 --2- 172.21.15.32:0/2095966142 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd08c0cfc60 0x7fd08c148cb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd08000c700 tx=0x7fd08000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:43.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.039+0000 7fd0737fe700 1 -- 172.21.15.32:0/2095966142 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd080005d70 con 0x7fd08c0cfc60 2023-06-20T13:33:43.043 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.039+0000 7fd0737fe700 1 -- 172.21.15.32:0/2095966142 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0800070d0 con 0x7fd08c0cfc60 2023-06-20T13:33:43.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.039+0000 7fd0737fe700 1 -- 172.21.15.32:0/2095966142 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd080007460 con 0x7fd08c0cfc60 2023-06-20T13:33:43.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.040+0000 7fd0913ff700 1 -- 172.21.15.32:0/2095966142 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd08c1f2400 con 0x7fd08c0cfc60 2023-06-20T13:33:43.044 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.040+0000 7fd0913ff700 1 -- 172.21.15.32:0/2095966142 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd08c1f1ac0 con 0x7fd08c0cfc60 2023-06-20T13:33:43.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.041+0000 7fd0913ff700 1 -- 172.21.15.32:0/2095966142 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd08c1f2920 con 0x7fd08c0cfc60 2023-06-20T13:33:43.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.042+0000 7fd0737fe700 1 -- 172.21.15.32:0/2095966142 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd0800075c0 con 0x7fd08c0cfc60 2023-06-20T13:33:43.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.043+0000 7fd0737fe700 1 --2- 172.21.15.32:0/2095966142 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd07806ace0 0x7fd07806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:43.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.043+0000 7fd0737fe700 1 -- 172.21.15.32:0/2095966142 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd080088bf0 con 0x7fd08c0cfc60 2023-06-20T13:33:43.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.043+0000 7fd08affd700 1 --2- 172.21.15.32:0/2095966142 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd07806ace0 0x7fd07806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:43.045 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.043+0000 7fd08affd700 1 --2- 172.21.15.32:0/2095966142 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd07806ace0 0x7fd07806d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd07c000c00 tx=0x7fd07c01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:43.048 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.047+0000 7fd0737fe700 1 -- 172.21.15.32:0/2095966142 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd08c1f2920 con 0x7fd08c0cfc60 2023-06-20T13:33:43.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.249+0000 7fd0913ff700 1 -- 172.21.15.32:0/2095966142 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd08c1f2920 con 0x7fd08c0cfc60 2023-06-20T13:33:43.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.249+0000 7fd0737fe700 1 -- 172.21.15.32:0/2095966142 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd080017020 con 0x7fd08c0cfc60 2023-06-20T13:33:43.252 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-06-20T13:33:43.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.251+0000 7fd0913ff700 1 -- 172.21.15.32:0/2095966142 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd07806ace0 msgr2=0x7fd07806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:43.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.251+0000 7fd0913ff700 1 --2- 172.21.15.32:0/2095966142 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd07806ace0 0x7fd07806d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd07c000c00 tx=0x7fd07c01c040 comp rx=0 tx=0).stop 2023-06-20T13:33:43.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.251+0000 7fd0913ff700 1 -- 172.21.15.32:0/2095966142 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd08c0cfc60 msgr2=0x7fd08c148cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:43.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.251+0000 7fd0913ff700 1 --2- 172.21.15.32:0/2095966142 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd08c0cfc60 0x7fd08c148cb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd08000c700 tx=0x7fd08000ca10 comp rx=0 tx=0).stop 2023-06-20T13:33:43.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.251+0000 7fd0913ff700 1 -- 172.21.15.32:0/2095966142 shutdown_connections 2023-06-20T13:33:43.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.251+0000 7fd0913ff700 1 --2- 172.21.15.32:0/2095966142 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd07806ace0 0x7fd07806d190 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:43.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.251+0000 7fd0913ff700 1 --2- 172.21.15.32:0/2095966142 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd08c0d3730 0x7fd08c1491f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:43.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.251+0000 7fd0913ff700 1 --2- 172.21.15.32:0/2095966142 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd08c0b8430 0x7fd08c0cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:43.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.251+0000 7fd0913ff700 1 --2- 172.21.15.32:0/2095966142 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd08c0cfc60 0x7fd08c148cb0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:43.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.251+0000 7fd0913ff700 1 -- 172.21.15.32:0/2095966142 >> 172.21.15.32:0/2095966142 conn(0x7fd08c06b3f0 msgr2=0x7fd08c0d1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:43.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.251+0000 7fd0913ff700 1 -- 172.21.15.32:0/2095966142 shutdown_connections 2023-06-20T13:33:43.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.251+0000 7fd0913ff700 1 -- 172.21.15.32:0/2095966142 wait complete. 2023-06-20T13:33:43.271 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-20T13:33:43.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.475+0000 7fe831dff700 1 Processor -- start 2023-06-20T13:33:43.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.475+0000 7fe831dff700 1 -- start start 2023-06-20T13:33:43.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.476+0000 7fe831dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe82c0b8430 0x7fe82c0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:43.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.476+0000 7fe831dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe82c0d3730 0x7fe82c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:43.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.476+0000 7fe831dff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe82c0d0b20 con 0x7fe82c0cfa90 2023-06-20T13:33:43.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.476+0000 7fe831dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe82c0b8800 con 0x7fe82c0b8430 2023-06-20T13:33:43.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.476+0000 7fe831dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c0cfeb0 con 0x7fe82c0d3730 2023-06-20T13:33:43.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.476+0000 7fe82bfff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe82c0cfa90 0x7fe82c15feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59218/0 (socket says 172.21.15.32:59218) 2023-06-20T13:33:43.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.476+0000 7fe82bfff700 1 -- 172.21.15.32:0/202786208 learned_addr learned my addr 172.21.15.32:0/202786208 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:43.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.476+0000 7fe82b7fe700 1 --2- 172.21.15.32:0/202786208 >> v2:172.21.15.115:3300/0 conn(0x7fe82c0b8430 0x7fe82c0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:43.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.476+0000 7fe82affd700 1 --2- 172.21.15.32:0/202786208 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe82c0d3730 0x7fe82c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:43.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.477+0000 7fe82a7fc700 1 -- 172.21.15.32:0/202786208 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1383371216 0 0) 0x7fe82c0d0b20 con 0x7fe82c0cfa90 2023-06-20T13:33:43.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.477+0000 7fe82a7fc700 1 -- 172.21.15.32:0/202786208 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8140035b0 con 0x7fe82c0cfa90 2023-06-20T13:33:43.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.477+0000 7fe82affd700 1 -- 172.21.15.32:0/202786208 >> v2:172.21.15.115:3300/0 conn(0x7fe82c0b8430 msgr2=0x7fe82c0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:43.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.477+0000 7fe82affd700 1 --2- 172.21.15.32:0/202786208 >> v2:172.21.15.115:3300/0 conn(0x7fe82c0b8430 0x7fe82c0cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:43.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.477+0000 7fe82affd700 1 -- 172.21.15.32:0/202786208 >> v1:172.21.15.32:6789/0 conn(0x7fe82c0cfa90 legacy=0x7fe82c15feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:43.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.477+0000 7fe82affd700 1 -- 172.21.15.32:0/202786208 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82c0b4ee0 con 0x7fe82c0d3730 2023-06-20T13:33:43.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.477+0000 7fe82b7fe700 1 --2- 172.21.15.32:0/202786208 >> v2:172.21.15.115:3300/0 conn(0x7fe82c0b8430 0x7fe82c0cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:33:43.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.477+0000 7fe82affd700 1 --2- 172.21.15.32:0/202786208 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe82c0d3730 0x7fe82c0cf550 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe820009840 tx=0x7fe820009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a70389b89681f156 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:43.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.477+0000 7fe82a7fc700 1 -- 172.21.15.32:0/202786208 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe820011830 con 0x7fe82c0d3730 2023-06-20T13:33:43.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.478+0000 7fe82a7fc700 1 -- 172.21.15.32:0/202786208 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe820011990 con 0x7fe82c0d3730 2023-06-20T13:33:43.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.478+0000 7fe82a7fc700 1 -- 172.21.15.32:0/202786208 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe820011d20 con 0x7fe82c0d3730 2023-06-20T13:33:43.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.478+0000 7fe831dff700 1 -- 172.21.15.32:0/202786208 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe82c0d3730 msgr2=0x7fe82c0cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:43.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.478+0000 7fe831dff700 1 --2- 172.21.15.32:0/202786208 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe82c0d3730 0x7fe82c0cf550 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe820009840 tx=0x7fe820009b50 comp rx=0 tx=0).stop 2023-06-20T13:33:43.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.478+0000 7fe831dff700 1 -- 172.21.15.32:0/202786208 shutdown_connections 2023-06-20T13:33:43.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.478+0000 7fe831dff700 1 --2- 172.21.15.32:0/202786208 >> v2:172.21.15.115:3300/0 conn(0x7fe82c0b8430 0x7fe82c0cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:43.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.478+0000 7fe831dff700 1 --2- 172.21.15.32:0/202786208 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe82c0d3730 0x7fe82c0cf550 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:43.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.478+0000 7fe831dff700 1 -- 172.21.15.32:0/202786208 >> 172.21.15.32:0/202786208 conn(0x7fe82c06b3f0 msgr2=0x7fe82c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:43.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.478+0000 7fe831dff700 1 -- 172.21.15.32:0/202786208 shutdown_connections 2023-06-20T13:33:43.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.478+0000 7fe831dff700 1 -- 172.21.15.32:0/202786208 wait complete. 2023-06-20T13:33:43.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.481+0000 7fe831dff700 1 Processor -- start 2023-06-20T13:33:43.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.481+0000 7fe831dff700 1 -- start start 2023-06-20T13:33:43.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.482+0000 7fe831dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe82c0b8430 0x7fe82c15f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:43.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.482+0000 7fe831dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe82c0cfa90 0x7fe82c14ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:43.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.482+0000 7fe831dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe82c0d3730 0x7fe82c0cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:43.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.482+0000 7fe831dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c0cc080 con 0x7fe82c0b8430 2023-06-20T13:33:43.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.482+0000 7fe831dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c0cb470 con 0x7fe82c0cfa90 2023-06-20T13:33:43.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.482+0000 7fe831dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c0cb750 con 0x7fe82c0d3730 2023-06-20T13:33:43.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.482+0000 7fe82b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe82c0b8430 0x7fe82c15f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:43.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.482+0000 7fe82b7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe82c0b8430 0x7fe82c15f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46398/0 (socket says 172.21.15.32:46398) 2023-06-20T13:33:43.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.482+0000 7fe82b7fe700 1 -- 172.21.15.32:0/1071416300 learned_addr learned my addr 172.21.15.32:0/1071416300 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:43.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.483+0000 7fe82b7fe700 1 -- 172.21.15.32:0/1071416300 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe82c0d3730 msgr2=0x7fe82c0cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:43.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.483+0000 7fe82b7fe700 1 --2- 172.21.15.32:0/1071416300 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe82c0d3730 0x7fe82c0cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:43.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.483+0000 7fe82b7fe700 1 -- 172.21.15.32:0/1071416300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe82c0cfa90 msgr2=0x7fe82c14ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:43.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.483+0000 7fe82b7fe700 1 --2- 172.21.15.32:0/1071416300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe82c0cfa90 0x7fe82c14ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:43.490 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.483+0000 7fe82b7fe700 1 -- 172.21.15.32:0/1071416300 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c0094a0 con 0x7fe82c0b8430 2023-06-20T13:33:43.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.483+0000 7fe82b7fe700 1 --2- 172.21.15.32:0/1071416300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe82c0b8430 0x7fe82c15f110 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe81c00ebe0 tx=0x7fe81c009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:43.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.483+0000 7fe813fff700 1 -- 172.21.15.32:0/1071416300 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81c00c8b0 con 0x7fe82c0b8430 2023-06-20T13:33:43.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.483+0000 7fe813fff700 1 -- 172.21.15.32:0/1071416300 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81c00ca10 con 0x7fe82c0b8430 2023-06-20T13:33:43.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.483+0000 7fe813fff700 1 -- 172.21.15.32:0/1071416300 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81c00cda0 con 0x7fe82c0b8430 2023-06-20T13:33:43.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.483+0000 7fe831dff700 1 -- 172.21.15.32:0/1071416300 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8200094a0 con 0x7fe82c0b8430 2023-06-20T13:33:43.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.483+0000 7fe831dff700 1 -- 172.21.15.32:0/1071416300 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe82c0cbd10 con 0x7fe82c0b8430 2023-06-20T13:33:43.491 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.484+0000 7fe831dff700 1 -- 172.21.15.32:0/1071416300 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe82c04ea60 con 0x7fe82c0b8430 2023-06-20T13:33:43.492 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.485+0000 7fe813fff700 1 -- 172.21.15.32:0/1071416300 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe81c013470 con 0x7fe82c0b8430 2023-06-20T13:33:43.492 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.487+0000 7fe813fff700 1 --2- 172.21.15.32:0/1071416300 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe81806ace0 0x7fe81806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:43.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.487+0000 7fe813fff700 1 -- 172.21.15.32:0/1071416300 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe81c089960 con 0x7fe82c0b8430 2023-06-20T13:33:43.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.487+0000 7fe82affd700 1 --2- 172.21.15.32:0/1071416300 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe81806ace0 0x7fe81806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:43.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.488+0000 7fe82affd700 1 --2- 172.21.15.32:0/1071416300 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe81806ace0 0x7fe81806d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe82c0cdf60 tx=0x7fe820010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:43.493 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.491+0000 7fe813fff700 1 -- 172.21.15.32:0/1071416300 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe81c0546d0 con 0x7fe82c0b8430 2023-06-20T13:33:43.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.696+0000 7fe831dff700 1 -- 172.21.15.32:0/1071416300 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe82c150480 con 0x7fe82c0b8430 2023-06-20T13:33:43.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.696+0000 7fe813fff700 1 -- 172.21.15.32:0/1071416300 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe81c057cf0 con 0x7fe82c0b8430 2023-06-20T13:33:43.699 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-06-20T13:33:43.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.698+0000 7fe831dff700 1 -- 172.21.15.32:0/1071416300 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe81806ace0 msgr2=0x7fe81806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:43.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.698+0000 7fe831dff700 1 --2- 172.21.15.32:0/1071416300 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe81806ace0 0x7fe81806d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe82c0cdf60 tx=0x7fe820010000 comp rx=0 tx=0).stop 2023-06-20T13:33:43.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.698+0000 7fe831dff700 1 -- 172.21.15.32:0/1071416300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe82c0b8430 msgr2=0x7fe82c15f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:43.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.698+0000 7fe831dff700 1 --2- 172.21.15.32:0/1071416300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe82c0b8430 0x7fe82c15f110 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe81c00ebe0 tx=0x7fe81c009e20 comp rx=0 tx=0).stop 2023-06-20T13:33:43.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.699+0000 7fe831dff700 1 -- 172.21.15.32:0/1071416300 shutdown_connections 2023-06-20T13:33:43.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.699+0000 7fe831dff700 1 --2- 172.21.15.32:0/1071416300 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe81806ace0 0x7fe81806d190 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:43.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.699+0000 7fe831dff700 1 --2- 172.21.15.32:0/1071416300 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe82c0d3730 0x7fe82c0cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:43.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.699+0000 7fe831dff700 1 --2- 172.21.15.32:0/1071416300 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe82c0b8430 0x7fe82c15f110 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:43.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.699+0000 7fe831dff700 1 --2- 172.21.15.32:0/1071416300 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe82c0cfa90 0x7fe82c14ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:43.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.699+0000 7fe831dff700 1 -- 172.21.15.32:0/1071416300 >> 172.21.15.32:0/1071416300 conn(0x7fe82c06b3f0 msgr2=0x7fe82c0b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:43.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.699+0000 7fe831dff700 1 -- 172.21.15.32:0/1071416300 shutdown_connections 2023-06-20T13:33:43.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.699+0000 7fe831dff700 1 -- 172.21.15.32:0/1071416300 wait complete. 2023-06-20T13:33:43.719 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-20T13:33:43.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.921+0000 7f08e85ff700 1 Processor -- start 2023-06-20T13:33:43.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.921+0000 7f08e85ff700 1 -- start start 2023-06-20T13:33:43.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.922+0000 7f08e85ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f08e00d3730 0x7f08e00cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:43.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.922+0000 7f08e85ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f08e00cfa90 0x7f08e00d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:43.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.922+0000 7f08e85ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e00d0b20 con 0x7f08e00b8430 2023-06-20T13:33:43.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.922+0000 7f08e85ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e00cda30 con 0x7f08e00d3730 2023-06-20T13:33:43.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.922+0000 7f08e85ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e00b8800 con 0x7f08e00cfa90 2023-06-20T13:33:43.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.922+0000 7f08e639b700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f08e00b8430 0x7f08e00cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59226/0 (socket says 172.21.15.32:59226) 2023-06-20T13:33:43.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.922+0000 7f08e639b700 1 -- 172.21.15.32:0/2189271087 learned_addr learned my addr 172.21.15.32:0/2189271087 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:43.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.922+0000 7f08e5b9a700 1 --2- 172.21.15.32:0/2189271087 >> v2:172.21.15.32:3300/0 conn(0x7f08e00d3730 0x7f08e00cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:43.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.922+0000 7f08e6b9c700 1 --2- 172.21.15.32:0/2189271087 >> v2:172.21.15.115:3300/0 conn(0x7f08e00cfa90 0x7f08e00d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:43.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.923+0000 7f08e5399700 1 -- 172.21.15.32:0/2189271087 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489333433 0 0) 0x7f08e00d0b20 con 0x7f08e00b8430 2023-06-20T13:33:43.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.923+0000 7f08e5b9a700 1 -- 172.21.15.32:0/2189271087 >> v2:172.21.15.115:3300/0 conn(0x7f08e00cfa90 msgr2=0x7f08e00d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:43.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.923+0000 7f08e5b9a700 1 --2- 172.21.15.32:0/2189271087 >> v2:172.21.15.115:3300/0 conn(0x7f08e00cfa90 0x7f08e00d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:43.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.923+0000 7f08e5b9a700 1 -- 172.21.15.32:0/2189271087 >> v1:172.21.15.32:6789/0 conn(0x7f08e00b8430 legacy=0x7f08e00cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:43.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.923+0000 7f08e5b9a700 1 -- 172.21.15.32:0/2189271087 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e00cfe90 con 0x7f08e00d3730 2023-06-20T13:33:43.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.923+0000 7f08e5b9a700 1 --2- 172.21.15.32:0/2189271087 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08e00d3730 0x7f08e00cf550 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f08e00b2100 tx=0x7f08d0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca5d5cea45c2da8 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:43.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.923+0000 7f08e5399700 1 -- 172.21.15.32:0/2189271087 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0011830 con 0x7f08e00d3730 2023-06-20T13:33:43.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.923+0000 7f08e5399700 1 -- 172.21.15.32:0/2189271087 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d0011990 con 0x7f08e00d3730 2023-06-20T13:33:43.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.923+0000 7f08e5399700 1 -- 172.21.15.32:0/2189271087 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0011d20 con 0x7f08e00d3730 2023-06-20T13:33:43.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.924+0000 7f08e85ff700 1 -- 172.21.15.32:0/2189271087 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08e00d3730 msgr2=0x7f08e00cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:43.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.924+0000 7f08e85ff700 1 --2- 172.21.15.32:0/2189271087 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08e00d3730 0x7f08e00cf550 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f08e00b2100 tx=0x7f08d0009b20 comp rx=0 tx=0).stop 2023-06-20T13:33:43.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.924+0000 7f08e85ff700 1 -- 172.21.15.32:0/2189271087 shutdown_connections 2023-06-20T13:33:43.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.924+0000 7f08e85ff700 1 --2- 172.21.15.32:0/2189271087 >> v2:172.21.15.115:3300/0 conn(0x7f08e00cfa90 0x7f08e00d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:43.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.924+0000 7f08e85ff700 1 --2- 172.21.15.32:0/2189271087 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08e00d3730 0x7f08e00cf550 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:43.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.924+0000 7f08e85ff700 1 -- 172.21.15.32:0/2189271087 >> 172.21.15.32:0/2189271087 conn(0x7f08e006b3f0 msgr2=0x7f08e006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:43.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.924+0000 7f08e85ff700 1 -- 172.21.15.32:0/2189271087 shutdown_connections 2023-06-20T13:33:43.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.924+0000 7f08e85ff700 1 -- 172.21.15.32:0/2189271087 wait complete. 2023-06-20T13:33:43.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.926+0000 7f08e85ff700 1 Processor -- start 2023-06-20T13:33:43.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.926+0000 7f08e85ff700 1 -- start start 2023-06-20T13:33:43.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.927+0000 7f08e85ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e00b8430 0x7f08e00c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:43.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.927+0000 7f08e85ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08e00cfa90 0x7f08e01f2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:43.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.927+0000 7f08e85ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08e00d3730 0x7f08e00d1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:43.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.927+0000 7f08e85ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e00c9560 con 0x7f08e00cfa90 2023-06-20T13:33:43.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.927+0000 7f08e85ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e00c8c30 con 0x7f08e00b8430 2023-06-20T13:33:43.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.927+0000 7f08e85ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e00c77f0 con 0x7f08e00d3730 2023-06-20T13:33:43.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.927+0000 7f08e5b9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08e00cfa90 0x7f08e01f2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:43.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.927+0000 7f08e5b9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08e00cfa90 0x7f08e01f2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46418/0 (socket says 172.21.15.32:46418) 2023-06-20T13:33:43.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.927+0000 7f08e5b9a700 1 -- 172.21.15.32:0/1189050911 learned_addr learned my addr 172.21.15.32:0/1189050911 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:43.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.927+0000 7f08e6b9c700 1 --2- 172.21.15.32:0/1189050911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08e00d3730 0x7f08e00d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:43.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.927+0000 7f08e639b700 1 --2- 172.21.15.32:0/1189050911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e00b8430 0x7f08e00c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:43.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.927+0000 7f08e5b9a700 1 -- 172.21.15.32:0/1189050911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08e00d3730 msgr2=0x7f08e00d1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:43.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.927+0000 7f08e5b9a700 1 --2- 172.21.15.32:0/1189050911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08e00d3730 0x7f08e00d1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:43.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.927+0000 7f08e5b9a700 1 -- 172.21.15.32:0/1189050911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e00b8430 msgr2=0x7f08e00c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:43.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.927+0000 7f08e5b9a700 1 --2- 172.21.15.32:0/1189050911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e00b8430 0x7f08e00c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:43.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.927+0000 7f08e5b9a700 1 -- 172.21.15.32:0/1189050911 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d00094a0 con 0x7f08e00cfa90 2023-06-20T13:33:43.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.927+0000 7f08e6b9c700 1 --2- 172.21.15.32:0/1189050911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08e00d3730 0x7f08e00d1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:43.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.927+0000 7f08e639b700 1 --2- 172.21.15.32:0/1189050911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e00b8430 0x7f08e00c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:43.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.928+0000 7f08e5b9a700 1 --2- 172.21.15.32:0/1189050911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08e00cfa90 0x7f08e01f2f00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f08d0014040 tx=0x7f08d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:43.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.928+0000 7f08d6ffd700 1 -- 172.21.15.32:0/1189050911 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d00038a0 con 0x7f08e00cfa90 2023-06-20T13:33:43.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.928+0000 7f08d6ffd700 1 -- 172.21.15.32:0/1189050911 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d001e070 con 0x7f08e00cfa90 2023-06-20T13:33:43.933 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.928+0000 7f08d6ffd700 1 -- 172.21.15.32:0/1189050911 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0003c20 con 0x7f08e00cfa90 2023-06-20T13:33:43.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.928+0000 7f08e85ff700 1 -- 172.21.15.32:0/1189050911 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e01f23d0 con 0x7f08e00cfa90 2023-06-20T13:33:43.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.928+0000 7f08e85ff700 1 -- 172.21.15.32:0/1189050911 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e01f2990 con 0x7f08e00cfa90 2023-06-20T13:33:43.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.929+0000 7f08e85ff700 1 -- 172.21.15.32:0/1189050911 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e004ea60 con 0x7f08e00cfa90 2023-06-20T13:33:43.935 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.930+0000 7f08d6ffd700 1 -- 172.21.15.32:0/1189050911 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f08d002d450 con 0x7f08e00cfa90 2023-06-20T13:33:43.935 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.931+0000 7f08d6ffd700 1 --2- 172.21.15.32:0/1189050911 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f08c406ace0 0x7f08c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:43.935 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.931+0000 7f08d6ffd700 1 -- 172.21.15.32:0/1189050911 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f08d008a7f0 con 0x7f08e00cfa90 2023-06-20T13:33:43.935 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.931+0000 7f08e639b700 1 --2- 172.21.15.32:0/1189050911 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f08c406ace0 0x7f08c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:43.935 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.932+0000 7f08e639b700 1 --2- 172.21.15.32:0/1189050911 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f08c406ace0 0x7f08c406d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f08dc000f60 tx=0x7f08dc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:43.937 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:43.935+0000 7f08d6ffd700 1 -- 172.21.15.32:0/1189050911 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f08d0055560 con 0x7f08e00cfa90 2023-06-20T13:33:44.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.143+0000 7f08e85ff700 1 -- 172.21.15.32:0/1189050911 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f08e00d1150 con 0x7f08e00cfa90 2023-06-20T13:33:44.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.143+0000 7f08d6ffd700 1 -- 172.21.15.32:0/1189050911 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f08d0058b80 con 0x7f08e00cfa90 2023-06-20T13:33:44.146 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-06-20T13:33:44.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.145+0000 7f08e85ff700 1 -- 172.21.15.32:0/1189050911 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f08c406ace0 msgr2=0x7f08c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:44.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.145+0000 7f08e85ff700 1 --2- 172.21.15.32:0/1189050911 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f08c406ace0 0x7f08c406d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f08dc000f60 tx=0x7f08dc009040 comp rx=0 tx=0).stop 2023-06-20T13:33:44.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.146+0000 7f08e85ff700 1 -- 172.21.15.32:0/1189050911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08e00cfa90 msgr2=0x7f08e01f2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:44.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.146+0000 7f08e85ff700 1 --2- 172.21.15.32:0/1189050911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08e00cfa90 0x7f08e01f2f00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f08d0014040 tx=0x7f08d0004750 comp rx=0 tx=0).stop 2023-06-20T13:33:44.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.146+0000 7f08e85ff700 1 -- 172.21.15.32:0/1189050911 shutdown_connections 2023-06-20T13:33:44.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.146+0000 7f08e85ff700 1 --2- 172.21.15.32:0/1189050911 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f08c406ace0 0x7f08c406d190 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:44.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.146+0000 7f08e85ff700 1 --2- 172.21.15.32:0/1189050911 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08e00d3730 0x7f08e00d1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:44.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.146+0000 7f08e85ff700 1 --2- 172.21.15.32:0/1189050911 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08e00b8430 0x7f08e00c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:44.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.146+0000 7f08e85ff700 1 --2- 172.21.15.32:0/1189050911 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f08e00cfa90 0x7f08e01f2f00 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:44.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.146+0000 7f08e85ff700 1 -- 172.21.15.32:0/1189050911 >> 172.21.15.32:0/1189050911 conn(0x7f08e006b3f0 msgr2=0x7f08e00b5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:44.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.146+0000 7f08e85ff700 1 -- 172.21.15.32:0/1189050911 shutdown_connections 2023-06-20T13:33:44.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.146+0000 7f08e85ff700 1 -- 172.21.15.32:0/1189050911 wait complete. 2023-06-20T13:33:44.167 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-20T13:33:44.369 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.367+0000 7f2d6a1ff700 1 Processor -- start 2023-06-20T13:33:44.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.367+0000 7f2d6a1ff700 1 -- start start 2023-06-20T13:33:44.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.368+0000 7f2d6a1ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2d6415c460 0x7f2d640b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:44.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.368+0000 7f2d6a1ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d640d2640 0x7f2d640cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:44.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.368+0000 7f2d6a1ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d640d1790 con 0x7f2d640cf720 2023-06-20T13:33:44.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.368+0000 7f2d6a1ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d640cedd0 con 0x7f2d6415c460 2023-06-20T13:33:44.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.368+0000 7f2d6a1ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d640cd950 con 0x7f2d640d2640 2023-06-20T13:33:44.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.368+0000 7f2d62ffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d640d2640 0x7f2d640cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:44.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.368+0000 7f2d62ffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d640d2640 0x7f2d640cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.32:40292/0 (socket says 172.21.15.32:40292) 2023-06-20T13:33:44.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.368+0000 7f2d637fe700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2d6415c460 0x7f2d640b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:44.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.368+0000 7f2d62ffd700 1 -- 172.21.15.32:0/494335755 learned_addr learned my addr 172.21.15.32:0/494335755 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:44.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.369+0000 7f2d62ffd700 1 -- 172.21.15.32:0/494335755 >> v2:172.21.15.115:3300/0 conn(0x7f2d6415c460 msgr2=0x7f2d640b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:44.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.369+0000 7f2d62ffd700 1 --2- 172.21.15.32:0/494335755 >> v2:172.21.15.115:3300/0 conn(0x7f2d6415c460 0x7f2d640b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:44.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.369+0000 7f2d62ffd700 1 -- 172.21.15.32:0/494335755 >> v1:172.21.15.115:6789/0 conn(0x7f2d640cf720 legacy=0x7f2d640d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:44.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.369+0000 7f2d62ffd700 1 -- 172.21.15.32:0/494335755 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d640d14b0 con 0x7f2d640d2640 2023-06-20T13:33:44.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.369+0000 7f2d62ffd700 1 --2- 172.21.15.32:0/494335755 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d640d2640 0x7f2d640cf1e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2d580098f0 tx=0x7f2d58009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a921e3bc3b57c305 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:44.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.369+0000 7f2d627fc700 1 -- 172.21.15.32:0/494335755 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d58011830 con 0x7f2d640d2640 2023-06-20T13:33:44.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.369+0000 7f2d627fc700 1 -- 172.21.15.32:0/494335755 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d58011990 con 0x7f2d640d2640 2023-06-20T13:33:44.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.369+0000 7f2d627fc700 1 -- 172.21.15.32:0/494335755 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d58011d20 con 0x7f2d640d2640 2023-06-20T13:33:44.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.370+0000 7f2d6a1ff700 1 -- 172.21.15.32:0/494335755 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d640d2640 msgr2=0x7f2d640cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:44.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.370+0000 7f2d6a1ff700 1 --2- 172.21.15.32:0/494335755 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d640d2640 0x7f2d640cf1e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2d580098f0 tx=0x7f2d58009c00 comp rx=0 tx=0).stop 2023-06-20T13:33:44.377 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.370+0000 7f2d6a1ff700 1 -- 172.21.15.32:0/494335755 shutdown_connections 2023-06-20T13:33:44.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.370+0000 7f2d6a1ff700 1 --2- 172.21.15.32:0/494335755 >> v2:172.21.15.115:3300/0 conn(0x7f2d6415c460 0x7f2d640b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:44.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.370+0000 7f2d6a1ff700 1 --2- 172.21.15.32:0/494335755 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d640d2640 0x7f2d640cf1e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:44.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.370+0000 7f2d6a1ff700 1 -- 172.21.15.32:0/494335755 >> 172.21.15.32:0/494335755 conn(0x7f2d64071660 msgr2=0x7f2d64071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:44.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.370+0000 7f2d6a1ff700 1 -- 172.21.15.32:0/494335755 shutdown_connections 2023-06-20T13:33:44.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.370+0000 7f2d6a1ff700 1 -- 172.21.15.32:0/494335755 wait complete. 2023-06-20T13:33:44.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.372+0000 7f2d6a1ff700 1 Processor -- start 2023-06-20T13:33:44.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.372+0000 7f2d6a1ff700 1 -- start start 2023-06-20T13:33:44.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.373+0000 7f2d6a1ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d640cf720 0x7f2d641461b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:44.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.373+0000 7f2d6a1ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d640d2640 0x7f2d6415d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:44.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.373+0000 7f2d6a1ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d6415c460 0x7f2d64142d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:44.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.373+0000 7f2d6a1ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6415ddc0 con 0x7f2d6415c460 2023-06-20T13:33:44.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.373+0000 7f2d6a1ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d641432a0 con 0x7f2d640cf720 2023-06-20T13:33:44.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.373+0000 7f2d6a1ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6415e060 con 0x7f2d640d2640 2023-06-20T13:33:44.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.373+0000 7f2d63fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d6415c460 0x7f2d64142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:44.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.373+0000 7f2d63fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d6415c460 0x7f2d64142d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46434/0 (socket says 172.21.15.32:46434) 2023-06-20T13:33:44.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.373+0000 7f2d63fff700 1 -- 172.21.15.32:0/3594231979 learned_addr learned my addr 172.21.15.32:0/3594231979 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:44.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.373+0000 7f2d637fe700 1 --2- 172.21.15.32:0/3594231979 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d640cf720 0x7f2d641461b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:44.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.373+0000 7f2d62ffd700 1 --2- 172.21.15.32:0/3594231979 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d640d2640 0x7f2d6415d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:44.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.374+0000 7f2d63fff700 1 -- 172.21.15.32:0/3594231979 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d640d2640 msgr2=0x7f2d6415d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:44.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.374+0000 7f2d63fff700 1 --2- 172.21.15.32:0/3594231979 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d640d2640 0x7f2d6415d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:44.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.374+0000 7f2d63fff700 1 -- 172.21.15.32:0/3594231979 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d640cf720 msgr2=0x7f2d641461b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:44.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.374+0000 7f2d63fff700 1 --2- 172.21.15.32:0/3594231979 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d640cf720 0x7f2d641461b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:44.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.374+0000 7f2d63fff700 1 -- 172.21.15.32:0/3594231979 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d58009550 con 0x7f2d6415c460 2023-06-20T13:33:44.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.374+0000 7f2d637fe700 1 --2- 172.21.15.32:0/3594231979 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d640cf720 0x7f2d641461b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:33:44.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.374+0000 7f2d63fff700 1 --2- 172.21.15.32:0/3594231979 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d6415c460 0x7f2d64142d60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c00cb50 tx=0x7f2d5c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:44.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.374+0000 7f2d4bfff700 1 -- 172.21.15.32:0/3594231979 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c003c00 con 0x7f2d6415c460 2023-06-20T13:33:44.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.374+0000 7f2d4bfff700 1 -- 172.21.15.32:0/3594231979 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5c003d60 con 0x7f2d6415c460 2023-06-20T13:33:44.383 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.374+0000 7f2d4bfff700 1 -- 172.21.15.32:0/3594231979 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c00aa20 con 0x7f2d6415c460 2023-06-20T13:33:44.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.374+0000 7f2d6a1ff700 1 -- 172.21.15.32:0/3594231979 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d6415e340 con 0x7f2d6415c460 2023-06-20T13:33:44.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.374+0000 7f2d6a1ff700 1 -- 172.21.15.32:0/3594231979 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d6415e900 con 0x7f2d6415c460 2023-06-20T13:33:44.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.375+0000 7f2d6a1ff700 1 -- 172.21.15.32:0/3594231979 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d6404ea60 con 0x7f2d6415c460 2023-06-20T13:33:44.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.376+0000 7f2d4bfff700 1 -- 172.21.15.32:0/3594231979 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2d5c00ab80 con 0x7f2d6415c460 2023-06-20T13:33:44.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.377+0000 7f2d4bfff700 1 --2- 172.21.15.32:0/3594231979 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f2d5006ace0 0x7f2d5006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:44.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.377+0000 7f2d4bfff700 1 -- 172.21.15.32:0/3594231979 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2d5c0897d0 con 0x7f2d6415c460 2023-06-20T13:33:44.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.377+0000 7f2d637fe700 1 --2- 172.21.15.32:0/3594231979 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f2d5006ace0 0x7f2d5006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:44.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.378+0000 7f2d637fe700 1 --2- 172.21.15.32:0/3594231979 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f2d5006ace0 0x7f2d5006d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2d54009fd0 tx=0x7f2d54009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:44.385 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.382+0000 7f2d4bfff700 1 -- 172.21.15.32:0/3594231979 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2d5c054540 con 0x7f2d6415c460 2023-06-20T13:33:44.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.603+0000 7f2d6a1ff700 1 -- 172.21.15.32:0/3594231979 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2d640c6450 con 0x7f2d6415c460 2023-06-20T13:33:44.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.604+0000 7f2d4bfff700 1 -- 172.21.15.32:0/3594231979 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2d5c057b60 con 0x7f2d6415c460 2023-06-20T13:33:44.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.606+0000 7f2d6a1ff700 1 -- 172.21.15.32:0/3594231979 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f2d5006ace0 msgr2=0x7f2d5006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:44.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.606+0000 7f2d6a1ff700 1 --2- 172.21.15.32:0/3594231979 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f2d5006ace0 0x7f2d5006d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2d54009fd0 tx=0x7f2d54009210 comp rx=0 tx=0).stop 2023-06-20T13:33:44.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.606+0000 7f2d6a1ff700 1 -- 172.21.15.32:0/3594231979 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d6415c460 msgr2=0x7f2d64142d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:44.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.606+0000 7f2d6a1ff700 1 --2- 172.21.15.32:0/3594231979 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d6415c460 0x7f2d64142d60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c00cb50 tx=0x7f2d5c00ce60 comp rx=0 tx=0).stop 2023-06-20T13:33:44.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.606+0000 7f2d6a1ff700 1 -- 172.21.15.32:0/3594231979 shutdown_connections 2023-06-20T13:33:44.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.606+0000 7f2d6a1ff700 1 --2- 172.21.15.32:0/3594231979 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f2d5006ace0 0x7f2d5006d190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:44.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.606+0000 7f2d6a1ff700 1 --2- 172.21.15.32:0/3594231979 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2d6415c460 0x7f2d64142d60 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:44.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.606+0000 7f2d6a1ff700 1 --2- 172.21.15.32:0/3594231979 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d640cf720 0x7f2d641461b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:44.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.606+0000 7f2d6a1ff700 1 --2- 172.21.15.32:0/3594231979 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d640d2640 0x7f2d6415d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:44.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.606+0000 7f2d6a1ff700 1 -- 172.21.15.32:0/3594231979 >> 172.21.15.32:0/3594231979 conn(0x7f2d64071660 msgr2=0x7f2d64153fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:44.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.606+0000 7f2d6a1ff700 1 -- 172.21.15.32:0/3594231979 shutdown_connections 2023-06-20T13:33:44.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.606+0000 7f2d6a1ff700 1 -- 172.21.15.32:0/3594231979 wait complete. 2023-06-20T13:33:44.611 INFO:teuthology.orchestra.run.smithi032.stderr:listed 0 entries 2023-06-20T13:33:44.626 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-06-20T13:33:44.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:44.627 DEBUG:teuthology.orchestra.run.smithi115:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-06-20T13:33:44.724 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-06-20T13:33:44.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:33:44.725 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-20T13:33:44.773 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-06-20T13:33:44.773 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-20T13:33:44.974 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.972+0000 7f23911ff700 1 Processor -- start 2023-06-20T13:33:44.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.972+0000 7f23911ff700 1 -- start start 2023-06-20T13:33:44.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.974+0000 7f23911ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f238c0b59d0 0x7f238c1671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:44.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.974+0000 7f23911ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f238c0d1790 con 0x7f238c0d2640 2023-06-20T13:33:44.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.974+0000 7f23911ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f238c0cd950 con 0x7f238c15c460 2023-06-20T13:33:44.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.974+0000 7f23911ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f238c0b5e10 con 0x7f238c0b59d0 2023-06-20T13:33:44.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.974+0000 7f238a59c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f238c0d2640 0x7f238c0cf8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59242/0 (socket says 172.21.15.32:59242) 2023-06-20T13:33:44.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.974+0000 7f238a59c700 1 -- 172.21.15.32:0/3196391228 learned_addr learned my addr 172.21.15.32:0/3196391228 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:44.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.974+0000 7f238b59e700 1 --2- 172.21.15.32:0/3196391228 >> v2:172.21.15.115:3300/0 conn(0x7f238c0b59d0 0x7f238c1671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:44.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.974+0000 7f2389d9b700 1 -- 172.21.15.32:0/3196391228 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1457833943 0 0) 0x7f238c0d1790 con 0x7f238c0d2640 2023-06-20T13:33:44.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.974+0000 7f2389d9b700 1 -- 172.21.15.32:0/3196391228 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23740035b0 con 0x7f238c0d2640 2023-06-20T13:33:44.978 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.974+0000 7f2389d9b700 1 -- 172.21.15.32:0/3196391228 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2040546258 0 0) 0x7f238c0cd950 con 0x7f238c15c460 2023-06-20T13:33:44.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.975+0000 7f2389d9b700 1 -- 172.21.15.32:0/3196391228 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f238c0d1790 con 0x7f238c15c460 2023-06-20T13:33:44.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.975+0000 7f238b59e700 1 -- 172.21.15.32:0/3196391228 >> v1:172.21.15.115:6789/0 conn(0x7f238c15c460 legacy=0x7f238c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:44.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.975+0000 7f238b59e700 1 -- 172.21.15.32:0/3196391228 >> v1:172.21.15.32:6789/0 conn(0x7f238c0d2640 legacy=0x7f238c0cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:44.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.975+0000 7f238b59e700 1 -- 172.21.15.32:0/3196391228 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c0d14b0 con 0x7f238c0b59d0 2023-06-20T13:33:44.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.975+0000 7f238b59e700 1 --2- 172.21.15.32:0/3196391228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f238c0b59d0 0x7f238c1671b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2384009d90 tx=0x7f238400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=740b5952d9ff0a45 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:44.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.975+0000 7f2389d9b700 1 -- 172.21.15.32:0/3196391228 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238400e070 con 0x7f238c0b59d0 2023-06-20T13:33:44.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.975+0000 7f2389d9b700 1 -- 172.21.15.32:0/3196391228 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238400bb20 con 0x7f238c0b59d0 2023-06-20T13:33:44.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.975+0000 7f2389d9b700 1 -- 172.21.15.32:0/3196391228 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2384012430 con 0x7f238c0b59d0 2023-06-20T13:33:44.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.976+0000 7f23911ff700 1 -- 172.21.15.32:0/3196391228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f238c0b59d0 msgr2=0x7f238c1671b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:44.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.976+0000 7f23911ff700 1 --2- 172.21.15.32:0/3196391228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f238c0b59d0 0x7f238c1671b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2384009d90 tx=0x7f238400b330 comp rx=0 tx=0).stop 2023-06-20T13:33:44.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.976+0000 7f23911ff700 1 -- 172.21.15.32:0/3196391228 shutdown_connections 2023-06-20T13:33:44.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.976+0000 7f23911ff700 1 --2- 172.21.15.32:0/3196391228 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f238c0b59d0 0x7f238c1671b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:44.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.976+0000 7f23911ff700 1 -- 172.21.15.32:0/3196391228 >> 172.21.15.32:0/3196391228 conn(0x7f238c071660 msgr2=0x7f238c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:44.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.976+0000 7f23911ff700 1 -- 172.21.15.32:0/3196391228 shutdown_connections 2023-06-20T13:33:44.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.976+0000 7f23911ff700 1 -- 172.21.15.32:0/3196391228 wait complete. 2023-06-20T13:33:44.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.978+0000 7f23911ff700 1 Processor -- start 2023-06-20T13:33:44.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.978+0000 7f23911ff700 1 -- start start 2023-06-20T13:33:44.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.979+0000 7f23911ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f238c0b59d0 0x7f238c14ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:44.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.979+0000 7f23911ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f238c0d2640 0x7f238c160350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:44.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.979+0000 7f23911ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f238c15c460 0x7f238c160890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:44.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.979+0000 7f23911ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c15cfb0 con 0x7f238c15c460 2023-06-20T13:33:44.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.979+0000 7f23911ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c15f800 con 0x7f238c0d2640 2023-06-20T13:33:44.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.979+0000 7f23911ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238c15f520 con 0x7f238c0b59d0 2023-06-20T13:33:44.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.979+0000 7f238b59e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f238c15c460 0x7f238c160890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:44.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.979+0000 7f238b59e700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f238c15c460 0x7f238c160890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46440/0 (socket says 172.21.15.32:46440) 2023-06-20T13:33:44.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.979+0000 7f238b59e700 1 -- 172.21.15.32:0/3590370665 learned_addr learned my addr 172.21.15.32:0/3590370665 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:44.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.979+0000 7f238a59c700 1 --2- 172.21.15.32:0/3590370665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f238c0d2640 0x7f238c160350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:44.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.979+0000 7f238ad9d700 1 --2- 172.21.15.32:0/3590370665 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f238c0b59d0 0x7f238c14ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:44.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.979+0000 7f238b59e700 1 -- 172.21.15.32:0/3590370665 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f238c0b59d0 msgr2=0x7f238c14ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:44.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.979+0000 7f238b59e700 1 --2- 172.21.15.32:0/3590370665 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f238c0b59d0 0x7f238c14ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:44.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.979+0000 7f238b59e700 1 -- 172.21.15.32:0/3590370665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f238c0d2640 msgr2=0x7f238c160350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:44.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.979+0000 7f238b59e700 1 --2- 172.21.15.32:0/3590370665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f238c0d2640 0x7f238c160350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:44.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.979+0000 7f238b59e700 1 -- 172.21.15.32:0/3590370665 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2384009a70 con 0x7f238c15c460 2023-06-20T13:33:44.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.980+0000 7f238b59e700 1 --2- 172.21.15.32:0/3590370665 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f238c15c460 0x7f238c160890 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f238c0d3c80 tx=0x7f2384004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:44.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.980+0000 7f23737fe700 1 -- 172.21.15.32:0/3590370665 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2384012430 con 0x7f238c15c460 2023-06-20T13:33:44.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.980+0000 7f23737fe700 1 -- 172.21.15.32:0/3590370665 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2384020070 con 0x7f238c15c460 2023-06-20T13:33:44.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.980+0000 7f23911ff700 1 -- 172.21.15.32:0/3590370665 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f238c15c960 con 0x7f238c15c460 2023-06-20T13:33:44.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.980+0000 7f23737fe700 1 -- 172.21.15.32:0/3590370665 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238401ba50 con 0x7f238c15c460 2023-06-20T13:33:44.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.980+0000 7f23911ff700 1 -- 172.21.15.32:0/3590370665 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f238c1504c0 con 0x7f238c15c460 2023-06-20T13:33:44.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.981+0000 7f23911ff700 1 -- 172.21.15.32:0/3590370665 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f238c15d120 con 0x7f238c15c460 2023-06-20T13:33:44.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.982+0000 7f23737fe700 1 -- 172.21.15.32:0/3590370665 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f238401bbb0 con 0x7f238c15c460 2023-06-20T13:33:44.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.983+0000 7f23737fe700 1 --2- 172.21.15.32:0/3590370665 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f237806ace0 0x7f237806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:44.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.983+0000 7f23737fe700 1 -- 172.21.15.32:0/3590370665 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2384022070 con 0x7f238c15c460 2023-06-20T13:33:44.987 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.983+0000 7f238ad9d700 1 --2- 172.21.15.32:0/3590370665 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f237806ace0 0x7f237806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:44.987 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.984+0000 7f238ad9d700 1 --2- 172.21.15.32:0/3590370665 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f237806ace0 0x7f237806d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f237c0011e0 tx=0x7f237c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:44.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:44.987+0000 7f23737fe700 1 -- 172.21.15.32:0/3590370665 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f23840565e0 con 0x7f238c15c460 2023-06-20T13:33:45.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.246+0000 7f23911ff700 1 -- 172.21.15.32:0/3590370665 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f238c04ea60 con 0x7f238c15c460 2023-06-20T13:33:45.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.246+0000 7f23737fe700 1 -- 172.21.15.32:0/3590370665 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f238401be60 con 0x7f238c15c460 2023-06-20T13:33:45.249 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:33:45.249 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2171664589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2171664589},{"type":"v1","addr":"172.21.15.115:6834","nonce":2171664589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/959333888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":959333888},{"type":"v1","addr":"172.21.15.32:6837","nonce":959333888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3388117179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":3388117179},{"type":"v1","addr":"172.21.15.32:6835","nonce":3388117179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-20T13:32:20.527725+0000","modified":"2023-06-20T13:32:49.006923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3566362693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3566362693},{"type":"v1","addr":"172.21.15.115:6835","nonce":3566362693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-20T13:33:45.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.249+0000 7f23911ff700 1 -- 172.21.15.32:0/3590370665 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f237806ace0 msgr2=0x7f237806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:45.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.249+0000 7f23911ff700 1 --2- 172.21.15.32:0/3590370665 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f237806ace0 0x7f237806d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f237c0011e0 tx=0x7f237c009040 comp rx=0 tx=0).stop 2023-06-20T13:33:45.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.249+0000 7f23911ff700 1 -- 172.21.15.32:0/3590370665 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f238c15c460 msgr2=0x7f238c160890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:45.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.249+0000 7f23911ff700 1 --2- 172.21.15.32:0/3590370665 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f238c15c460 0x7f238c160890 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f238c0d3c80 tx=0x7f2384004ad0 comp rx=0 tx=0).stop 2023-06-20T13:33:45.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.249+0000 7f23911ff700 1 -- 172.21.15.32:0/3590370665 shutdown_connections 2023-06-20T13:33:45.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.249+0000 7f23911ff700 1 --2- 172.21.15.32:0/3590370665 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f237806ace0 0x7f237806d190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:45.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.249+0000 7f23911ff700 1 --2- 172.21.15.32:0/3590370665 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f238c15c460 0x7f238c160890 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:45.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.249+0000 7f23911ff700 1 --2- 172.21.15.32:0/3590370665 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f238c0b59d0 0x7f238c14ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:45.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.249+0000 7f23911ff700 1 --2- 172.21.15.32:0/3590370665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f238c0d2640 0x7f238c160350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:45.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.249+0000 7f23911ff700 1 -- 172.21.15.32:0/3590370665 >> 172.21.15.32:0/3590370665 conn(0x7f238c071660 msgr2=0x7f238c0d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:45.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.249+0000 7f23911ff700 1 -- 172.21.15.32:0/3590370665 shutdown_connections 2023-06-20T13:33:45.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.249+0000 7f23911ff700 1 -- 172.21.15.32:0/3590370665 wait complete. 2023-06-20T13:33:45.253 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2023-06-20T13:33:45.269 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:33:45.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.468+0000 7f6b2cfff700 1 Processor -- start 2023-06-20T13:33:45.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.468+0000 7f6b2cfff700 1 -- start start 2023-06-20T13:33:45.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.469+0000 7f6b2cfff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6b280b59d0 0x7f6b281671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:45.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.469+0000 7f6b2cfff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b280d1790 con 0x7f6b280d2640 2023-06-20T13:33:45.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.469+0000 7f6b2cfff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b280cd950 con 0x7f6b2815c460 2023-06-20T13:33:45.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.469+0000 7f6b2cfff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b280b5e10 con 0x7f6b280b59d0 2023-06-20T13:33:45.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.469+0000 7f6b1ffff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f6b280d2640 0x7f6b280cf8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59244/0 (socket says 172.21.15.32:59244) 2023-06-20T13:33:45.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.469+0000 7f6b1ffff700 1 -- 172.21.15.32:0/2860283317 learned_addr learned my addr 172.21.15.32:0/2860283317 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:45.474 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.470+0000 7f6b26d9d700 1 --2- 172.21.15.32:0/2860283317 >> v2:172.21.15.115:3300/0 conn(0x7f6b280b59d0 0x7f6b281671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:45.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.470+0000 7f6b25d9b700 1 -- 172.21.15.32:0/2860283317 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3168196872 0 0) 0x7f6b280d1790 con 0x7f6b280d2640 2023-06-20T13:33:45.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.470+0000 7f6b25d9b700 1 -- 172.21.15.32:0/2860283317 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b140035b0 con 0x7f6b280d2640 2023-06-20T13:33:45.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.470+0000 7f6b25d9b700 1 -- 172.21.15.32:0/2860283317 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 123055466 0 0) 0x7f6b280cd950 con 0x7f6b2815c460 2023-06-20T13:33:45.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.470+0000 7f6b25d9b700 1 -- 172.21.15.32:0/2860283317 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b280d1790 con 0x7f6b2815c460 2023-06-20T13:33:45.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.470+0000 7f6b25d9b700 1 -- 172.21.15.32:0/2860283317 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1366684221 0 0) 0x7f6b140035b0 con 0x7f6b280d2640 2023-06-20T13:33:45.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.470+0000 7f6b25d9b700 1 -- 172.21.15.32:0/2860283317 >> v2:172.21.15.115:3300/0 conn(0x7f6b280b59d0 msgr2=0x7f6b281671b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:45.475 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.470+0000 7f6b25d9b700 1 --2- 172.21.15.32:0/2860283317 >> v2:172.21.15.115:3300/0 conn(0x7f6b280b59d0 0x7f6b281671b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:45.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.470+0000 7f6b25d9b700 1 -- 172.21.15.32:0/2860283317 >> v1:172.21.15.115:6789/0 conn(0x7f6b2815c460 legacy=0x7f6b280cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:45.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.470+0000 7f6b25d9b700 1 -- 172.21.15.32:0/2860283317 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b280d14b0 con 0x7f6b280d2640 2023-06-20T13:33:45.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.470+0000 7f6b25d9b700 1 -- 172.21.15.32:0/2860283317 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3380058562 0 0) 0x7f6b100015f0 con 0x7f6b280d2640 2023-06-20T13:33:45.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.470+0000 7f6b25d9b700 1 -- 172.21.15.32:0/2860283317 >> v1:172.21.15.32:6789/0 conn(0x7f6b280d2640 legacy=0x7f6b280cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:45.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.470+0000 7f6b25d9b700 1 --2- 172.21.15.32:0/2860283317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b14003be0 0x7f6b14003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:45.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.471+0000 7f6b25d9b700 1 --2- 172.21.15.32:0/2860283317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b14004850 0x7f6b14004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:45.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.471+0000 7f6b25d9b700 1 --2- 172.21.15.32:0/2860283317 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b140052c0 0x7f6b1400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:45.476 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.471+0000 7f6b25d9b700 1 -- 172.21.15.32:0/2860283317 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b280b5e10 con 0x7f6b14003be0 2023-06-20T13:33:45.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.471+0000 7f6b25d9b700 1 -- 172.21.15.32:0/2860283317 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1400c200 con 0x7f6b14004850 2023-06-20T13:33:45.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.471+0000 7f6b25d9b700 1 -- 172.21.15.32:0/2860283317 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1400c3c0 con 0x7f6b140052c0 2023-06-20T13:33:45.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.471+0000 7f6b2659c700 1 --2- 172.21.15.32:0/2860283317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b14003be0 0x7f6b14003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:45.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.471+0000 7f6b1ffff700 1 --2- 172.21.15.32:0/2860283317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b14004850 0x7f6b14004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:45.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.471+0000 7f6b26d9d700 1 --2- 172.21.15.32:0/2860283317 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b140052c0 0x7f6b1400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:45.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.471+0000 7f6b2659c700 1 -- 172.21.15.32:0/2860283317 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b140052c0 msgr2=0x7f6b1400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:45.477 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.471+0000 7f6b2659c700 1 --2- 172.21.15.32:0/2860283317 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b140052c0 0x7f6b1400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:45.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.471+0000 7f6b2659c700 1 -- 172.21.15.32:0/2860283317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b14004850 msgr2=0x7f6b14004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:45.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.471+0000 7f6b2659c700 1 --2- 172.21.15.32:0/2860283317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b14004850 0x7f6b14004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:45.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.471+0000 7f6b2659c700 1 -- 172.21.15.32:0/2860283317 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b140035b0 con 0x7f6b14003be0 2023-06-20T13:33:45.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.471+0000 7f6b1ffff700 1 --2- 172.21.15.32:0/2860283317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b14004850 0x7f6b14004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:33:45.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.471+0000 7f6b26d9d700 1 -- 172.21.15.32:0/2860283317 reap_dead start 2023-06-20T13:33:45.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.472+0000 7f6b2659c700 1 --2- 172.21.15.32:0/2860283317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b14003be0 0x7f6b14003fd0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6b18001940 tx=0x7f6b14005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf89be0afa13f58d server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:45.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.472+0000 7f6b25d9b700 1 -- 172.21.15.32:0/2860283317 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b18001430 con 0x7f6b14003be0 2023-06-20T13:33:45.478 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.472+0000 7f6b25d9b700 1 -- 172.21.15.32:0/2860283317 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b18001d70 con 0x7f6b14003be0 2023-06-20T13:33:45.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.472+0000 7f6b25d9b700 1 -- 172.21.15.32:0/2860283317 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b18005510 con 0x7f6b14003be0 2023-06-20T13:33:45.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.472+0000 7f6b2cfff700 1 -- 172.21.15.32:0/2860283317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b14003be0 msgr2=0x7f6b14003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:45.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.472+0000 7f6b2cfff700 1 --2- 172.21.15.32:0/2860283317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b14003be0 0x7f6b14003fd0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6b18001940 tx=0x7f6b14005880 comp rx=0 tx=0).stop 2023-06-20T13:33:45.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.472+0000 7f6b2cfff700 1 -- 172.21.15.32:0/2860283317 shutdown_connections 2023-06-20T13:33:45.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.472+0000 7f6b2cfff700 1 --2- 172.21.15.32:0/2860283317 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b14003be0 0x7f6b14003fd0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:45.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.472+0000 7f6b2cfff700 1 -- 172.21.15.32:0/2860283317 >> 172.21.15.32:0/2860283317 conn(0x7f6b28071660 msgr2=0x7f6b28071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:45.479 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.472+0000 7f6b2cfff700 1 -- 172.21.15.32:0/2860283317 shutdown_connections 2023-06-20T13:33:45.480 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.472+0000 7f6b2cfff700 1 -- 172.21.15.32:0/2860283317 wait complete. 2023-06-20T13:33:45.481 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.474+0000 7f6b2cfff700 1 Processor -- start 2023-06-20T13:33:45.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.474+0000 7f6b2cfff700 1 -- start start 2023-06-20T13:33:45.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.475+0000 7f6b2cfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b14003be0 0x7f6b28155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:45.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.475+0000 7f6b2cfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b280cb390 0x7f6b28155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:45.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.475+0000 7f6b2cfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b281563e0 0x7f6b2815a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:45.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.475+0000 7f6b2cfff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b28155bb0 con 0x7f6b281563e0 2023-06-20T13:33:45.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.475+0000 7f6b2cfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b280ca660 con 0x7f6b14003be0 2023-06-20T13:33:45.482 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.475+0000 7f6b2cfff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b280caf00 con 0x7f6b280cb390 2023-06-20T13:33:45.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.476+0000 7f6b26d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b281563e0 0x7f6b2815a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:45.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.476+0000 7f6b2659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b14003be0 0x7f6b28155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:45.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.476+0000 7f6b26d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b281563e0 0x7f6b2815a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46454/0 (socket says 172.21.15.32:46454) 2023-06-20T13:33:45.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.476+0000 7f6b2659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b14003be0 0x7f6b28155670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:53994/0 (socket says 172.21.15.32:53994) 2023-06-20T13:33:45.483 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.476+0000 7f6b1ffff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b280cb390 0x7f6b28155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:45.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.476+0000 7f6b26d9d700 1 -- 172.21.15.32:0/2242074715 learned_addr learned my addr 172.21.15.32:0/2242074715 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:45.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.476+0000 7f6b26d9d700 1 -- 172.21.15.32:0/2242074715 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b280cb390 msgr2=0x7f6b28155ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:45.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.476+0000 7f6b26d9d700 1 --2- 172.21.15.32:0/2242074715 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b280cb390 0x7f6b28155ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:45.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.476+0000 7f6b26d9d700 1 -- 172.21.15.32:0/2242074715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b14003be0 msgr2=0x7f6b28155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:45.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.476+0000 7f6b26d9d700 1 --2- 172.21.15.32:0/2242074715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b14003be0 0x7f6b28155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:45.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.476+0000 7f6b26d9d700 1 -- 172.21.15.32:0/2242074715 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b28159730 con 0x7f6b281563e0 2023-06-20T13:33:45.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.476+0000 7f6b26d9d700 1 --2- 172.21.15.32:0/2242074715 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b281563e0 0x7f6b2815a4f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6b2806abd0 tx=0x7f6b20011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:45.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.477+0000 7f6b1effd700 1 -- 172.21.15.32:0/2242074715 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2000e040 con 0x7f6b281563e0 2023-06-20T13:33:45.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.477+0000 7f6b1effd700 1 -- 172.21.15.32:0/2242074715 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2000f040 con 0x7f6b281563e0 2023-06-20T13:33:45.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.477+0000 7f6b1effd700 1 -- 172.21.15.32:0/2242074715 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2000fc10 con 0x7f6b281563e0 2023-06-20T13:33:45.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.477+0000 7f6b2cfff700 1 -- 172.21.15.32:0/2242074715 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b280ca8b0 con 0x7f6b281563e0 2023-06-20T13:33:45.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.477+0000 7f6b2cfff700 1 -- 172.21.15.32:0/2242074715 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b2815aa30 con 0x7f6b281563e0 2023-06-20T13:33:45.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.478+0000 7f6b2cfff700 1 -- 172.21.15.32:0/2242074715 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b2804ea60 con 0x7f6b281563e0 2023-06-20T13:33:45.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.479+0000 7f6b1effd700 1 -- 172.21.15.32:0/2242074715 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6b2000fd70 con 0x7f6b281563e0 2023-06-20T13:33:45.485 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.480+0000 7f6b1effd700 1 --2- 172.21.15.32:0/2242074715 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6b0806acb0 0x7f6b0806d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:45.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.480+0000 7f6b1effd700 1 -- 172.21.15.32:0/2242074715 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6b20089b40 con 0x7f6b281563e0 2023-06-20T13:33:45.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.480+0000 7f6b2659c700 1 --2- 172.21.15.32:0/2242074715 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6b0806acb0 0x7f6b0806d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:45.486 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.481+0000 7f6b2659c700 1 --2- 172.21.15.32:0/2242074715 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6b0806acb0 0x7f6b0806d160 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6b18005040 tx=0x7f6b1800a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:45.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.484+0000 7f6b1effd700 1 -- 172.21.15.32:0/2242074715 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6b200582b0 con 0x7f6b281563e0 2023-06-20T13:33:45.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.692+0000 7f6b2cfff700 1 -- 172.21.15.32:0/2242074715 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b280cb040 con 0x7f6b281563e0 2023-06-20T13:33:45.695 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.693+0000 7f6b1effd700 1 -- 172.21.15.32:0/2242074715 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20191 (secure 0 0 0) 0x7f6b20057e40 con 0x7f6b281563e0 2023-06-20T13:33:45.696 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:33:45.696 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":29,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:33:00.976862+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-20T13:32:18.120021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-20T13:32:19.503624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-20T13:32:23.074912+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:33:45.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.696+0000 7f6b2cfff700 1 -- 172.21.15.32:0/2242074715 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6b0806acb0 msgr2=0x7f6b0806d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:45.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.696+0000 7f6b2cfff700 1 --2- 172.21.15.32:0/2242074715 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6b0806acb0 0x7f6b0806d160 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6b18005040 tx=0x7f6b1800a000 comp rx=0 tx=0).stop 2023-06-20T13:33:45.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.696+0000 7f6b2cfff700 1 -- 172.21.15.32:0/2242074715 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b281563e0 msgr2=0x7f6b2815a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:45.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.696+0000 7f6b2cfff700 1 --2- 172.21.15.32:0/2242074715 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b281563e0 0x7f6b2815a4f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6b2806abd0 tx=0x7f6b20011ed0 comp rx=0 tx=0).stop 2023-06-20T13:33:45.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.696+0000 7f6b2cfff700 1 -- 172.21.15.32:0/2242074715 shutdown_connections 2023-06-20T13:33:45.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.696+0000 7f6b2cfff700 1 --2- 172.21.15.32:0/2242074715 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f6b0806acb0 0x7f6b0806d160 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:45.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.696+0000 7f6b2cfff700 1 --2- 172.21.15.32:0/2242074715 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f6b281563e0 0x7f6b2815a4f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:45.702 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.696+0000 7f6b2cfff700 1 --2- 172.21.15.32:0/2242074715 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b14003be0 0x7f6b28155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:45.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.696+0000 7f6b2cfff700 1 --2- 172.21.15.32:0/2242074715 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b280cb390 0x7f6b28155ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:45.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.696+0000 7f6b2cfff700 1 -- 172.21.15.32:0/2242074715 >> 172.21.15.32:0/2242074715 conn(0x7f6b28071660 msgr2=0x7f6b2815b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:45.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.696+0000 7f6b2cfff700 1 -- 172.21.15.32:0/2242074715 shutdown_connections 2023-06-20T13:33:45.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.696+0000 7f6b2cfff700 1 -- 172.21.15.32:0/2242074715 wait complete. 2023-06-20T13:33:45.717 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-20T13:32:05.308022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-20T13:32:12.857161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-20T13:32:18.120021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-20T13:32:19.503624+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-20T13:32:23.074912+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-20T13:33:45.719 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-20T13:33:45.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.920+0000 7fe9d41ff700 1 Processor -- start 2023-06-20T13:33:45.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.920+0000 7fe9d41ff700 1 -- start start 2023-06-20T13:33:45.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.921+0000 7fe9d41ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9cc0b4cd0 0x7fe9cc0b5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:45.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.921+0000 7fe9d41ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe9cc0cf8a0 0x7fe9cc15fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:45.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.921+0000 7fe9d41ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9cc0ced60 con 0x7fe9cc15c360 2023-06-20T13:33:45.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.921+0000 7fe9d41ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9cc0d1740 con 0x7fe9cc0cf8a0 2023-06-20T13:33:45.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.921+0000 7fe9d41ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc0d1460 con 0x7fe9cc0b4cd0 2023-06-20T13:33:45.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.921+0000 7fe9d279c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe9cc0cf8a0 0x7fe9cc15fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:45.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.922+0000 7fe9d279c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe9cc0cf8a0 0x7fe9cc15fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46470/0 (socket says 172.21.15.32:46470) 2023-06-20T13:33:45.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.922+0000 7fe9d279c700 1 -- 172.21.15.32:0/3784663707 learned_addr learned my addr 172.21.15.32:0/3784663707 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:45.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.922+0000 7fe9d179a700 1 --2- 172.21.15.32:0/3784663707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9cc0b4cd0 0x7fe9cc0b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:45.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.922+0000 7fe9d279c700 1 -- 172.21.15.32:0/3784663707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9cc0b4cd0 msgr2=0x7fe9cc0b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:45.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.922+0000 7fe9d279c700 1 --2- 172.21.15.32:0/3784663707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9cc0b4cd0 0x7fe9cc0b5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:45.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.922+0000 7fe9d279c700 1 -- 172.21.15.32:0/3784663707 >> v1:172.21.15.115:6789/0 conn(0x7fe9cc15c360 legacy=0x7fe9cc0cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:45.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.922+0000 7fe9d279c700 1 -- 172.21.15.32:0/3784663707 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9cc0cd290 con 0x7fe9cc0cf8a0 2023-06-20T13:33:45.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.922+0000 7fe9d179a700 1 --2- 172.21.15.32:0/3784663707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9cc0b4cd0 0x7fe9cc0b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:45.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.922+0000 7fe9d279c700 1 --2- 172.21.15.32:0/3784663707 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9cc0cf8a0 0x7fe9cc15fd60 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4009e50 tx=0x7fe9c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac822903789f63a7 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:45.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.922+0000 7fe9d0f99700 1 -- 172.21.15.32:0/3784663707 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c400e070 con 0x7fe9cc0cf8a0 2023-06-20T13:33:45.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.922+0000 7fe9d0f99700 1 -- 172.21.15.32:0/3784663707 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c4003a20 con 0x7fe9cc0cf8a0 2023-06-20T13:33:45.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.922+0000 7fe9d0f99700 1 -- 172.21.15.32:0/3784663707 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c4003dd0 con 0x7fe9cc0cf8a0 2023-06-20T13:33:45.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.923+0000 7fe9d41ff700 1 -- 172.21.15.32:0/3784663707 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9cc0cf8a0 msgr2=0x7fe9cc15fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:45.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.923+0000 7fe9d41ff700 1 --2- 172.21.15.32:0/3784663707 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9cc0cf8a0 0x7fe9cc15fd60 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4009e50 tx=0x7fe9c400b330 comp rx=0 tx=0).stop 2023-06-20T13:33:45.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.923+0000 7fe9d41ff700 1 -- 172.21.15.32:0/3784663707 shutdown_connections 2023-06-20T13:33:45.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.923+0000 7fe9d41ff700 1 --2- 172.21.15.32:0/3784663707 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9cc0cf8a0 0x7fe9cc15fd60 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:45.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.923+0000 7fe9d41ff700 1 --2- 172.21.15.32:0/3784663707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9cc0b4cd0 0x7fe9cc0b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:45.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.923+0000 7fe9d41ff700 1 -- 172.21.15.32:0/3784663707 >> 172.21.15.32:0/3784663707 conn(0x7fe9cc071660 msgr2=0x7fe9cc071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:45.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.923+0000 7fe9d41ff700 1 -- 172.21.15.32:0/3784663707 shutdown_connections 2023-06-20T13:33:45.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.923+0000 7fe9d41ff700 1 -- 172.21.15.32:0/3784663707 wait complete. 2023-06-20T13:33:45.932 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.925+0000 7fe9d41ff700 1 Processor -- start 2023-06-20T13:33:45.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.925+0000 7fe9d41ff700 1 -- start start 2023-06-20T13:33:45.934 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.926+0000 7fe9d41ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9cc0b4cd0 0x7fe9cc15c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:45.935 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.926+0000 7fe9d41ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9cc0cf8a0 0x7fe9cc0b7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:45.935 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.926+0000 7fe9d41ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9cc15c360 0x7fe9cc1f5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:45.935 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.926+0000 7fe9d41ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc15cdf0 con 0x7fe9cc0cf8a0 2023-06-20T13:33:45.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.926+0000 7fe9d41ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc15d0d0 con 0x7fe9cc0b4cd0 2023-06-20T13:33:45.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.926+0000 7fe9d41ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc15d3b0 con 0x7fe9cc15c360 2023-06-20T13:33:45.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.926+0000 7fe9d179a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9cc0cf8a0 0x7fe9cc0b7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:45.936 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.926+0000 7fe9d1f9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9cc0b4cd0 0x7fe9cc15c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:45.937 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.926+0000 7fe9d179a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9cc0cf8a0 0x7fe9cc0b7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46480/0 (socket says 172.21.15.32:46480) 2023-06-20T13:33:45.937 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.926+0000 7fe9d179a700 1 -- 172.21.15.32:0/1466175690 learned_addr learned my addr 172.21.15.32:0/1466175690 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:45.937 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.926+0000 7fe9d279c700 1 --2- 172.21.15.32:0/1466175690 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9cc15c360 0x7fe9cc1f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:45.938 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.927+0000 7fe9d179a700 1 -- 172.21.15.32:0/1466175690 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9cc15c360 msgr2=0x7fe9cc1f5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:45.938 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.927+0000 7fe9d179a700 1 --2- 172.21.15.32:0/1466175690 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9cc15c360 0x7fe9cc1f5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:45.938 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.927+0000 7fe9d179a700 1 -- 172.21.15.32:0/1466175690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9cc0b4cd0 msgr2=0x7fe9cc15c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:45.939 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.927+0000 7fe9d179a700 1 --2- 172.21.15.32:0/1466175690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9cc0b4cd0 0x7fe9cc15c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:45.939 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.927+0000 7fe9d179a700 1 -- 172.21.15.32:0/1466175690 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c4009b30 con 0x7fe9cc0cf8a0 2023-06-20T13:33:45.939 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.927+0000 7fe9d179a700 1 --2- 172.21.15.32:0/1466175690 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9cc0cf8a0 0x7fe9cc0b7d40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00c740 tx=0x7fe9bc00ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:45.940 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.927+0000 7fe9c27fc700 1 -- 172.21.15.32:0/1466175690 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc004220 con 0x7fe9cc0cf8a0 2023-06-20T13:33:45.940 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.927+0000 7fe9c27fc700 1 -- 172.21.15.32:0/1466175690 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9bc004380 con 0x7fe9cc0cf8a0 2023-06-20T13:33:45.940 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.927+0000 7fe9c27fc700 1 -- 172.21.15.32:0/1466175690 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc0036c0 con 0x7fe9cc0cf8a0 2023-06-20T13:33:45.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.927+0000 7fe9d41ff700 1 -- 172.21.15.32:0/1466175690 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9cc1f5090 con 0x7fe9cc0cf8a0 2023-06-20T13:33:45.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.928+0000 7fe9d41ff700 1 -- 172.21.15.32:0/1466175690 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9cc1f5dd0 con 0x7fe9cc0cf8a0 2023-06-20T13:33:45.941 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.928+0000 7fe9d41ff700 1 -- 172.21.15.32:0/1466175690 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9cc1f56e0 con 0x7fe9cc0cf8a0 2023-06-20T13:33:45.942 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.930+0000 7fe9c27fc700 1 -- 172.21.15.32:0/1466175690 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe9bc003820 con 0x7fe9cc0cf8a0 2023-06-20T13:33:45.942 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.931+0000 7fe9c27fc700 1 --2- 172.21.15.32:0/1466175690 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe9b006ace0 0x7fe9b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:45.942 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.931+0000 7fe9c27fc700 1 -- 172.21.15.32:0/1466175690 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe9bc089a50 con 0x7fe9cc0cf8a0 2023-06-20T13:33:45.943 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.931+0000 7fe9d1f9b700 1 --2- 172.21.15.32:0/1466175690 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe9b006ace0 0x7fe9b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:45.943 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.932+0000 7fe9d1f9b700 1 --2- 172.21.15.32:0/1466175690 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe9b006ace0 0x7fe9b006d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc159630 tx=0x7fe9c80090e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:45.944 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:45.936+0000 7fe9c27fc700 1 -- 172.21.15.32:0/1466175690 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe9bc0581c0 con 0x7fe9cc0cf8a0 2023-06-20T13:33:46.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.141+0000 7fe9d41ff700 1 -- 172.21.15.32:0/1466175690 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe9cc04ea60 con 0x7fe9cc0cf8a0 2023-06-20T13:33:46.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.142+0000 7fe9c27fc700 1 -- 172.21.15.32:0/1466175690 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe9bc057d50 con 0x7fe9cc0cf8a0 2023-06-20T13:33:46.145 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-06-20T13:33:46.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.144+0000 7fe9d41ff700 1 -- 172.21.15.32:0/1466175690 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe9b006ace0 msgr2=0x7fe9b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:46.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.144+0000 7fe9d41ff700 1 --2- 172.21.15.32:0/1466175690 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe9b006ace0 0x7fe9b006d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc159630 tx=0x7fe9c80090e0 comp rx=0 tx=0).stop 2023-06-20T13:33:46.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.144+0000 7fe9d41ff700 1 -- 172.21.15.32:0/1466175690 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9cc0cf8a0 msgr2=0x7fe9cc0b7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:46.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.144+0000 7fe9d41ff700 1 --2- 172.21.15.32:0/1466175690 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9cc0cf8a0 0x7fe9cc0b7d40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00c740 tx=0x7fe9bc00ca50 comp rx=0 tx=0).stop 2023-06-20T13:33:46.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.144+0000 7fe9d41ff700 1 -- 172.21.15.32:0/1466175690 shutdown_connections 2023-06-20T13:33:46.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.144+0000 7fe9d41ff700 1 --2- 172.21.15.32:0/1466175690 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe9b006ace0 0x7fe9b006d190 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:46.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.144+0000 7fe9d41ff700 1 --2- 172.21.15.32:0/1466175690 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe9cc15c360 0x7fe9cc1f5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:46.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.144+0000 7fe9d41ff700 1 --2- 172.21.15.32:0/1466175690 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9cc0b4cd0 0x7fe9cc15c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:46.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.144+0000 7fe9d41ff700 1 --2- 172.21.15.32:0/1466175690 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe9cc0cf8a0 0x7fe9cc0b7d40 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:46.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.144+0000 7fe9d41ff700 1 -- 172.21.15.32:0/1466175690 >> 172.21.15.32:0/1466175690 conn(0x7fe9cc071660 msgr2=0x7fe9cc15aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:46.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.144+0000 7fe9d41ff700 1 -- 172.21.15.32:0/1466175690 shutdown_connections 2023-06-20T13:33:46.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.144+0000 7fe9d41ff700 1 -- 172.21.15.32:0/1466175690 wait complete. 2023-06-20T13:33:46.165 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-20T13:33:46.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.368+0000 7f8e3e7ff700 1 Processor -- start 2023-06-20T13:33:46.370 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.368+0000 7f8e3e7ff700 1 -- start start 2023-06-20T13:33:46.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.369+0000 7f8e3e7ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8e380b8430 0x7f8e380cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:46.371 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.369+0000 7f8e3e7ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e380d3730 0x7f8e380cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:46.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.369+0000 7f8e3e7ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e380d0b20 con 0x7f8e380cfa90 2023-06-20T13:33:46.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.369+0000 7f8e3e7ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e380b8800 con 0x7f8e380b8430 2023-06-20T13:33:46.372 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.369+0000 7f8e3e7ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380cfeb0 con 0x7f8e380d3730 2023-06-20T13:33:46.373 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.370+0000 7f8e37fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8e380b8430 0x7f8e380cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:46.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.370+0000 7f8e3cd9c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f8e380cfa90 0x7f8e3815feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59250/0 (socket says 172.21.15.32:59250) 2023-06-20T13:33:46.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.370+0000 7f8e3cd9c700 1 -- 172.21.15.32:0/2402954865 learned_addr learned my addr 172.21.15.32:0/2402954865 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:46.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.370+0000 7f8e377fe700 1 --2- 172.21.15.32:0/2402954865 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e380d3730 0x7f8e380cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:46.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.370+0000 7f8e37fff700 1 -- 172.21.15.32:0/2402954865 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e380d3730 msgr2=0x7f8e380cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:46.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.370+0000 7f8e37fff700 1 --2- 172.21.15.32:0/2402954865 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e380d3730 0x7f8e380cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:46.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.370+0000 7f8e36ffd700 1 -- 172.21.15.32:0/2402954865 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1246979287 0 0) 0x7f8e380d0b20 con 0x7f8e380cfa90 2023-06-20T13:33:46.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.370+0000 7f8e37fff700 1 -- 172.21.15.32:0/2402954865 >> v1:172.21.15.32:6789/0 conn(0x7f8e380cfa90 legacy=0x7f8e3815feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:46.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.370+0000 7f8e37fff700 1 -- 172.21.15.32:0/2402954865 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e380b4ee0 con 0x7f8e380b8430 2023-06-20T13:33:46.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.370+0000 7f8e37fff700 1 --2- 172.21.15.32:0/2402954865 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e380b8430 0x7f8e380cd320 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8e28009840 tx=0x7f8e28009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ba307922a19035 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:46.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.371+0000 7f8e36ffd700 1 -- 172.21.15.32:0/2402954865 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e28011830 con 0x7f8e380b8430 2023-06-20T13:33:46.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.371+0000 7f8e36ffd700 1 -- 172.21.15.32:0/2402954865 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e28011990 con 0x7f8e380b8430 2023-06-20T13:33:46.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.371+0000 7f8e36ffd700 1 -- 172.21.15.32:0/2402954865 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e28011d20 con 0x7f8e380b8430 2023-06-20T13:33:46.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.371+0000 7f8e3e7ff700 1 -- 172.21.15.32:0/2402954865 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e380b8430 msgr2=0x7f8e380cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:46.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.371+0000 7f8e3e7ff700 1 --2- 172.21.15.32:0/2402954865 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e380b8430 0x7f8e380cd320 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8e28009840 tx=0x7f8e28009b50 comp rx=0 tx=0).stop 2023-06-20T13:33:46.375 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.371+0000 7f8e3e7ff700 1 -- 172.21.15.32:0/2402954865 shutdown_connections 2023-06-20T13:33:46.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.371+0000 7f8e3e7ff700 1 --2- 172.21.15.32:0/2402954865 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e380b8430 0x7f8e380cd320 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:46.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.371+0000 7f8e3e7ff700 1 --2- 172.21.15.32:0/2402954865 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e380d3730 0x7f8e380cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:46.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.371+0000 7f8e3e7ff700 1 -- 172.21.15.32:0/2402954865 >> 172.21.15.32:0/2402954865 conn(0x7f8e3806b3f0 msgr2=0x7f8e3806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:46.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.371+0000 7f8e3e7ff700 1 -- 172.21.15.32:0/2402954865 shutdown_connections 2023-06-20T13:33:46.376 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.371+0000 7f8e3e7ff700 1 -- 172.21.15.32:0/2402954865 wait complete. 2023-06-20T13:33:46.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.373+0000 7f8e3e7ff700 1 Processor -- start 2023-06-20T13:33:46.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.373+0000 7f8e3e7ff700 1 -- start start 2023-06-20T13:33:46.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.374+0000 7f8e3e7ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e380b8430 0x7f8e3814aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:46.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.374+0000 7f8e3e7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e380cfa90 0x7f8e380cac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:46.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.374+0000 7f8e3e7ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e380d3730 0x7f8e380b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:46.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.374+0000 7f8e3e7ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380cbb90 con 0x7f8e380d3730 2023-06-20T13:33:46.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.374+0000 7f8e3e7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380cb5d0 con 0x7f8e380cfa90 2023-06-20T13:33:46.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.374+0000 7f8e3e7ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380cb8b0 con 0x7f8e380b8430 2023-06-20T13:33:46.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.374+0000 7f8e3cd9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e380d3730 0x7f8e380b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:46.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.374+0000 7f8e3cd9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e380d3730 0x7f8e380b3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46498/0 (socket says 172.21.15.32:46498) 2023-06-20T13:33:46.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.374+0000 7f8e3cd9c700 1 -- 172.21.15.32:0/1405244021 learned_addr learned my addr 172.21.15.32:0/1405244021 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:46.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.375+0000 7f8e37fff700 1 --2- 172.21.15.32:0/1405244021 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e380b8430 0x7f8e3814aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:46.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.375+0000 7f8e377fe700 1 --2- 172.21.15.32:0/1405244021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e380cfa90 0x7f8e380cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:46.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.375+0000 7f8e3cd9c700 1 -- 172.21.15.32:0/1405244021 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e380b8430 msgr2=0x7f8e3814aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:46.379 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.375+0000 7f8e3cd9c700 1 --2- 172.21.15.32:0/1405244021 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e380b8430 0x7f8e3814aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:46.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.375+0000 7f8e3cd9c700 1 -- 172.21.15.32:0/1405244021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e380cfa90 msgr2=0x7f8e380cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:46.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.375+0000 7f8e3cd9c700 1 --2- 172.21.15.32:0/1405244021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e380cfa90 0x7f8e380cac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:46.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.375+0000 7f8e3cd9c700 1 -- 172.21.15.32:0/1405244021 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e280094a0 con 0x7f8e380d3730 2023-06-20T13:33:46.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.375+0000 7f8e3cd9c700 1 --2- 172.21.15.32:0/1405244021 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e380d3730 0x7f8e380b3b10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8e30002230 tx=0x7f8e3000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:46.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.375+0000 7f8e34ff9700 1 -- 172.21.15.32:0/1405244021 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3000aac0 con 0x7f8e380d3730 2023-06-20T13:33:46.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.375+0000 7f8e34ff9700 1 -- 172.21.15.32:0/1405244021 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3000ac40 con 0x7f8e380d3730 2023-06-20T13:33:46.380 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.375+0000 7f8e3e7ff700 1 -- 172.21.15.32:0/1405244021 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e38156c70 con 0x7f8e380d3730 2023-06-20T13:33:46.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.375+0000 7f8e34ff9700 1 -- 172.21.15.32:0/1405244021 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e300070d0 con 0x7f8e380d3730 2023-06-20T13:33:46.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.376+0000 7f8e3e7ff700 1 -- 172.21.15.32:0/1405244021 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e3814b3f0 con 0x7f8e380d3730 2023-06-20T13:33:46.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.377+0000 7f8e3e7ff700 1 -- 172.21.15.32:0/1405244021 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e38157190 con 0x7f8e380d3730 2023-06-20T13:33:46.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.378+0000 7f8e34ff9700 1 -- 172.21.15.32:0/1405244021 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8e30007250 con 0x7f8e380d3730 2023-06-20T13:33:46.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.379+0000 7f8e34ff9700 1 --2- 172.21.15.32:0/1405244021 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8e2406ace0 0x7f8e2406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:46.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.379+0000 7f8e34ff9700 1 -- 172.21.15.32:0/1405244021 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8e30089400 con 0x7f8e380d3730 2023-06-20T13:33:46.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.379+0000 7f8e37fff700 1 --2- 172.21.15.32:0/1405244021 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8e2406ace0 0x7f8e2406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:46.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.380+0000 7f8e37fff700 1 --2- 172.21.15.32:0/1405244021 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8e2406ace0 0x7f8e2406d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8e280090b0 tx=0x7f8e2801c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:46.384 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.382+0000 7f8e34ff9700 1 -- 172.21.15.32:0/1405244021 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8e30054160 con 0x7f8e380d3730 2023-06-20T13:33:46.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.586+0000 7f8e3e7ff700 1 -- 172.21.15.32:0/1405244021 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8e38157190 con 0x7f8e380d3730 2023-06-20T13:33:46.589 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.586+0000 7f8e34ff9700 1 -- 172.21.15.32:0/1405244021 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8e38157190 con 0x7f8e380d3730 2023-06-20T13:33:46.589 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 8 2023-06-20T13:33:46.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.589+0000 7f8e3e7ff700 1 -- 172.21.15.32:0/1405244021 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8e2406ace0 msgr2=0x7f8e2406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:46.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.589+0000 7f8e3e7ff700 1 --2- 172.21.15.32:0/1405244021 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8e2406ace0 0x7f8e2406d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8e280090b0 tx=0x7f8e2801c040 comp rx=0 tx=0).stop 2023-06-20T13:33:46.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.589+0000 7f8e3e7ff700 1 -- 172.21.15.32:0/1405244021 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e380d3730 msgr2=0x7f8e380b3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:46.591 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.589+0000 7f8e3e7ff700 1 --2- 172.21.15.32:0/1405244021 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e380d3730 0x7f8e380b3b10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8e30002230 tx=0x7f8e3000cf50 comp rx=0 tx=0).stop 2023-06-20T13:33:46.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.589+0000 7f8e3e7ff700 1 -- 172.21.15.32:0/1405244021 shutdown_connections 2023-06-20T13:33:46.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.589+0000 7f8e3e7ff700 1 --2- 172.21.15.32:0/1405244021 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8e2406ace0 0x7f8e2406d190 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:46.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.589+0000 7f8e3e7ff700 1 --2- 172.21.15.32:0/1405244021 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8e380d3730 0x7f8e380b3b10 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:46.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.589+0000 7f8e3e7ff700 1 --2- 172.21.15.32:0/1405244021 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8e380b8430 0x7f8e3814aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:46.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.589+0000 7f8e3e7ff700 1 --2- 172.21.15.32:0/1405244021 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8e380cfa90 0x7f8e380cac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:46.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.589+0000 7f8e3e7ff700 1 -- 172.21.15.32:0/1405244021 >> 172.21.15.32:0/1405244021 conn(0x7f8e3806b3f0 msgr2=0x7f8e3815bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:46.592 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.589+0000 7f8e3e7ff700 1 -- 172.21.15.32:0/1405244021 shutdown_connections 2023-06-20T13:33:46.593 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.589+0000 7f8e3e7ff700 1 -- 172.21.15.32:0/1405244021 wait complete. 2023-06-20T13:33:46.609 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-20T13:33:46.811 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.809+0000 7efe17fff700 1 Processor -- start 2023-06-20T13:33:46.812 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.810+0000 7efe17fff700 1 -- start start 2023-06-20T13:33:46.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.811+0000 7efe17fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe100b8430 0x7efe100cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:46.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.811+0000 7efe17fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efe100cfc60 0x7efe100d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:46.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.811+0000 7efe17fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe100d0b20 con 0x7efe100d3730 2023-06-20T13:33:46.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.811+0000 7efe17fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe100b8800 con 0x7efe100cfc60 2023-06-20T13:33:46.814 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.811+0000 7efe17fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe100b4ee0 con 0x7efe100b8430 2023-06-20T13:33:46.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.812+0000 7efe15d9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe100b8430 0x7efe100cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:46.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.812+0000 7efe1659c700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efe100cfc60 0x7efe100d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:46.816 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.812+0000 7efe15d9b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe100b8430 0x7efe100cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.32:40380/0 (socket says 172.21.15.32:40380) 2023-06-20T13:33:46.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.812+0000 7efe15d9b700 1 -- 172.21.15.32:0/461828671 learned_addr learned my addr 172.21.15.32:0/461828671 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:46.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.812+0000 7efe1559a700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7efe100d3730 0x7efe100cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.32:43320/0 (socket says 172.21.15.32:43320) 2023-06-20T13:33:46.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.813+0000 7efe15d9b700 1 -- 172.21.15.32:0/461828671 >> v2:172.21.15.115:3300/0 conn(0x7efe100cfc60 msgr2=0x7efe100d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:46.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.813+0000 7efe15d9b700 1 --2- 172.21.15.32:0/461828671 >> v2:172.21.15.115:3300/0 conn(0x7efe100cfc60 0x7efe100d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:46.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.813+0000 7efe15d9b700 1 -- 172.21.15.32:0/461828671 >> v1:172.21.15.115:6789/0 conn(0x7efe100d3730 legacy=0x7efe100cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:46.817 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.813+0000 7efe15d9b700 1 -- 172.21.15.32:0/461828671 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe100b51c0 con 0x7efe100b8430 2023-06-20T13:33:46.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.813+0000 7efe15d9b700 1 --2- 172.21.15.32:0/461828671 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe100b8430 0x7efe100cd320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0098f0 tx=0x7efe0c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe62966a7b7bd15b server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:46.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.813+0000 7efe14d99700 1 -- 172.21.15.32:0/461828671 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c011830 con 0x7efe100b8430 2023-06-20T13:33:46.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.813+0000 7efe14d99700 1 -- 172.21.15.32:0/461828671 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0c011990 con 0x7efe100b8430 2023-06-20T13:33:46.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.813+0000 7efe14d99700 1 -- 172.21.15.32:0/461828671 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c011d20 con 0x7efe100b8430 2023-06-20T13:33:46.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.814+0000 7efe17fff700 1 -- 172.21.15.32:0/461828671 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe100b8430 msgr2=0x7efe100cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:46.818 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.814+0000 7efe17fff700 1 --2- 172.21.15.32:0/461828671 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe100b8430 0x7efe100cd320 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0098f0 tx=0x7efe0c009c00 comp rx=0 tx=0).stop 2023-06-20T13:33:46.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.814+0000 7efe17fff700 1 -- 172.21.15.32:0/461828671 shutdown_connections 2023-06-20T13:33:46.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.814+0000 7efe17fff700 1 --2- 172.21.15.32:0/461828671 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe100b8430 0x7efe100cd320 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:46.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.814+0000 7efe17fff700 1 --2- 172.21.15.32:0/461828671 >> v2:172.21.15.115:3300/0 conn(0x7efe100cfc60 0x7efe100d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:46.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.814+0000 7efe17fff700 1 -- 172.21.15.32:0/461828671 >> 172.21.15.32:0/461828671 conn(0x7efe1006b3f0 msgr2=0x7efe1006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:46.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.814+0000 7efe17fff700 1 -- 172.21.15.32:0/461828671 shutdown_connections 2023-06-20T13:33:46.819 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.814+0000 7efe17fff700 1 -- 172.21.15.32:0/461828671 wait complete. 2023-06-20T13:33:46.821 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.816+0000 7efe17fff700 1 Processor -- start 2023-06-20T13:33:46.821 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.816+0000 7efe17fff700 1 -- start start 2023-06-20T13:33:46.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.817+0000 7efe17fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe100b8430 0x7efe10155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:46.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.817+0000 7efe17fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe100cfc60 0x7efe100d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:46.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.817+0000 7efe17fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efe100d3730 0x7efe100d14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:46.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.817+0000 7efe17fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe101f2b30 con 0x7efe100d3730 2023-06-20T13:33:46.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.817+0000 7efe17fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe101f1eb0 con 0x7efe100b8430 2023-06-20T13:33:46.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.817+0000 7efe17fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe101f2190 con 0x7efe100cfc60 2023-06-20T13:33:46.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.817+0000 7efe15d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe100b8430 0x7efe10155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:46.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.817+0000 7efe15d9b700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe100b8430 0x7efe10155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:54024/0 (socket says 172.21.15.32:54024) 2023-06-20T13:33:46.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.817+0000 7efe15d9b700 1 -- 172.21.15.32:0/464344099 learned_addr learned my addr 172.21.15.32:0/464344099 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:46.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.817+0000 7efe1559a700 1 --2- 172.21.15.32:0/464344099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe100cfc60 0x7efe100d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:46.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.817+0000 7efe1659c700 1 --2- 172.21.15.32:0/464344099 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efe100d3730 0x7efe100d14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:46.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.818+0000 7efe15d9b700 1 -- 172.21.15.32:0/464344099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe100cfc60 msgr2=0x7efe100d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:46.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.818+0000 7efe15d9b700 1 --2- 172.21.15.32:0/464344099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe100cfc60 0x7efe100d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:46.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.818+0000 7efe15d9b700 1 -- 172.21.15.32:0/464344099 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efe100d3730 msgr2=0x7efe100d14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:46.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.818+0000 7efe15d9b700 1 --2- 172.21.15.32:0/464344099 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efe100d3730 0x7efe100d14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:46.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.818+0000 7efe15d9b700 1 -- 172.21.15.32:0/464344099 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c009550 con 0x7efe100b8430 2023-06-20T13:33:46.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.818+0000 7efe15d9b700 1 --2- 172.21.15.32:0/464344099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe100b8430 0x7efe10155070 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7efe0c000c00 tx=0x7efe0c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:46.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.818+0000 7efe067fc700 1 -- 172.21.15.32:0/464344099 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c004400 con 0x7efe100b8430 2023-06-20T13:33:46.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.818+0000 7efe067fc700 1 -- 172.21.15.32:0/464344099 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0c01f070 con 0x7efe100b8430 2023-06-20T13:33:46.824 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.818+0000 7efe067fc700 1 -- 172.21.15.32:0/464344099 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c0038e0 con 0x7efe100b8430 2023-06-20T13:33:46.825 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.818+0000 7efe17fff700 1 -- 172.21.15.32:0/464344099 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe101f2470 con 0x7efe100b8430 2023-06-20T13:33:46.825 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.818+0000 7efe17fff700 1 -- 172.21.15.32:0/464344099 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe101555b0 con 0x7efe100b8430 2023-06-20T13:33:46.825 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.819+0000 7efe17fff700 1 -- 172.21.15.32:0/464344099 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe101f2c70 con 0x7efe100b8430 2023-06-20T13:33:46.826 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.821+0000 7efe067fc700 1 -- 172.21.15.32:0/464344099 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efe0c021030 con 0x7efe100b8430 2023-06-20T13:33:46.826 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.822+0000 7efe067fc700 1 --2- 172.21.15.32:0/464344099 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7efdf406ace0 0x7efdf406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:46.826 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.822+0000 7efe067fc700 1 -- 172.21.15.32:0/464344099 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7efe0c08b120 con 0x7efe100b8430 2023-06-20T13:33:46.826 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.822+0000 7efe1559a700 1 --2- 172.21.15.32:0/464344099 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7efdf406ace0 0x7efdf406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:46.826 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.822+0000 7efe1559a700 1 --2- 172.21.15.32:0/464344099 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7efdf406ace0 0x7efdf406d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efe1015b1f0 tx=0x7efe00007ed0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:46.827 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:46.825+0000 7efe067fc700 1 -- 172.21.15.32:0/464344099 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efe0c055e90 con 0x7efe100b8430 2023-06-20T13:33:47.037 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.035+0000 7efe17fff700 1 -- 172.21.15.32:0/464344099 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efe10155740 con 0x7efe100b8430 2023-06-20T13:33:47.038 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.036+0000 7efe067fc700 1 -- 172.21.15.32:0/464344099 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7efe0c0594b0 con 0x7efe100b8430 2023-06-20T13:33:47.038 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-06-20T13:33:47.040 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.038+0000 7efe17fff700 1 -- 172.21.15.32:0/464344099 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7efdf406ace0 msgr2=0x7efdf406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:47.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.038+0000 7efe17fff700 1 --2- 172.21.15.32:0/464344099 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7efdf406ace0 0x7efdf406d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efe1015b1f0 tx=0x7efe00007ed0 comp rx=0 tx=0).stop 2023-06-20T13:33:47.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.038+0000 7efe17fff700 1 -- 172.21.15.32:0/464344099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe100b8430 msgr2=0x7efe10155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:47.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.038+0000 7efe17fff700 1 --2- 172.21.15.32:0/464344099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe100b8430 0x7efe10155070 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7efe0c000c00 tx=0x7efe0c004750 comp rx=0 tx=0).stop 2023-06-20T13:33:47.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.038+0000 7efe17fff700 1 -- 172.21.15.32:0/464344099 shutdown_connections 2023-06-20T13:33:47.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.038+0000 7efe17fff700 1 --2- 172.21.15.32:0/464344099 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7efdf406ace0 0x7efdf406d190 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:47.041 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.038+0000 7efe17fff700 1 --2- 172.21.15.32:0/464344099 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efe100d3730 0x7efe100d14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:47.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.038+0000 7efe17fff700 1 --2- 172.21.15.32:0/464344099 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efe100b8430 0x7efe10155070 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:47.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.038+0000 7efe17fff700 1 --2- 172.21.15.32:0/464344099 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efe100cfc60 0x7efe100d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:47.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.038+0000 7efe17fff700 1 -- 172.21.15.32:0/464344099 >> 172.21.15.32:0/464344099 conn(0x7efe1006b3f0 msgr2=0x7efe100d1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:47.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.038+0000 7efe17fff700 1 -- 172.21.15.32:0/464344099 shutdown_connections 2023-06-20T13:33:47.042 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.038+0000 7efe17fff700 1 -- 172.21.15.32:0/464344099 wait complete. 2023-06-20T13:33:47.059 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-20T13:33:47.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.261+0000 7f1793fff700 1 Processor -- start 2023-06-20T13:33:47.264 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.261+0000 7f1793fff700 1 -- start start 2023-06-20T13:33:47.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.263+0000 7f1793fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f178c160920 0x7f178c0cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:47.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.263+0000 7f1793fff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f178c160cf0 con 0x7f178c0c8e00 2023-06-20T13:33:47.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.263+0000 7f1793fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f178c06c900 con 0x7f178c0ceec0 2023-06-20T13:33:47.265 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.263+0000 7f1793fff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f178c0c21a0 con 0x7f178c160920 2023-06-20T13:33:47.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.263+0000 7f1791d9b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f178c160920 0x7f178c0cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:47.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.263+0000 7f179259c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f178c0c8e00 0x7f178c069f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59262/0 (socket says 172.21.15.32:59262) 2023-06-20T13:33:47.266 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.263+0000 7f179259c700 1 -- 172.21.15.32:0/3519067762 learned_addr learned my addr 172.21.15.32:0/3519067762 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:47.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.264+0000 7f1791d9b700 1 -- 172.21.15.32:0/3519067762 >> v1:172.21.15.115:6789/0 conn(0x7f178c0ceec0 legacy=0x7f178c06cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:47.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.264+0000 7f1791d9b700 1 -- 172.21.15.32:0/3519067762 >> v1:172.21.15.32:6789/0 conn(0x7f178c0c8e00 legacy=0x7f178c069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:47.267 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.264+0000 7f1791d9b700 1 -- 172.21.15.32:0/3519067762 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178c06c5d0 con 0x7f178c160920 2023-06-20T13:33:47.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.264+0000 7f1791d9b700 1 --2- 172.21.15.32:0/3519067762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f178c160920 0x7f178c0cdf80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1788009840 tx=0x7f1788009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de45d9e67eb5649d server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:47.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.264+0000 7f1790d99700 1 -- 172.21.15.32:0/3519067762 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1788011830 con 0x7f178c160920 2023-06-20T13:33:47.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.264+0000 7f1790d99700 1 -- 172.21.15.32:0/3519067762 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1788011990 con 0x7f178c160920 2023-06-20T13:33:47.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.264+0000 7f1790d99700 1 -- 172.21.15.32:0/3519067762 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1788011d20 con 0x7f178c160920 2023-06-20T13:33:47.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.265+0000 7f1793fff700 1 -- 172.21.15.32:0/3519067762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f178c160920 msgr2=0x7f178c0cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:47.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.265+0000 7f1793fff700 1 --2- 172.21.15.32:0/3519067762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f178c160920 0x7f178c0cdf80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1788009840 tx=0x7f1788009b50 comp rx=0 tx=0).stop 2023-06-20T13:33:47.268 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.265+0000 7f1793fff700 1 -- 172.21.15.32:0/3519067762 shutdown_connections 2023-06-20T13:33:47.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.265+0000 7f1793fff700 1 --2- 172.21.15.32:0/3519067762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f178c160920 0x7f178c0cdf80 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:47.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.265+0000 7f1793fff700 1 -- 172.21.15.32:0/3519067762 >> 172.21.15.32:0/3519067762 conn(0x7f178c0b0fd0 msgr2=0x7f178c0ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:47.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.265+0000 7f1793fff700 1 -- 172.21.15.32:0/3519067762 shutdown_connections 2023-06-20T13:33:47.269 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.265+0000 7f1793fff700 1 -- 172.21.15.32:0/3519067762 wait complete. 2023-06-20T13:33:47.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.267+0000 7f1793fff700 1 Processor -- start 2023-06-20T13:33:47.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.267+0000 7f1793fff700 1 -- start start 2023-06-20T13:33:47.270 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.268+0000 7f1793fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f178c0c8e00 0x7f178c15e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:47.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.268+0000 7f1793fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f178c0ceec0 0x7f178c0c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:47.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.268+0000 7f1793fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f178c160920 0x7f178c0c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:47.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.268+0000 7f1793fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178c0b2360 con 0x7f178c0ceec0 2023-06-20T13:33:47.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.268+0000 7f1793fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178c15e840 con 0x7f178c160920 2023-06-20T13:33:47.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.268+0000 7f1793fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178c0b16e0 con 0x7f178c0c8e00 2023-06-20T13:33:47.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.268+0000 7f179159a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f178c0ceec0 0x7f178c0c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:47.271 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.268+0000 7f179159a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f178c0ceec0 0x7f178c0c7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46526/0 (socket says 172.21.15.32:46526) 2023-06-20T13:33:47.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.268+0000 7f179159a700 1 -- 172.21.15.32:0/2938238003 learned_addr learned my addr 172.21.15.32:0/2938238003 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:47.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.268+0000 7f1791d9b700 1 --2- 172.21.15.32:0/2938238003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f178c0c8e00 0x7f178c15e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:47.272 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.268+0000 7f179259c700 1 --2- 172.21.15.32:0/2938238003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f178c160920 0x7f178c0c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:47.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.269+0000 7f179159a700 1 -- 172.21.15.32:0/2938238003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f178c0c8e00 msgr2=0x7f178c15e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:47.273 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.269+0000 7f179159a700 1 --2- 172.21.15.32:0/2938238003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f178c0c8e00 0x7f178c15e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:47.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.269+0000 7f179159a700 1 -- 172.21.15.32:0/2938238003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f178c160920 msgr2=0x7f178c0c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:47.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.269+0000 7f179159a700 1 --2- 172.21.15.32:0/2938238003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f178c160920 0x7f178c0c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:47.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.269+0000 7f179159a700 1 -- 172.21.15.32:0/2938238003 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17880094a0 con 0x7f178c0ceec0 2023-06-20T13:33:47.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.269+0000 7f179259c700 1 --2- 172.21.15.32:0/2938238003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f178c160920 0x7f178c0c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:47.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.269+0000 7f179159a700 1 --2- 172.21.15.32:0/2938238003 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f178c0ceec0 0x7f178c0c7a50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f177c00c450 tx=0x7f177c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:47.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.269+0000 7f17827fc700 1 -- 172.21.15.32:0/2938238003 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c0052d0 con 0x7f178c0ceec0 2023-06-20T13:33:47.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.269+0000 7f17827fc700 1 -- 172.21.15.32:0/2938238003 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177c005430 con 0x7f178c0ceec0 2023-06-20T13:33:47.274 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.269+0000 7f17827fc700 1 -- 172.21.15.32:0/2938238003 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c0038c0 con 0x7f178c0ceec0 2023-06-20T13:33:47.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.269+0000 7f1793fff700 1 -- 172.21.15.32:0/2938238003 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f178c0b19c0 con 0x7f178c0ceec0 2023-06-20T13:33:47.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.269+0000 7f1793fff700 1 -- 172.21.15.32:0/2938238003 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f178c0b1f80 con 0x7f178c0ceec0 2023-06-20T13:33:47.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.270+0000 7f1793fff700 1 -- 172.21.15.32:0/2938238003 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f178c0b24a0 con 0x7f178c0ceec0 2023-06-20T13:33:47.275 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.271+0000 7f17827fc700 1 -- 172.21.15.32:0/2938238003 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f177c003a20 con 0x7f178c0ceec0 2023-06-20T13:33:47.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.273+0000 7f17827fc700 1 --2- 172.21.15.32:0/2938238003 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f177006ace0 0x7f177006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:47.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.273+0000 7f17827fc700 1 -- 172.21.15.32:0/2938238003 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f177c088be0 con 0x7f178c0ceec0 2023-06-20T13:33:47.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.273+0000 7f1791d9b700 1 --2- 172.21.15.32:0/2938238003 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f177006ace0 0x7f177006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:47.276 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.274+0000 7f1791d9b700 1 --2- 172.21.15.32:0/2938238003 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f177006ace0 0x7f177006d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f17880090b0 tx=0x7f1788008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:47.280 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.278+0000 7f17827fc700 1 -- 172.21.15.32:0/2938238003 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f178c0b24a0 con 0x7f178c0ceec0 2023-06-20T13:33:47.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.482+0000 7f1793fff700 1 -- 172.21.15.32:0/2938238003 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f178c0b24a0 con 0x7f178c0ceec0 2023-06-20T13:33:47.484 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.482+0000 7f17827fc700 1 -- 172.21.15.32:0/2938238003 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f178c0b24a0 con 0x7f178c0ceec0 2023-06-20T13:33:47.485 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-06-20T13:33:47.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.485+0000 7f1793fff700 1 -- 172.21.15.32:0/2938238003 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f177006ace0 msgr2=0x7f177006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:47.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.485+0000 7f1793fff700 1 --2- 172.21.15.32:0/2938238003 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f177006ace0 0x7f177006d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f17880090b0 tx=0x7f1788008030 comp rx=0 tx=0).stop 2023-06-20T13:33:47.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.485+0000 7f1793fff700 1 -- 172.21.15.32:0/2938238003 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f178c0ceec0 msgr2=0x7f178c0c7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:47.487 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.485+0000 7f1793fff700 1 --2- 172.21.15.32:0/2938238003 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f178c0ceec0 0x7f178c0c7a50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f177c00c450 tx=0x7f177c00c760 comp rx=0 tx=0).stop 2023-06-20T13:33:47.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.485+0000 7f1793fff700 1 -- 172.21.15.32:0/2938238003 shutdown_connections 2023-06-20T13:33:47.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.485+0000 7f1793fff700 1 --2- 172.21.15.32:0/2938238003 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f177006ace0 0x7f177006d190 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:47.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.485+0000 7f1793fff700 1 --2- 172.21.15.32:0/2938238003 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f178c160920 0x7f178c0c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:47.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.485+0000 7f1793fff700 1 --2- 172.21.15.32:0/2938238003 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f178c0c8e00 0x7f178c15e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:47.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.485+0000 7f1793fff700 1 --2- 172.21.15.32:0/2938238003 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f178c0ceec0 0x7f178c0c7a50 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:47.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.485+0000 7f1793fff700 1 -- 172.21.15.32:0/2938238003 >> 172.21.15.32:0/2938238003 conn(0x7f178c0b0fd0 msgr2=0x7f178c069f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:47.488 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.485+0000 7f1793fff700 1 -- 172.21.15.32:0/2938238003 shutdown_connections 2023-06-20T13:33:47.489 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.485+0000 7f1793fff700 1 -- 172.21.15.32:0/2938238003 wait complete. 2023-06-20T13:33:47.505 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-20T13:33:47.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.707+0000 7f64207ff700 1 Processor -- start 2023-06-20T13:33:47.709 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.707+0000 7f64207ff700 1 -- start start 2023-06-20T13:33:47.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.708+0000 7f64207ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64180b8430 0x7f64180cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:47.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.708+0000 7f64207ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64180d0b20 con 0x7f64180d3730 2023-06-20T13:33:47.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.708+0000 7f64207ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64180b4ee0 con 0x7f64180cfc60 2023-06-20T13:33:47.710 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.708+0000 7f64207ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64180b8800 con 0x7f64180b8430 2023-06-20T13:33:47.712 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.708+0000 7f641dd9a700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f64180d3730 0x7f64180cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59274/0 (socket says 172.21.15.32:59274) 2023-06-20T13:33:47.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.708+0000 7f641dd9a700 1 -- 172.21.15.32:0/2832978571 learned_addr learned my addr 172.21.15.32:0/2832978571 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:47.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.708+0000 7f641e59b700 1 --2- 172.21.15.32:0/2832978571 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64180b8430 0x7f64180cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:47.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.709+0000 7f641d599700 1 -- 172.21.15.32:0/2832978571 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611288106 0 0) 0x7f64180d0b20 con 0x7f64180d3730 2023-06-20T13:33:47.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.709+0000 7f641d599700 1 -- 172.21.15.32:0/2832978571 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64040035b0 con 0x7f64180d3730 2023-06-20T13:33:47.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.709+0000 7f641d599700 1 -- 172.21.15.32:0/2832978571 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 779379872 0 0) 0x7f64180b4ee0 con 0x7f64180cfc60 2023-06-20T13:33:47.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.709+0000 7f641d599700 1 -- 172.21.15.32:0/2832978571 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64180d0b20 con 0x7f64180cfc60 2023-06-20T13:33:47.713 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.709+0000 7f641e59b700 1 -- 172.21.15.32:0/2832978571 >> v1:172.21.15.115:6789/0 conn(0x7f64180cfc60 legacy=0x7f64180d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:47.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.709+0000 7f641e59b700 1 -- 172.21.15.32:0/2832978571 >> v1:172.21.15.32:6789/0 conn(0x7f64180d3730 legacy=0x7f64180cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:47.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.709+0000 7f641e59b700 1 -- 172.21.15.32:0/2832978571 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64180b51c0 con 0x7f64180b8430 2023-06-20T13:33:47.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.709+0000 7f641e59b700 1 --2- 172.21.15.32:0/2832978571 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64180b8430 0x7f64180cd320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6414009870 tx=0x7f6414009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62ee41dd0494ce9b server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:47.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.709+0000 7f641d599700 1 -- 172.21.15.32:0/2832978571 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6414011830 con 0x7f64180b8430 2023-06-20T13:33:47.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.709+0000 7f641d599700 1 -- 172.21.15.32:0/2832978571 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6414011990 con 0x7f64180b8430 2023-06-20T13:33:47.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.709+0000 7f641d599700 1 -- 172.21.15.32:0/2832978571 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6414011d20 con 0x7f64180b8430 2023-06-20T13:33:47.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.710+0000 7f64207ff700 1 -- 172.21.15.32:0/2832978571 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64180b8430 msgr2=0x7f64180cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:47.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.710+0000 7f64207ff700 1 --2- 172.21.15.32:0/2832978571 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64180b8430 0x7f64180cd320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6414009870 tx=0x7f6414009b80 comp rx=0 tx=0).stop 2023-06-20T13:33:47.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.710+0000 7f64207ff700 1 -- 172.21.15.32:0/2832978571 shutdown_connections 2023-06-20T13:33:47.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.710+0000 7f64207ff700 1 --2- 172.21.15.32:0/2832978571 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64180b8430 0x7f64180cd320 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:47.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.710+0000 7f64207ff700 1 -- 172.21.15.32:0/2832978571 >> 172.21.15.32:0/2832978571 conn(0x7f641806b3f0 msgr2=0x7f641806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:47.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.710+0000 7f64207ff700 1 -- 172.21.15.32:0/2832978571 shutdown_connections 2023-06-20T13:33:47.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.710+0000 7f64207ff700 1 -- 172.21.15.32:0/2832978571 wait complete. 2023-06-20T13:33:47.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.712+0000 7f64207ff700 1 Processor -- start 2023-06-20T13:33:47.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.712+0000 7f64207ff700 1 -- start start 2023-06-20T13:33:47.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.713+0000 7f64207ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64180b8430 0x7f64180cb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:47.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.713+0000 7f64207ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f64180cfc60 0x7f64180c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:47.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.713+0000 7f64207ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64180d3730 0x7f64181f1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:47.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.713+0000 7f64207ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6418156830 con 0x7f64180cfc60 2023-06-20T13:33:47.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.713+0000 7f64207ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64180c6bb0 con 0x7f64180d3730 2023-06-20T13:33:47.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.713+0000 7f64207ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64181f19b0 con 0x7f64180b8430 2023-06-20T13:33:47.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.713+0000 7f641dd9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f64180cfc60 0x7f64180c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:47.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.713+0000 7f641dd9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f64180cfc60 0x7f64180c6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46538/0 (socket says 172.21.15.32:46538) 2023-06-20T13:33:47.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.713+0000 7f641dd9a700 1 -- 172.21.15.32:0/1814228446 learned_addr learned my addr 172.21.15.32:0/1814228446 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:47.718 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.713+0000 7f641e59b700 1 --2- 172.21.15.32:0/1814228446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64180b8430 0x7f64180cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:47.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.713+0000 7f641ed9c700 1 --2- 172.21.15.32:0/1814228446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64180d3730 0x7f64181f1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:47.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.714+0000 7f641dd9a700 1 -- 172.21.15.32:0/1814228446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64180b8430 msgr2=0x7f64180cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:47.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.714+0000 7f641dd9a700 1 --2- 172.21.15.32:0/1814228446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64180b8430 0x7f64180cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:47.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.714+0000 7f641dd9a700 1 -- 172.21.15.32:0/1814228446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64180d3730 msgr2=0x7f64181f1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:47.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.714+0000 7f641dd9a700 1 --2- 172.21.15.32:0/1814228446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64180d3730 0x7f64181f1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:47.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.714+0000 7f641dd9a700 1 -- 172.21.15.32:0/1814228446 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64140094a0 con 0x7f64180cfc60 2023-06-20T13:33:47.719 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.714+0000 7f641dd9a700 1 --2- 172.21.15.32:0/1814228446 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f64180cfc60 0x7f64180c6670 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6408001eb0 tx=0x7f640800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:47.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.714+0000 7f640effd700 1 -- 172.21.15.32:0/1814228446 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6408005d70 con 0x7f64180cfc60 2023-06-20T13:33:47.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.714+0000 7f640effd700 1 -- 172.21.15.32:0/1814228446 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64080070d0 con 0x7f64180cfc60 2023-06-20T13:33:47.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.714+0000 7f640effd700 1 -- 172.21.15.32:0/1814228446 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6408007460 con 0x7f64180cfc60 2023-06-20T13:33:47.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.714+0000 7f64207ff700 1 -- 172.21.15.32:0/1814228446 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64180c76d0 con 0x7f64180cfc60 2023-06-20T13:33:47.720 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.714+0000 7f64207ff700 1 -- 172.21.15.32:0/1814228446 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64180c7110 con 0x7f64180cfc60 2023-06-20T13:33:47.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.715+0000 7f64207ff700 1 -- 172.21.15.32:0/1814228446 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6418156600 con 0x7f64180cfc60 2023-06-20T13:33:47.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.716+0000 7f640effd700 1 -- 172.21.15.32:0/1814228446 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f64080075c0 con 0x7f64180cfc60 2023-06-20T13:33:47.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.717+0000 7f640effd700 1 --2- 172.21.15.32:0/1814228446 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f63fc06ace0 0x7f63fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:47.721 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.717+0000 7f640effd700 1 -- 172.21.15.32:0/1814228446 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6408088d20 con 0x7f64180cfc60 2023-06-20T13:33:47.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.718+0000 7f641e59b700 1 --2- 172.21.15.32:0/1814228446 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f63fc06ace0 0x7f63fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:47.722 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.718+0000 7f641e59b700 1 --2- 172.21.15.32:0/1814228446 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f63fc06ace0 0x7f63fc06d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f64140097c0 tx=0x7f641401c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:47.723 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.721+0000 7f640effd700 1 -- 172.21.15.32:0/1814228446 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6418156600 con 0x7f64180cfc60 2023-06-20T13:33:47.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.924+0000 7f64207ff700 1 -- 172.21.15.32:0/1814228446 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6418156600 con 0x7f64180cfc60 2023-06-20T13:33:47.927 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.925+0000 7f640effd700 1 -- 172.21.15.32:0/1814228446 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6418156600 con 0x7f64180cfc60 2023-06-20T13:33:47.927 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-06-20T13:33:47.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.927+0000 7f64207ff700 1 -- 172.21.15.32:0/1814228446 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f63fc06ace0 msgr2=0x7f63fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:47.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.927+0000 7f64207ff700 1 --2- 172.21.15.32:0/1814228446 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f63fc06ace0 0x7f63fc06d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f64140097c0 tx=0x7f641401c040 comp rx=0 tx=0).stop 2023-06-20T13:33:47.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.927+0000 7f64207ff700 1 -- 172.21.15.32:0/1814228446 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f64180cfc60 msgr2=0x7f64180c6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:47.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.927+0000 7f64207ff700 1 --2- 172.21.15.32:0/1814228446 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f64180cfc60 0x7f64180c6670 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6408001eb0 tx=0x7f640800c7b0 comp rx=0 tx=0).stop 2023-06-20T13:33:47.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.927+0000 7f64207ff700 1 -- 172.21.15.32:0/1814228446 shutdown_connections 2023-06-20T13:33:47.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.927+0000 7f64207ff700 1 --2- 172.21.15.32:0/1814228446 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f63fc06ace0 0x7f63fc06d190 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:47.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.927+0000 7f64207ff700 1 --2- 172.21.15.32:0/1814228446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f64180d3730 0x7f64181f1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:47.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.927+0000 7f64207ff700 1 --2- 172.21.15.32:0/1814228446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f64180b8430 0x7f64180cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:47.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.927+0000 7f64207ff700 1 --2- 172.21.15.32:0/1814228446 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f64180cfc60 0x7f64180c6670 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:47.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.927+0000 7f64207ff700 1 -- 172.21.15.32:0/1814228446 >> 172.21.15.32:0/1814228446 conn(0x7f641806b3f0 msgr2=0x7f64180cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:47.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.928+0000 7f64207ff700 1 -- 172.21.15.32:0/1814228446 shutdown_connections 2023-06-20T13:33:47.931 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:47.928+0000 7f64207ff700 1 -- 172.21.15.32:0/1814228446 wait complete. 2023-06-20T13:33:47.947 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-20T13:33:48.149 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.147+0000 7f39f8dff700 1 Processor -- start 2023-06-20T13:33:48.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.147+0000 7f39f8dff700 1 -- start start 2023-06-20T13:33:48.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.148+0000 7f39f8dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39f415c460 0x7f39f40b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:48.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.148+0000 7f39f8dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f39f40cf8f0 0x7f39f415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:48.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.149+0000 7f39f8dff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39f40d1790 con 0x7f39f40d2640 2023-06-20T13:33:48.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.149+0000 7f39f8dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f40cedd0 con 0x7f39f40cf8f0 2023-06-20T13:33:48.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.149+0000 7f39f8dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f40cd950 con 0x7f39f415c460 2023-06-20T13:33:48.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.149+0000 7f39f1d9b700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f39f40d2640 0x7f39f40cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59288/0 (socket says 172.21.15.32:59288) 2023-06-20T13:33:48.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.149+0000 7f39f1d9b700 1 -- 172.21.15.32:0/2495615063 learned_addr learned my addr 172.21.15.32:0/2495615063 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:48.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.149+0000 7f39f2d9d700 1 --2- 172.21.15.32:0/2495615063 >> v2:172.21.15.115:3300/0 conn(0x7f39f40cf8f0 0x7f39f415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:48.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.149+0000 7f39f259c700 1 --2- 172.21.15.32:0/2495615063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39f415c460 0x7f39f40b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:48.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.149+0000 7f39f159a700 1 -- 172.21.15.32:0/2495615063 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 864258249 0 0) 0x7f39f40d1790 con 0x7f39f40d2640 2023-06-20T13:33:48.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.149+0000 7f39f159a700 1 -- 172.21.15.32:0/2495615063 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39dc0035b0 con 0x7f39f40d2640 2023-06-20T13:33:48.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.150+0000 7f39f159a700 1 -- 172.21.15.32:0/2495615063 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1107603719 0 0) 0x7f39dc0035b0 con 0x7f39f40d2640 2023-06-20T13:33:48.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.150+0000 7f39f159a700 1 -- 172.21.15.32:0/2495615063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39f415c460 msgr2=0x7f39f40b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:48.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.150+0000 7f39f159a700 1 --2- 172.21.15.32:0/2495615063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39f415c460 0x7f39f40b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:48.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.150+0000 7f39f159a700 1 -- 172.21.15.32:0/2495615063 >> v2:172.21.15.115:3300/0 conn(0x7f39f40cf8f0 msgr2=0x7f39f415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:48.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.150+0000 7f39f159a700 1 --2- 172.21.15.32:0/2495615063 >> v2:172.21.15.115:3300/0 conn(0x7f39f40cf8f0 0x7f39f415fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:48.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.150+0000 7f39f159a700 1 -- 172.21.15.32:0/2495615063 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f40d14b0 con 0x7f39f40d2640 2023-06-20T13:33:48.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.150+0000 7f39f159a700 1 -- 172.21.15.32:0/2495615063 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3380058562 0 0) 0x7f39e8001670 con 0x7f39f40d2640 2023-06-20T13:33:48.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.150+0000 7f39f159a700 1 -- 172.21.15.32:0/2495615063 >> v1:172.21.15.32:6789/0 conn(0x7f39f40d2640 legacy=0x7f39f40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:48.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.150+0000 7f39f159a700 1 --2- 172.21.15.32:0/2495615063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39dc003a00 0x7f39dc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:48.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.150+0000 7f39f159a700 1 --2- 172.21.15.32:0/2495615063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39f415c460 0x7f39dc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:48.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.150+0000 7f39f159a700 1 --2- 172.21.15.32:0/2495615063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39dc004d90 0x7f39dc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:48.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.150+0000 7f39f159a700 1 -- 172.21.15.32:0/2495615063 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f40cedd0 con 0x7f39dc004d90 2023-06-20T13:33:48.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.150+0000 7f39f159a700 1 -- 172.21.15.32:0/2495615063 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f40cd950 con 0x7f39dc003a00 2023-06-20T13:33:48.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.150+0000 7f39f159a700 1 -- 172.21.15.32:0/2495615063 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc00ba90 con 0x7f39f415c460 2023-06-20T13:33:48.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.150+0000 7f39f2d9d700 1 --2- 172.21.15.32:0/2495615063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39dc004d90 0x7f39dc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:48.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.150+0000 7f39f259c700 1 --2- 172.21.15.32:0/2495615063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39dc003a00 0x7f39dc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:48.156 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.150+0000 7f39f1d9b700 1 --2- 172.21.15.32:0/2495615063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39f415c460 0x7f39dc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:48.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.151+0000 7f39f2d9d700 1 -- 172.21.15.32:0/2495615063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39f415c460 msgr2=0x7f39dc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:48.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.151+0000 7f39f2d9d700 1 --2- 172.21.15.32:0/2495615063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39f415c460 0x7f39dc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:48.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.151+0000 7f39f2d9d700 1 -- 172.21.15.32:0/2495615063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39dc003a00 msgr2=0x7f39dc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:48.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.151+0000 7f39f2d9d700 1 --2- 172.21.15.32:0/2495615063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39dc003a00 0x7f39dc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:48.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.151+0000 7f39f2d9d700 1 -- 172.21.15.32:0/2495615063 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39dc0035b0 con 0x7f39dc004d90 2023-06-20T13:33:48.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.151+0000 7f39f2d9d700 1 --2- 172.21.15.32:0/2495615063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39dc004d90 0x7f39dc005200 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f39ec009fc0 tx=0x7f39dc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c7aefd8847b46c server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:48.157 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.151+0000 7f39f159a700 1 -- 172.21.15.32:0/2495615063 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec00ec30 con 0x7f39dc004d90 2023-06-20T13:33:48.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.151+0000 7f39f159a700 1 -- 172.21.15.32:0/2495615063 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ec00f040 con 0x7f39dc004d90 2023-06-20T13:33:48.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.151+0000 7f39f159a700 1 -- 172.21.15.32:0/2495615063 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec014480 con 0x7f39dc004d90 2023-06-20T13:33:48.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.152+0000 7f39f8dff700 1 -- 172.21.15.32:0/2495615063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39dc004d90 msgr2=0x7f39dc005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:48.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.152+0000 7f39f8dff700 1 --2- 172.21.15.32:0/2495615063 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39dc004d90 0x7f39dc005200 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f39ec009fc0 tx=0x7f39dc005880 comp rx=0 tx=0).stop 2023-06-20T13:33:48.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.152+0000 7f39f2d9d700 1 -- 172.21.15.32:0/2495615063 reap_dead start 2023-06-20T13:33:48.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.152+0000 7f39f8dff700 1 -- 172.21.15.32:0/2495615063 shutdown_connections 2023-06-20T13:33:48.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.152+0000 7f39f8dff700 1 -- 172.21.15.32:0/2495615063 >> 172.21.15.32:0/2495615063 conn(0x7f39f4071660 msgr2=0x7f39f4071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:48.158 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.152+0000 7f39f8dff700 1 -- 172.21.15.32:0/2495615063 shutdown_connections 2023-06-20T13:33:48.159 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.152+0000 7f39f8dff700 1 -- 172.21.15.32:0/2495615063 wait complete. 2023-06-20T13:33:48.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.154+0000 7f39f8dff700 1 Processor -- start 2023-06-20T13:33:48.160 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.154+0000 7f39f8dff700 1 -- start start 2023-06-20T13:33:48.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.155+0000 7f39f8dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39dc004d90 0x7f39f40c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:48.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.155+0000 7f39f8dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39f40ccd80 0x7f39f40ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:48.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.155+0000 7f39f8dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39f41f2e80 0x7f39f415e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:48.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.155+0000 7f39f8dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f415d880 con 0x7f39dc004d90 2023-06-20T13:33:48.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.155+0000 7f39f8dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f40c5fb0 con 0x7f39f40ccd80 2023-06-20T13:33:48.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.155+0000 7f39f8dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f415dad0 con 0x7f39f41f2e80 2023-06-20T13:33:48.161 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.155+0000 7f39f259c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39dc004d90 0x7f39f40c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:48.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.155+0000 7f39f259c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39dc004d90 0x7f39f40c5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46562/0 (socket says 172.21.15.32:46562) 2023-06-20T13:33:48.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.155+0000 7f39f259c700 1 -- 172.21.15.32:0/3191326443 learned_addr learned my addr 172.21.15.32:0/3191326443 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:48.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.155+0000 7f39f1d9b700 1 --2- 172.21.15.32:0/3191326443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39f40ccd80 0x7f39f40ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:48.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.155+0000 7f39f2d9d700 1 --2- 172.21.15.32:0/3191326443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39f41f2e80 0x7f39f415e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:48.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.155+0000 7f39f259c700 1 -- 172.21.15.32:0/3191326443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39f41f2e80 msgr2=0x7f39f415e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:48.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.155+0000 7f39f259c700 1 --2- 172.21.15.32:0/3191326443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39f41f2e80 0x7f39f415e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:48.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.155+0000 7f39f259c700 1 -- 172.21.15.32:0/3191326443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39f40ccd80 msgr2=0x7f39f40ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:48.162 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.155+0000 7f39f259c700 1 --2- 172.21.15.32:0/3191326443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39f40ccd80 0x7f39f40ca310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:48.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.155+0000 7f39f259c700 1 -- 172.21.15.32:0/3191326443 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f415ddb0 con 0x7f39dc004d90 2023-06-20T13:33:48.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.155+0000 7f39f1d9b700 1 --2- 172.21.15.32:0/3191326443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39f40ccd80 0x7f39f40ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:48.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.155+0000 7f39f2d9d700 1 --2- 172.21.15.32:0/3191326443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39f41f2e80 0x7f39f415e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:48.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.156+0000 7f39f259c700 1 --2- 172.21.15.32:0/3191326443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39dc004d90 0x7f39f40c5a70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f39e40119d0 tx=0x7f39e4011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:48.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.156+0000 7f39e2ffd700 1 -- 172.21.15.32:0/3191326443 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e400f940 con 0x7f39dc004d90 2023-06-20T13:33:48.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.156+0000 7f39e2ffd700 1 -- 172.21.15.32:0/3191326443 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e400faa0 con 0x7f39dc004d90 2023-06-20T13:33:48.163 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.156+0000 7f39e2ffd700 1 -- 172.21.15.32:0/3191326443 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e400fe30 con 0x7f39dc004d90 2023-06-20T13:33:48.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.156+0000 7f39f8dff700 1 -- 172.21.15.32:0/3191326443 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f415e090 con 0x7f39dc004d90 2023-06-20T13:33:48.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.156+0000 7f39f8dff700 1 -- 172.21.15.32:0/3191326443 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f40ca850 con 0x7f39dc004d90 2023-06-20T13:33:48.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.157+0000 7f39f8dff700 1 -- 172.21.15.32:0/3191326443 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f404ea60 con 0x7f39dc004d90 2023-06-20T13:33:48.164 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.158+0000 7f39e2ffd700 1 -- 172.21.15.32:0/3191326443 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f39e4014440 con 0x7f39dc004d90 2023-06-20T13:33:48.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.159+0000 7f39e2ffd700 1 --2- 172.21.15.32:0/3191326443 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f39d406ace0 0x7f39d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:48.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.160+0000 7f39e2ffd700 1 -- 172.21.15.32:0/3191326443 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f39e4089f50 con 0x7f39dc004d90 2023-06-20T13:33:48.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.160+0000 7f39f1d9b700 1 --2- 172.21.15.32:0/3191326443 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f39d406ace0 0x7f39d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:48.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.160+0000 7f39f1d9b700 1 --2- 172.21.15.32:0/3191326443 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f39d406ace0 0x7f39d406d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f39e8001120 tx=0x7f39e8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:48.166 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.164+0000 7f39e2ffd700 1 -- 172.21.15.32:0/3191326443 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f39e4054d70 con 0x7f39dc004d90 2023-06-20T13:33:48.416 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.414+0000 7f39f8dff700 1 -- 172.21.15.32:0/3191326443 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39f40b4fa0 con 0x7f39dc004d90 2023-06-20T13:33:48.417 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.414+0000 7f39e2ffd700 1 -- 172.21.15.32:0/3191326443 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f39e4022090 con 0x7f39dc004d90 2023-06-20T13:33:48.417 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:33:48.417 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2171664589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2171664589},{"type":"v1","addr":"172.21.15.115:6834","nonce":2171664589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/959333888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":959333888},{"type":"v1","addr":"172.21.15.32:6837","nonce":959333888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3388117179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":3388117179},{"type":"v1","addr":"172.21.15.32:6835","nonce":3388117179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-20T13:32:20.527725+0000","modified":"2023-06-20T13:32:49.006923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3566362693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3566362693},{"type":"v1","addr":"172.21.15.115:6835","nonce":3566362693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-20T13:33:48.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.417+0000 7f39f8dff700 1 -- 172.21.15.32:0/3191326443 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f39d406ace0 msgr2=0x7f39d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:48.419 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.417+0000 7f39f8dff700 1 --2- 172.21.15.32:0/3191326443 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f39d406ace0 0x7f39d406d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f39e8001120 tx=0x7f39e8009040 comp rx=0 tx=0).stop 2023-06-20T13:33:48.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.417+0000 7f39f8dff700 1 -- 172.21.15.32:0/3191326443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39dc004d90 msgr2=0x7f39f40c5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:48.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.417+0000 7f39f8dff700 1 --2- 172.21.15.32:0/3191326443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39dc004d90 0x7f39f40c5a70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f39e40119d0 tx=0x7f39e4011d90 comp rx=0 tx=0).stop 2023-06-20T13:33:48.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.417+0000 7f39f8dff700 1 -- 172.21.15.32:0/3191326443 shutdown_connections 2023-06-20T13:33:48.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.417+0000 7f39f8dff700 1 --2- 172.21.15.32:0/3191326443 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f39d406ace0 0x7f39d406d190 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:48.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.417+0000 7f39f8dff700 1 --2- 172.21.15.32:0/3191326443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39f41f2e80 0x7f39f415e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:48.420 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.417+0000 7f39f8dff700 1 --2- 172.21.15.32:0/3191326443 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39dc004d90 0x7f39f40c5a70 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:48.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.417+0000 7f39f8dff700 1 --2- 172.21.15.32:0/3191326443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39f40ccd80 0x7f39f40ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:48.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.417+0000 7f39f8dff700 1 -- 172.21.15.32:0/3191326443 >> 172.21.15.32:0/3191326443 conn(0x7f39f4071660 msgr2=0x7f39f415fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:48.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.417+0000 7f39f8dff700 1 -- 172.21.15.32:0/3191326443 shutdown_connections 2023-06-20T13:33:48.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.417+0000 7f39f8dff700 1 -- 172.21.15.32:0/3191326443 wait complete. 2023-06-20T13:33:48.421 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2023-06-20T13:33:48.437 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:33:48.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.636+0000 7f9af9fff700 1 Processor -- start 2023-06-20T13:33:48.639 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.637+0000 7f9af9fff700 1 -- start start 2023-06-20T13:33:48.640 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.638+0000 7f9af9fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9af40d2640 0x7f9af40b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:48.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.638+0000 7f9af9fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9af40cf8f0 0x7f9af415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:48.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.638+0000 7f9af9fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af40d1790 con 0x7f9af415c460 2023-06-20T13:33:48.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.638+0000 7f9af9fff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af40cedd0 con 0x7f9af40d2640 2023-06-20T13:33:48.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.638+0000 7f9af9fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af40cd950 con 0x7f9af40cf8f0 2023-06-20T13:33:48.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.638+0000 7f9aebfff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9af40d2640 0x7f9af40b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:48.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.638+0000 7f9aebfff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f9af40d2640 0x7f9af40b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46574/0 (socket says 172.21.15.32:46574) 2023-06-20T13:33:48.641 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.638+0000 7f9aebfff700 1 -- 172.21.15.32:0/4047803100 learned_addr learned my addr 172.21.15.32:0/4047803100 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:48.642 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.638+0000 7f9af3fff700 1 --2- 172.21.15.32:0/4047803100 >> v2:172.21.15.115:3300/0 conn(0x7f9af40cf8f0 0x7f9af415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:48.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.639+0000 7f9aebfff700 1 -- 172.21.15.32:0/4047803100 >> v2:172.21.15.115:3300/0 conn(0x7f9af40cf8f0 msgr2=0x7f9af415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:48.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.639+0000 7f9aebfff700 1 --2- 172.21.15.32:0/4047803100 >> v2:172.21.15.115:3300/0 conn(0x7f9af40cf8f0 0x7f9af415fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:48.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.639+0000 7f9aebfff700 1 -- 172.21.15.32:0/4047803100 >> v1:172.21.15.115:6789/0 conn(0x7f9af415c460 legacy=0x7f9af40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:48.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.639+0000 7f9aebfff700 1 -- 172.21.15.32:0/4047803100 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af40d14b0 con 0x7f9af40d2640 2023-06-20T13:33:48.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.639+0000 7f9aebfff700 1 --2- 172.21.15.32:0/4047803100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9af40d2640 0x7f9af40b59d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9af4072140 tx=0x7f9adc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad59b2170211fea7 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:48.643 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.639+0000 7f9af2ffd700 1 -- 172.21.15.32:0/4047803100 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc011830 con 0x7f9af40d2640 2023-06-20T13:33:48.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.639+0000 7f9af2ffd700 1 -- 172.21.15.32:0/4047803100 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9adc011990 con 0x7f9af40d2640 2023-06-20T13:33:48.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.639+0000 7f9af2ffd700 1 -- 172.21.15.32:0/4047803100 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc011d20 con 0x7f9af40d2640 2023-06-20T13:33:48.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.640+0000 7f9af9fff700 1 -- 172.21.15.32:0/4047803100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9af40d2640 msgr2=0x7f9af40b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:48.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.640+0000 7f9af9fff700 1 --2- 172.21.15.32:0/4047803100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9af40d2640 0x7f9af40b59d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9af4072140 tx=0x7f9adc009bd0 comp rx=0 tx=0).stop 2023-06-20T13:33:48.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.640+0000 7f9af9fff700 1 -- 172.21.15.32:0/4047803100 shutdown_connections 2023-06-20T13:33:48.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.640+0000 7f9af9fff700 1 --2- 172.21.15.32:0/4047803100 >> v2:172.21.15.115:3300/0 conn(0x7f9af40cf8f0 0x7f9af415fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:48.644 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.640+0000 7f9af9fff700 1 --2- 172.21.15.32:0/4047803100 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9af40d2640 0x7f9af40b59d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:48.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.640+0000 7f9af9fff700 1 -- 172.21.15.32:0/4047803100 >> 172.21.15.32:0/4047803100 conn(0x7f9af4071660 msgr2=0x7f9af4071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:48.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.640+0000 7f9af9fff700 1 -- 172.21.15.32:0/4047803100 shutdown_connections 2023-06-20T13:33:48.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.640+0000 7f9af9fff700 1 -- 172.21.15.32:0/4047803100 wait complete. 2023-06-20T13:33:48.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.642+0000 7f9af9fff700 1 Processor -- start 2023-06-20T13:33:48.645 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.643+0000 7f9af9fff700 1 -- start start 2023-06-20T13:33:48.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.644+0000 7f9af9fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9af40cf8f0 0x7f9af414eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:48.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.644+0000 7f9af9fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9af40d2640 0x7f9af40cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:48.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.644+0000 7f9af9fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9af415c460 0x7f9af41e72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:48.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.644+0000 7f9af9fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af40c6d40 con 0x7f9af40d2640 2023-06-20T13:33:48.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.644+0000 7f9af9fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af40c7020 con 0x7f9af40cf8f0 2023-06-20T13:33:48.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.644+0000 7f9af9fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af40c7300 con 0x7f9af415c460 2023-06-20T13:33:48.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.644+0000 7f9aebfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9af40d2640 0x7f9af40cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:48.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.644+0000 7f9aebfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9af40d2640 0x7f9af40cb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46582/0 (socket says 172.21.15.32:46582) 2023-06-20T13:33:48.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.644+0000 7f9aebfff700 1 -- 172.21.15.32:0/4108730325 learned_addr learned my addr 172.21.15.32:0/4108730325 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:48.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.644+0000 7f9aebfff700 1 -- 172.21.15.32:0/4108730325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9af415c460 msgr2=0x7f9af41e72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:48.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.644+0000 7f9aebfff700 1 --2- 172.21.15.32:0/4108730325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9af415c460 0x7f9af41e72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:48.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.644+0000 7f9af37fe700 1 --2- 172.21.15.32:0/4108730325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9af40cf8f0 0x7f9af414eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:48.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.644+0000 7f9aebfff700 1 -- 172.21.15.32:0/4108730325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9af40cf8f0 msgr2=0x7f9af414eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:48.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.645+0000 7f9aebfff700 1 --2- 172.21.15.32:0/4108730325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9af40cf8f0 0x7f9af414eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:48.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.645+0000 7f9aebfff700 1 -- 172.21.15.32:0/4108730325 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9adc009550 con 0x7f9af40d2640 2023-06-20T13:33:48.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.645+0000 7f9af37fe700 1 --2- 172.21.15.32:0/4108730325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9af40cf8f0 0x7f9af414eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:48.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.645+0000 7f9aebfff700 1 --2- 172.21.15.32:0/4108730325 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9af40d2640 0x7f9af40cb2a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9adc009c10 tx=0x7f9adc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:48.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.645+0000 7f9af0ff9700 1 -- 172.21.15.32:0/4108730325 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc004550 con 0x7f9af40d2640 2023-06-20T13:33:48.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.645+0000 7f9af0ff9700 1 -- 172.21.15.32:0/4108730325 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9adc01e070 con 0x7f9af40d2640 2023-06-20T13:33:48.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.645+0000 7f9af9fff700 1 -- 172.21.15.32:0/4108730325 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af40c75e0 con 0x7f9af40d2640 2023-06-20T13:33:48.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.645+0000 7f9af0ff9700 1 -- 172.21.15.32:0/4108730325 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9adc0038c0 con 0x7f9af40d2640 2023-06-20T13:33:48.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.645+0000 7f9af9fff700 1 -- 172.21.15.32:0/4108730325 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af414f040 con 0x7f9af40d2640 2023-06-20T13:33:48.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.646+0000 7f9af9fff700 1 -- 172.21.15.32:0/4108730325 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af40c7b00 con 0x7f9af40d2640 2023-06-20T13:33:48.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.647+0000 7f9af0ff9700 1 -- 172.21.15.32:0/4108730325 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9adc003a20 con 0x7f9af40d2640 2023-06-20T13:33:48.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.648+0000 7f9af0ff9700 1 --2- 172.21.15.32:0/4108730325 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f9ad406ace0 0x7f9ad406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:48.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.648+0000 7f9af0ff9700 1 -- 172.21.15.32:0/4108730325 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9adc020070 con 0x7f9af40d2640 2023-06-20T13:33:48.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.648+0000 7f9af37fe700 1 --2- 172.21.15.32:0/4108730325 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f9ad406ace0 0x7f9ad406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:48.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.649+0000 7f9af37fe700 1 --2- 172.21.15.32:0/4108730325 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f9ad406ace0 0x7f9ad406d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4000f60 tx=0x7f9ae4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:48.654 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.652+0000 7f9af0ff9700 1 -- 172.21.15.32:0/4108730325 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9af40c7b00 con 0x7f9af40d2640 2023-06-20T13:33:48.860 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.858+0000 7f9af9fff700 1 -- 172.21.15.32:0/4108730325 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9af40c7b00 con 0x7f9af40d2640 2023-06-20T13:33:48.862 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.860+0000 7f9af0ff9700 1 -- 172.21.15.32:0/4108730325 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20191 (secure 0 0 0) 0x7f9af40c7b00 con 0x7f9af40d2640 2023-06-20T13:33:48.862 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:33:48.863 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":29,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:33:00.976862+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-20T13:32:18.120021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-20T13:32:19.503624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-20T13:32:23.074912+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:33:48.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.862+0000 7f9af9fff700 1 -- 172.21.15.32:0/4108730325 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f9ad406ace0 msgr2=0x7f9ad406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:48.864 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.862+0000 7f9af9fff700 1 --2- 172.21.15.32:0/4108730325 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f9ad406ace0 0x7f9ad406d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4000f60 tx=0x7f9ae4009040 comp rx=0 tx=0).stop 2023-06-20T13:33:48.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.862+0000 7f9af9fff700 1 -- 172.21.15.32:0/4108730325 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9af40d2640 msgr2=0x7f9af40cb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:48.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.862+0000 7f9af9fff700 1 --2- 172.21.15.32:0/4108730325 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9af40d2640 0x7f9af40cb2a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9adc009c10 tx=0x7f9adc004750 comp rx=0 tx=0).stop 2023-06-20T13:33:48.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.862+0000 7f9af9fff700 1 -- 172.21.15.32:0/4108730325 shutdown_connections 2023-06-20T13:33:48.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.862+0000 7f9af9fff700 1 --2- 172.21.15.32:0/4108730325 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f9ad406ace0 0x7f9ad406d190 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:48.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.862+0000 7f9af9fff700 1 --2- 172.21.15.32:0/4108730325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9af415c460 0x7f9af41e72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:48.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.862+0000 7f9af9fff700 1 --2- 172.21.15.32:0/4108730325 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9af40cf8f0 0x7f9af414eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:48.865 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.862+0000 7f9af9fff700 1 --2- 172.21.15.32:0/4108730325 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f9af40d2640 0x7f9af40cb2a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:48.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.862+0000 7f9af9fff700 1 -- 172.21.15.32:0/4108730325 >> 172.21.15.32:0/4108730325 conn(0x7f9af4071660 msgr2=0x7f9af40d1920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:48.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.862+0000 7f9af9fff700 1 -- 172.21.15.32:0/4108730325 shutdown_connections 2023-06-20T13:33:48.866 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:48.862+0000 7f9af9fff700 1 -- 172.21.15.32:0/4108730325 wait complete. 2023-06-20T13:33:48.882 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-06-20T13:33:48.883 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-20T13:33:49.086 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.084+0000 7ff4e85ff700 1 Processor -- start 2023-06-20T13:33:49.087 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.084+0000 7ff4e85ff700 1 -- start start 2023-06-20T13:33:49.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.086+0000 7ff4e85ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff4e00d2640 0x7ff4e00b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:49.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.086+0000 7ff4e85ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff4e00cf8f0 0x7ff4e015fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:49.088 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.086+0000 7ff4e85ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4e00d1790 con 0x7ff4e015c460 2023-06-20T13:33:49.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.086+0000 7ff4e85ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4e00cedd0 con 0x7ff4e00d2640 2023-06-20T13:33:49.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.086+0000 7ff4e85ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4e00cd950 con 0x7ff4e00cf8f0 2023-06-20T13:33:49.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.086+0000 7ff4e5b9a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff4e00d2640 0x7ff4e00b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:49.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.086+0000 7ff4e5b9a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff4e00d2640 0x7ff4e00b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46594/0 (socket says 172.21.15.32:46594) 2023-06-20T13:33:49.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.086+0000 7ff4e5b9a700 1 -- 172.21.15.32:0/3596595632 learned_addr learned my addr 172.21.15.32:0/3596595632 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:49.089 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.086+0000 7ff4e6b9c700 1 --2- 172.21.15.32:0/3596595632 >> v2:172.21.15.115:3300/0 conn(0x7ff4e00cf8f0 0x7ff4e015fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:49.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.086+0000 7ff4e5b9a700 1 -- 172.21.15.32:0/3596595632 >> v2:172.21.15.115:3300/0 conn(0x7ff4e00cf8f0 msgr2=0x7ff4e015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:49.090 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.086+0000 7ff4e5b9a700 1 --2- 172.21.15.32:0/3596595632 >> v2:172.21.15.115:3300/0 conn(0x7ff4e00cf8f0 0x7ff4e015fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:49.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.086+0000 7ff4e5b9a700 1 -- 172.21.15.32:0/3596595632 >> v1:172.21.15.115:6789/0 conn(0x7ff4e015c460 legacy=0x7ff4e00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:49.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.086+0000 7ff4e5b9a700 1 -- 172.21.15.32:0/3596595632 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e00d14b0 con 0x7ff4e00d2640 2023-06-20T13:33:49.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.086+0000 7ff4e6b9c700 1 --2- 172.21.15.32:0/3596595632 >> v2:172.21.15.115:3300/0 conn(0x7ff4e00cf8f0 0x7ff4e015fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:49.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.087+0000 7ff4e5b9a700 1 --2- 172.21.15.32:0/3596595632 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4e00d2640 0x7ff4e00b59d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0072140 tx=0x7ff4d0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482a9e5dab5cf026 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:49.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.087+0000 7ff4e5399700 1 -- 172.21.15.32:0/3596595632 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d000b870 con 0x7ff4e00d2640 2023-06-20T13:33:49.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.087+0000 7ff4e5399700 1 -- 172.21.15.32:0/3596595632 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d000b9d0 con 0x7ff4e00d2640 2023-06-20T13:33:49.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.087+0000 7ff4e5399700 1 -- 172.21.15.32:0/3596595632 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d000bd60 con 0x7ff4e00d2640 2023-06-20T13:33:49.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.087+0000 7ff4e85ff700 1 -- 172.21.15.32:0/3596595632 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4e00d2640 msgr2=0x7ff4e00b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:49.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.087+0000 7ff4e85ff700 1 --2- 172.21.15.32:0/3596595632 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4e00d2640 0x7ff4e00b59d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0072140 tx=0x7ff4d0009bd0 comp rx=0 tx=0).stop 2023-06-20T13:33:49.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.087+0000 7ff4e85ff700 1 -- 172.21.15.32:0/3596595632 shutdown_connections 2023-06-20T13:33:49.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.087+0000 7ff4e85ff700 1 --2- 172.21.15.32:0/3596595632 >> v2:172.21.15.115:3300/0 conn(0x7ff4e00cf8f0 0x7ff4e015fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:49.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.087+0000 7ff4e85ff700 1 --2- 172.21.15.32:0/3596595632 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4e00d2640 0x7ff4e00b59d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:49.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.087+0000 7ff4e85ff700 1 -- 172.21.15.32:0/3596595632 >> 172.21.15.32:0/3596595632 conn(0x7ff4e0071660 msgr2=0x7ff4e0071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:49.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.088+0000 7ff4e85ff700 1 -- 172.21.15.32:0/3596595632 shutdown_connections 2023-06-20T13:33:49.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.088+0000 7ff4e85ff700 1 -- 172.21.15.32:0/3596595632 wait complete. 2023-06-20T13:33:49.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.089+0000 7ff4e85ff700 1 Processor -- start 2023-06-20T13:33:49.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.089+0000 7ff4e85ff700 1 -- start start 2023-06-20T13:33:49.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.090+0000 7ff4e85ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4e00cf8f0 0x7ff4e01593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:49.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.090+0000 7ff4e85ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4e00d2640 0x7ff4e015b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:49.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.090+0000 7ff4e85ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4e015c460 0x7ff4e0149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:49.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.090+0000 7ff4e85ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e00cb5c0 con 0x7ff4e015c460 2023-06-20T13:33:49.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.090+0000 7ff4e85ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e015bc90 con 0x7ff4e00cf8f0 2023-06-20T13:33:49.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.090+0000 7ff4e85ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e01599c0 con 0x7ff4e00d2640 2023-06-20T13:33:49.095 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.091+0000 7ff4e6b9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4e015c460 0x7ff4e0149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:49.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.091+0000 7ff4e6b9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4e015c460 0x7ff4e0149e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46600/0 (socket says 172.21.15.32:46600) 2023-06-20T13:33:49.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.091+0000 7ff4e6b9c700 1 -- 172.21.15.32:0/2170999915 learned_addr learned my addr 172.21.15.32:0/2170999915 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:49.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.091+0000 7ff4e5b9a700 1 --2- 172.21.15.32:0/2170999915 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4e00d2640 0x7ff4e015b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:49.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.091+0000 7ff4e639b700 1 --2- 172.21.15.32:0/2170999915 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4e00cf8f0 0x7ff4e01593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:49.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.091+0000 7ff4e6b9c700 1 -- 172.21.15.32:0/2170999915 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4e00d2640 msgr2=0x7ff4e015b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:49.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.091+0000 7ff4e6b9c700 1 --2- 172.21.15.32:0/2170999915 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4e00d2640 0x7ff4e015b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:49.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.091+0000 7ff4e6b9c700 1 -- 172.21.15.32:0/2170999915 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4e00cf8f0 msgr2=0x7ff4e01593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:49.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.091+0000 7ff4e6b9c700 1 --2- 172.21.15.32:0/2170999915 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4e00cf8f0 0x7ff4e01593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:49.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.091+0000 7ff4e6b9c700 1 -- 172.21.15.32:0/2170999915 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d0009550 con 0x7ff4e015c460 2023-06-20T13:33:49.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.091+0000 7ff4e5b9a700 1 --2- 172.21.15.32:0/2170999915 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4e00d2640 0x7ff4e015b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:49.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.091+0000 7ff4e639b700 1 --2- 172.21.15.32:0/2170999915 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4e00cf8f0 0x7ff4e01593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:49.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.091+0000 7ff4e6b9c700 1 --2- 172.21.15.32:0/2170999915 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4e015c460 0x7ff4e0149e40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8007df0 tx=0x7ff4d800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:49.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.092+0000 7ff4d6ffd700 1 -- 172.21.15.32:0/2170999915 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d800ddd0 con 0x7ff4e015c460 2023-06-20T13:33:49.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.092+0000 7ff4d6ffd700 1 -- 172.21.15.32:0/2170999915 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d800f040 con 0x7ff4e015c460 2023-06-20T13:33:49.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.092+0000 7ff4d6ffd700 1 -- 172.21.15.32:0/2170999915 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d8003c60 con 0x7ff4e015c460 2023-06-20T13:33:49.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.092+0000 7ff4e85ff700 1 -- 172.21.15.32:0/2170999915 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e0159ca0 con 0x7ff4e015c460 2023-06-20T13:33:49.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.092+0000 7ff4e85ff700 1 -- 172.21.15.32:0/2170999915 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e00cb1e0 con 0x7ff4e015c460 2023-06-20T13:33:49.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.093+0000 7ff4e85ff700 1 -- 172.21.15.32:0/2170999915 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4e004ea60 con 0x7ff4e015c460 2023-06-20T13:33:49.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.094+0000 7ff4d6ffd700 1 -- 172.21.15.32:0/2170999915 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff4d8004030 con 0x7ff4e015c460 2023-06-20T13:33:49.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.095+0000 7ff4d6ffd700 1 --2- 172.21.15.32:0/2170999915 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff4c406ace0 0x7ff4c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:49.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.095+0000 7ff4d6ffd700 1 -- 172.21.15.32:0/2170999915 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff4d80899d0 con 0x7ff4e015c460 2023-06-20T13:33:49.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.095+0000 7ff4e639b700 1 --2- 172.21.15.32:0/2170999915 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff4c406ace0 0x7ff4c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:49.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.096+0000 7ff4e639b700 1 --2- 172.21.15.32:0/2170999915 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff4c406ace0 0x7ff4c406d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc000f60 tx=0x7ff4dc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:49.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.099+0000 7ff4d6ffd700 1 -- 172.21.15.32:0/2170999915 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff4d8054740 con 0x7ff4e015c460 2023-06-20T13:33:49.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.351+0000 7ff4e85ff700 1 -- 172.21.15.32:0/2170999915 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4e00b4fa0 con 0x7ff4e015c460 2023-06-20T13:33:49.354 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.352+0000 7ff4d6ffd700 1 -- 172.21.15.32:0/2170999915 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4670 (secure 0 0 0) 0x7ff4d8057d60 con 0x7ff4e015c460 2023-06-20T13:33:49.355 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:33:49.355 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2171664589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2171664589},{"type":"v1","addr":"172.21.15.115:6834","nonce":2171664589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/959333888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":959333888},{"type":"v1","addr":"172.21.15.32:6837","nonce":959333888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3388117179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":3388117179},{"type":"v1","addr":"172.21.15.32:6835","nonce":3388117179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-20T13:32:20.527725+0000","modified":"2023-06-20T13:32:49.006923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3566362693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3566362693},{"type":"v1","addr":"172.21.15.115:6835","nonce":3566362693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-20T13:33:49.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.354+0000 7ff4e85ff700 1 -- 172.21.15.32:0/2170999915 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff4c406ace0 msgr2=0x7ff4c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:49.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.354+0000 7ff4e85ff700 1 --2- 172.21.15.32:0/2170999915 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff4c406ace0 0x7ff4c406d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc000f60 tx=0x7ff4dc009040 comp rx=0 tx=0).stop 2023-06-20T13:33:49.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.354+0000 7ff4e85ff700 1 -- 172.21.15.32:0/2170999915 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4e015c460 msgr2=0x7ff4e0149e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:49.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.354+0000 7ff4e85ff700 1 --2- 172.21.15.32:0/2170999915 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4e015c460 0x7ff4e0149e40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8007df0 tx=0x7ff4d800d3b0 comp rx=0 tx=0).stop 2023-06-20T13:33:49.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.354+0000 7ff4e85ff700 1 -- 172.21.15.32:0/2170999915 shutdown_connections 2023-06-20T13:33:49.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.354+0000 7ff4e85ff700 1 --2- 172.21.15.32:0/2170999915 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff4c406ace0 0x7ff4c406d190 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:49.357 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.354+0000 7ff4e85ff700 1 --2- 172.21.15.32:0/2170999915 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff4e015c460 0x7ff4e0149e40 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:49.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.354+0000 7ff4e85ff700 1 --2- 172.21.15.32:0/2170999915 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff4e00cf8f0 0x7ff4e01593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:49.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.354+0000 7ff4e85ff700 1 --2- 172.21.15.32:0/2170999915 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff4e00d2640 0x7ff4e015b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:49.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.354+0000 7ff4e85ff700 1 -- 172.21.15.32:0/2170999915 >> 172.21.15.32:0/2170999915 conn(0x7ff4e0071660 msgr2=0x7ff4e00cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:49.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.355+0000 7ff4e85ff700 1 -- 172.21.15.32:0/2170999915 shutdown_connections 2023-06-20T13:33:49.358 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.355+0000 7ff4e85ff700 1 -- 172.21.15.32:0/2170999915 wait complete. 2023-06-20T13:33:49.358 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2023-06-20T13:33:49.374 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-20T13:33:49.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.574+0000 7fd6c59ff700 1 Processor -- start 2023-06-20T13:33:49.576 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.574+0000 7fd6c59ff700 1 -- start start 2023-06-20T13:33:49.577 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.575+0000 7fd6c59ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6c015c460 0x7fd6c00b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:49.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.575+0000 7fd6c59ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd6c00cf8f0 0x7fd6c015fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:49.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.575+0000 7fd6c59ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c00d1790 con 0x7fd6c00d2640 2023-06-20T13:33:49.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.575+0000 7fd6c59ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c00cedd0 con 0x7fd6c00cf8f0 2023-06-20T13:33:49.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.575+0000 7fd6c59ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c00cd950 con 0x7fd6c015c460 2023-06-20T13:33:49.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.575+0000 7fd6bf7fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd6c00cf8f0 0x7fd6c015fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:49.578 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.575+0000 7fd6be7fc700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd6c00d2640 0x7fd6c00cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:59290/0 (socket says 172.21.15.32:59290) 2023-06-20T13:33:49.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.575+0000 7fd6be7fc700 1 -- 172.21.15.32:0/3224639480 learned_addr learned my addr 172.21.15.32:0/3224639480 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:49.579 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.575+0000 7fd6beffd700 1 --2- 172.21.15.32:0/3224639480 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6c015c460 0x7fd6c00b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:49.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.576+0000 7fd6bf7fe700 1 -- 172.21.15.32:0/3224639480 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6c015c460 msgr2=0x7fd6c00b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:49.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.576+0000 7fd6bf7fe700 1 --2- 172.21.15.32:0/3224639480 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6c015c460 0x7fd6c00b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:49.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.576+0000 7fd6bf7fe700 1 -- 172.21.15.32:0/3224639480 >> v1:172.21.15.32:6789/0 conn(0x7fd6c00d2640 legacy=0x7fd6c00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:49.580 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.576+0000 7fd6bf7fe700 1 -- 172.21.15.32:0/3224639480 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c00d14b0 con 0x7fd6c00cf8f0 2023-06-20T13:33:49.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.576+0000 7fd6bdffb700 1 -- 172.21.15.32:0/3224639480 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3000060289 0 0) 0x7fd6c00d1790 con 0x7fd6c00d2640 2023-06-20T13:33:49.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.576+0000 7fd6bf7fe700 1 --2- 172.21.15.32:0/3224639480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6c00cf8f0 0x7fd6c015fe20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8009d90 tx=0x7fd6b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b17e1cb0d74904f server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:49.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.576+0000 7fd6bdffb700 1 -- 172.21.15.32:0/3224639480 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b800e070 con 0x7fd6c00cf8f0 2023-06-20T13:33:49.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.576+0000 7fd6bdffb700 1 -- 172.21.15.32:0/3224639480 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b800bb20 con 0x7fd6c00cf8f0 2023-06-20T13:33:49.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.576+0000 7fd6bdffb700 1 -- 172.21.15.32:0/3224639480 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b8012430 con 0x7fd6c00cf8f0 2023-06-20T13:33:49.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.577+0000 7fd6c59ff700 1 -- 172.21.15.32:0/3224639480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6c00cf8f0 msgr2=0x7fd6c015fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:49.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.577+0000 7fd6c59ff700 1 --2- 172.21.15.32:0/3224639480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6c00cf8f0 0x7fd6c015fe20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8009d90 tx=0x7fd6b800b330 comp rx=0 tx=0).stop 2023-06-20T13:33:49.581 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.577+0000 7fd6c59ff700 1 -- 172.21.15.32:0/3224639480 shutdown_connections 2023-06-20T13:33:49.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.577+0000 7fd6c59ff700 1 --2- 172.21.15.32:0/3224639480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6c00cf8f0 0x7fd6c015fe20 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:49.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.577+0000 7fd6c59ff700 1 --2- 172.21.15.32:0/3224639480 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6c015c460 0x7fd6c00b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:49.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.577+0000 7fd6c59ff700 1 -- 172.21.15.32:0/3224639480 >> 172.21.15.32:0/3224639480 conn(0x7fd6c0071660 msgr2=0x7fd6c0071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:49.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.577+0000 7fd6c59ff700 1 -- 172.21.15.32:0/3224639480 shutdown_connections 2023-06-20T13:33:49.582 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.577+0000 7fd6c59ff700 1 -- 172.21.15.32:0/3224639480 wait complete. 2023-06-20T13:33:49.583 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.579+0000 7fd6c59ff700 1 Processor -- start 2023-06-20T13:33:49.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.579+0000 7fd6c59ff700 1 -- start start 2023-06-20T13:33:49.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.580+0000 7fd6c59ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6c00cf8f0 0x7fd6c0157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:49.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.580+0000 7fd6c59ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6c00d2640 0x7fd6c0159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:49.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.580+0000 7fd6c59ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6c015c460 0x7fd6c015a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:49.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.580+0000 7fd6c59ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c01584d0 con 0x7fd6c00d2640 2023-06-20T13:33:49.584 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.580+0000 7fd6c59ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c01587b0 con 0x7fd6c015c460 2023-06-20T13:33:49.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.580+0000 7fd6c59ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c0158a90 con 0x7fd6c00cf8f0 2023-06-20T13:33:49.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.580+0000 7fd6be7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6c00d2640 0x7fd6c0159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:49.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.580+0000 7fd6be7fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6c00d2640 0x7fd6c0159af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46628/0 (socket says 172.21.15.32:46628) 2023-06-20T13:33:49.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.580+0000 7fd6be7fc700 1 -- 172.21.15.32:0/3682059305 learned_addr learned my addr 172.21.15.32:0/3682059305 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:49.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.580+0000 7fd6beffd700 1 --2- 172.21.15.32:0/3682059305 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6c00cf8f0 0x7fd6c0157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:49.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.580+0000 7fd6bf7fe700 1 --2- 172.21.15.32:0/3682059305 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6c015c460 0x7fd6c015a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:49.585 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.581+0000 7fd6be7fc700 1 -- 172.21.15.32:0/3682059305 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6c00cf8f0 msgr2=0x7fd6c0157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:49.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.581+0000 7fd6be7fc700 1 --2- 172.21.15.32:0/3682059305 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6c00cf8f0 0x7fd6c0157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:49.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.581+0000 7fd6be7fc700 1 -- 172.21.15.32:0/3682059305 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6c015c460 msgr2=0x7fd6c015a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:49.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.581+0000 7fd6be7fc700 1 --2- 172.21.15.32:0/3682059305 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6c015c460 0x7fd6c015a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:49.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.581+0000 7fd6be7fc700 1 -- 172.21.15.32:0/3682059305 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b8009a70 con 0x7fd6c00d2640 2023-06-20T13:33:49.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.581+0000 7fd6be7fc700 1 --2- 172.21.15.32:0/3682059305 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6c00d2640 0x7fd6c0159af0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd6b400c550 tx=0x7fd6b400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:49.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.581+0000 7fd6a7fff700 1 -- 172.21.15.32:0/3682059305 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4004c80 con 0x7fd6c00d2640 2023-06-20T13:33:49.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.581+0000 7fd6a7fff700 1 -- 172.21.15.32:0/3682059305 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b4004e00 con 0x7fd6c00d2640 2023-06-20T13:33:49.586 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.581+0000 7fd6a7fff700 1 -- 172.21.15.32:0/3682059305 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4007310 con 0x7fd6c00d2640 2023-06-20T13:33:49.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.581+0000 7fd6c59ff700 1 -- 172.21.15.32:0/3682059305 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c0158d70 con 0x7fd6c00d2640 2023-06-20T13:33:49.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.581+0000 7fd6c59ff700 1 -- 172.21.15.32:0/3682059305 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c0159330 con 0x7fd6c00d2640 2023-06-20T13:33:49.587 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.582+0000 7fd6c59ff700 1 -- 172.21.15.32:0/3682059305 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c004ea60 con 0x7fd6c00d2640 2023-06-20T13:33:49.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.583+0000 7fd6a7fff700 1 -- 172.21.15.32:0/3682059305 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd6b4007470 con 0x7fd6c00d2640 2023-06-20T13:33:49.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.584+0000 7fd6a7fff700 1 --2- 172.21.15.32:0/3682059305 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd6ac06ace0 0x7fd6ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:49.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.584+0000 7fd6a7fff700 1 -- 172.21.15.32:0/3682059305 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd6b40894f0 con 0x7fd6c00d2640 2023-06-20T13:33:49.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.584+0000 7fd6beffd700 1 --2- 172.21.15.32:0/3682059305 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd6ac06ace0 0x7fd6ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:49.588 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.585+0000 7fd6beffd700 1 --2- 172.21.15.32:0/3682059305 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd6ac06ace0 0x7fd6ac06d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0009be0 tx=0x7fd6b0009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:49.590 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.589+0000 7fd6a7fff700 1 -- 172.21.15.32:0/3682059305 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd6b4054150 con 0x7fd6c00d2640 2023-06-20T13:33:49.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.843+0000 7fd6c59ff700 1 -- 172.21.15.32:0/3682059305 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6c00b4fa0 con 0x7fd6c00d2640 2023-06-20T13:33:49.845 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.843+0000 7fd6a7fff700 1 -- 172.21.15.32:0/3682059305 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4670 (secure 0 0 0) 0x7fd6b4057770 con 0x7fd6c00d2640 2023-06-20T13:33:49.846 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:33:49.846 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2171664589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2171664589},{"type":"v1","addr":"172.21.15.115:6834","nonce":2171664589}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/959333888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6836","nonce":959333888},{"type":"v1","addr":"172.21.15.32:6837","nonce":959333888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6835/3388117179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":3388117179},{"type":"v1","addr":"172.21.15.32:6835","nonce":3388117179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-20T13:32:20.527725+0000","modified":"2023-06-20T13:32:49.006923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.115:6835/3566362693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":3566362693},{"type":"v1","addr":"172.21.15.115:6835","nonce":3566362693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-20T13:33:49.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.845+0000 7fd6c59ff700 1 -- 172.21.15.32:0/3682059305 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd6ac06ace0 msgr2=0x7fd6ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:49.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.845+0000 7fd6c59ff700 1 --2- 172.21.15.32:0/3682059305 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd6ac06ace0 0x7fd6ac06d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0009be0 tx=0x7fd6b0009210 comp rx=0 tx=0).stop 2023-06-20T13:33:49.848 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.845+0000 7fd6c59ff700 1 -- 172.21.15.32:0/3682059305 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6c00d2640 msgr2=0x7fd6c0159af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:49.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.845+0000 7fd6c59ff700 1 --2- 172.21.15.32:0/3682059305 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6c00d2640 0x7fd6c0159af0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd6b400c550 tx=0x7fd6b400c860 comp rx=0 tx=0).stop 2023-06-20T13:33:49.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.846+0000 7fd6c59ff700 1 -- 172.21.15.32:0/3682059305 shutdown_connections 2023-06-20T13:33:49.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.846+0000 7fd6c59ff700 1 --2- 172.21.15.32:0/3682059305 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd6ac06ace0 0x7fd6ac06d190 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:49.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.846+0000 7fd6c59ff700 1 --2- 172.21.15.32:0/3682059305 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6c015c460 0x7fd6c015a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:49.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.846+0000 7fd6c59ff700 1 --2- 172.21.15.32:0/3682059305 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6c00cf8f0 0x7fd6c0157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:49.849 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.846+0000 7fd6c59ff700 1 --2- 172.21.15.32:0/3682059305 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6c00d2640 0x7fd6c0159af0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:49.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.846+0000 7fd6c59ff700 1 -- 172.21.15.32:0/3682059305 >> 172.21.15.32:0/3682059305 conn(0x7fd6c0071660 msgr2=0x7fd6c00b7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:49.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.846+0000 7fd6c59ff700 1 -- 172.21.15.32:0/3682059305 shutdown_connections 2023-06-20T13:33:49.850 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:49.846+0000 7fd6c59ff700 1 -- 172.21.15.32:0/3682059305 wait complete. 2023-06-20T13:33:49.850 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 8 2023-06-20T13:33:49.866 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:33:50.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.064+0000 7f638f9ff700 1 Processor -- start 2023-06-20T13:33:50.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.064+0000 7f638f9ff700 1 -- start start 2023-06-20T13:33:50.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.065+0000 7f638f9ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f63880b59d0 0x7f63881671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:50.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.065+0000 7f638f9ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63880d1790 con 0x7f638815c460 2023-06-20T13:33:50.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.065+0000 7f638f9ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63880cd950 con 0x7f63880d2640 2023-06-20T13:33:50.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.065+0000 7f638f9ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63880b5e10 con 0x7f63880b59d0 2023-06-20T13:33:50.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.065+0000 7f638d79b700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f638815c460 0x7f63880cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43882/0 (socket says 172.21.15.32:43882) 2023-06-20T13:33:50.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.065+0000 7f638d79b700 1 -- 172.21.15.32:0/371414563 learned_addr learned my addr 172.21.15.32:0/371414563 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:50.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.065+0000 7f638df9c700 1 --2- 172.21.15.32:0/371414563 >> v2:172.21.15.32:3300/0 conn(0x7f63880b59d0 0x7f63881671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:50.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.066+0000 7f637ffff700 1 -- 172.21.15.32:0/371414563 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301808335 0 0) 0x7f63880d1790 con 0x7f638815c460 2023-06-20T13:33:50.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.066+0000 7f637ffff700 1 -- 172.21.15.32:0/371414563 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63740035b0 con 0x7f638815c460 2023-06-20T13:33:50.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.066+0000 7f637ffff700 1 -- 172.21.15.32:0/371414563 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1421556206 0 0) 0x7f63880cd950 con 0x7f63880d2640 2023-06-20T13:33:50.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.066+0000 7f637ffff700 1 -- 172.21.15.32:0/371414563 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63880d1790 con 0x7f63880d2640 2023-06-20T13:33:50.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.066+0000 7f638df9c700 1 -- 172.21.15.32:0/371414563 >> v1:172.21.15.115:6789/0 conn(0x7f63880d2640 legacy=0x7f63880cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:50.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.066+0000 7f638df9c700 1 -- 172.21.15.32:0/371414563 >> v1:172.21.15.32:6789/0 conn(0x7f638815c460 legacy=0x7f63880cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:50.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.066+0000 7f638df9c700 1 -- 172.21.15.32:0/371414563 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63880d14b0 con 0x7f63880b59d0 2023-06-20T13:33:50.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.066+0000 7f638df9c700 1 --2- 172.21.15.32:0/371414563 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63880b59d0 0x7f63881671b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6380009d90 tx=0x7f638000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a214b1ff72cd3b server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:50.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.066+0000 7f637ffff700 1 -- 172.21.15.32:0/371414563 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638000e070 con 0x7f63880b59d0 2023-06-20T13:33:50.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.066+0000 7f637ffff700 1 -- 172.21.15.32:0/371414563 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638000bb20 con 0x7f63880b59d0 2023-06-20T13:33:50.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.066+0000 7f637ffff700 1 -- 172.21.15.32:0/371414563 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6380012430 con 0x7f63880b59d0 2023-06-20T13:33:50.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.067+0000 7f638f9ff700 1 -- 172.21.15.32:0/371414563 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63880b59d0 msgr2=0x7f63881671b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:50.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.067+0000 7f638f9ff700 1 --2- 172.21.15.32:0/371414563 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63880b59d0 0x7f63881671b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6380009d90 tx=0x7f638000b330 comp rx=0 tx=0).stop 2023-06-20T13:33:50.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.067+0000 7f638f9ff700 1 -- 172.21.15.32:0/371414563 shutdown_connections 2023-06-20T13:33:50.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.067+0000 7f638f9ff700 1 --2- 172.21.15.32:0/371414563 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63880b59d0 0x7f63881671b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:50.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.067+0000 7f638f9ff700 1 -- 172.21.15.32:0/371414563 >> 172.21.15.32:0/371414563 conn(0x7f6388071660 msgr2=0x7f6388071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:50.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.067+0000 7f638f9ff700 1 -- 172.21.15.32:0/371414563 shutdown_connections 2023-06-20T13:33:50.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.067+0000 7f638f9ff700 1 -- 172.21.15.32:0/371414563 wait complete. 2023-06-20T13:33:50.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.069+0000 7f638f9ff700 1 Processor -- start 2023-06-20T13:33:50.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.070+0000 7f638f9ff700 1 -- start start 2023-06-20T13:33:50.077 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.070+0000 7f638f9ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63880b59d0 0x7f63881efb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:50.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.070+0000 7f638f9ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63880d2640 0x7f63880c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:50.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.070+0000 7f638f9ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f638815c460 0x7f63880c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:50.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.071+0000 7f638f9ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63880caca0 con 0x7f63880d2640 2023-06-20T13:33:50.078 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.071+0000 7f638f9ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63880c9400 con 0x7f638815c460 2023-06-20T13:33:50.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.071+0000 7f638f9ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63880cae80 con 0x7f63880b59d0 2023-06-20T13:33:50.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.071+0000 7f638cf9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63880d2640 0x7f63880c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:50.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.071+0000 7f638cf9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63880d2640 0x7f63880c6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37154/0 (socket says 172.21.15.32:37154) 2023-06-20T13:33:50.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.071+0000 7f638cf9a700 1 -- 172.21.15.32:0/3732721710 learned_addr learned my addr 172.21.15.32:0/3732721710 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:50.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.071+0000 7f638df9c700 1 --2- 172.21.15.32:0/3732721710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f638815c460 0x7f63880c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:50.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.071+0000 7f638d79b700 1 --2- 172.21.15.32:0/3732721710 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63880b59d0 0x7f63881efb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:50.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.071+0000 7f638cf9a700 1 -- 172.21.15.32:0/3732721710 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63880b59d0 msgr2=0x7f63881efb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:50.079 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.071+0000 7f638cf9a700 1 --2- 172.21.15.32:0/3732721710 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63880b59d0 0x7f63881efb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:50.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.071+0000 7f638cf9a700 1 -- 172.21.15.32:0/3732721710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f638815c460 msgr2=0x7f63880c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:50.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.071+0000 7f638cf9a700 1 --2- 172.21.15.32:0/3732721710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f638815c460 0x7f63880c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:50.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.071+0000 7f638cf9a700 1 -- 172.21.15.32:0/3732721710 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6380009a70 con 0x7f63880d2640 2023-06-20T13:33:50.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.071+0000 7f638df9c700 1 --2- 172.21.15.32:0/3732721710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f638815c460 0x7f63880c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:50.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.071+0000 7f638cf9a700 1 --2- 172.21.15.32:0/3732721710 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63880d2640 0x7f63880c6ae0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f637800c520 tx=0x7f637800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:50.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.072+0000 7f637dffb700 1 -- 172.21.15.32:0/3732721710 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63780052d0 con 0x7f63880d2640 2023-06-20T13:33:50.080 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.072+0000 7f637dffb700 1 -- 172.21.15.32:0/3732721710 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6378005430 con 0x7f63880d2640 2023-06-20T13:33:50.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.072+0000 7f637dffb700 1 -- 172.21.15.32:0/3732721710 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63780038c0 con 0x7f63880d2640 2023-06-20T13:33:50.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.072+0000 7f638f9ff700 1 -- 172.21.15.32:0/3732721710 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63880cb160 con 0x7f63880d2640 2023-06-20T13:33:50.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.072+0000 7f638f9ff700 1 -- 172.21.15.32:0/3732721710 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63880c7020 con 0x7f63880d2640 2023-06-20T13:33:50.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.073+0000 7f638f9ff700 1 -- 172.21.15.32:0/3732721710 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63880cb680 con 0x7f63880d2640 2023-06-20T13:33:50.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.074+0000 7f637dffb700 1 -- 172.21.15.32:0/3732721710 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6378003a20 con 0x7f63880d2640 2023-06-20T13:33:50.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.075+0000 7f637dffb700 1 --2- 172.21.15.32:0/3732721710 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f636c06ace0 0x7f636c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:50.081 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.075+0000 7f637dffb700 1 -- 172.21.15.32:0/3732721710 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6378088e00 con 0x7f63880d2640 2023-06-20T13:33:50.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.075+0000 7f638d79b700 1 --2- 172.21.15.32:0/3732721710 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f636c06ace0 0x7f636c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:50.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.076+0000 7f638d79b700 1 --2- 172.21.15.32:0/3732721710 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f636c06ace0 0x7f636c06d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f63840011e0 tx=0x7f6384009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:50.082 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.080+0000 7f637dffb700 1 -- 172.21.15.32:0/3732721710 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f63880cb680 con 0x7f63880d2640 2023-06-20T13:33:50.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.291+0000 7f638f9ff700 1 -- 172.21.15.32:0/3732721710 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63880cb680 con 0x7f63880d2640 2023-06-20T13:33:50.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.292+0000 7f637dffb700 1 -- 172.21.15.32:0/3732721710 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20191 (secure 0 0 0) 0x7f6378074ef0 con 0x7f63880d2640 2023-06-20T13:33:50.295 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:33:50.295 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":29,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:33:00.976862+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-20T13:32:18.120021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-20T13:32:19.503624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-20T13:32:23.074912+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:33:50.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.295+0000 7f638f9ff700 1 -- 172.21.15.32:0/3732721710 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f636c06ace0 msgr2=0x7f636c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:50.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.295+0000 7f638f9ff700 1 --2- 172.21.15.32:0/3732721710 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f636c06ace0 0x7f636c06d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f63840011e0 tx=0x7f6384009040 comp rx=0 tx=0).stop 2023-06-20T13:33:50.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.295+0000 7f638f9ff700 1 -- 172.21.15.32:0/3732721710 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63880d2640 msgr2=0x7f63880c6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:50.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.295+0000 7f638f9ff700 1 --2- 172.21.15.32:0/3732721710 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63880d2640 0x7f63880c6ae0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f637800c520 tx=0x7f637800c8e0 comp rx=0 tx=0).stop 2023-06-20T13:33:50.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.295+0000 7f638f9ff700 1 -- 172.21.15.32:0/3732721710 shutdown_connections 2023-06-20T13:33:50.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.295+0000 7f638f9ff700 1 --2- 172.21.15.32:0/3732721710 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f636c06ace0 0x7f636c06d190 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:50.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.295+0000 7f638f9ff700 1 --2- 172.21.15.32:0/3732721710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f638815c460 0x7f63880c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:50.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.295+0000 7f638f9ff700 1 --2- 172.21.15.32:0/3732721710 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f63880b59d0 0x7f63881efb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:50.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.295+0000 7f638f9ff700 1 --2- 172.21.15.32:0/3732721710 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f63880d2640 0x7f63880c6ae0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:50.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.295+0000 7f638f9ff700 1 -- 172.21.15.32:0/3732721710 >> 172.21.15.32:0/3732721710 conn(0x7f6388071660 msgr2=0x7f63880d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:50.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.295+0000 7f638f9ff700 1 -- 172.21.15.32:0/3732721710 shutdown_connections 2023-06-20T13:33:50.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.295+0000 7f638f9ff700 1 -- 172.21.15.32:0/3732721710 wait complete. 2023-06-20T13:33:50.315 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-06-20T13:33:50.517 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.515+0000 7f86a3dff700 1 Processor -- start 2023-06-20T13:33:50.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.515+0000 7f86a3dff700 1 -- start start 2023-06-20T13:33:50.518 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.516+0000 7f86a3dff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f869c15fe00 0x7f869c0cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:50.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.516+0000 7f86a3dff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f869c1601d0 0x7f869c160620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:50.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.516+0000 7f86a3dff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f869c0cd120 con 0x7f869c0d29b0 2023-06-20T13:33:50.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.516+0000 7f86a3dff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f869c0cd930 con 0x7f869c1601d0 2023-06-20T13:33:50.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.516+0000 7f86a3dff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f869c0d06a0 con 0x7f869c15fe00 2023-06-20T13:33:50.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.516+0000 7f86a139a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f869c1601d0 0x7f869c160620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:50.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.516+0000 7f86a139a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f869c1601d0 0x7f869c160620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37168/0 (socket says 172.21.15.32:37168) 2023-06-20T13:33:50.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.516+0000 7f86a139a700 1 -- 172.21.15.32:0/2349311835 learned_addr learned my addr 172.21.15.32:0/2349311835 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:50.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.517+0000 7f86a1b9b700 1 --2- 172.21.15.32:0/2349311835 >> v2:172.21.15.115:3300/0 conn(0x7f869c15fe00 0x7f869c0cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:50.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.517+0000 7f86a139a700 1 -- 172.21.15.32:0/2349311835 >> v2:172.21.15.115:3300/0 conn(0x7f869c15fe00 msgr2=0x7f869c0cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:50.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.517+0000 7f86a139a700 1 --2- 172.21.15.32:0/2349311835 >> v2:172.21.15.115:3300/0 conn(0x7f869c15fe00 0x7f869c0cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:50.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.517+0000 7f86a139a700 1 -- 172.21.15.32:0/2349311835 >> v1:172.21.15.115:6789/0 conn(0x7f869c0d29b0 legacy=0x7f869c0d2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:50.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.517+0000 7f86a139a700 1 -- 172.21.15.32:0/2349311835 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869c0d0940 con 0x7f869c1601d0 2023-06-20T13:33:50.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.517+0000 7f86a139a700 1 --2- 172.21.15.32:0/2349311835 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f869c1601d0 0x7f869c160620 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f869c08bdb0 tx=0x7f868c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce3e194b652499c server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:50.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.517+0000 7f86a0b99700 1 -- 172.21.15.32:0/2349311835 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c011830 con 0x7f869c1601d0 2023-06-20T13:33:50.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.517+0000 7f86a0b99700 1 -- 172.21.15.32:0/2349311835 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868c011990 con 0x7f869c1601d0 2023-06-20T13:33:50.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.517+0000 7f86a0b99700 1 -- 172.21.15.32:0/2349311835 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c011d20 con 0x7f869c1601d0 2023-06-20T13:33:50.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.518+0000 7f86a3dff700 1 -- 172.21.15.32:0/2349311835 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f869c1601d0 msgr2=0x7f869c160620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:50.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.518+0000 7f86a3dff700 1 --2- 172.21.15.32:0/2349311835 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f869c1601d0 0x7f869c160620 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f869c08bdb0 tx=0x7f868c009bd0 comp rx=0 tx=0).stop 2023-06-20T13:33:50.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.518+0000 7f86a3dff700 1 -- 172.21.15.32:0/2349311835 shutdown_connections 2023-06-20T13:33:50.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.518+0000 7f86a3dff700 1 --2- 172.21.15.32:0/2349311835 >> v2:172.21.15.115:3300/0 conn(0x7f869c15fe00 0x7f869c0cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:50.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.518+0000 7f86a3dff700 1 --2- 172.21.15.32:0/2349311835 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f869c1601d0 0x7f869c160620 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:50.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.518+0000 7f86a3dff700 1 -- 172.21.15.32:0/2349311835 >> 172.21.15.32:0/2349311835 conn(0x7f869c071660 msgr2=0x7f869c071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:50.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.518+0000 7f86a3dff700 1 -- 172.21.15.32:0/2349311835 shutdown_connections 2023-06-20T13:33:50.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.518+0000 7f86a3dff700 1 -- 172.21.15.32:0/2349311835 wait complete. 2023-06-20T13:33:50.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.521+0000 7f86a3dff700 1 Processor -- start 2023-06-20T13:33:50.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.521+0000 7f86a3dff700 1 -- start start 2023-06-20T13:33:50.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.522+0000 7f86a3dff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f869c0d29b0 0x7f869c14cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:50.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.522+0000 7f86a3dff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f869c15fe00 0x7f869c0cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:50.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.522+0000 7f86a3dff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f869c1601d0 0x7f869c0ca560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:50.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.522+0000 7f86a3dff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869c0c66a0 con 0x7f869c0d29b0 2023-06-20T13:33:50.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.522+0000 7f86a3dff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869c0c6980 con 0x7f869c15fe00 2023-06-20T13:33:50.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.522+0000 7f86a3dff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f869c0c6c60 con 0x7f869c1601d0 2023-06-20T13:33:50.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.522+0000 7f86a1b9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f869c0d29b0 0x7f869c14cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:50.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.522+0000 7f86a1b9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f869c0d29b0 0x7f869c14cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37170/0 (socket says 172.21.15.32:37170) 2023-06-20T13:33:50.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.522+0000 7f86a1b9b700 1 -- 172.21.15.32:0/2053124301 learned_addr learned my addr 172.21.15.32:0/2053124301 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:50.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.522+0000 7f86a139a700 1 --2- 172.21.15.32:0/2053124301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f869c15fe00 0x7f869c0cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:50.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.523+0000 7f86a239c700 1 --2- 172.21.15.32:0/2053124301 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f869c1601d0 0x7f869c0ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:50.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.523+0000 7f86a1b9b700 1 -- 172.21.15.32:0/2053124301 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f869c1601d0 msgr2=0x7f869c0ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:50.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.523+0000 7f86a1b9b700 1 --2- 172.21.15.32:0/2053124301 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f869c1601d0 0x7f869c0ca560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:50.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.523+0000 7f86a1b9b700 1 -- 172.21.15.32:0/2053124301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f869c15fe00 msgr2=0x7f869c0cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:50.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.523+0000 7f86a1b9b700 1 --2- 172.21.15.32:0/2053124301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f869c15fe00 0x7f869c0cc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:50.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.523+0000 7f86a1b9b700 1 -- 172.21.15.32:0/2053124301 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868c009550 con 0x7f869c0d29b0 2023-06-20T13:33:50.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.523+0000 7f86a1b9b700 1 --2- 172.21.15.32:0/2053124301 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f869c0d29b0 0x7f869c14cef0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f869800efc0 tx=0x7f869800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:50.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.523+0000 7f86927fc700 1 -- 172.21.15.32:0/2053124301 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869800cc00 con 0x7f869c0d29b0 2023-06-20T13:33:50.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.523+0000 7f86927fc700 1 -- 172.21.15.32:0/2053124301 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869800f040 con 0x7f869c0d29b0 2023-06-20T13:33:50.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.523+0000 7f86927fc700 1 -- 172.21.15.32:0/2053124301 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8698014480 con 0x7f869c0d29b0 2023-06-20T13:33:50.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.523+0000 7f86a3dff700 1 -- 172.21.15.32:0/2053124301 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f869c0c6f40 con 0x7f869c0d29b0 2023-06-20T13:33:50.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.523+0000 7f86a3dff700 1 -- 172.21.15.32:0/2053124301 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f869c14d430 con 0x7f869c0d29b0 2023-06-20T13:33:50.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.524+0000 7f86a3dff700 1 -- 172.21.15.32:0/2053124301 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f869c04ea60 con 0x7f869c0d29b0 2023-06-20T13:33:50.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.525+0000 7f86927fc700 1 -- 172.21.15.32:0/2053124301 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f86980145e0 con 0x7f869c0d29b0 2023-06-20T13:33:50.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.526+0000 7f86927fc700 1 --2- 172.21.15.32:0/2053124301 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f868006ace0 0x7f868006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:50.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.526+0000 7f86927fc700 1 -- 172.21.15.32:0/2053124301 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f869808a110 con 0x7f869c0d29b0 2023-06-20T13:33:50.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.527+0000 7f86a139a700 1 --2- 172.21.15.32:0/2053124301 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f868006ace0 0x7f868006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:50.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.527+0000 7f86a139a700 1 --2- 172.21.15.32:0/2053124301 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f868006ace0 0x7f868006d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f868c009c10 tx=0x7f868c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:50.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.530+0000 7f86927fc700 1 -- 172.21.15.32:0/2053124301 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8698054df0 con 0x7f869c0d29b0 2023-06-20T13:33:50.782 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.780+0000 7f86a3dff700 1 -- 172.21.15.32:0/2053124301 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f869c0c6ac0 con 0x7f869c0d29b0 2023-06-20T13:33:50.783 INFO:tasks.ceph.mon.a.smithi032.stderr:2023-06-20T13:33:50.781+0000 7f819c3f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-06-20T13:33:50.788 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.786+0000 7f86927fc700 1 -- 172.21.15.32:0/2053124301 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f869c0c6ac0 con 0x7f869c0d29b0 2023-06-20T13:33:50.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.788+0000 7f86a3dff700 1 -- 172.21.15.32:0/2053124301 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f868006ace0 msgr2=0x7f868006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:50.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.788+0000 7f86a3dff700 1 --2- 172.21.15.32:0/2053124301 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f868006ace0 0x7f868006d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f868c009c10 tx=0x7f868c008030 comp rx=0 tx=0).stop 2023-06-20T13:33:50.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.788+0000 7f86a3dff700 1 -- 172.21.15.32:0/2053124301 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f869c0d29b0 msgr2=0x7f869c14cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:50.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.788+0000 7f86a3dff700 1 --2- 172.21.15.32:0/2053124301 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f869c0d29b0 0x7f869c14cef0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f869800efc0 tx=0x7f869800c0c0 comp rx=0 tx=0).stop 2023-06-20T13:33:50.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.788+0000 7f86a3dff700 1 -- 172.21.15.32:0/2053124301 shutdown_connections 2023-06-20T13:33:50.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.788+0000 7f86a3dff700 1 --2- 172.21.15.32:0/2053124301 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f868006ace0 0x7f868006d190 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:50.791 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.788+0000 7f86a3dff700 1 --2- 172.21.15.32:0/2053124301 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f869c1601d0 0x7f869c0ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:50.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.788+0000 7f86a3dff700 1 --2- 172.21.15.32:0/2053124301 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f869c0d29b0 0x7f869c14cef0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:50.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.788+0000 7f86a3dff700 1 --2- 172.21.15.32:0/2053124301 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f869c15fe00 0x7f869c0cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:50.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.788+0000 7f86a3dff700 1 -- 172.21.15.32:0/2053124301 >> 172.21.15.32:0/2053124301 conn(0x7f869c071660 msgr2=0x7f869c0b19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:50.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.789+0000 7f86a3dff700 1 -- 172.21.15.32:0/2053124301 shutdown_connections 2023-06-20T13:33:50.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:50.789+0000 7f86a3dff700 1 -- 172.21.15.32:0/2053124301 wait complete. 2023-06-20T13:33:50.793 INFO:teuthology.orchestra.run.smithi032.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-06-20T13:33:50.801 INFO:tasks.ceph.mds.b.smithi115.stderr: -6755> 2023-06-20T13:32:25.180+0000 7f8258ff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-20T13:33:50.808 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-06-20T13:33:50.854 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-06-20T13:33:51.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.009+0000 7fd6487ff700 1 Processor -- start 2023-06-20T13:33:51.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.010+0000 7fd6487ff700 1 -- start start 2023-06-20T13:33:51.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.011+0000 7fd6487ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd6400d25c0 0x7fd6400cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:51.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.011+0000 7fd6487ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd640160a00 con 0x7fd6400b4d20 2023-06-20T13:33:51.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.011+0000 7fd6487ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd640160ce0 con 0x7fd6400b8260 2023-06-20T13:33:51.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.011+0000 7fd6487ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6400cd280 con 0x7fd6400d25c0 2023-06-20T13:33:51.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.011+0000 7fd645d9a700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd6400b4d20 0x7fd6400d0a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43894/0 (socket says 172.21.15.32:43894) 2023-06-20T13:33:51.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.011+0000 7fd645d9a700 1 -- 172.21.15.32:0/1139601196 learned_addr learned my addr 172.21.15.32:0/1139601196 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:51.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.011+0000 7fd646d9c700 1 --2- 172.21.15.32:0/1139601196 >> v2:172.21.15.32:3300/0 conn(0x7fd6400d25c0 0x7fd6400cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:51.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.011+0000 7fd646d9c700 1 -- 172.21.15.32:0/1139601196 >> v1:172.21.15.115:6789/0 conn(0x7fd6400b8260 legacy=0x7fd6400b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:51.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.011+0000 7fd646d9c700 1 -- 172.21.15.32:0/1139601196 >> v1:172.21.15.32:6789/0 conn(0x7fd6400b4d20 legacy=0x7fd6400d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:51.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.011+0000 7fd646d9c700 1 -- 172.21.15.32:0/1139601196 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6400cd560 con 0x7fd6400d25c0 2023-06-20T13:33:51.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.012+0000 7fd646d9c700 1 --2- 172.21.15.32:0/1139601196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6400d25c0 0x7fd6400cede0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd638009d90 tx=0x7fd63800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=240059b41601b242 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:51.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.012+0000 7fd645599700 1 -- 172.21.15.32:0/1139601196 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63800e070 con 0x7fd6400d25c0 2023-06-20T13:33:51.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.012+0000 7fd645599700 1 -- 172.21.15.32:0/1139601196 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63800bbd0 con 0x7fd6400d25c0 2023-06-20T13:33:51.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.012+0000 7fd645599700 1 -- 172.21.15.32:0/1139601196 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd638012430 con 0x7fd6400d25c0 2023-06-20T13:33:51.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.012+0000 7fd6487ff700 1 -- 172.21.15.32:0/1139601196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6400d25c0 msgr2=0x7fd6400cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:51.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.012+0000 7fd6487ff700 1 --2- 172.21.15.32:0/1139601196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6400d25c0 0x7fd6400cede0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd638009d90 tx=0x7fd63800b330 comp rx=0 tx=0).stop 2023-06-20T13:33:51.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.013+0000 7fd6487ff700 1 -- 172.21.15.32:0/1139601196 shutdown_connections 2023-06-20T13:33:51.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.013+0000 7fd6487ff700 1 --2- 172.21.15.32:0/1139601196 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6400d25c0 0x7fd6400cede0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:51.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.013+0000 7fd6487ff700 1 -- 172.21.15.32:0/1139601196 >> 172.21.15.32:0/1139601196 conn(0x7fd6400722b0 msgr2=0x7fd6400cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:51.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.013+0000 7fd6487ff700 1 -- 172.21.15.32:0/1139601196 shutdown_connections 2023-06-20T13:33:51.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.013+0000 7fd6487ff700 1 -- 172.21.15.32:0/1139601196 wait complete. 2023-06-20T13:33:51.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.015+0000 7fd6487ff700 1 Processor -- start 2023-06-20T13:33:51.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.015+0000 7fd6487ff700 1 -- start start 2023-06-20T13:33:51.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.016+0000 7fd6487ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6400b8260 0x7fd6400c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:51.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.016+0000 7fd6487ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6400d25c0 0x7fd64014bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:51.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.017+0000 7fd6487ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6400c73a0 0x7fd640159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:51.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.017+0000 7fd6487ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6400c8860 con 0x7fd6400b8260 2023-06-20T13:33:51.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.017+0000 7fd6487ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6400c7c50 con 0x7fd6400d25c0 2023-06-20T13:33:51.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.017+0000 7fd6487ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6400c7f30 con 0x7fd6400c73a0 2023-06-20T13:33:51.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.017+0000 7fd64659b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6400b8260 0x7fd6400c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:51.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.017+0000 7fd64659b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6400b8260 0x7fd6400c8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37190/0 (socket says 172.21.15.32:37190) 2023-06-20T13:33:51.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.017+0000 7fd64659b700 1 -- 172.21.15.32:0/2360940529 learned_addr learned my addr 172.21.15.32:0/2360940529 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:51.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.017+0000 7fd645d9a700 1 --2- 172.21.15.32:0/2360940529 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6400d25c0 0x7fd64014bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:51.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.017+0000 7fd646d9c700 1 --2- 172.21.15.32:0/2360940529 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6400c73a0 0x7fd640159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:51.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.017+0000 7fd64659b700 1 -- 172.21.15.32:0/2360940529 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6400c73a0 msgr2=0x7fd640159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:51.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.017+0000 7fd64659b700 1 --2- 172.21.15.32:0/2360940529 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6400c73a0 0x7fd640159740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:51.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.017+0000 7fd64659b700 1 -- 172.21.15.32:0/2360940529 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6400d25c0 msgr2=0x7fd64014bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:51.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.017+0000 7fd64659b700 1 --2- 172.21.15.32:0/2360940529 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6400d25c0 0x7fd64014bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:51.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.017+0000 7fd64659b700 1 -- 172.21.15.32:0/2360940529 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd638009a70 con 0x7fd6400b8260 2023-06-20T13:33:51.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.018+0000 7fd64659b700 1 --2- 172.21.15.32:0/2360940529 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6400b8260 0x7fd6400c8cf0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00c4e0 tx=0x7fd63c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:51.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.018+0000 7fd636ffd700 1 -- 172.21.15.32:0/2360940529 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c0052d0 con 0x7fd6400b8260 2023-06-20T13:33:51.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.018+0000 7fd636ffd700 1 -- 172.21.15.32:0/2360940529 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63c005430 con 0x7fd6400b8260 2023-06-20T13:33:51.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.018+0000 7fd6487ff700 1 -- 172.21.15.32:0/2360940529 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6400c8210 con 0x7fd6400b8260 2023-06-20T13:33:51.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.018+0000 7fd636ffd700 1 -- 172.21.15.32:0/2360940529 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c0038c0 con 0x7fd6400b8260 2023-06-20T13:33:51.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.018+0000 7fd6487ff700 1 -- 172.21.15.32:0/2360940529 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd64014c470 con 0x7fd6400b8260 2023-06-20T13:33:51.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.019+0000 7fd6487ff700 1 -- 172.21.15.32:0/2360940529 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd64004ea60 con 0x7fd6400b8260 2023-06-20T13:33:51.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.020+0000 7fd636ffd700 1 -- 172.21.15.32:0/2360940529 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd63c003a20 con 0x7fd6400b8260 2023-06-20T13:33:51.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.021+0000 7fd636ffd700 1 --2- 172.21.15.32:0/2360940529 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd62406ace0 0x7fd62406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:51.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.021+0000 7fd636ffd700 1 -- 172.21.15.32:0/2360940529 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6957+0+0 (secure 0 0 0) 0x7fd63c088d30 con 0x7fd6400b8260 2023-06-20T13:33:51.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.021+0000 7fd645d9a700 1 --2- 172.21.15.32:0/2360940529 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd62406ace0 0x7fd62406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:51.024 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.022+0000 7fd645d9a700 1 --2- 172.21.15.32:0/2360940529 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd62406ace0 0x7fd62406d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd6400c79d0 tx=0x7fd630009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:51.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.025+0000 7fd636ffd700 1 -- 172.21.15.32:0/2360940529 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd63c053a50 con 0x7fd6400b8260 2023-06-20T13:33:51.283 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.281+0000 7fd6487ff700 1 -- 172.21.15.32:0/2360940529 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd6400c8b40 con 0x7fd6400b8260 2023-06-20T13:33:51.789 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.787+0000 7fd636ffd700 1 -- 172.21.15.32:0/2360940529 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd63c057070 con 0x7fd6400b8260 2023-06-20T13:33:51.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.790+0000 7fd6487ff700 1 -- 172.21.15.32:0/2360940529 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd62406ace0 msgr2=0x7fd62406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:51.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.790+0000 7fd6487ff700 1 --2- 172.21.15.32:0/2360940529 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd62406ace0 0x7fd62406d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd6400c79d0 tx=0x7fd630009040 comp rx=0 tx=0).stop 2023-06-20T13:33:51.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.790+0000 7fd6487ff700 1 -- 172.21.15.32:0/2360940529 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6400b8260 msgr2=0x7fd6400c8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:51.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.790+0000 7fd6487ff700 1 --2- 172.21.15.32:0/2360940529 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6400b8260 0x7fd6400c8cf0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00c4e0 tx=0x7fd63c00c8a0 comp rx=0 tx=0).stop 2023-06-20T13:33:51.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.790+0000 7fd6487ff700 1 -- 172.21.15.32:0/2360940529 shutdown_connections 2023-06-20T13:33:51.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.790+0000 7fd6487ff700 1 --2- 172.21.15.32:0/2360940529 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd62406ace0 0x7fd62406d190 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:51.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.790+0000 7fd6487ff700 1 --2- 172.21.15.32:0/2360940529 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6400c73a0 0x7fd640159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:51.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.790+0000 7fd6487ff700 1 --2- 172.21.15.32:0/2360940529 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd6400b8260 0x7fd6400c8cf0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:51.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.790+0000 7fd6487ff700 1 --2- 172.21.15.32:0/2360940529 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6400d25c0 0x7fd64014bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:51.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.790+0000 7fd6487ff700 1 -- 172.21.15.32:0/2360940529 >> 172.21.15.32:0/2360940529 conn(0x7fd6400b4d20 msgr2=0x7fd6400b6360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:51.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.790+0000 7fd6487ff700 1 -- 172.21.15.32:0/2360940529 shutdown_connections 2023-06-20T13:33:51.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:51.790+0000 7fd6487ff700 1 -- 172.21.15.32:0/2360940529 wait complete. 2023-06-20T13:33:51.812 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-06-20T13:33:52.021 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.019+0000 7fdd445ff700 1 Processor -- start 2023-06-20T13:33:52.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.019+0000 7fdd445ff700 1 -- start start 2023-06-20T13:33:52.022 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.020+0000 7fdd445ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fdd3c0b82c0 0x7fdd3c160870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:52.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.020+0000 7fdd445ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdd3c0cf4d0 0x7fdd3c0cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:52.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.020+0000 7fdd445ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd3c160db0 con 0x7fdd3c0b1f00 2023-06-20T13:33:52.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.020+0000 7fdd445ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd3c0b8690 con 0x7fdd3c0b82c0 2023-06-20T13:33:52.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.020+0000 7fdd445ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd3c15fe20 con 0x7fdd3c0cf4d0 2023-06-20T13:33:52.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.020+0000 7fdd41b9a700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fdd3c0b1f00 0x7fdd3c0ceca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43910/0 (socket says 172.21.15.32:43910) 2023-06-20T13:33:52.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.020+0000 7fdd41b9a700 1 -- 172.21.15.32:0/68865689 learned_addr learned my addr 172.21.15.32:0/68865689 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:52.023 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.020+0000 7fdd4239b700 1 --2- 172.21.15.32:0/68865689 >> v2:172.21.15.32:3300/0 conn(0x7fdd3c0b82c0 0x7fdd3c160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:52.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.021+0000 7fdd42b9c700 1 --2- 172.21.15.32:0/68865689 >> v2:172.21.15.115:3300/0 conn(0x7fdd3c0cf4d0 0x7fdd3c0cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:52.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.021+0000 7fdd4239b700 1 -- 172.21.15.32:0/68865689 >> v2:172.21.15.115:3300/0 conn(0x7fdd3c0cf4d0 msgr2=0x7fdd3c0cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:52.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.021+0000 7fdd4239b700 1 --2- 172.21.15.32:0/68865689 >> v2:172.21.15.115:3300/0 conn(0x7fdd3c0cf4d0 0x7fdd3c0cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:52.025 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.021+0000 7fdd4239b700 1 -- 172.21.15.32:0/68865689 >> v1:172.21.15.32:6789/0 conn(0x7fdd3c0b1f00 legacy=0x7fdd3c0ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:52.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.021+0000 7fdd4239b700 1 -- 172.21.15.32:0/68865689 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd3c1603e0 con 0x7fdd3c0b82c0 2023-06-20T13:33:52.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.021+0000 7fdd42b9c700 1 --2- 172.21.15.32:0/68865689 >> v2:172.21.15.115:3300/0 conn(0x7fdd3c0cf4d0 0x7fdd3c0cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:52.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.021+0000 7fdd4239b700 1 --2- 172.21.15.32:0/68865689 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd3c0b82c0 0x7fdd3c160870 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c0b2500 tx=0x7fdd38009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1023beeff50a5395 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:52.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.021+0000 7fdd41399700 1 -- 172.21.15.32:0/68865689 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd38011830 con 0x7fdd3c0b82c0 2023-06-20T13:33:52.026 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.021+0000 7fdd41399700 1 -- 172.21.15.32:0/68865689 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd38011990 con 0x7fdd3c0b82c0 2023-06-20T13:33:52.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.021+0000 7fdd41399700 1 -- 172.21.15.32:0/68865689 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd38011d20 con 0x7fdd3c0b82c0 2023-06-20T13:33:52.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.022+0000 7fdd445ff700 1 -- 172.21.15.32:0/68865689 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd3c0b82c0 msgr2=0x7fdd3c160870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:52.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.022+0000 7fdd445ff700 1 --2- 172.21.15.32:0/68865689 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd3c0b82c0 0x7fdd3c160870 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c0b2500 tx=0x7fdd38009b20 comp rx=0 tx=0).stop 2023-06-20T13:33:52.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.022+0000 7fdd445ff700 1 -- 172.21.15.32:0/68865689 shutdown_connections 2023-06-20T13:33:52.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.022+0000 7fdd445ff700 1 --2- 172.21.15.32:0/68865689 >> v2:172.21.15.115:3300/0 conn(0x7fdd3c0cf4d0 0x7fdd3c0cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:52.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.022+0000 7fdd445ff700 1 --2- 172.21.15.32:0/68865689 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd3c0b82c0 0x7fdd3c160870 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:52.027 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.022+0000 7fdd445ff700 1 -- 172.21.15.32:0/68865689 >> 172.21.15.32:0/68865689 conn(0x7fdd3c071660 msgr2=0x7fdd3c071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:52.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.022+0000 7fdd445ff700 1 -- 172.21.15.32:0/68865689 shutdown_connections 2023-06-20T13:33:52.028 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.022+0000 7fdd445ff700 1 -- 172.21.15.32:0/68865689 wait complete. 2023-06-20T13:33:52.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.024+0000 7fdd445ff700 1 Processor -- start 2023-06-20T13:33:52.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.024+0000 7fdd445ff700 1 -- start start 2023-06-20T13:33:52.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.025+0000 7fdd445ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd3c0b1f00 0x7fdd3c0c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:52.030 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.025+0000 7fdd445ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd3c0b82c0 0x7fdd3c0cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:52.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.025+0000 7fdd445ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd3c0cf4d0 0x7fdd3c0cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:52.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.025+0000 7fdd445ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3c0c7cb0 con 0x7fdd3c0cf4d0 2023-06-20T13:33:52.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.025+0000 7fdd445ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3c0c70a0 con 0x7fdd3c0b82c0 2023-06-20T13:33:52.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.025+0000 7fdd445ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3c0c7380 con 0x7fdd3c0b1f00 2023-06-20T13:33:52.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.025+0000 7fdd42b9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd3c0cf4d0 0x7fdd3c0cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:52.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.025+0000 7fdd42b9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd3c0cf4d0 0x7fdd3c0cc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37196/0 (socket says 172.21.15.32:37196) 2023-06-20T13:33:52.031 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.025+0000 7fdd42b9c700 1 -- 172.21.15.32:0/184920848 learned_addr learned my addr 172.21.15.32:0/184920848 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:52.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.025+0000 7fdd41b9a700 1 --2- 172.21.15.32:0/184920848 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd3c0b82c0 0x7fdd3c0cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:52.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.025+0000 7fdd4239b700 1 --2- 172.21.15.32:0/184920848 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd3c0b1f00 0x7fdd3c0c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:52.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.025+0000 7fdd42b9c700 1 -- 172.21.15.32:0/184920848 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd3c0b1f00 msgr2=0x7fdd3c0c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:52.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.025+0000 7fdd42b9c700 1 --2- 172.21.15.32:0/184920848 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd3c0b1f00 0x7fdd3c0c6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:52.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.025+0000 7fdd42b9c700 1 -- 172.21.15.32:0/184920848 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd3c0b82c0 msgr2=0x7fdd3c0cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:52.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.025+0000 7fdd42b9c700 1 --2- 172.21.15.32:0/184920848 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd3c0b82c0 0x7fdd3c0cbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:52.032 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.025+0000 7fdd42b9c700 1 -- 172.21.15.32:0/184920848 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd380094a0 con 0x7fdd3c0cf4d0 2023-06-20T13:33:52.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.026+0000 7fdd42b9c700 1 --2- 172.21.15.32:0/184920848 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd3c0cf4d0 0x7fdd3c0cc1c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400cef0 tx=0x7fdd3400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:52.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.026+0000 7fdd32ffd700 1 -- 172.21.15.32:0/184920848 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3400ae50 con 0x7fdd3c0cf4d0 2023-06-20T13:33:52.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.026+0000 7fdd32ffd700 1 -- 172.21.15.32:0/184920848 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd34015440 con 0x7fdd3c0cf4d0 2023-06-20T13:33:52.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.026+0000 7fdd32ffd700 1 -- 172.21.15.32:0/184920848 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd340157f0 con 0x7fdd3c0cf4d0 2023-06-20T13:33:52.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.026+0000 7fdd445ff700 1 -- 172.21.15.32:0/184920848 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd3c0c7660 con 0x7fdd3c0cf4d0 2023-06-20T13:33:52.033 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.026+0000 7fdd445ff700 1 -- 172.21.15.32:0/184920848 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd3c0c9000 con 0x7fdd3c0cf4d0 2023-06-20T13:33:52.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.027+0000 7fdd445ff700 1 -- 172.21.15.32:0/184920848 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd3c0c7e60 con 0x7fdd3c0cf4d0 2023-06-20T13:33:52.034 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.028+0000 7fdd32ffd700 1 -- 172.21.15.32:0/184920848 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdd3400d430 con 0x7fdd3c0cf4d0 2023-06-20T13:33:52.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.030+0000 7fdd32ffd700 1 --2- 172.21.15.32:0/184920848 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdd2006ace0 0x7fdd2006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:52.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.030+0000 7fdd32ffd700 1 -- 172.21.15.32:0/184920848 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6957+0+0 (secure 0 0 0) 0x7fdd34089ec0 con 0x7fdd3c0cf4d0 2023-06-20T13:33:52.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.030+0000 7fdd4239b700 1 --2- 172.21.15.32:0/184920848 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdd2006ace0 0x7fdd2006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:52.035 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.031+0000 7fdd4239b700 1 --2- 172.21.15.32:0/184920848 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdd2006ace0 0x7fdd2006d190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdd380090b0 tx=0x7fdd38008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:52.036 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.034+0000 7fdd32ffd700 1 -- 172.21.15.32:0/184920848 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdd3c0c7e60 con 0x7fdd3c0cf4d0 2023-06-20T13:33:52.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:52.245+0000 7fdd445ff700 1 -- 172.21.15.32:0/184920848 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdd3c074180 con 0x7fdd3c0cf4d0 2023-06-20T13:33:53.206 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.203+0000 7fdd32ffd700 1 -- 172.21.15.32:0/184920848 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) v1 ==== 181+0+0 (secure 0 0 0) 0x7fdd3401a0d0 con 0x7fdd3c0cf4d0 2023-06-20T13:33:53.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.208+0000 7fdd445ff700 1 -- 172.21.15.32:0/184920848 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdd2006ace0 msgr2=0x7fdd2006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:53.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.208+0000 7fdd445ff700 1 --2- 172.21.15.32:0/184920848 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdd2006ace0 0x7fdd2006d190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdd380090b0 tx=0x7fdd38008030 comp rx=0 tx=0).stop 2023-06-20T13:33:53.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.208+0000 7fdd445ff700 1 -- 172.21.15.32:0/184920848 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd3c0cf4d0 msgr2=0x7fdd3c0cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:53.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.208+0000 7fdd445ff700 1 --2- 172.21.15.32:0/184920848 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd3c0cf4d0 0x7fdd3c0cc1c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400cef0 tx=0x7fdd3400a340 comp rx=0 tx=0).stop 2023-06-20T13:33:53.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.208+0000 7fdd445ff700 1 -- 172.21.15.32:0/184920848 shutdown_connections 2023-06-20T13:33:53.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.208+0000 7fdd445ff700 1 --2- 172.21.15.32:0/184920848 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fdd2006ace0 0x7fdd2006d190 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:53.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.208+0000 7fdd445ff700 1 --2- 172.21.15.32:0/184920848 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fdd3c0cf4d0 0x7fdd3c0cc1c0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:53.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.208+0000 7fdd445ff700 1 --2- 172.21.15.32:0/184920848 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdd3c0b1f00 0x7fdd3c0c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:53.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.208+0000 7fdd445ff700 1 --2- 172.21.15.32:0/184920848 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd3c0b82c0 0x7fdd3c0cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:53.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.208+0000 7fdd445ff700 1 -- 172.21.15.32:0/184920848 >> 172.21.15.32:0/184920848 conn(0x7fdd3c071660 msgr2=0x7fdd3c0b3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:53.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.209+0000 7fdd445ff700 1 -- 172.21.15.32:0/184920848 shutdown_connections 2023-06-20T13:33:53.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.209+0000 7fdd445ff700 1 -- 172.21.15.32:0/184920848 wait complete. 2023-06-20T13:33:53.213 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_metadata' removed 2023-06-20T13:33:53.233 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-06-20T13:33:53.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.440+0000 7f31b85ff700 1 Processor -- start 2023-06-20T13:33:53.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.440+0000 7f31b85ff700 1 -- start start 2023-06-20T13:33:53.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.441+0000 7f31b85ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f31b00b82c0 0x7f31b0160870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:53.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.441+0000 7f31b85ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b0160db0 con 0x7f31b00b1f00 2023-06-20T13:33:53.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.441+0000 7f31b85ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b015fe20 con 0x7f31b00cf4d0 2023-06-20T13:33:53.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.441+0000 7f31b85ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b00b8690 con 0x7f31b00b82c0 2023-06-20T13:33:53.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.441+0000 7f31b639b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f31b00b82c0 0x7f31b0160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:53.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.441+0000 7f31b5b9a700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f31b00b1f00 0x7f31b00ceca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43922/0 (socket says 172.21.15.32:43922) 2023-06-20T13:33:53.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.441+0000 7f31b5b9a700 1 -- 172.21.15.32:0/1853415054 learned_addr learned my addr 172.21.15.32:0/1853415054 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:53.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.442+0000 7f31b5399700 1 -- 172.21.15.32:0/1853415054 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2489551904 0 0) 0x7f31a0001110 con 0x7f31b00b1f00 2023-06-20T13:33:53.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.442+0000 7f31b5399700 1 -- 172.21.15.32:0/1853415054 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f319c0035b0 con 0x7f31b00b1f00 2023-06-20T13:33:53.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.442+0000 7f31b639b700 1 -- 172.21.15.32:0/1853415054 >> v1:172.21.15.115:6789/0 conn(0x7f31b00cf4d0 legacy=0x7f31b00cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:53.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.442+0000 7f31b639b700 1 -- 172.21.15.32:0/1853415054 >> v1:172.21.15.32:6789/0 conn(0x7f31b00b1f00 legacy=0x7f31b00ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:53.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.442+0000 7f31b639b700 1 -- 172.21.15.32:0/1853415054 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b01603e0 con 0x7f31b00b82c0 2023-06-20T13:33:53.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.442+0000 7f31b639b700 1 --2- 172.21.15.32:0/1853415054 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31b00b82c0 0x7f31b0160870 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009840 tx=0x7f31ac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ee7a38337afa81 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:53.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.442+0000 7f31b5399700 1 -- 172.21.15.32:0/1853415054 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac011830 con 0x7f31b00b82c0 2023-06-20T13:33:53.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.443+0000 7f31b5399700 1 -- 172.21.15.32:0/1853415054 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ac011990 con 0x7f31b00b82c0 2023-06-20T13:33:53.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.443+0000 7f31b5399700 1 -- 172.21.15.32:0/1853415054 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac011d20 con 0x7f31b00b82c0 2023-06-20T13:33:53.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.443+0000 7f31b85ff700 1 -- 172.21.15.32:0/1853415054 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31b00b82c0 msgr2=0x7f31b0160870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:53.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.443+0000 7f31b85ff700 1 --2- 172.21.15.32:0/1853415054 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31b00b82c0 0x7f31b0160870 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009840 tx=0x7f31ac009b50 comp rx=0 tx=0).stop 2023-06-20T13:33:53.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.443+0000 7f31b85ff700 1 -- 172.21.15.32:0/1853415054 shutdown_connections 2023-06-20T13:33:53.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.443+0000 7f31b85ff700 1 --2- 172.21.15.32:0/1853415054 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31b00b82c0 0x7f31b0160870 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:53.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.443+0000 7f31b85ff700 1 -- 172.21.15.32:0/1853415054 >> 172.21.15.32:0/1853415054 conn(0x7f31b0071660 msgr2=0x7f31b0071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:53.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.443+0000 7f31b85ff700 1 -- 172.21.15.32:0/1853415054 shutdown_connections 2023-06-20T13:33:53.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.443+0000 7f31b85ff700 1 -- 172.21.15.32:0/1853415054 wait complete. 2023-06-20T13:33:53.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.445+0000 7f31b85ff700 1 Processor -- start 2023-06-20T13:33:53.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.445+0000 7f31b85ff700 1 -- start start 2023-06-20T13:33:53.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.446+0000 7f31b85ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31b00b1f00 0x7f31b015e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:53.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.446+0000 7f31b85ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31b00b82c0 0x7f31b00b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:53.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.446+0000 7f31b85ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31b00cf4d0 0x7f31b00c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:53.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.446+0000 7f31b85ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b015ef80 con 0x7f31b00b82c0 2023-06-20T13:33:53.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.446+0000 7f31b85ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b015e6e0 con 0x7f31b00cf4d0 2023-06-20T13:33:53.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.446+0000 7f31b85ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b015e9c0 con 0x7f31b00b1f00 2023-06-20T13:33:53.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.446+0000 7f31b5b9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31b00b82c0 0x7f31b00b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:53.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.446+0000 7f31b5b9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31b00b82c0 0x7f31b00b3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37210/0 (socket says 172.21.15.32:37210) 2023-06-20T13:33:53.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.446+0000 7f31b5b9a700 1 -- 172.21.15.32:0/3184163528 learned_addr learned my addr 172.21.15.32:0/3184163528 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:53.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.446+0000 7f31b639b700 1 --2- 172.21.15.32:0/3184163528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31b00b1f00 0x7f31b015e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:53.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.446+0000 7f31b6b9c700 1 --2- 172.21.15.32:0/3184163528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31b00cf4d0 0x7f31b00c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:53.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.447+0000 7f31b5b9a700 1 -- 172.21.15.32:0/3184163528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31b00b1f00 msgr2=0x7f31b015e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:53.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.447+0000 7f31b5b9a700 1 --2- 172.21.15.32:0/3184163528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31b00b1f00 0x7f31b015e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:53.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.447+0000 7f31b5b9a700 1 -- 172.21.15.32:0/3184163528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31b00cf4d0 msgr2=0x7f31b00c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:53.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.447+0000 7f31b5b9a700 1 --2- 172.21.15.32:0/3184163528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31b00cf4d0 0x7f31b00c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:53.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.447+0000 7f31b5b9a700 1 -- 172.21.15.32:0/3184163528 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ac0094a0 con 0x7f31b00b82c0 2023-06-20T13:33:53.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.447+0000 7f31b5b9a700 1 --2- 172.21.15.32:0/3184163528 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31b00b82c0 0x7f31b00b3a10 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f31a000c500 tx=0x7f31a000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:53.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.447+0000 7f31a6ffd700 1 -- 172.21.15.32:0/3184163528 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0005d70 con 0x7f31b00b82c0 2023-06-20T13:33:53.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.447+0000 7f31a6ffd700 1 -- 172.21.15.32:0/3184163528 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a00070d0 con 0x7f31b00b82c0 2023-06-20T13:33:53.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.447+0000 7f31a6ffd700 1 -- 172.21.15.32:0/3184163528 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0007460 con 0x7f31b00b82c0 2023-06-20T13:33:53.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.447+0000 7f31b85ff700 1 -- 172.21.15.32:0/3184163528 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b015eca0 con 0x7f31b00b82c0 2023-06-20T13:33:53.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.447+0000 7f31b85ff700 1 -- 172.21.15.32:0/3184163528 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b00b3f50 con 0x7f31b00b82c0 2023-06-20T13:33:53.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.448+0000 7f31b85ff700 1 -- 172.21.15.32:0/3184163528 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b00cafb0 con 0x7f31b00b82c0 2023-06-20T13:33:53.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.449+0000 7f31a6ffd700 1 -- 172.21.15.32:0/3184163528 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f31a00075c0 con 0x7f31b00b82c0 2023-06-20T13:33:53.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.450+0000 7f31a6ffd700 1 --2- 172.21.15.32:0/3184163528 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f319406ace0 0x7f319406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:53.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.450+0000 7f31a6ffd700 1 -- 172.21.15.32:0/3184163528 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f31a00889b0 con 0x7f31b00b82c0 2023-06-20T13:33:53.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.451+0000 7f31b639b700 1 --2- 172.21.15.32:0/3184163528 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f319406ace0 0x7f319406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:53.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.451+0000 7f31b639b700 1 --2- 172.21.15.32:0/3184163528 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f319406ace0 0x7f319406d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0090b0 tx=0x7f31ac008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:53.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.454+0000 7f31a6ffd700 1 -- 172.21.15.32:0/3184163528 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f31b00cafb0 con 0x7f31b00b82c0 2023-06-20T13:33:53.662 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:53.660+0000 7f31b85ff700 1 -- 172.21.15.32:0/3184163528 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f31b0160db0 con 0x7f31b00b82c0 2023-06-20T13:33:54.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.211+0000 7f31a6ffd700 1 -- 172.21.15.32:0/3184163528 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) v1 ==== 169+0+0 (secure 0 0 0) 0x7f31b0160db0 con 0x7f31b00b82c0 2023-06-20T13:33:54.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.214+0000 7f31b85ff700 1 -- 172.21.15.32:0/3184163528 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f319406ace0 msgr2=0x7f319406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:54.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.214+0000 7f31b85ff700 1 --2- 172.21.15.32:0/3184163528 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f319406ace0 0x7f319406d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0090b0 tx=0x7f31ac008030 comp rx=0 tx=0).stop 2023-06-20T13:33:54.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.214+0000 7f31b85ff700 1 -- 172.21.15.32:0/3184163528 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31b00b82c0 msgr2=0x7f31b00b3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:54.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.214+0000 7f31b85ff700 1 --2- 172.21.15.32:0/3184163528 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31b00b82c0 0x7f31b00b3a10 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f31a000c500 tx=0x7f31a000c8c0 comp rx=0 tx=0).stop 2023-06-20T13:33:54.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.215+0000 7f31b85ff700 1 -- 172.21.15.32:0/3184163528 shutdown_connections 2023-06-20T13:33:54.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.215+0000 7f31b85ff700 1 --2- 172.21.15.32:0/3184163528 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f319406ace0 0x7f319406d190 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:54.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.215+0000 7f31b85ff700 1 --2- 172.21.15.32:0/3184163528 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f31b00cf4d0 0x7f31b00c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:54.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.215+0000 7f31b85ff700 1 --2- 172.21.15.32:0/3184163528 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f31b00b1f00 0x7f31b015e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:54.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.215+0000 7f31b85ff700 1 --2- 172.21.15.32:0/3184163528 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f31b00b82c0 0x7f31b00b3a10 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:54.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.215+0000 7f31b85ff700 1 -- 172.21.15.32:0/3184163528 >> 172.21.15.32:0/3184163528 conn(0x7f31b0071660 msgr2=0x7f31b00b4930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:54.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.215+0000 7f31b85ff700 1 -- 172.21.15.32:0/3184163528 shutdown_connections 2023-06-20T13:33:54.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.215+0000 7f31b85ff700 1 -- 172.21.15.32:0/3184163528 wait complete. 2023-06-20T13:33:54.219 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data' removed 2023-06-20T13:33:54.238 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-06-20T13:33:54.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.446+0000 7f04159ff700 1 Processor -- start 2023-06-20T13:33:54.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.447+0000 7f04159ff700 1 -- start start 2023-06-20T13:33:54.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.448+0000 7f04159ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04100b82c0 0x7f0410160870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:54.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.448+0000 7f04159ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f04100cf4d0 0x7f04100cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:54.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.448+0000 7f04159ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0410160db0 con 0x7f04100b1f00 2023-06-20T13:33:54.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.448+0000 7f04159ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04100b8690 con 0x7f04100cf4d0 2023-06-20T13:33:54.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.448+0000 7f04159ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04100cfe90 con 0x7f04100b82c0 2023-06-20T13:33:54.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.448+0000 7f040f7fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f04100cf4d0 0x7f04100cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:54.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.448+0000 7f0407fff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f04100b1f00 0x7f04100ceca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43932/0 (socket says 172.21.15.32:43932) 2023-06-20T13:33:54.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.448+0000 7f0407fff700 1 -- 172.21.15.32:0/1418995721 learned_addr learned my addr 172.21.15.32:0/1418995721 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:54.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.448+0000 7f040effd700 1 --2- 172.21.15.32:0/1418995721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04100b82c0 0x7f0410160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:54.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.449+0000 7f040f7fe700 1 -- 172.21.15.32:0/1418995721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04100b82c0 msgr2=0x7f0410160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:54.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.449+0000 7f040f7fe700 1 --2- 172.21.15.32:0/1418995721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04100b82c0 0x7f0410160870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:54.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.449+0000 7f040f7fe700 1 -- 172.21.15.32:0/1418995721 >> v1:172.21.15.32:6789/0 conn(0x7f04100b1f00 legacy=0x7f04100ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:54.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.449+0000 7f040f7fe700 1 -- 172.21.15.32:0/1418995721 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041015fe20 con 0x7f04100cf4d0 2023-06-20T13:33:54.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.449+0000 7f040e7fc700 1 -- 172.21.15.32:0/1418995721 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3758929980 0 0) 0x7f03f8001110 con 0x7f04100b1f00 2023-06-20T13:33:54.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.449+0000 7f040f7fe700 1 --2- 172.21.15.32:0/1418995721 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04100cf4d0 0x7f04100cf950 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0408009d90 tx=0x7f040800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a48c91ff80138d server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:54.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.449+0000 7f040e7fc700 1 -- 172.21.15.32:0/1418995721 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040800e070 con 0x7f04100cf4d0 2023-06-20T13:33:54.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.449+0000 7f040e7fc700 1 -- 172.21.15.32:0/1418995721 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040800bb20 con 0x7f04100cf4d0 2023-06-20T13:33:54.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.449+0000 7f040e7fc700 1 -- 172.21.15.32:0/1418995721 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0408012430 con 0x7f04100cf4d0 2023-06-20T13:33:54.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.450+0000 7f04159ff700 1 -- 172.21.15.32:0/1418995721 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04100cf4d0 msgr2=0x7f04100cf950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:54.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.450+0000 7f04159ff700 1 --2- 172.21.15.32:0/1418995721 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04100cf4d0 0x7f04100cf950 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0408009d90 tx=0x7f040800b330 comp rx=0 tx=0).stop 2023-06-20T13:33:54.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.450+0000 7f04159ff700 1 -- 172.21.15.32:0/1418995721 shutdown_connections 2023-06-20T13:33:54.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.450+0000 7f04159ff700 1 --2- 172.21.15.32:0/1418995721 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04100cf4d0 0x7f04100cf950 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:54.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.450+0000 7f04159ff700 1 --2- 172.21.15.32:0/1418995721 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04100b82c0 0x7f0410160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:54.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.450+0000 7f04159ff700 1 -- 172.21.15.32:0/1418995721 >> 172.21.15.32:0/1418995721 conn(0x7f0410071660 msgr2=0x7f0410071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:54.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.450+0000 7f04159ff700 1 -- 172.21.15.32:0/1418995721 shutdown_connections 2023-06-20T13:33:54.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.450+0000 7f04159ff700 1 -- 172.21.15.32:0/1418995721 wait complete. 2023-06-20T13:33:54.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.452+0000 7f04159ff700 1 Processor -- start 2023-06-20T13:33:54.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.452+0000 7f04159ff700 1 -- start start 2023-06-20T13:33:54.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.453+0000 7f04159ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04100b1f00 0x7f04101f16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:54.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.453+0000 7f04159ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04100b82c0 0x7f04101e5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:54.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.453+0000 7f04159ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04100cf4d0 0x7f04101e61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:54.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.453+0000 7f04159ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0410147390 con 0x7f04100b1f00 2023-06-20T13:33:54.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.453+0000 7f04159ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0410146a30 con 0x7f04100cf4d0 2023-06-20T13:33:54.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.453+0000 7f04159ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04100c8e70 con 0x7f04100b82c0 2023-06-20T13:33:54.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.453+0000 7f040effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04100b1f00 0x7f04101f16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:54.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.453+0000 7f040effd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04100b1f00 0x7f04101f16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37234/0 (socket says 172.21.15.32:37234) 2023-06-20T13:33:54.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.453+0000 7f040effd700 1 -- 172.21.15.32:0/866563892 learned_addr learned my addr 172.21.15.32:0/866563892 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:54.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.453+0000 7f0407fff700 1 --2- 172.21.15.32:0/866563892 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04100b82c0 0x7f04101e5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:54.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.453+0000 7f040f7fe700 1 --2- 172.21.15.32:0/866563892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04100cf4d0 0x7f04101e61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:54.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.453+0000 7f040effd700 1 -- 172.21.15.32:0/866563892 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04100b82c0 msgr2=0x7f04101e5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:54.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.453+0000 7f040effd700 1 --2- 172.21.15.32:0/866563892 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04100b82c0 0x7f04101e5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:54.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.453+0000 7f040effd700 1 -- 172.21.15.32:0/866563892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04100cf4d0 msgr2=0x7f04101e61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:54.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.453+0000 7f040effd700 1 --2- 172.21.15.32:0/866563892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04100cf4d0 0x7f04101e61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:54.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.453+0000 7f040effd700 1 -- 172.21.15.32:0/866563892 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0408009a70 con 0x7f04100b1f00 2023-06-20T13:33:54.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.454+0000 7f040effd700 1 --2- 172.21.15.32:0/866563892 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04100b1f00 0x7f04101f16f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f040000e870 tx=0x7f040000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:54.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.454+0000 7f040cff9700 1 -- 172.21.15.32:0/866563892 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0400009590 con 0x7f04100b1f00 2023-06-20T13:33:54.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.454+0000 7f040cff9700 1 -- 172.21.15.32:0/866563892 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040000ee70 con 0x7f04100b1f00 2023-06-20T13:33:54.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.454+0000 7f040cff9700 1 -- 172.21.15.32:0/866563892 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040000ca50 con 0x7f04100b1f00 2023-06-20T13:33:54.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.454+0000 7f04159ff700 1 -- 172.21.15.32:0/866563892 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0410146cd0 con 0x7f04100b1f00 2023-06-20T13:33:54.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.454+0000 7f04159ff700 1 -- 172.21.15.32:0/866563892 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041015d2f0 con 0x7f04100b1f00 2023-06-20T13:33:54.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.455+0000 7f04159ff700 1 -- 172.21.15.32:0/866563892 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0410147600 con 0x7f04100b1f00 2023-06-20T13:33:54.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.456+0000 7f040cff9700 1 -- 172.21.15.32:0/866563892 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f040000cbb0 con 0x7f04100b1f00 2023-06-20T13:33:54.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.457+0000 7f040cff9700 1 --2- 172.21.15.32:0/866563892 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f03f006ace0 0x7f03f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:54.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.457+0000 7f040cff9700 1 -- 172.21.15.32:0/866563892 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f0400089450 con 0x7f04100b1f00 2023-06-20T13:33:54.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.457+0000 7f0407fff700 1 --2- 172.21.15.32:0/866563892 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f03f006ace0 0x7f03f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:54.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.458+0000 7f0407fff700 1 --2- 172.21.15.32:0/866563892 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f03f006ace0 0x7f03f006d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f03f8000f60 tx=0x7f03f8007c90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:54.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.461+0000 7f040cff9700 1 -- 172.21.15.32:0/866563892 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0400057f90 con 0x7f04100b1f00 2023-06-20T13:33:54.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:54.670+0000 7f04159ff700 1 -- 172.21.15.32:0/866563892 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0410074180 con 0x7f04100b1f00 2023-06-20T13:33:55.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.216+0000 7f040cff9700 1 -- 172.21.15.32:0/866563892 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) v1 ==== 178+0+0 (secure 0 0 0) 0x7f040000ce60 con 0x7f04100b1f00 2023-06-20T13:33:55.226 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.221+0000 7f04159ff700 1 -- 172.21.15.32:0/866563892 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f03f006ace0 msgr2=0x7f03f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:55.226 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.221+0000 7f04159ff700 1 --2- 172.21.15.32:0/866563892 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f03f006ace0 0x7f03f006d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f03f8000f60 tx=0x7f03f8007c90 comp rx=0 tx=0).stop 2023-06-20T13:33:55.226 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.221+0000 7f04159ff700 1 -- 172.21.15.32:0/866563892 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04100b1f00 msgr2=0x7f04101f16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:55.226 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.221+0000 7f04159ff700 1 --2- 172.21.15.32:0/866563892 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04100b1f00 0x7f04101f16f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f040000e870 tx=0x7f040000ec30 comp rx=0 tx=0).stop 2023-06-20T13:33:55.227 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.224+0000 7f04159ff700 1 -- 172.21.15.32:0/866563892 shutdown_connections 2023-06-20T13:33:55.227 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.224+0000 7f04159ff700 1 --2- 172.21.15.32:0/866563892 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f03f006ace0 0x7f03f006d190 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:55.227 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.224+0000 7f04159ff700 1 --2- 172.21.15.32:0/866563892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04100cf4d0 0x7f04101e61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:55.227 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.224+0000 7f04159ff700 1 --2- 172.21.15.32:0/866563892 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f04100b1f00 0x7f04101f16f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:55.227 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.224+0000 7f04159ff700 1 --2- 172.21.15.32:0/866563892 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04100b82c0 0x7f04101e5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:55.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.224+0000 7f04159ff700 1 -- 172.21.15.32:0/866563892 >> 172.21.15.32:0/866563892 conn(0x7f0410071660 msgr2=0x7f04100b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:55.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.225+0000 7f04159ff700 1 -- 172.21.15.32:0/866563892 shutdown_connections 2023-06-20T13:33:55.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.226+0000 7f04159ff700 1 -- 172.21.15.32:0/866563892 wait complete. 2023-06-20T13:33:55.230 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data_ec' removed 2023-06-20T13:33:55.249 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-20T13:33:55.249 INFO:tasks.ceph.mds.a:Stopping old one... 2023-06-20T13:33:55.249 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-20T13:33:55.250 INFO:teuthology.orchestra.run:waiting for 300 2023-06-20T13:33:55.250 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-20T13:33:55.250 INFO:tasks.ceph.mds.c:Stopping old one... 2023-06-20T13:33:55.250 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-06-20T13:33:55.251 INFO:teuthology.orchestra.run:waiting for 300 2023-06-20T13:33:55.251 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-20T13:33:55.251 INFO:tasks.ceph.mds.b:Stopping old one... 2023-06-20T13:33:55.251 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-20T13:33:55.251 INFO:teuthology.orchestra.run:waiting for 300 2023-06-20T13:33:55.252 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-20T13:33:55.252 INFO:tasks.ceph.mds.d:Stopping old one... 2023-06-20T13:33:55.252 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-06-20T13:33:55.252 INFO:teuthology.orchestra.run:waiting for 300 2023-06-20T13:33:55.265 INFO:tasks.ceph.mds.a:Stopped 2023-06-20T13:33:55.265 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-20T13:33:55.266 INFO:tasks.ceph.mds.c:Stopped 2023-06-20T13:33:55.266 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-20T13:33:55.268 INFO:tasks.ceph.mds.b:Stopped 2023-06-20T13:33:55.269 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-20T13:33:55.269 INFO:tasks.ceph.mds.d:Stopped 2023-06-20T13:33:55.270 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-20T13:33:55.309 INFO:tasks.ceph.mds.a:Started 2023-06-20T13:33:55.310 DEBUG:teuthology.parallel:result is None 2023-06-20T13:33:55.312 INFO:tasks.ceph.mds.c:Started 2023-06-20T13:33:55.312 DEBUG:teuthology.parallel:result is None 2023-06-20T13:33:55.314 INFO:tasks.ceph.mds.b:Started 2023-06-20T13:33:55.315 DEBUG:teuthology.parallel:result is None 2023-06-20T13:33:55.317 INFO:tasks.ceph.mds.d:Started 2023-06-20T13:33:55.318 DEBUG:teuthology.parallel:result is None 2023-06-20T13:33:55.318 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-06-20T13:33:55.466 INFO:tasks.ceph.mds.a.smithi032.stdout:starting mds.a at 2023-06-20T13:33:55.467 INFO:tasks.ceph.mds.c.smithi032.stdout:starting mds.c at 2023-06-20T13:33:55.480 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2023-06-20T13:33:55.482 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2023-06-20T13:33:55.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.535+0000 7faf2c3ff700 1 Processor -- start 2023-06-20T13:33:55.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.535+0000 7faf2c3ff700 1 -- start start 2023-06-20T13:33:55.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.536+0000 7faf2c3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7faf24156be0 0x7faf240cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:55.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.536+0000 7faf2c3ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf240cd600 0x7faf240cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:55.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.536+0000 7faf2c3ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf240cbc00 con 0x7faf240cb4f0 2023-06-20T13:33:55.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.536+0000 7faf2c3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf24156fb0 con 0x7faf24156be0 2023-06-20T13:33:55.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.536+0000 7faf2c3ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2415da40 con 0x7faf240cd600 2023-06-20T13:33:55.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.536+0000 7faf2a99c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7faf240cb4f0 0x7faf24070340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43960/0 (socket says 172.21.15.32:43960) 2023-06-20T13:33:55.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.536+0000 7faf2a99c700 1 -- 172.21.15.32:0/307660988 learned_addr learned my addr 172.21.15.32:0/307660988 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:55.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.537+0000 7faf2999a700 1 --2- 172.21.15.32:0/307660988 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf240cd600 0x7faf240cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:55.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.537+0000 7faf2a19b700 1 --2- 172.21.15.32:0/307660988 >> v2:172.21.15.115:3300/0 conn(0x7faf24156be0 0x7faf240cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:55.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.537+0000 7faf29199700 1 -- 172.21.15.32:0/307660988 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3518170843 0 0) 0x7faf240cbc00 con 0x7faf240cb4f0 2023-06-20T13:33:55.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.537+0000 7faf29199700 1 -- 172.21.15.32:0/307660988 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf100035b0 con 0x7faf240cb4f0 2023-06-20T13:33:55.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.537+0000 7faf2999a700 1 -- 172.21.15.32:0/307660988 >> v2:172.21.15.115:3300/0 conn(0x7faf24156be0 msgr2=0x7faf240cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:55.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.537+0000 7faf2999a700 1 --2- 172.21.15.32:0/307660988 >> v2:172.21.15.115:3300/0 conn(0x7faf24156be0 0x7faf240cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:55.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.537+0000 7faf2999a700 1 -- 172.21.15.32:0/307660988 >> v1:172.21.15.32:6789/0 conn(0x7faf240cb4f0 legacy=0x7faf24070340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:55.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.537+0000 7faf2999a700 1 -- 172.21.15.32:0/307660988 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf240cda50 con 0x7faf240cd600 2023-06-20T13:33:55.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.537+0000 7faf2999a700 1 --2- 172.21.15.32:0/307660988 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf240cd600 0x7faf240cafb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faf14009840 tx=0x7faf14009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cb57f82acb84a90 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:55.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.538+0000 7faf29199700 1 -- 172.21.15.32:0/307660988 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf14011830 con 0x7faf240cd600 2023-06-20T13:33:55.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.538+0000 7faf29199700 1 -- 172.21.15.32:0/307660988 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf14011990 con 0x7faf240cd600 2023-06-20T13:33:55.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.538+0000 7faf29199700 1 -- 172.21.15.32:0/307660988 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf14011d20 con 0x7faf240cd600 2023-06-20T13:33:55.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.538+0000 7faf2c3ff700 1 -- 172.21.15.32:0/307660988 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf240cd600 msgr2=0x7faf240cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:55.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.538+0000 7faf2c3ff700 1 --2- 172.21.15.32:0/307660988 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf240cd600 0x7faf240cafb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faf14009840 tx=0x7faf14009b50 comp rx=0 tx=0).stop 2023-06-20T13:33:55.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.538+0000 7faf2c3ff700 1 -- 172.21.15.32:0/307660988 shutdown_connections 2023-06-20T13:33:55.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.538+0000 7faf2c3ff700 1 --2- 172.21.15.32:0/307660988 >> v2:172.21.15.115:3300/0 conn(0x7faf24156be0 0x7faf240cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:55.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.538+0000 7faf2c3ff700 1 --2- 172.21.15.32:0/307660988 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf240cd600 0x7faf240cafb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:55.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.538+0000 7faf2c3ff700 1 -- 172.21.15.32:0/307660988 >> 172.21.15.32:0/307660988 conn(0x7faf240b0390 msgr2=0x7faf240b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:55.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.538+0000 7faf2c3ff700 1 -- 172.21.15.32:0/307660988 shutdown_connections 2023-06-20T13:33:55.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.538+0000 7faf2c3ff700 1 -- 172.21.15.32:0/307660988 wait complete. 2023-06-20T13:33:55.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.540+0000 7faf2c3ff700 1 Processor -- start 2023-06-20T13:33:55.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.540+0000 7faf2c3ff700 1 -- start start 2023-06-20T13:33:55.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.541+0000 7faf2c3ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf240cb4f0 0x7faf240af630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:55.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.541+0000 7faf2c3ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf240cd600 0x7faf241665b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:55.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.541+0000 7faf2c3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf24156be0 0x7faf24166af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:55.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.541+0000 7faf2c3ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf24165dc0 con 0x7faf240cd600 2023-06-20T13:33:55.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.541+0000 7faf2c3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf24164ef0 con 0x7faf24156be0 2023-06-20T13:33:55.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.541+0000 7faf2c3ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf24165140 con 0x7faf240cb4f0 2023-06-20T13:33:55.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.541+0000 7faf2999a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf240cd600 0x7faf241665b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:55.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.541+0000 7faf2a19b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf240cb4f0 0x7faf240af630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:55.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.541+0000 7faf2999a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf240cd600 0x7faf241665b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37276/0 (socket says 172.21.15.32:37276) 2023-06-20T13:33:55.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.541+0000 7faf2999a700 1 -- 172.21.15.32:0/1666058477 learned_addr learned my addr 172.21.15.32:0/1666058477 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:55.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.542+0000 7faf2a99c700 1 --2- 172.21.15.32:0/1666058477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf24156be0 0x7faf24166af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:55.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.542+0000 7faf2999a700 1 -- 172.21.15.32:0/1666058477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf240cb4f0 msgr2=0x7faf240af630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:55.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.542+0000 7faf2999a700 1 --2- 172.21.15.32:0/1666058477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf240cb4f0 0x7faf240af630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:55.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.542+0000 7faf2999a700 1 -- 172.21.15.32:0/1666058477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf24156be0 msgr2=0x7faf24166af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:55.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.542+0000 7faf2999a700 1 --2- 172.21.15.32:0/1666058477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf24156be0 0x7faf24166af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:55.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.542+0000 7faf2999a700 1 -- 172.21.15.32:0/1666058477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf140094a0 con 0x7faf240cd600 2023-06-20T13:33:55.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.542+0000 7faf2999a700 1 --2- 172.21.15.32:0/1666058477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf240cd600 0x7faf241665b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7faf14009fd0 tx=0x7faf14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:55.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.542+0000 7faf1affd700 1 -- 172.21.15.32:0/1666058477 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf140036a0 con 0x7faf240cd600 2023-06-20T13:33:55.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.542+0000 7faf1affd700 1 -- 172.21.15.32:0/1666058477 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1401f070 con 0x7faf240cd600 2023-06-20T13:33:55.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.542+0000 7faf1affd700 1 -- 172.21.15.32:0/1666058477 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf14003a40 con 0x7faf240cd600 2023-06-20T13:33:55.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.543+0000 7faf2c3ff700 1 -- 172.21.15.32:0/1666058477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf24165420 con 0x7faf240cd600 2023-06-20T13:33:55.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.543+0000 7faf2c3ff700 1 -- 172.21.15.32:0/1666058477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf241659e0 con 0x7faf240cd600 2023-06-20T13:33:55.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.544+0000 7faf2c3ff700 1 -- 172.21.15.32:0/1666058477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf24165b70 con 0x7faf240cd600 2023-06-20T13:33:55.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.545+0000 7faf1affd700 1 -- 172.21.15.32:0/1666058477 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faf14003ba0 con 0x7faf240cd600 2023-06-20T13:33:55.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.546+0000 7faf1affd700 1 --2- 172.21.15.32:0/1666058477 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7faf0806ace0 0x7faf0806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:55.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.546+0000 7faf1affd700 1 -- 172.21.15.32:0/1666058477 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5616+0+0 (secure 0 0 0) 0x7faf14021070 con 0x7faf240cd600 2023-06-20T13:33:55.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.546+0000 7faf2a19b700 1 --2- 172.21.15.32:0/1666058477 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7faf0806ace0 0x7faf0806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:55.550 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.547+0000 7faf2a19b700 1 --2- 172.21.15.32:0/1666058477 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7faf0806ace0 0x7faf0806d190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7faf20009b40 tx=0x7faf20009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:55.552 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.550+0000 7faf1affd700 1 -- 172.21.15.32:0/1666058477 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7faf14055d30 con 0x7faf240cd600 2023-06-20T13:33:55.772 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:55.770+0000 7faf2c3ff700 1 -- 172.21.15.32:0/1666058477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7faf2404ea60 con 0x7faf240cd600 2023-06-20T13:33:56.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.228+0000 7faf1affd700 1 -- 172.21.15.32:0/1666058477 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) v1 ==== 97+0+0 (secure 0 0 0) 0x7faf1402b080 con 0x7faf240cd600 2023-06-20T13:33:56.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.231+0000 7faf2c3ff700 1 -- 172.21.15.32:0/1666058477 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7faf0806ace0 msgr2=0x7faf0806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:56.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.231+0000 7faf2c3ff700 1 --2- 172.21.15.32:0/1666058477 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7faf0806ace0 0x7faf0806d190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7faf20009b40 tx=0x7faf20009210 comp rx=0 tx=0).stop 2023-06-20T13:33:56.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.231+0000 7faf2c3ff700 1 -- 172.21.15.32:0/1666058477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf240cd600 msgr2=0x7faf241665b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:56.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.231+0000 7faf2c3ff700 1 --2- 172.21.15.32:0/1666058477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf240cd600 0x7faf241665b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7faf14009fd0 tx=0x7faf14004750 comp rx=0 tx=0).stop 2023-06-20T13:33:56.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.231+0000 7faf2c3ff700 1 -- 172.21.15.32:0/1666058477 shutdown_connections 2023-06-20T13:33:56.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.231+0000 7faf2c3ff700 1 --2- 172.21.15.32:0/1666058477 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7faf0806ace0 0x7faf0806d190 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:56.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.231+0000 7faf2c3ff700 1 --2- 172.21.15.32:0/1666058477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf24156be0 0x7faf24166af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:56.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.231+0000 7faf2c3ff700 1 --2- 172.21.15.32:0/1666058477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf240cb4f0 0x7faf240af630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:56.234 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.231+0000 7faf2c3ff700 1 --2- 172.21.15.32:0/1666058477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf240cd600 0x7faf241665b0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:56.235 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.231+0000 7faf2c3ff700 1 -- 172.21.15.32:0/1666058477 >> 172.21.15.32:0/1666058477 conn(0x7faf240b0390 msgr2=0x7faf240ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:56.235 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.231+0000 7faf2c3ff700 1 -- 172.21.15.32:0/1666058477 shutdown_connections 2023-06-20T13:33:56.235 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.231+0000 7faf2c3ff700 1 -- 172.21.15.32:0/1666058477 wait complete. 2023-06-20T13:33:56.235 INFO:teuthology.orchestra.run.smithi032.stderr: removed all blocklist entries 2023-06-20T13:33:56.255 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-06-20T13:33:56.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.456+0000 7f28d43ff700 1 Processor -- start 2023-06-20T13:33:56.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.456+0000 7f28d43ff700 1 -- start start 2023-06-20T13:33:56.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.457+0000 7f28d43ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f28cc15c460 0x7f28cc0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:56.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.457+0000 7f28d43ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28cc0d2640 0x7f28cc0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:56.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.457+0000 7f28d43ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28cc0d1790 con 0x7f28cc0cf720 2023-06-20T13:33:56.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.457+0000 7f28d43ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28cc0cedd0 con 0x7f28cc15c460 2023-06-20T13:33:56.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.457+0000 7f28d43ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc0cd950 con 0x7f28cc0d2640 2023-06-20T13:33:56.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.457+0000 7f28d219b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f28cc15c460 0x7f28cc0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:56.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.457+0000 7f28d219b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f28cc15c460 0x7f28cc0b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37292/0 (socket says 172.21.15.32:37292) 2023-06-20T13:33:56.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.457+0000 7f28d219b700 1 -- 172.21.15.32:0/3495969577 learned_addr learned my addr 172.21.15.32:0/3495969577 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:56.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.457+0000 7f28d199a700 1 --2- 172.21.15.32:0/3495969577 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28cc0d2640 0x7f28cc0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:56.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.458+0000 7f28d219b700 1 -- 172.21.15.32:0/3495969577 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28cc0d2640 msgr2=0x7f28cc0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:56.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.458+0000 7f28d219b700 1 --2- 172.21.15.32:0/3495969577 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28cc0d2640 0x7f28cc0cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:56.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.458+0000 7f28d219b700 1 -- 172.21.15.32:0/3495969577 >> v1:172.21.15.115:6789/0 conn(0x7f28cc0cf720 legacy=0x7f28cc0d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:56.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.458+0000 7f28d219b700 1 -- 172.21.15.32:0/3495969577 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28cc0d14b0 con 0x7f28cc15c460 2023-06-20T13:33:56.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.458+0000 7f28d199a700 1 --2- 172.21.15.32:0/3495969577 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28cc0d2640 0x7f28cc0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:56.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.458+0000 7f28d219b700 1 --2- 172.21.15.32:0/3495969577 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28cc15c460 0x7f28cc0b59d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f28c80098f0 tx=0x7f28c8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836b47a6e2af3bf9 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:56.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.458+0000 7f28d1199700 1 -- 172.21.15.32:0/3495969577 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c800b8a0 con 0x7f28cc15c460 2023-06-20T13:33:56.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.458+0000 7f28d1199700 1 -- 172.21.15.32:0/3495969577 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c800ba00 con 0x7f28cc15c460 2023-06-20T13:33:56.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.458+0000 7f28d1199700 1 -- 172.21.15.32:0/3495969577 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c800bd90 con 0x7f28cc15c460 2023-06-20T13:33:56.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.459+0000 7f28d43ff700 1 -- 172.21.15.32:0/3495969577 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28cc15c460 msgr2=0x7f28cc0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:56.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.459+0000 7f28d43ff700 1 --2- 172.21.15.32:0/3495969577 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28cc15c460 0x7f28cc0b59d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f28c80098f0 tx=0x7f28c8009c00 comp rx=0 tx=0).stop 2023-06-20T13:33:56.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.459+0000 7f28d43ff700 1 -- 172.21.15.32:0/3495969577 shutdown_connections 2023-06-20T13:33:56.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.459+0000 7f28d43ff700 1 --2- 172.21.15.32:0/3495969577 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28cc15c460 0x7f28cc0b59d0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:56.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.459+0000 7f28d43ff700 1 --2- 172.21.15.32:0/3495969577 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28cc0d2640 0x7f28cc0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:56.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.459+0000 7f28d43ff700 1 -- 172.21.15.32:0/3495969577 >> 172.21.15.32:0/3495969577 conn(0x7f28cc071660 msgr2=0x7f28cc071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:56.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.459+0000 7f28d43ff700 1 -- 172.21.15.32:0/3495969577 shutdown_connections 2023-06-20T13:33:56.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.459+0000 7f28d43ff700 1 -- 172.21.15.32:0/3495969577 wait complete. 2023-06-20T13:33:56.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.461+0000 7f28d43ff700 1 Processor -- start 2023-06-20T13:33:56.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.461+0000 7f28d43ff700 1 -- start start 2023-06-20T13:33:56.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.462+0000 7f28d43ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28cc0cf720 0x7f28cc0cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:56.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.462+0000 7f28d43ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28cc0d2640 0x7f28cc148ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:56.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.462+0000 7f28d43ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28cc15c460 0x7f28cc15af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:56.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.462+0000 7f28d43ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc1f6a80 con 0x7f28cc15c460 2023-06-20T13:33:56.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.462+0000 7f28d43ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc149430 con 0x7f28cc0cf720 2023-06-20T13:33:56.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.462+0000 7f28d43ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc1f5b20 con 0x7f28cc0d2640 2023-06-20T13:33:56.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.462+0000 7f28d299c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28cc15c460 0x7f28cc15af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:56.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.462+0000 7f28d299c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28cc15c460 0x7f28cc15af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37304/0 (socket says 172.21.15.32:37304) 2023-06-20T13:33:56.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.462+0000 7f28d299c700 1 -- 172.21.15.32:0/3319698683 learned_addr learned my addr 172.21.15.32:0/3319698683 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:56.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.462+0000 7f28d199a700 1 --2- 172.21.15.32:0/3319698683 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28cc0d2640 0x7f28cc148ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:56.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.463+0000 7f28d219b700 1 --2- 172.21.15.32:0/3319698683 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28cc0cf720 0x7f28cc0cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:56.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.463+0000 7f28d299c700 1 -- 172.21.15.32:0/3319698683 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28cc0d2640 msgr2=0x7f28cc148ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:56.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.463+0000 7f28d299c700 1 --2- 172.21.15.32:0/3319698683 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28cc0d2640 0x7f28cc148ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:56.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.463+0000 7f28d299c700 1 -- 172.21.15.32:0/3319698683 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28cc0cf720 msgr2=0x7f28cc0cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:56.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.463+0000 7f28d299c700 1 --2- 172.21.15.32:0/3319698683 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28cc0cf720 0x7f28cc0cafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:56.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.463+0000 7f28d299c700 1 -- 172.21.15.32:0/3319698683 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c8009550 con 0x7f28cc15c460 2023-06-20T13:33:56.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.463+0000 7f28d219b700 1 --2- 172.21.15.32:0/3319698683 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28cc0cf720 0x7f28cc0cafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:56.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.463+0000 7f28d299c700 1 --2- 172.21.15.32:0/3319698683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28cc15c460 0x7f28cc15af60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f28c400cb50 tx=0x7f28c400cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:56.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.463+0000 7f28c2ffd700 1 -- 172.21.15.32:0/3319698683 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4003c00 con 0x7f28cc15c460 2023-06-20T13:33:56.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.463+0000 7f28c2ffd700 1 -- 172.21.15.32:0/3319698683 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c4003d60 con 0x7f28cc15c460 2023-06-20T13:33:56.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.463+0000 7f28c2ffd700 1 -- 172.21.15.32:0/3319698683 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c400ab70 con 0x7f28cc15c460 2023-06-20T13:33:56.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.463+0000 7f28d43ff700 1 -- 172.21.15.32:0/3319698683 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28cc1f5e00 con 0x7f28cc15c460 2023-06-20T13:33:56.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.463+0000 7f28d43ff700 1 -- 172.21.15.32:0/3319698683 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28cc1f63c0 con 0x7f28cc15c460 2023-06-20T13:33:56.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.464+0000 7f28d43ff700 1 -- 172.21.15.32:0/3319698683 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28cc04ea60 con 0x7f28cc15c460 2023-06-20T13:33:56.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.465+0000 7f28c2ffd700 1 -- 172.21.15.32:0/3319698683 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f28c400acd0 con 0x7f28cc15c460 2023-06-20T13:33:56.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.466+0000 7f28c2ffd700 1 --2- 172.21.15.32:0/3319698683 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f28b006ace0 0x7f28b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:56.470 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.466+0000 7f28c2ffd700 1 -- 172.21.15.32:0/3319698683 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f28c4089360 con 0x7f28cc15c460 2023-06-20T13:33:56.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.467+0000 7f28d219b700 1 --2- 172.21.15.32:0/3319698683 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f28b006ace0 0x7f28b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:56.471 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.467+0000 7f28d219b700 1 --2- 172.21.15.32:0/3319698683 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f28b006ace0 0x7f28b006d190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f28c8009130 tx=0x7f28c8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:56.473 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.471+0000 7f28c2ffd700 1 -- 172.21.15.32:0/3319698683 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f28c4054590 con 0x7f28cc15c460 2023-06-20T13:33:56.758 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.756+0000 7f28d43ff700 1 -- 172.21.15.32:0/3319698683 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f28cc0b4fa0 con 0x7f28cc15c460 2023-06-20T13:33:56.758 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.756+0000 7f28c2ffd700 1 -- 172.21.15.32:0/3319698683 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f28c4057bb0 con 0x7f28cc15c460 2023-06-20T13:33:56.759 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:33:56.759 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-06-20T13:33:56.759 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_dump": [ 2023-06-20T13:33:56.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-06-20T13:33:56.759 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.a", 2023-06-20T13:33:56.760 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAfqpFkM16FKRAA8QcmTCS8fBq+3SiK6BU9PA==", 2023-06-20T13:33:56.760 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-06-20T13:33:56.760 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2023-06-20T13:33:56.760 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2023-06-20T13:33:56.760 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2023-06-20T13:33:56.760 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-06-20T13:33:56.760 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-06-20T13:33:56.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:33:56.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-06-20T13:33:56.761 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.b", 2023-06-20T13:33:56.761 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAgqpFkz/uFBRAA/iPte8VV4JP6h8P7ytGK+A==", 2023-06-20T13:33:56.761 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-06-20T13:33:56.761 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2023-06-20T13:33:56.761 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2023-06-20T13:33:56.762 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2023-06-20T13:33:56.762 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-06-20T13:33:56.762 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-06-20T13:33:56.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:33:56.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-06-20T13:33:56.762 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.c", 2023-06-20T13:33:56.762 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAfqpFkCVxyNRAAz1fUAMK+Sue96mAvTt2V5w==", 2023-06-20T13:33:56.763 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-06-20T13:33:56.763 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2023-06-20T13:33:56.763 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2023-06-20T13:33:56.763 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2023-06-20T13:33:56.763 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-06-20T13:33:56.763 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-06-20T13:33:56.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:33:56.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-06-20T13:33:56.764 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mds.d", 2023-06-20T13:33:56.764 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAgqpFkUDsAERAAfLpa27zj64NOo20efZa5ow==", 2023-06-20T13:33:56.764 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-06-20T13:33:56.764 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2023-06-20T13:33:56.764 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2023-06-20T13:33:56.764 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2023-06-20T13:33:56.765 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-06-20T13:33:56.765 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-06-20T13:33:56.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:33:56.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-06-20T13:33:56.765 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.0", 2023-06-20T13:33:56.765 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAiqpFkuXyJFxAA6sxIDdmmSE/1UMenB0ElUg==", 2023-06-20T13:33:56.765 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-06-20T13:33:56.765 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2023-06-20T13:33:56.766 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2023-06-20T13:33:56.766 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-06-20T13:33:56.766 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-06-20T13:33:56.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:33:56.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-06-20T13:33:56.766 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.1", 2023-06-20T13:33:56.766 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAlqpFkZiJBGxAAwMVC0DmyKhjwzOfzb2J4Vw==", 2023-06-20T13:33:56.767 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-06-20T13:33:56.767 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2023-06-20T13:33:56.767 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2023-06-20T13:33:56.767 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-06-20T13:33:56.767 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-06-20T13:33:56.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:33:56.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-06-20T13:33:56.768 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.2", 2023-06-20T13:33:56.768 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAoqpFk0RR5HxAAXx0vVBC6fLD5bGUhhHbXCw==", 2023-06-20T13:33:56.768 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-06-20T13:33:56.768 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2023-06-20T13:33:56.768 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2023-06-20T13:33:56.768 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-06-20T13:33:56.768 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-06-20T13:33:56.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:33:56.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-06-20T13:33:56.769 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.3", 2023-06-20T13:33:56.769 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQArqpFkF3wTIxAAzzrTDc4NfRMWNpU8KjIIiA==", 2023-06-20T13:33:56.769 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-06-20T13:33:56.769 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2023-06-20T13:33:56.769 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2023-06-20T13:33:56.770 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-06-20T13:33:56.770 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-06-20T13:33:56.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:33:56.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-06-20T13:33:56.770 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.4", 2023-06-20T13:33:56.770 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAxqpFkoanvOhAAV0mSlBoQWiw3PSNci4A1Yg==", 2023-06-20T13:33:56.770 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-06-20T13:33:56.770 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2023-06-20T13:33:56.771 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2023-06-20T13:33:56.771 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-06-20T13:33:56.771 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-06-20T13:33:56.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:33:56.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-06-20T13:33:56.771 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.5", 2023-06-20T13:33:56.771 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQA1qpFkrt9VAxAAYcQMhl0UBMpriukyYvDBxg==", 2023-06-20T13:33:56.772 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-06-20T13:33:56.772 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2023-06-20T13:33:56.772 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2023-06-20T13:33:56.772 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-06-20T13:33:56.772 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-06-20T13:33:56.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:33:56.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-06-20T13:33:56.773 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.6", 2023-06-20T13:33:56.773 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQA4qpFkVdOaBhAAoS/lnK+Up+kYuKyXVrMK0w==", 2023-06-20T13:33:56.773 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-06-20T13:33:56.773 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2023-06-20T13:33:56.773 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2023-06-20T13:33:56.773 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-06-20T13:33:56.773 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-06-20T13:33:56.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:33:56.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-06-20T13:33:56.774 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "osd.7", 2023-06-20T13:33:56.774 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQA7qpFk1N4uChAAZYE8l4QoUnpU+TdVEc41GQ==", 2023-06-20T13:33:56.774 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-06-20T13:33:56.774 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow profile osd", 2023-06-20T13:33:56.774 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile osd", 2023-06-20T13:33:56.774 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-06-20T13:33:56.775 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-06-20T13:33:56.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:33:56.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-06-20T13:33:56.775 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.0", 2023-06-20T13:33:56.775 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAgqpFkKA1jGxAA7ykwu3Vv2LeMgJEJ1ebfpA==", 2023-06-20T13:33:56.775 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-06-20T13:33:56.775 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2023-06-20T13:33:56.776 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow r", 2023-06-20T13:33:56.776 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow rw", 2023-06-20T13:33:56.776 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rwx" 2023-06-20T13:33:56.776 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-06-20T13:33:56.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:33:56.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-06-20T13:33:56.776 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.1", 2023-06-20T13:33:56.777 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAgqpFk8ramKhAA9N7jU+F4wIXMxvs54mCzWQ==", 2023-06-20T13:33:56.777 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-06-20T13:33:56.777 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2023-06-20T13:33:56.777 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow r", 2023-06-20T13:33:56.777 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow rw", 2023-06-20T13:33:56.777 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rwx" 2023-06-20T13:33:56.777 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-06-20T13:33:56.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:33:56.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-06-20T13:33:56.778 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.2", 2023-06-20T13:33:56.778 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAgqpFkkmESIxAAr+atYIDDJRTNcxYgiGuI8A==", 2023-06-20T13:33:56.778 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-06-20T13:33:56.778 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2023-06-20T13:33:56.778 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow r", 2023-06-20T13:33:56.779 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow rw", 2023-06-20T13:33:56.779 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rwx" 2023-06-20T13:33:56.779 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-06-20T13:33:56.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:33:56.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-06-20T13:33:56.779 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.3", 2023-06-20T13:33:56.779 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAgqpFkI8QCMhAAv86O0vCMhMADLo03CFH8eQ==", 2023-06-20T13:33:56.780 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-06-20T13:33:56.780 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow", 2023-06-20T13:33:56.780 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow r", 2023-06-20T13:33:56.780 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow rw", 2023-06-20T13:33:56.780 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow rwx" 2023-06-20T13:33:56.780 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-06-20T13:33:56.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:33:56.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-06-20T13:33:56.781 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.admin", 2023-06-20T13:33:56.781 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ==", 2023-06-20T13:33:56.781 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-06-20T13:33:56.781 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow *", 2023-06-20T13:33:56.781 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr": "allow *", 2023-06-20T13:33:56.781 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow *", 2023-06-20T13:33:56.782 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-06-20T13:33:56.782 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-06-20T13:33:56.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:33:56.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-06-20T13:33:56.782 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-mds", 2023-06-20T13:33:56.782 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBHqpFkFg10OhAAB0YuayRHU2rC3IO8MNz8+w==", 2023-06-20T13:33:56.782 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-06-20T13:33:56.782 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-mds" 2023-06-20T13:33:56.783 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-06-20T13:33:56.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:33:56.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-06-20T13:33:56.783 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-mgr", 2023-06-20T13:33:56.783 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBHqpFkXBd0OhAAITLGkAK7nFb00vT5r1JIfg==", 2023-06-20T13:33:56.783 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-06-20T13:33:56.783 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-mgr" 2023-06-20T13:33:56.784 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-06-20T13:33:56.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:33:56.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-06-20T13:33:56.784 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-osd", 2023-06-20T13:33:56.784 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBHqpFkRSB0OhAAplfQhAAhOpUeA05zoOAO6A==", 2023-06-20T13:33:56.784 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-06-20T13:33:56.784 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-osd" 2023-06-20T13:33:56.785 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-06-20T13:33:56.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:33:56.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-06-20T13:33:56.785 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-rbd", 2023-06-20T13:33:56.785 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBHqpFkByp0OhAAxUz2v0YtxCQdRNsG8137RA==", 2023-06-20T13:33:56.785 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-06-20T13:33:56.785 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-rbd" 2023-06-20T13:33:56.786 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-06-20T13:33:56.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:33:56.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-06-20T13:33:56.786 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-06-20T13:33:56.786 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBHqpFkITN0OhAA8Inch9eEKiApr4shNH8g4w==", 2023-06-20T13:33:56.786 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-06-20T13:33:56.786 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-06-20T13:33:56.787 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-06-20T13:33:56.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:33:56.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-06-20T13:33:56.787 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "client.bootstrap-rgw", 2023-06-20T13:33:56.787 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQBHqpFkqzx0OhAAVvZVXjQs4zVqqVgZoHb4gA==", 2023-06-20T13:33:56.787 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-06-20T13:33:56.787 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile bootstrap-rgw" 2023-06-20T13:33:56.787 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-06-20T13:33:56.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:33:56.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-06-20T13:33:56.788 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mgr.x", 2023-06-20T13:33:56.788 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAfqpFkEDGbIRAAztYtbP68oFJEn/+OX19Z9A==", 2023-06-20T13:33:56.788 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-06-20T13:33:56.788 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow *", 2023-06-20T13:33:56.788 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile mgr", 2023-06-20T13:33:56.789 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-06-20T13:33:56.789 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-06-20T13:33:56.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:33:56.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-06-20T13:33:56.789 INFO:teuthology.orchestra.run.smithi032.stdout: "entity": "mgr.y", 2023-06-20T13:33:56.789 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "AQAfqpFk32kwGRAANc0nhK56zfZ74dA5eOJGYQ==", 2023-06-20T13:33:56.790 INFO:teuthology.orchestra.run.smithi032.stdout: "caps": { 2023-06-20T13:33:56.790 INFO:teuthology.orchestra.run.smithi032.stdout: "mds": "allow *", 2023-06-20T13:33:56.790 INFO:teuthology.orchestra.run.smithi032.stdout: "mon": "allow profile mgr", 2023-06-20T13:33:56.790 INFO:teuthology.orchestra.run.smithi032.stdout: "osd": "allow *" 2023-06-20T13:33:56.790 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-06-20T13:33:56.791 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-06-20T13:33:56.791 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2023-06-20T13:33:56.791 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-06-20T13:33:56.792 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.758+0000 7f28d43ff700 1 -- 172.21.15.32:0/3319698683 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f28b006ace0 msgr2=0x7f28b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:56.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.758+0000 7f28d43ff700 1 --2- 172.21.15.32:0/3319698683 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f28b006ace0 0x7f28b006d190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f28c8009130 tx=0x7f28c8008030 comp rx=0 tx=0).stop 2023-06-20T13:33:56.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.758+0000 7f28d43ff700 1 -- 172.21.15.32:0/3319698683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28cc15c460 msgr2=0x7f28cc15af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:56.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.758+0000 7f28d43ff700 1 --2- 172.21.15.32:0/3319698683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28cc15c460 0x7f28cc15af60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f28c400cb50 tx=0x7f28c400cf10 comp rx=0 tx=0).stop 2023-06-20T13:33:56.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.759+0000 7f28d43ff700 1 -- 172.21.15.32:0/3319698683 shutdown_connections 2023-06-20T13:33:56.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.759+0000 7f28d43ff700 1 --2- 172.21.15.32:0/3319698683 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f28b006ace0 0x7f28b006d190 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:56.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.759+0000 7f28d43ff700 1 --2- 172.21.15.32:0/3319698683 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f28cc15c460 0x7f28cc15af60 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:56.793 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.759+0000 7f28d43ff700 1 --2- 172.21.15.32:0/3319698683 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f28cc0cf720 0x7f28cc0cafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:56.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.759+0000 7f28d43ff700 1 --2- 172.21.15.32:0/3319698683 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f28cc0d2640 0x7f28cc148ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:56.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.759+0000 7f28d43ff700 1 -- 172.21.15.32:0/3319698683 >> 172.21.15.32:0/3319698683 conn(0x7f28cc071660 msgr2=0x7f28cc15c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:56.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.759+0000 7f28d43ff700 1 -- 172.21.15.32:0/3319698683 shutdown_connections 2023-06-20T13:33:56.794 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.759+0000 7f28d43ff700 1 -- 172.21.15.32:0/3319698683 wait complete. 2023-06-20T13:33:56.794 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-06-20T13:33:56.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.995+0000 7ff3bcdff700 1 Processor -- start 2023-06-20T13:33:56.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.995+0000 7ff3bcdff700 1 -- start start 2023-06-20T13:33:56.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.997+0000 7ff3bcdff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3b80cd7d0 0x7ff3b80cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:56.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.997+0000 7ff3bcdff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff3b80cb4f0 0x7ff3b81595d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:56.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.997+0000 7ff3bcdff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b80cbc00 con 0x7ff3b8156be0 2023-06-20T13:33:56.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.997+0000 7ff3bcdff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b8156fb0 con 0x7ff3b80cb4f0 2023-06-20T13:33:56.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.997+0000 7ff3bcdff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b815da40 con 0x7ff3b80cd7d0 2023-06-20T13:33:57.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.997+0000 7ff3b659c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ff3b8156be0 0x7ff3b80cd0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43974/0 (socket says 172.21.15.32:43974) 2023-06-20T13:33:57.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.997+0000 7ff3b659c700 1 -- 172.21.15.32:0/1577032251 learned_addr learned my addr 172.21.15.32:0/1577032251 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:57.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.997+0000 7ff3b6d9d700 1 --2- 172.21.15.32:0/1577032251 >> v2:172.21.15.115:3300/0 conn(0x7ff3b80cb4f0 0x7ff3b81595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:57.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.997+0000 7ff3b5d9b700 1 -- 172.21.15.32:0/1577032251 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2430343546 0 0) 0x7ff3b80cbc00 con 0x7ff3b8156be0 2023-06-20T13:33:57.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.997+0000 7ff3affff700 1 --2- 172.21.15.32:0/1577032251 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3b80cd7d0 0x7ff3b80cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:57.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.997+0000 7ff3b5d9b700 1 -- 172.21.15.32:0/1577032251 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3a40035b0 con 0x7ff3b8156be0 2023-06-20T13:33:57.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.998+0000 7ff3b5d9b700 1 -- 172.21.15.32:0/1577032251 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2639841995 0 0) 0x7ff3a40035b0 con 0x7ff3b8156be0 2023-06-20T13:33:57.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.998+0000 7ff3b5d9b700 1 -- 172.21.15.32:0/1577032251 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3b80cd7d0 msgr2=0x7ff3b80cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:57.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.998+0000 7ff3b5d9b700 1 --2- 172.21.15.32:0/1577032251 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3b80cd7d0 0x7ff3b80cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:57.002 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.998+0000 7ff3b5d9b700 1 -- 172.21.15.32:0/1577032251 >> v2:172.21.15.115:3300/0 conn(0x7ff3b80cb4f0 msgr2=0x7ff3b81595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:57.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.998+0000 7ff3b5d9b700 1 --2- 172.21.15.32:0/1577032251 >> v2:172.21.15.115:3300/0 conn(0x7ff3b80cb4f0 0x7ff3b81595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:57.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.998+0000 7ff3b5d9b700 1 -- 172.21.15.32:0/1577032251 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b80cb990 con 0x7ff3b8156be0 2023-06-20T13:33:57.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.998+0000 7ff3b5d9b700 1 -- 172.21.15.32:0/1577032251 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3380058562 0 0) 0x7ff3a8001670 con 0x7ff3b8156be0 2023-06-20T13:33:57.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.998+0000 7ff3b5d9b700 1 -- 172.21.15.32:0/1577032251 >> v1:172.21.15.32:6789/0 conn(0x7ff3b8156be0 legacy=0x7ff3b80cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:57.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.998+0000 7ff3b5d9b700 1 --2- 172.21.15.32:0/1577032251 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3a4003a30 0x7ff3a4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:57.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.998+0000 7ff3b5d9b700 1 --2- 172.21.15.32:0/1577032251 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3b80cd7d0 0x7ff3a4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:57.003 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.998+0000 7ff3b5d9b700 1 --2- 172.21.15.32:0/1577032251 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3a4004d90 0x7ff3a4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:57.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.998+0000 7ff3b5d9b700 1 -- 172.21.15.32:0/1577032251 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b8156fb0 con 0x7ff3a4004d90 2023-06-20T13:33:57.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.998+0000 7ff3b5d9b700 1 -- 172.21.15.32:0/1577032251 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b815da40 con 0x7ff3a4003a30 2023-06-20T13:33:57.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.998+0000 7ff3b5d9b700 1 -- 172.21.15.32:0/1577032251 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a400dc20 con 0x7ff3b80cd7d0 2023-06-20T13:33:57.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.998+0000 7ff3b6d9d700 1 --2- 172.21.15.32:0/1577032251 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3a4004d90 0x7ff3a4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:57.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.998+0000 7ff3b659c700 1 --2- 172.21.15.32:0/1577032251 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3a4003a30 0x7ff3a4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:57.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.998+0000 7ff3affff700 1 --2- 172.21.15.32:0/1577032251 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3b80cd7d0 0x7ff3a4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:57.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.999+0000 7ff3b6d9d700 1 -- 172.21.15.32:0/1577032251 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3b80cd7d0 msgr2=0x7ff3a4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:57.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.999+0000 7ff3b6d9d700 1 --2- 172.21.15.32:0/1577032251 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3b80cd7d0 0x7ff3a4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:57.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.999+0000 7ff3b6d9d700 1 -- 172.21.15.32:0/1577032251 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3a4003a30 msgr2=0x7ff3a4003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:57.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.999+0000 7ff3b6d9d700 1 --2- 172.21.15.32:0/1577032251 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3a4003a30 0x7ff3a4003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:57.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.999+0000 7ff3b6d9d700 1 -- 172.21.15.32:0/1577032251 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a40035b0 con 0x7ff3a4004d90 2023-06-20T13:33:57.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.999+0000 7ff3b6d9d700 1 --2- 172.21.15.32:0/1577032251 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3a4004d90 0x7ff3a4005200 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0009fc0 tx=0x7ff3a4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81911c32b5624e8b server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:57.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.999+0000 7ff3b5d9b700 1 -- 172.21.15.32:0/1577032251 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b000ec30 con 0x7ff3a4004d90 2023-06-20T13:33:57.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.999+0000 7ff3b5d9b700 1 -- 172.21.15.32:0/1577032251 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b000f040 con 0x7ff3a4004d90 2023-06-20T13:33:57.005 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:56.999+0000 7ff3b5d9b700 1 -- 172.21.15.32:0/1577032251 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b0014480 con 0x7ff3a4004d90 2023-06-20T13:33:57.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.000+0000 7ff3bcdff700 1 -- 172.21.15.32:0/1577032251 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3a4004d90 msgr2=0x7ff3a4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:57.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.000+0000 7ff3bcdff700 1 --2- 172.21.15.32:0/1577032251 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3a4004d90 0x7ff3a4005200 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0009fc0 tx=0x7ff3a4005880 comp rx=0 tx=0).stop 2023-06-20T13:33:57.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.000+0000 7ff3b6d9d700 1 -- 172.21.15.32:0/1577032251 reap_dead start 2023-06-20T13:33:57.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.000+0000 7ff3bcdff700 1 -- 172.21.15.32:0/1577032251 shutdown_connections 2023-06-20T13:33:57.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.000+0000 7ff3bcdff700 1 -- 172.21.15.32:0/1577032251 >> 172.21.15.32:0/1577032251 conn(0x7ff3b80b0390 msgr2=0x7ff3b80b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:57.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.000+0000 7ff3bcdff700 1 -- 172.21.15.32:0/1577032251 shutdown_connections 2023-06-20T13:33:57.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.000+0000 7ff3bcdff700 1 -- 172.21.15.32:0/1577032251 wait complete. 2023-06-20T13:33:57.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.002+0000 7ff3bcdff700 1 Processor -- start 2023-06-20T13:33:57.008 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.002+0000 7ff3bcdff700 1 -- start start 2023-06-20T13:33:57.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.003+0000 7ff3bcdff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3a4004d90 0x7ff3b81e32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:57.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.003+0000 7ff3bcdff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3b80b26d0 0x7ff3b80c4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:57.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.003+0000 7ff3bcdff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3b8070240 0x7ff3b80706e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:57.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.003+0000 7ff3bcdff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b8070c20 con 0x7ff3b8070240 2023-06-20T13:33:57.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.003+0000 7ff3bcdff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b8151000 con 0x7ff3b80b26d0 2023-06-20T13:33:57.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.003+0000 7ff3bcdff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b80b2bb0 con 0x7ff3a4004d90 2023-06-20T13:33:57.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.004+0000 7ff3b6d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3b8070240 0x7ff3b80706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:57.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.004+0000 7ff3b6d9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3b8070240 0x7ff3b80706e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37328/0 (socket says 172.21.15.32:37328) 2023-06-20T13:33:57.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.004+0000 7ff3b659c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3a4004d90 0x7ff3b81e32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:57.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.004+0000 7ff3b6d9d700 1 -- 172.21.15.32:0/3425626364 learned_addr learned my addr 172.21.15.32:0/3425626364 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:57.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.004+0000 7ff3affff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3b80b26d0 0x7ff3b80c4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:57.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.004+0000 7ff3b6d9d700 1 -- 172.21.15.32:0/3425626364 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3a4004d90 msgr2=0x7ff3b81e32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:57.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.004+0000 7ff3b6d9d700 1 --2- 172.21.15.32:0/3425626364 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3a4004d90 0x7ff3b81e32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:57.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.004+0000 7ff3b6d9d700 1 -- 172.21.15.32:0/3425626364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3b80b26d0 msgr2=0x7ff3b80c4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:57.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.004+0000 7ff3b6d9d700 1 --2- 172.21.15.32:0/3425626364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3b80b26d0 0x7ff3b80c4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:57.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.004+0000 7ff3b6d9d700 1 -- 172.21.15.32:0/3425626364 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b80b2e90 con 0x7ff3b8070240 2023-06-20T13:33:57.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.004+0000 7ff3b6d9d700 1 --2- 172.21.15.32:0/3425626364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3b8070240 0x7ff3b80706e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff3b000b010 tx=0x7ff3b0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:57.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.005+0000 7ff3aeffd700 1 -- 172.21.15.32:0/3425626364 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b0007000 con 0x7ff3b8070240 2023-06-20T13:33:57.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.005+0000 7ff3aeffd700 1 -- 172.21.15.32:0/3425626364 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b0014d20 con 0x7ff3b8070240 2023-06-20T13:33:57.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.005+0000 7ff3aeffd700 1 -- 172.21.15.32:0/3425626364 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b00266b0 con 0x7ff3b8070240 2023-06-20T13:33:57.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.005+0000 7ff3bcdff700 1 -- 172.21.15.32:0/3425626364 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b80b3170 con 0x7ff3b8070240 2023-06-20T13:33:57.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.005+0000 7ff3bcdff700 1 -- 172.21.15.32:0/3425626364 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b80b3730 con 0x7ff3b8070240 2023-06-20T13:33:57.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.006+0000 7ff3bcdff700 1 -- 172.21.15.32:0/3425626364 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b80b3920 con 0x7ff3b8070240 2023-06-20T13:33:57.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.007+0000 7ff3aeffd700 1 -- 172.21.15.32:0/3425626364 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff3b0023070 con 0x7ff3b8070240 2023-06-20T13:33:57.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.008+0000 7ff3aeffd700 1 --2- 172.21.15.32:0/3425626364 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff39806ace0 0x7ff39806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:57.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.008+0000 7ff3aeffd700 1 -- 172.21.15.32:0/3425626364 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ff3b008a460 con 0x7ff3b8070240 2023-06-20T13:33:57.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.008+0000 7ff3b659c700 1 --2- 172.21.15.32:0/3425626364 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff39806ace0 0x7ff39806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:57.013 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.009+0000 7ff3b659c700 1 --2- 172.21.15.32:0/3425626364 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff39806ace0 0x7ff39806d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff3b81f10a0 tx=0x7ff3a8001c00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:57.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.012+0000 7ff3aeffd700 1 -- 172.21.15.32:0/3425626364 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff3b00557d0 con 0x7ff3b8070240 2023-06-20T13:33:57.305 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.303+0000 7ff3bcdff700 1 -- 172.21.15.32:0/3425626364 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7ff3b804ea60 con 0x7ff3b8070240 2023-06-20T13:33:57.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.307+0000 7ff3aeffd700 1 -- 172.21.15.32:0/3425626364 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff3b0058df0 con 0x7ff3b8070240 2023-06-20T13:33:57.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.309+0000 7ff3bcdff700 1 -- 172.21.15.32:0/3425626364 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff39806ace0 msgr2=0x7ff39806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:57.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.309+0000 7ff3bcdff700 1 --2- 172.21.15.32:0/3425626364 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff39806ace0 0x7ff39806d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff3b81f10a0 tx=0x7ff3a8001c00 comp rx=0 tx=0).stop 2023-06-20T13:33:57.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.309+0000 7ff3bcdff700 1 -- 172.21.15.32:0/3425626364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3b8070240 msgr2=0x7ff3b80706e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:57.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.309+0000 7ff3bcdff700 1 --2- 172.21.15.32:0/3425626364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3b8070240 0x7ff3b80706e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff3b000b010 tx=0x7ff3b0009750 comp rx=0 tx=0).stop 2023-06-20T13:33:57.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.309+0000 7ff3bcdff700 1 -- 172.21.15.32:0/3425626364 shutdown_connections 2023-06-20T13:33:57.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.309+0000 7ff3bcdff700 1 --2- 172.21.15.32:0/3425626364 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff39806ace0 0x7ff39806d190 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:57.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.309+0000 7ff3bcdff700 1 --2- 172.21.15.32:0/3425626364 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff3b8070240 0x7ff3b80706e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:57.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.309+0000 7ff3bcdff700 1 --2- 172.21.15.32:0/3425626364 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3a4004d90 0x7ff3b81e32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:57.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.309+0000 7ff3bcdff700 1 --2- 172.21.15.32:0/3425626364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3b80b26d0 0x7ff3b80c4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:57.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.309+0000 7ff3bcdff700 1 -- 172.21.15.32:0/3425626364 >> 172.21.15.32:0/3425626364 conn(0x7ff3b80b0390 msgr2=0x7ff3b806c340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:57.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.310+0000 7ff3bcdff700 1 -- 172.21.15.32:0/3425626364 shutdown_connections 2023-06-20T13:33:57.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.310+0000 7ff3bcdff700 1 -- 172.21.15.32:0/3425626364 wait complete. 2023-06-20T13:33:57.330 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-06-20T13:33:57.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.529+0000 7fd6095ff700 1 Processor -- start 2023-06-20T13:33:57.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.529+0000 7fd6095ff700 1 -- start start 2023-06-20T13:33:57.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.530+0000 7fd6095ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd60415c460 0x7fd6040b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:57.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.530+0000 7fd6095ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6040cf8f0 0x7fd60415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:57.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.530+0000 7fd6095ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6040d1790 con 0x7fd6040d2640 2023-06-20T13:33:57.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.530+0000 7fd6095ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6040cedd0 con 0x7fd60415c460 2023-06-20T13:33:57.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.530+0000 7fd6095ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6040cd950 con 0x7fd6040cf8f0 2023-06-20T13:33:57.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.530+0000 7fd602ffd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fd60415c460 0x7fd6040b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:57.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.530+0000 7fd6027fc700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fd6040d2640 0x7fd6040cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43982/0 (socket says 172.21.15.32:43982) 2023-06-20T13:33:57.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.530+0000 7fd6027fc700 1 -- 172.21.15.32:0/2868925591 learned_addr learned my addr 172.21.15.32:0/2868925591 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:57.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.531+0000 7fd6037fe700 1 --2- 172.21.15.32:0/2868925591 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6040cf8f0 0x7fd60415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:57.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.531+0000 7fd602ffd700 1 -- 172.21.15.32:0/2868925591 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6040cf8f0 msgr2=0x7fd60415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:57.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.531+0000 7fd602ffd700 1 --2- 172.21.15.32:0/2868925591 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6040cf8f0 0x7fd60415fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:57.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.531+0000 7fd602ffd700 1 -- 172.21.15.32:0/2868925591 >> v1:172.21.15.32:6789/0 conn(0x7fd6040d2640 legacy=0x7fd6040cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:57.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.531+0000 7fd602ffd700 1 -- 172.21.15.32:0/2868925591 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6040d14b0 con 0x7fd60415c460 2023-06-20T13:33:57.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.531+0000 7fd602ffd700 1 --2- 172.21.15.32:0/2868925591 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd60415c460 0x7fd6040b59d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4009840 tx=0x7fd5f4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd2a44548f46304 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:57.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.531+0000 7fd601ffb700 1 -- 172.21.15.32:0/2868925591 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4011830 con 0x7fd60415c460 2023-06-20T13:33:57.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.531+0000 7fd601ffb700 1 -- 172.21.15.32:0/2868925591 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f4011990 con 0x7fd60415c460 2023-06-20T13:33:57.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.531+0000 7fd601ffb700 1 -- 172.21.15.32:0/2868925591 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4011d20 con 0x7fd60415c460 2023-06-20T13:33:57.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.532+0000 7fd6095ff700 1 -- 172.21.15.32:0/2868925591 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd60415c460 msgr2=0x7fd6040b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:57.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.532+0000 7fd6095ff700 1 --2- 172.21.15.32:0/2868925591 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd60415c460 0x7fd6040b59d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4009840 tx=0x7fd5f4009b50 comp rx=0 tx=0).stop 2023-06-20T13:33:57.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.532+0000 7fd6095ff700 1 -- 172.21.15.32:0/2868925591 shutdown_connections 2023-06-20T13:33:57.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.532+0000 7fd6095ff700 1 --2- 172.21.15.32:0/2868925591 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6040cf8f0 0x7fd60415fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:57.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.532+0000 7fd6095ff700 1 --2- 172.21.15.32:0/2868925591 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd60415c460 0x7fd6040b59d0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:57.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.532+0000 7fd6095ff700 1 -- 172.21.15.32:0/2868925591 >> 172.21.15.32:0/2868925591 conn(0x7fd604071660 msgr2=0x7fd604071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:57.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.532+0000 7fd6095ff700 1 -- 172.21.15.32:0/2868925591 shutdown_connections 2023-06-20T13:33:57.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.532+0000 7fd6095ff700 1 -- 172.21.15.32:0/2868925591 wait complete. 2023-06-20T13:33:57.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.534+0000 7fd6095ff700 1 Processor -- start 2023-06-20T13:33:57.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.534+0000 7fd6095ff700 1 -- start start 2023-06-20T13:33:57.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.535+0000 7fd6095ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6040cf8f0 0x7fd6041f2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:57.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.535+0000 7fd6095ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6040d2640 0x7fd604143970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:57.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.535+0000 7fd6095ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd60415c460 0x7fd6040cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:57.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.535+0000 7fd6095ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6040c5db0 con 0x7fd60415c460 2023-06-20T13:33:57.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.535+0000 7fd6095ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6041539d0 con 0x7fd6040d2640 2023-06-20T13:33:57.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.535+0000 7fd6095ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd604154830 con 0x7fd6040cf8f0 2023-06-20T13:33:57.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.535+0000 7fd6037fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd60415c460 0x7fd6040cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:57.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.535+0000 7fd6037fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd60415c460 0x7fd6040cc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37346/0 (socket says 172.21.15.32:37346) 2023-06-20T13:33:57.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.535+0000 7fd6037fe700 1 -- 172.21.15.32:0/2592122908 learned_addr learned my addr 172.21.15.32:0/2592122908 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:57.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.535+0000 7fd602ffd700 1 --2- 172.21.15.32:0/2592122908 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6040cf8f0 0x7fd6041f2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:57.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.535+0000 7fd6027fc700 1 --2- 172.21.15.32:0/2592122908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6040d2640 0x7fd604143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:57.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.536+0000 7fd6037fe700 1 -- 172.21.15.32:0/2592122908 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6040cf8f0 msgr2=0x7fd6041f2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:57.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.536+0000 7fd6037fe700 1 --2- 172.21.15.32:0/2592122908 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6040cf8f0 0x7fd6041f2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:57.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.536+0000 7fd6037fe700 1 -- 172.21.15.32:0/2592122908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6040d2640 msgr2=0x7fd604143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:57.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.536+0000 7fd6037fe700 1 --2- 172.21.15.32:0/2592122908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6040d2640 0x7fd604143970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:57.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.536+0000 7fd6037fe700 1 -- 172.21.15.32:0/2592122908 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f40094a0 con 0x7fd60415c460 2023-06-20T13:33:57.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.536+0000 7fd6027fc700 1 --2- 172.21.15.32:0/2592122908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6040d2640 0x7fd604143970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:57.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.536+0000 7fd6037fe700 1 --2- 172.21.15.32:0/2592122908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd60415c460 0x7fd6040cc3c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc007e60 tx=0x7fd5fc00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:57.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.536+0000 7fd5eb7fe700 1 -- 172.21.15.32:0/2592122908 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc00ede0 con 0x7fd60415c460 2023-06-20T13:33:57.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.536+0000 7fd5eb7fe700 1 -- 172.21.15.32:0/2592122908 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5fc014420 con 0x7fd60415c460 2023-06-20T13:33:57.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.536+0000 7fd5eb7fe700 1 -- 172.21.15.32:0/2592122908 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc0147d0 con 0x7fd60415c460 2023-06-20T13:33:57.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.536+0000 7fd6095ff700 1 -- 172.21.15.32:0/2592122908 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd604153c20 con 0x7fd60415c460 2023-06-20T13:33:57.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.536+0000 7fd6095ff700 1 -- 172.21.15.32:0/2592122908 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6041541e0 con 0x7fd60415c460 2023-06-20T13:33:57.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.537+0000 7fd6095ff700 1 -- 172.21.15.32:0/2592122908 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd60404ea60 con 0x7fd60415c460 2023-06-20T13:33:57.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.538+0000 7fd5eb7fe700 1 -- 172.21.15.32:0/2592122908 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd5fc014930 con 0x7fd60415c460 2023-06-20T13:33:57.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.539+0000 7fd5eb7fe700 1 --2- 172.21.15.32:0/2592122908 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd5f006ace0 0x7fd5f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:57.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.539+0000 7fd5eb7fe700 1 -- 172.21.15.32:0/2592122908 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd5fc089970 con 0x7fd60415c460 2023-06-20T13:33:57.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.540+0000 7fd602ffd700 1 --2- 172.21.15.32:0/2592122908 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd5f006ace0 0x7fd5f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:57.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.540+0000 7fd602ffd700 1 --2- 172.21.15.32:0/2592122908 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd5f006ace0 0x7fd5f006d190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd5f40090b0 tx=0x7fd5f4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:57.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.544+0000 7fd5eb7fe700 1 -- 172.21.15.32:0/2592122908 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd5fc054cd0 con 0x7fd60415c460 2023-06-20T13:33:57.833 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.831+0000 7fd6095ff700 1 -- 172.21.15.32:0/2592122908 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fd604154970 con 0x7fd60415c460 2023-06-20T13:33:57.837 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.835+0000 7fd5eb7fe700 1 -- 172.21.15.32:0/2592122908 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd5fc0582f0 con 0x7fd60415c460 2023-06-20T13:33:57.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.837+0000 7fd6095ff700 1 -- 172.21.15.32:0/2592122908 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd5f006ace0 msgr2=0x7fd5f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:57.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.837+0000 7fd6095ff700 1 --2- 172.21.15.32:0/2592122908 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd5f006ace0 0x7fd5f006d190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd5f40090b0 tx=0x7fd5f4008030 comp rx=0 tx=0).stop 2023-06-20T13:33:57.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.837+0000 7fd6095ff700 1 -- 172.21.15.32:0/2592122908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd60415c460 msgr2=0x7fd6040cc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:57.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.837+0000 7fd6095ff700 1 --2- 172.21.15.32:0/2592122908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd60415c460 0x7fd6040cc3c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc007e60 tx=0x7fd5fc00e3c0 comp rx=0 tx=0).stop 2023-06-20T13:33:57.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.837+0000 7fd6095ff700 1 -- 172.21.15.32:0/2592122908 shutdown_connections 2023-06-20T13:33:57.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.837+0000 7fd6095ff700 1 --2- 172.21.15.32:0/2592122908 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fd5f006ace0 0x7fd5f006d190 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:57.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.837+0000 7fd6095ff700 1 --2- 172.21.15.32:0/2592122908 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fd60415c460 0x7fd6040cc3c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:57.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.837+0000 7fd6095ff700 1 --2- 172.21.15.32:0/2592122908 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd6040cf8f0 0x7fd6041f2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:57.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.837+0000 7fd6095ff700 1 --2- 172.21.15.32:0/2592122908 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd6040d2640 0x7fd604143970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:57.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.837+0000 7fd6095ff700 1 -- 172.21.15.32:0/2592122908 >> 172.21.15.32:0/2592122908 conn(0x7fd604071660 msgr2=0x7fd60415ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:57.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.837+0000 7fd6095ff700 1 -- 172.21.15.32:0/2592122908 shutdown_connections 2023-06-20T13:33:57.841 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:57.837+0000 7fd6095ff700 1 -- 172.21.15.32:0/2592122908 wait complete. 2023-06-20T13:33:57.858 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-06-20T13:33:58.060 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.058+0000 7fef2a5ff700 1 Processor -- start 2023-06-20T13:33:58.061 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.058+0000 7fef2a5ff700 1 -- start start 2023-06-20T13:33:58.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.059+0000 7fef2a5ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fef2415c460 0x7fef240b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:58.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.059+0000 7fef2a5ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef240d2640 0x7fef240cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:58.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.059+0000 7fef2a5ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fef240cf720 0x7fef240cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:58.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.059+0000 7fef2a5ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef240cedd0 con 0x7fef240cf720 2023-06-20T13:33:58.062 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.059+0000 7fef2a5ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef240d1790 con 0x7fef2415c460 2023-06-20T13:33:58.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.059+0000 7fef2a5ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef240cd950 con 0x7fef240d2640 2023-06-20T13:33:58.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.060+0000 7fef28b9c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fef240cf720 0x7fef240cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:58.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.060+0000 7fef28b9c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fef240cf720 0x7fef240cfbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37360/0 (socket says 172.21.15.32:37360) 2023-06-20T13:33:58.063 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.060+0000 7fef28b9c700 1 -- 172.21.15.32:0/4042503654 learned_addr learned my addr 172.21.15.32:0/4042503654 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:58.064 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.060+0000 7fef237fe700 1 --2- 172.21.15.32:0/4042503654 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef240d2640 0x7fef240cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:58.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.060+0000 7fef28b9c700 1 -- 172.21.15.32:0/4042503654 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef240d2640 msgr2=0x7fef240cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:58.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.060+0000 7fef23fff700 1 --2- 172.21.15.32:0/4042503654 >> v2:172.21.15.115:3300/0 conn(0x7fef2415c460 0x7fef240b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:58.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.060+0000 7fef28b9c700 1 --2- 172.21.15.32:0/4042503654 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef240d2640 0x7fef240cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:58.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.060+0000 7fef28b9c700 1 -- 172.21.15.32:0/4042503654 >> v2:172.21.15.115:3300/0 conn(0x7fef2415c460 msgr2=0x7fef240b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:58.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.060+0000 7fef28b9c700 1 --2- 172.21.15.32:0/4042503654 >> v2:172.21.15.115:3300/0 conn(0x7fef2415c460 0x7fef240b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:58.065 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.060+0000 7fef28b9c700 1 -- 172.21.15.32:0/4042503654 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef240d14b0 con 0x7fef240cf720 2023-06-20T13:33:58.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.060+0000 7fef237fe700 1 --2- 172.21.15.32:0/4042503654 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef240d2640 0x7fef240cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:58.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.060+0000 7fef23fff700 1 --2- 172.21.15.32:0/4042503654 >> v2:172.21.15.115:3300/0 conn(0x7fef2415c460 0x7fef240b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:58.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.061+0000 7fef28b9c700 1 --2- 172.21.15.32:0/4042503654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef240cf720 0x7fef240cfbc0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fef240b4f00 tx=0x7fef1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11fbee891de6b83 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:58.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.061+0000 7fef22ffd700 1 -- 172.21.15.32:0/4042503654 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c00e070 con 0x7fef240cf720 2023-06-20T13:33:58.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.061+0000 7fef22ffd700 1 -- 172.21.15.32:0/4042503654 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1c00b9c0 con 0x7fef240cf720 2023-06-20T13:33:58.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.061+0000 7fef22ffd700 1 -- 172.21.15.32:0/4042503654 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c00bd70 con 0x7fef240cf720 2023-06-20T13:33:58.066 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.061+0000 7fef2a5ff700 1 -- 172.21.15.32:0/4042503654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef240cf720 msgr2=0x7fef240cfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:58.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.061+0000 7fef2a5ff700 1 --2- 172.21.15.32:0/4042503654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef240cf720 0x7fef240cfbc0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fef240b4f00 tx=0x7fef1c00b330 comp rx=0 tx=0).stop 2023-06-20T13:33:58.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.061+0000 7fef2a5ff700 1 -- 172.21.15.32:0/4042503654 shutdown_connections 2023-06-20T13:33:58.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.061+0000 7fef2a5ff700 1 --2- 172.21.15.32:0/4042503654 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef240cf720 0x7fef240cfbc0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:58.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.061+0000 7fef2a5ff700 1 --2- 172.21.15.32:0/4042503654 >> v2:172.21.15.115:3300/0 conn(0x7fef2415c460 0x7fef240b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:58.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.061+0000 7fef2a5ff700 1 --2- 172.21.15.32:0/4042503654 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef240d2640 0x7fef240cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:58.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.061+0000 7fef2a5ff700 1 -- 172.21.15.32:0/4042503654 >> 172.21.15.32:0/4042503654 conn(0x7fef24071660 msgr2=0x7fef24071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:58.067 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.061+0000 7fef2a5ff700 1 -- 172.21.15.32:0/4042503654 shutdown_connections 2023-06-20T13:33:58.068 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.062+0000 7fef2a5ff700 1 -- 172.21.15.32:0/4042503654 wait complete. 2023-06-20T13:33:58.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.063+0000 7fef2a5ff700 1 Processor -- start 2023-06-20T13:33:58.069 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.063+0000 7fef2a5ff700 1 -- start start 2023-06-20T13:33:58.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.064+0000 7fef2a5ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef240cf720 0x7fef240c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:58.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.064+0000 7fef2a5ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef240d2640 0x7fef24157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:58.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.064+0000 7fef2a5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef2415c460 0x7fef241580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:58.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.064+0000 7fef2a5ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef24159de0 con 0x7fef240d2640 2023-06-20T13:33:58.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.064+0000 7fef2a5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef24158610 con 0x7fef2415c460 2023-06-20T13:33:58.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.065+0000 7fef2a5ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef240cabf0 con 0x7fef240cf720 2023-06-20T13:33:58.070 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.065+0000 7fef237fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef240d2640 0x7fef24157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:58.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.065+0000 7fef237fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef240d2640 0x7fef24157b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37372/0 (socket says 172.21.15.32:37372) 2023-06-20T13:33:58.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.065+0000 7fef237fe700 1 -- 172.21.15.32:0/2003275480 learned_addr learned my addr 172.21.15.32:0/2003275480 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:58.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.065+0000 7fef237fe700 1 -- 172.21.15.32:0/2003275480 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef240cf720 msgr2=0x7fef240c8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:58.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.065+0000 7fef23fff700 1 --2- 172.21.15.32:0/2003275480 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef240cf720 0x7fef240c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:58.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.065+0000 7fef28b9c700 1 --2- 172.21.15.32:0/2003275480 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef2415c460 0x7fef241580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:58.071 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.065+0000 7fef237fe700 1 --2- 172.21.15.32:0/2003275480 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef240cf720 0x7fef240c8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:58.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.065+0000 7fef237fe700 1 -- 172.21.15.32:0/2003275480 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef2415c460 msgr2=0x7fef241580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:58.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.065+0000 7fef237fe700 1 --2- 172.21.15.32:0/2003275480 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef2415c460 0x7fef241580d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:58.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.065+0000 7fef237fe700 1 -- 172.21.15.32:0/2003275480 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c009b30 con 0x7fef240d2640 2023-06-20T13:33:58.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.065+0000 7fef28b9c700 1 --2- 172.21.15.32:0/2003275480 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef2415c460 0x7fef241580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:58.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.065+0000 7fef23fff700 1 --2- 172.21.15.32:0/2003275480 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef240cf720 0x7fef240c8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:33:58.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.065+0000 7fef237fe700 1 --2- 172.21.15.32:0/2003275480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef240d2640 0x7fef24157b90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fef1800c7f0 tx=0x7fef1800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:58.072 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.066+0000 7fef20ff9700 1 -- 172.21.15.32:0/2003275480 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef18011800 con 0x7fef240d2640 2023-06-20T13:33:58.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.066+0000 7fef20ff9700 1 -- 172.21.15.32:0/2003275480 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef18011960 con 0x7fef240d2640 2023-06-20T13:33:58.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.066+0000 7fef2a5ff700 1 -- 172.21.15.32:0/2003275480 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef24159440 con 0x7fef240d2640 2023-06-20T13:33:58.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.066+0000 7fef20ff9700 1 -- 172.21.15.32:0/2003275480 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef18011d10 con 0x7fef240d2640 2023-06-20T13:33:58.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.066+0000 7fef2a5ff700 1 -- 172.21.15.32:0/2003275480 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef24159a00 con 0x7fef240d2640 2023-06-20T13:33:58.073 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.067+0000 7fef2a5ff700 1 -- 172.21.15.32:0/2003275480 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef24159f20 con 0x7fef240d2640 2023-06-20T13:33:58.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.068+0000 7fef20ff9700 1 -- 172.21.15.32:0/2003275480 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fef18018360 con 0x7fef240d2640 2023-06-20T13:33:58.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.068+0000 7fef20ff9700 1 --2- 172.21.15.32:0/2003275480 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fef1006ace0 0x7fef1006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:58.074 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.069+0000 7fef20ff9700 1 -- 172.21.15.32:0/2003275480 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fef18089330 con 0x7fef240d2640 2023-06-20T13:33:58.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.069+0000 7fef23fff700 1 --2- 172.21.15.32:0/2003275480 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fef1006ace0 0x7fef1006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:58.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.069+0000 7fef23fff700 1 --2- 172.21.15.32:0/2003275480 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fef1006ace0 0x7fef1006d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fef14008910 tx=0x7fef14008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:58.075 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.073+0000 7fef20ff9700 1 -- 172.21.15.32:0/2003275480 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fef24159f20 con 0x7fef240d2640 2023-06-20T13:33:58.374 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.372+0000 7fef2a5ff700 1 -- 172.21.15.32:0/2003275480 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fef24159f20 con 0x7fef240d2640 2023-06-20T13:33:58.378 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.376+0000 7fef20ff9700 1 -- 172.21.15.32:0/2003275480 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fef24159f20 con 0x7fef240d2640 2023-06-20T13:33:58.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.378+0000 7fef2a5ff700 1 -- 172.21.15.32:0/2003275480 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fef1006ace0 msgr2=0x7fef1006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:58.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.378+0000 7fef2a5ff700 1 --2- 172.21.15.32:0/2003275480 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fef1006ace0 0x7fef1006d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fef14008910 tx=0x7fef14008040 comp rx=0 tx=0).stop 2023-06-20T13:33:58.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.378+0000 7fef2a5ff700 1 -- 172.21.15.32:0/2003275480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef240d2640 msgr2=0x7fef24157b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:58.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.378+0000 7fef2a5ff700 1 --2- 172.21.15.32:0/2003275480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef240d2640 0x7fef24157b90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fef1800c7f0 tx=0x7fef1800cbb0 comp rx=0 tx=0).stop 2023-06-20T13:33:58.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.378+0000 7fef2a5ff700 1 -- 172.21.15.32:0/2003275480 shutdown_connections 2023-06-20T13:33:58.381 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.378+0000 7fef2a5ff700 1 --2- 172.21.15.32:0/2003275480 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fef1006ace0 0x7fef1006d190 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:58.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.378+0000 7fef2a5ff700 1 --2- 172.21.15.32:0/2003275480 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef2415c460 0x7fef241580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:58.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.378+0000 7fef2a5ff700 1 --2- 172.21.15.32:0/2003275480 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef240cf720 0x7fef240c8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:58.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.378+0000 7fef2a5ff700 1 --2- 172.21.15.32:0/2003275480 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fef240d2640 0x7fef24157b90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:58.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.378+0000 7fef2a5ff700 1 -- 172.21.15.32:0/2003275480 >> 172.21.15.32:0/2003275480 conn(0x7fef24071660 msgr2=0x7fef24071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:58.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.378+0000 7fef2a5ff700 1 -- 172.21.15.32:0/2003275480 shutdown_connections 2023-06-20T13:33:58.382 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.378+0000 7fef2a5ff700 1 -- 172.21.15.32:0/2003275480 wait complete. 2023-06-20T13:33:58.398 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-06-20T13:33:58.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.598+0000 7f4f207ff700 1 Processor -- start 2023-06-20T13:33:58.601 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.599+0000 7f4f207ff700 1 -- start start 2023-06-20T13:33:58.602 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.600+0000 7f4f207ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4f180ce6b0 0x7f4f180b1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:58.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.600+0000 7f4f207ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f1806cc90 0x7f4f1806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:58.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.600+0000 7f4f207ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f180cd2a0 con 0x7f4f180b10a0 2023-06-20T13:33:58.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.600+0000 7f4f207ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f180cee30 con 0x7f4f180ce6b0 2023-06-20T13:33:58.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.600+0000 7f4f207ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180b19c0 con 0x7f4f1806cc90 2023-06-20T13:33:58.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.600+0000 7f4f1dd9a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f4f180ce6b0 0x7f4f180b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:58.603 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.600+0000 7f4f1e59b700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f4f180b10a0 0x7f4f1815c750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:43996/0 (socket says 172.21.15.32:43996) 2023-06-20T13:33:58.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.600+0000 7f4f1e59b700 1 -- 172.21.15.32:0/1141421866 learned_addr learned my addr 172.21.15.32:0/1141421866 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:58.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.600+0000 7f4f1ed9c700 1 --2- 172.21.15.32:0/1141421866 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f1806cc90 0x7f4f1806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:58.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.601+0000 7f4f1dd9a700 1 -- 172.21.15.32:0/1141421866 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f1806cc90 msgr2=0x7f4f1806d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:58.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.601+0000 7f4f1dd9a700 1 --2- 172.21.15.32:0/1141421866 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f1806cc90 0x7f4f1806d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:58.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.601+0000 7f4f1dd9a700 1 -- 172.21.15.32:0/1141421866 >> v1:172.21.15.32:6789/0 conn(0x7f4f180b10a0 legacy=0x7f4f1815c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:58.604 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.601+0000 7f4f1dd9a700 1 -- 172.21.15.32:0/1141421866 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1806d630 con 0x7f4f180ce6b0 2023-06-20T13:33:58.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.601+0000 7f4f1dd9a700 1 --2- 172.21.15.32:0/1141421866 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f180ce6b0 0x7f4f180b1480 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009840 tx=0x7f4f08009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74464ae014a40443 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:58.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.601+0000 7f4f1d599700 1 -- 172.21.15.32:0/1141421866 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f08011830 con 0x7f4f180ce6b0 2023-06-20T13:33:58.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.601+0000 7f4f1d599700 1 -- 172.21.15.32:0/1141421866 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f08011990 con 0x7f4f180ce6b0 2023-06-20T13:33:58.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.601+0000 7f4f1d599700 1 -- 172.21.15.32:0/1141421866 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f08011d20 con 0x7f4f180ce6b0 2023-06-20T13:33:58.606 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.602+0000 7f4f207ff700 1 -- 172.21.15.32:0/1141421866 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f180ce6b0 msgr2=0x7f4f180b1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:58.607 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.602+0000 7f4f207ff700 1 --2- 172.21.15.32:0/1141421866 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f180ce6b0 0x7f4f180b1480 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009840 tx=0x7f4f08009b50 comp rx=0 tx=0).stop 2023-06-20T13:33:58.607 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.602+0000 7f4f207ff700 1 -- 172.21.15.32:0/1141421866 shutdown_connections 2023-06-20T13:33:58.607 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.602+0000 7f4f207ff700 1 --2- 172.21.15.32:0/1141421866 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f1806cc90 0x7f4f1806d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:58.607 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.602+0000 7f4f207ff700 1 --2- 172.21.15.32:0/1141421866 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f180ce6b0 0x7f4f180b1480 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:58.607 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.602+0000 7f4f207ff700 1 -- 172.21.15.32:0/1141421866 >> 172.21.15.32:0/1141421866 conn(0x7f4f180cef70 msgr2=0x7f4f180cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:58.607 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.602+0000 7f4f207ff700 1 -- 172.21.15.32:0/1141421866 shutdown_connections 2023-06-20T13:33:58.607 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.602+0000 7f4f207ff700 1 -- 172.21.15.32:0/1141421866 wait complete. 2023-06-20T13:33:58.607 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.604+0000 7f4f207ff700 1 Processor -- start 2023-06-20T13:33:58.608 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.604+0000 7f4f207ff700 1 -- start start 2023-06-20T13:33:58.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.605+0000 7f4f207ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f1806cc90 0x7f4f180c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:58.609 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.605+0000 7f4f207ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f180ce6b0 0x7f4f181e5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:58.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.605+0000 7f4f207ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f180c3e10 0x7f4f18143f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:58.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.605+0000 7f4f207ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180c5400 con 0x7f4f180c3e10 2023-06-20T13:33:58.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.605+0000 7f4f207ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180c47f0 con 0x7f4f180ce6b0 2023-06-20T13:33:58.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.605+0000 7f4f207ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180c4ad0 con 0x7f4f1806cc90 2023-06-20T13:33:58.610 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.605+0000 7f4f1ed9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f180c3e10 0x7f4f18143f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:58.611 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.605+0000 7f4f1ed9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f180c3e10 0x7f4f18143f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37396/0 (socket says 172.21.15.32:37396) 2023-06-20T13:33:58.611 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.605+0000 7f4f1ed9c700 1 -- 172.21.15.32:0/2188153001 learned_addr learned my addr 172.21.15.32:0/2188153001 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:58.611 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.605+0000 7f4f1e59b700 1 --2- 172.21.15.32:0/2188153001 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f1806cc90 0x7f4f180c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:58.611 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.605+0000 7f4f1dd9a700 1 --2- 172.21.15.32:0/2188153001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f180ce6b0 0x7f4f181e5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:58.611 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.605+0000 7f4f1ed9c700 1 -- 172.21.15.32:0/2188153001 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f1806cc90 msgr2=0x7f4f180c5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:58.612 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.605+0000 7f4f1ed9c700 1 --2- 172.21.15.32:0/2188153001 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f1806cc90 0x7f4f180c5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:58.612 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.605+0000 7f4f1ed9c700 1 -- 172.21.15.32:0/2188153001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f180ce6b0 msgr2=0x7f4f181e5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:58.612 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.605+0000 7f4f1ed9c700 1 --2- 172.21.15.32:0/2188153001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f180ce6b0 0x7f4f181e5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:58.612 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.605+0000 7f4f1ed9c700 1 -- 172.21.15.32:0/2188153001 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f080094a0 con 0x7f4f180c3e10 2023-06-20T13:33:58.612 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.605+0000 7f4f1dd9a700 1 --2- 172.21.15.32:0/2188153001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f180ce6b0 0x7f4f181e5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:58.612 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.606+0000 7f4f1ed9c700 1 --2- 172.21.15.32:0/2188153001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f180c3e10 0x7f4f18143f50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4f10007e40 tx=0x7f4f1000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:58.613 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.606+0000 7f4f0effd700 1 -- 172.21.15.32:0/2188153001 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1000ede0 con 0x7f4f180c3e10 2023-06-20T13:33:58.613 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.606+0000 7f4f0effd700 1 -- 172.21.15.32:0/2188153001 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f10014420 con 0x7f4f180c3e10 2023-06-20T13:33:58.613 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.606+0000 7f4f207ff700 1 -- 172.21.15.32:0/2188153001 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f180c4db0 con 0x7f4f180c3e10 2023-06-20T13:33:58.613 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.606+0000 7f4f0effd700 1 -- 172.21.15.32:0/2188153001 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f100147d0 con 0x7f4f180c3e10 2023-06-20T13:33:58.613 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.606+0000 7f4f207ff700 1 -- 172.21.15.32:0/2188153001 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f18155e40 con 0x7f4f180c3e10 2023-06-20T13:33:58.613 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.607+0000 7f4f207ff700 1 -- 172.21.15.32:0/2188153001 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f18155fd0 con 0x7f4f180c3e10 2023-06-20T13:33:58.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.608+0000 7f4f0effd700 1 -- 172.21.15.32:0/2188153001 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4f10014930 con 0x7f4f180c3e10 2023-06-20T13:33:58.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.609+0000 7f4f0effd700 1 --2- 172.21.15.32:0/2188153001 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4efc06ad10 0x7f4efc06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:58.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.609+0000 7f4f0effd700 1 -- 172.21.15.32:0/2188153001 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f4f10089a60 con 0x7f4f180c3e10 2023-06-20T13:33:58.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.609+0000 7f4f1e59b700 1 --2- 172.21.15.32:0/2188153001 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4efc06ad10 0x7f4efc06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:58.614 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.610+0000 7f4f1e59b700 1 --2- 172.21.15.32:0/2188153001 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4efc06ad10 0x7f4efc06d1c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4f14005910 tx=0x7f4f14009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:58.615 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.613+0000 7f4f0effd700 1 -- 172.21.15.32:0/2188153001 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4f10058710 con 0x7f4f180c3e10 2023-06-20T13:33:58.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.898+0000 7f4f207ff700 1 -- 172.21.15.32:0/2188153001 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f4f1804ea60 con 0x7f4f180c3e10 2023-06-20T13:33:58.904 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.902+0000 7f4f0effd700 1 -- 172.21.15.32:0/2188153001 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4f100582a0 con 0x7f4f180c3e10 2023-06-20T13:33:58.906 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.904+0000 7f4f207ff700 1 -- 172.21.15.32:0/2188153001 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4efc06ad10 msgr2=0x7f4efc06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:58.906 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.904+0000 7f4f207ff700 1 --2- 172.21.15.32:0/2188153001 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4efc06ad10 0x7f4efc06d1c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4f14005910 tx=0x7f4f14009040 comp rx=0 tx=0).stop 2023-06-20T13:33:58.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.904+0000 7f4f207ff700 1 -- 172.21.15.32:0/2188153001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f180c3e10 msgr2=0x7f4f18143f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:58.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.904+0000 7f4f207ff700 1 --2- 172.21.15.32:0/2188153001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f180c3e10 0x7f4f18143f50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4f10007e40 tx=0x7f4f1000e3c0 comp rx=0 tx=0).stop 2023-06-20T13:33:58.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.904+0000 7f4f207ff700 1 -- 172.21.15.32:0/2188153001 shutdown_connections 2023-06-20T13:33:58.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.904+0000 7f4f207ff700 1 --2- 172.21.15.32:0/2188153001 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4efc06ad10 0x7f4efc06d1c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:58.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.904+0000 7f4f207ff700 1 --2- 172.21.15.32:0/2188153001 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4f180c3e10 0x7f4f18143f50 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:58.907 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.904+0000 7f4f207ff700 1 --2- 172.21.15.32:0/2188153001 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f1806cc90 0x7f4f180c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:58.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.904+0000 7f4f207ff700 1 --2- 172.21.15.32:0/2188153001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f180ce6b0 0x7f4f181e5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:58.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.904+0000 7f4f207ff700 1 -- 172.21.15.32:0/2188153001 >> 172.21.15.32:0/2188153001 conn(0x7f4f180cef70 msgr2=0x7f4f1815cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:58.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.904+0000 7f4f207ff700 1 -- 172.21.15.32:0/2188153001 shutdown_connections 2023-06-20T13:33:58.908 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:58.904+0000 7f4f207ff700 1 -- 172.21.15.32:0/2188153001 wait complete. 2023-06-20T13:33:58.924 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-06-20T13:33:59.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.126+0000 7fe319bff700 1 Processor -- start 2023-06-20T13:33:59.128 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.126+0000 7fe319bff700 1 -- start start 2023-06-20T13:33:59.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.127+0000 7fe319bff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe31415c460 0x7fe3140b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:59.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.127+0000 7fe319bff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3140d1790 con 0x7fe3140cf8f0 2023-06-20T13:33:59.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.127+0000 7fe319bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3140cd950 con 0x7fe3140d2640 2023-06-20T13:33:59.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.127+0000 7fe319bff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3140cedd0 con 0x7fe31415c460 2023-06-20T13:33:59.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.127+0000 7fe3137fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fe31415c460 0x7fe3140b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:59.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.127+0000 7fe313fff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe3140cf8f0 0x7fe31415fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:44000/0 (socket says 172.21.15.32:44000) 2023-06-20T13:33:59.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.127+0000 7fe313fff700 1 -- 172.21.15.32:0/2847848374 learned_addr learned my addr 172.21.15.32:0/2847848374 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:59.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.128+0000 7fe3137fe700 1 -- 172.21.15.32:0/2847848374 >> v1:172.21.15.115:6789/0 conn(0x7fe3140d2640 legacy=0x7fe3140cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:59.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.128+0000 7fe3137fe700 1 -- 172.21.15.32:0/2847848374 >> v1:172.21.15.32:6789/0 conn(0x7fe3140cf8f0 legacy=0x7fe31415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:59.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.128+0000 7fe3137fe700 1 -- 172.21.15.32:0/2847848374 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3140d14b0 con 0x7fe31415c460 2023-06-20T13:33:59.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.128+0000 7fe3127fc700 1 -- 172.21.15.32:0/2847848374 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2581135471 0 0) 0x7fe3140d1790 con 0x7fe3140cf8f0 2023-06-20T13:33:59.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.128+0000 7fe3137fe700 1 --2- 172.21.15.32:0/2847848374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe31415c460 0x7fe3140b59d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe304009840 tx=0x7fe304009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca9dfd176a5b5c5 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:59.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.128+0000 7fe3127fc700 1 -- 172.21.15.32:0/2847848374 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe304011830 con 0x7fe31415c460 2023-06-20T13:33:59.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.128+0000 7fe3127fc700 1 -- 172.21.15.32:0/2847848374 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe304011990 con 0x7fe31415c460 2023-06-20T13:33:59.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.128+0000 7fe3127fc700 1 -- 172.21.15.32:0/2847848374 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe304011d20 con 0x7fe31415c460 2023-06-20T13:33:59.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.129+0000 7fe319bff700 1 -- 172.21.15.32:0/2847848374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe31415c460 msgr2=0x7fe3140b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:59.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.129+0000 7fe319bff700 1 --2- 172.21.15.32:0/2847848374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe31415c460 0x7fe3140b59d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe304009840 tx=0x7fe304009b50 comp rx=0 tx=0).stop 2023-06-20T13:33:59.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.129+0000 7fe319bff700 1 -- 172.21.15.32:0/2847848374 shutdown_connections 2023-06-20T13:33:59.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.129+0000 7fe319bff700 1 --2- 172.21.15.32:0/2847848374 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe31415c460 0x7fe3140b59d0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:59.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.129+0000 7fe319bff700 1 -- 172.21.15.32:0/2847848374 >> 172.21.15.32:0/2847848374 conn(0x7fe314071660 msgr2=0x7fe314071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:59.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.129+0000 7fe319bff700 1 -- 172.21.15.32:0/2847848374 shutdown_connections 2023-06-20T13:33:59.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.129+0000 7fe319bff700 1 -- 172.21.15.32:0/2847848374 wait complete. 2023-06-20T13:33:59.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.131+0000 7fe319bff700 1 Processor -- start 2023-06-20T13:33:59.135 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.131+0000 7fe319bff700 1 -- start start 2023-06-20T13:33:59.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.132+0000 7fe319bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3140cf8f0 0x7fe31415c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:59.136 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.132+0000 7fe319bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe3140d2640 0x7fe31415d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:59.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.132+0000 7fe319bff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe31415c460 0x7fe3140caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:59.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.132+0000 7fe319bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3140cc5f0 con 0x7fe3140d2640 2023-06-20T13:33:59.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.132+0000 7fe319bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31415f7a0 con 0x7fe3140cf8f0 2023-06-20T13:33:59.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.132+0000 7fe319bff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3140cbd50 con 0x7fe31415c460 2023-06-20T13:33:59.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.132+0000 7fe312ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe3140d2640 0x7fe31415d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:59.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.132+0000 7fe312ffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe3140d2640 0x7fe31415d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37412/0 (socket says 172.21.15.32:37412) 2023-06-20T13:33:59.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.132+0000 7fe312ffd700 1 -- 172.21.15.32:0/3527925363 learned_addr learned my addr 172.21.15.32:0/3527925363 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:59.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.132+0000 7fe3137fe700 1 --2- 172.21.15.32:0/3527925363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3140cf8f0 0x7fe31415c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:59.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.132+0000 7fe313fff700 1 --2- 172.21.15.32:0/3527925363 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe31415c460 0x7fe3140caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:59.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.133+0000 7fe312ffd700 1 -- 172.21.15.32:0/3527925363 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe31415c460 msgr2=0x7fe3140caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:59.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.133+0000 7fe312ffd700 1 --2- 172.21.15.32:0/3527925363 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe31415c460 0x7fe3140caca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:59.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.133+0000 7fe312ffd700 1 -- 172.21.15.32:0/3527925363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3140cf8f0 msgr2=0x7fe31415c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:59.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.133+0000 7fe312ffd700 1 --2- 172.21.15.32:0/3527925363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3140cf8f0 0x7fe31415c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:59.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.133+0000 7fe312ffd700 1 -- 172.21.15.32:0/3527925363 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3040094a0 con 0x7fe3140d2640 2023-06-20T13:33:59.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.133+0000 7fe313fff700 1 --2- 172.21.15.32:0/3527925363 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe31415c460 0x7fe3140caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:59.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.133+0000 7fe312ffd700 1 --2- 172.21.15.32:0/3527925363 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe3140d2640 0x7fe31415d490 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe30800c4e0 tx=0x7fe30800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:59.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.133+0000 7fe2fbfff700 1 -- 172.21.15.32:0/3527925363 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3080052d0 con 0x7fe3140d2640 2023-06-20T13:33:59.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.133+0000 7fe2fbfff700 1 -- 172.21.15.32:0/3527925363 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe308005430 con 0x7fe3140d2640 2023-06-20T13:33:59.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.133+0000 7fe319bff700 1 -- 172.21.15.32:0/3527925363 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3140cc030 con 0x7fe3140d2640 2023-06-20T13:33:59.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.133+0000 7fe2fbfff700 1 -- 172.21.15.32:0/3527925363 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3080038c0 con 0x7fe3140d2640 2023-06-20T13:33:59.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.134+0000 7fe319bff700 1 -- 172.21.15.32:0/3527925363 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe31415cf30 con 0x7fe3140d2640 2023-06-20T13:33:59.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.135+0000 7fe319bff700 1 -- 172.21.15.32:0/3527925363 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe31404ea60 con 0x7fe3140d2640 2023-06-20T13:33:59.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.136+0000 7fe2fbfff700 1 -- 172.21.15.32:0/3527925363 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe308003a20 con 0x7fe3140d2640 2023-06-20T13:33:59.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.136+0000 7fe2fbfff700 1 --2- 172.21.15.32:0/3527925363 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe30006ace0 0x7fe30006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:59.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.136+0000 7fe2fbfff700 1 -- 172.21.15.32:0/3527925363 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fe3080887b0 con 0x7fe3140d2640 2023-06-20T13:33:59.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.137+0000 7fe3137fe700 1 --2- 172.21.15.32:0/3527925363 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe30006ace0 0x7fe30006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:59.141 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.137+0000 7fe3137fe700 1 --2- 172.21.15.32:0/3527925363 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe30006ace0 0x7fe30006d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe3040090b0 tx=0x7fe30401c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:59.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.141+0000 7fe2fbfff700 1 -- 172.21.15.32:0/3527925363 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe3080539d0 con 0x7fe3140d2640 2023-06-20T13:33:59.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.434+0000 7fe319bff700 1 -- 172.21.15.32:0/3527925363 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fe3140b4fa0 con 0x7fe3140d2640 2023-06-20T13:33:59.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.438+0000 7fe2fbfff700 1 -- 172.21.15.32:0/3527925363 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe308056ff0 con 0x7fe3140d2640 2023-06-20T13:33:59.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.440+0000 7fe319bff700 1 -- 172.21.15.32:0/3527925363 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe30006ace0 msgr2=0x7fe30006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:59.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.440+0000 7fe319bff700 1 --2- 172.21.15.32:0/3527925363 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe30006ace0 0x7fe30006d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe3040090b0 tx=0x7fe30401c040 comp rx=0 tx=0).stop 2023-06-20T13:33:59.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.440+0000 7fe319bff700 1 -- 172.21.15.32:0/3527925363 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe3140d2640 msgr2=0x7fe31415d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:59.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.440+0000 7fe319bff700 1 --2- 172.21.15.32:0/3527925363 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe3140d2640 0x7fe31415d490 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe30800c4e0 tx=0x7fe30800c7f0 comp rx=0 tx=0).stop 2023-06-20T13:33:59.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.440+0000 7fe319bff700 1 -- 172.21.15.32:0/3527925363 shutdown_connections 2023-06-20T13:33:59.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.440+0000 7fe319bff700 1 --2- 172.21.15.32:0/3527925363 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe30006ace0 0x7fe30006d190 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:59.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.440+0000 7fe319bff700 1 --2- 172.21.15.32:0/3527925363 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe31415c460 0x7fe3140caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:59.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.440+0000 7fe319bff700 1 --2- 172.21.15.32:0/3527925363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3140cf8f0 0x7fe31415c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:59.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.441+0000 7fe319bff700 1 --2- 172.21.15.32:0/3527925363 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe3140d2640 0x7fe31415d490 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:59.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.441+0000 7fe319bff700 1 -- 172.21.15.32:0/3527925363 >> 172.21.15.32:0/3527925363 conn(0x7fe314071660 msgr2=0x7fe31415b580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:59.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.441+0000 7fe319bff700 1 -- 172.21.15.32:0/3527925363 shutdown_connections 2023-06-20T13:33:59.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.441+0000 7fe319bff700 1 -- 172.21.15.32:0/3527925363 wait complete. 2023-06-20T13:33:59.461 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-06-20T13:33:59.663 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.661+0000 7f4de43ff700 1 Processor -- start 2023-06-20T13:33:59.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.661+0000 7f4de43ff700 1 -- start start 2023-06-20T13:33:59.664 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.662+0000 7f4de43ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ddc0d2640 0x7f4ddc0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:59.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.662+0000 7f4de43ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ddc0d1790 con 0x7f4ddc0cf8f0 2023-06-20T13:33:59.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.662+0000 7f4de43ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ddc0cd950 con 0x7f4ddc15c460 2023-06-20T13:33:59.665 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.662+0000 7f4de43ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc0cedd0 con 0x7f4ddc0d2640 2023-06-20T13:33:59.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.663+0000 7f4de299c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f4ddc0cf8f0 0x7f4ddc15fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:44002/0 (socket says 172.21.15.32:44002) 2023-06-20T13:33:59.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.663+0000 7f4de299c700 1 -- 172.21.15.32:0/421552393 learned_addr learned my addr 172.21.15.32:0/421552393 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:33:59.667 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.663+0000 7f4de199a700 1 --2- 172.21.15.32:0/421552393 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ddc0d2640 0x7f4ddc0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:59.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.663+0000 7f4de1199700 1 -- 172.21.15.32:0/421552393 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1643629348 0 0) 0x7f4ddc0d1790 con 0x7f4ddc0cf8f0 2023-06-20T13:33:59.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.663+0000 7f4de1199700 1 -- 172.21.15.32:0/421552393 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dc80035b0 con 0x7f4ddc0cf8f0 2023-06-20T13:33:59.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.663+0000 7f4de1199700 1 -- 172.21.15.32:0/421552393 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3938276422 0 0) 0x7f4ddc0cd950 con 0x7f4ddc15c460 2023-06-20T13:33:59.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.663+0000 7f4de1199700 1 -- 172.21.15.32:0/421552393 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ddc0d1790 con 0x7f4ddc15c460 2023-06-20T13:33:59.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.663+0000 7f4de1199700 1 -- 172.21.15.32:0/421552393 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 323494553 0 0) 0x7f4dc80035b0 con 0x7f4ddc0cf8f0 2023-06-20T13:33:59.668 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.663+0000 7f4de1199700 1 -- 172.21.15.32:0/421552393 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ddc0d2640 msgr2=0x7f4ddc0b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:59.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.663+0000 7f4de1199700 1 --2- 172.21.15.32:0/421552393 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ddc0d2640 0x7f4ddc0b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:59.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.663+0000 7f4de1199700 1 -- 172.21.15.32:0/421552393 >> v1:172.21.15.115:6789/0 conn(0x7f4ddc15c460 legacy=0x7f4ddc0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:59.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.664+0000 7f4de1199700 1 -- 172.21.15.32:0/421552393 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ddc0d14b0 con 0x7f4ddc0cf8f0 2023-06-20T13:33:59.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.664+0000 7f4de1199700 1 -- 172.21.15.32:0/421552393 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3380058562 0 0) 0x7f4dd40019f0 con 0x7f4ddc0cf8f0 2023-06-20T13:33:59.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.664+0000 7f4de1199700 1 -- 172.21.15.32:0/421552393 >> v1:172.21.15.32:6789/0 conn(0x7f4ddc0cf8f0 legacy=0x7f4ddc15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:59.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.664+0000 7f4de1199700 1 --2- 172.21.15.32:0/421552393 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dc8003bc0 0x7f4dc8003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:59.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.664+0000 7f4de1199700 1 --2- 172.21.15.32:0/421552393 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ddc0d2640 0x7f4dc8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:59.669 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.664+0000 7f4de1199700 1 --2- 172.21.15.32:0/421552393 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4dc8004d90 0x7f4dc8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:59.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.664+0000 7f4de1199700 1 -- 172.21.15.32:0/421552393 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc0cedd0 con 0x7f4dc8004d90 2023-06-20T13:33:59.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.664+0000 7f4de1199700 1 -- 172.21.15.32:0/421552393 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc800bba0 con 0x7f4dc8003bc0 2023-06-20T13:33:59.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.664+0000 7f4de1199700 1 -- 172.21.15.32:0/421552393 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc800bd60 con 0x7f4ddc0d2640 2023-06-20T13:33:59.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.664+0000 7f4de219b700 1 --2- 172.21.15.32:0/421552393 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dc8003bc0 0x7f4dc8003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:59.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.664+0000 7f4de299c700 1 --2- 172.21.15.32:0/421552393 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4dc8004d90 0x7f4dc8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:59.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.664+0000 7f4de199a700 1 --2- 172.21.15.32:0/421552393 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ddc0d2640 0x7f4dc8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:59.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.664+0000 7f4de219b700 1 -- 172.21.15.32:0/421552393 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ddc0d2640 msgr2=0x7f4dc8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:59.670 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.664+0000 7f4de219b700 1 --2- 172.21.15.32:0/421552393 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ddc0d2640 0x7f4dc8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:59.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.664+0000 7f4de219b700 1 -- 172.21.15.32:0/421552393 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4dc8004d90 msgr2=0x7f4dc8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:33:59.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.664+0000 7f4de219b700 1 --2- 172.21.15.32:0/421552393 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4dc8004d90 0x7f4dc8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:59.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.664+0000 7f4de219b700 1 -- 172.21.15.32:0/421552393 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc80035b0 con 0x7f4dc8003bc0 2023-06-20T13:33:59.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.665+0000 7f4de219b700 1 --2- 172.21.15.32:0/421552393 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dc8003bc0 0x7f4dc8003fb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8001970 tx=0x7f4dc8005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b099ceb5c148e05 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:59.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.665+0000 7f4de1199700 1 -- 172.21.15.32:0/421552393 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8001430 con 0x7f4dc8003bc0 2023-06-20T13:33:59.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.665+0000 7f4de1199700 1 -- 172.21.15.32:0/421552393 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd80052d0 con 0x7f4dc8003bc0 2023-06-20T13:33:59.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.665+0000 7f4de1199700 1 -- 172.21.15.32:0/421552393 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8003680 con 0x7f4dc8003bc0 2023-06-20T13:33:59.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.665+0000 7f4de43ff700 1 -- 172.21.15.32:0/421552393 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dc8003bc0 msgr2=0x7f4dc8003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:59.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.665+0000 7f4de43ff700 1 --2- 172.21.15.32:0/421552393 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4dc8003bc0 0x7f4dc8003fb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8001970 tx=0x7f4dc8005880 comp rx=0 tx=0).stop 2023-06-20T13:33:59.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.665+0000 7f4de299c700 1 -- 172.21.15.32:0/421552393 reap_dead start 2023-06-20T13:33:59.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.666+0000 7f4de43ff700 1 -- 172.21.15.32:0/421552393 shutdown_connections 2023-06-20T13:33:59.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.666+0000 7f4de43ff700 1 -- 172.21.15.32:0/421552393 >> 172.21.15.32:0/421552393 conn(0x7f4ddc071660 msgr2=0x7f4ddc071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:59.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.666+0000 7f4de43ff700 1 -- 172.21.15.32:0/421552393 shutdown_connections 2023-06-20T13:33:59.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.666+0000 7f4de43ff700 1 -- 172.21.15.32:0/421552393 wait complete. 2023-06-20T13:33:59.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.668+0000 7f4de43ff700 1 Processor -- start 2023-06-20T13:33:59.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.668+0000 7f4de43ff700 1 -- start start 2023-06-20T13:33:59.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.669+0000 7f4de43ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4dc8003bc0 0x7f4ddc15b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:59.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.669+0000 7f4de43ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ddc0c9240 0x7f4ddc157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:59.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.669+0000 7f4de43ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ddc1e66a0 0x7f4ddc1e6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:59.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.669+0000 7f4de43ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc0c9ae0 con 0x7f4dc8003bc0 2023-06-20T13:33:59.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.669+0000 7f4de43ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc1e7060 con 0x7f4ddc0c9240 2023-06-20T13:33:59.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.669+0000 7f4de43ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc0c9800 con 0x7f4ddc1e66a0 2023-06-20T13:33:59.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.669+0000 7f4de219b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4dc8003bc0 0x7f4ddc15b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:59.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.669+0000 7f4de219b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4dc8003bc0 0x7f4ddc15b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:37428/0 (socket says 172.21.15.32:37428) 2023-06-20T13:33:59.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.669+0000 7f4de219b700 1 -- 172.21.15.32:0/2054767469 learned_addr learned my addr 172.21.15.32:0/2054767469 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:33:59.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.669+0000 7f4de299c700 1 --2- 172.21.15.32:0/2054767469 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ddc1e66a0 0x7f4ddc1e6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:59.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.669+0000 7f4de199a700 1 --2- 172.21.15.32:0/2054767469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ddc0c9240 0x7f4ddc157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:59.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.669+0000 7f4de219b700 1 -- 172.21.15.32:0/2054767469 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ddc1e66a0 msgr2=0x7f4ddc1e6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:59.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.669+0000 7f4de219b700 1 --2- 172.21.15.32:0/2054767469 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ddc1e66a0 0x7f4ddc1e6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:59.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.669+0000 7f4de219b700 1 -- 172.21.15.32:0/2054767469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ddc0c9240 msgr2=0x7f4ddc157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:59.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.669+0000 7f4de219b700 1 --2- 172.21.15.32:0/2054767469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ddc0c9240 0x7f4ddc157060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:59.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.669+0000 7f4de219b700 1 -- 172.21.15.32:0/2054767469 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ddc1e55b0 con 0x7f4dc8003bc0 2023-06-20T13:33:59.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.669+0000 7f4de299c700 1 --2- 172.21.15.32:0/2054767469 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ddc1e66a0 0x7f4ddc1e6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:33:59.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.670+0000 7f4de219b700 1 --2- 172.21.15.32:0/2054767469 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4dc8003bc0 0x7f4ddc15b710 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4dd800c3c0 tx=0x7f4dd80012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:59.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.670+0000 7f4dd2ffd700 1 -- 172.21.15.32:0/2054767469 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd80013d0 con 0x7f4dc8003bc0 2023-06-20T13:33:59.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.670+0000 7f4dd2ffd700 1 -- 172.21.15.32:0/2054767469 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd8001060 con 0x7f4dc8003bc0 2023-06-20T13:33:59.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.670+0000 7f4dd2ffd700 1 -- 172.21.15.32:0/2054767469 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8007250 con 0x7f4dc8003bc0 2023-06-20T13:33:59.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.670+0000 7f4de43ff700 1 -- 172.21.15.32:0/2054767469 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ddc1e5890 con 0x7f4dc8003bc0 2023-06-20T13:33:59.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.670+0000 7f4de43ff700 1 -- 172.21.15.32:0/2054767469 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ddc15bc50 con 0x7f4dc8003bc0 2023-06-20T13:33:59.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.671+0000 7f4de43ff700 1 -- 172.21.15.32:0/2054767469 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ddc1e53e0 con 0x7f4dc8003bc0 2023-06-20T13:33:59.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.672+0000 7f4dd2ffd700 1 -- 172.21.15.32:0/2054767469 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4dd80073b0 con 0x7f4dc8003bc0 2023-06-20T13:33:59.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.673+0000 7f4dd2ffd700 1 --2- 172.21.15.32:0/2054767469 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4dc006ace0 0x7f4dc006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:33:59.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.673+0000 7f4dd2ffd700 1 -- 172.21.15.32:0/2054767469 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f4dd8089dc0 con 0x7f4dc8003bc0 2023-06-20T13:33:59.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.673+0000 7f4de199a700 1 --2- 172.21.15.32:0/2054767469 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4dc006ace0 0x7f4dc006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:33:59.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.674+0000 7f4de199a700 1 --2- 172.21.15.32:0/2054767469 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4dc006ace0 0x7f4dc006d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc009c60 tx=0x7f4dcc009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:33:59.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.677+0000 7f4dd2ffd700 1 -- 172.21.15.32:0/2054767469 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4dd8055190 con 0x7f4dc8003bc0 2023-06-20T13:33:59.969 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.967+0000 7f4de43ff700 1 -- 172.21.15.32:0/2054767469 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f4ddc04ea60 con 0x7f4dc8003bc0 2023-06-20T13:33:59.972 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.970+0000 7f4dd2ffd700 1 -- 172.21.15.32:0/2054767469 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4dd80587b0 con 0x7f4dc8003bc0 2023-06-20T13:33:59.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.973+0000 7f4de43ff700 1 -- 172.21.15.32:0/2054767469 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4dc006ace0 msgr2=0x7f4dc006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:59.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.973+0000 7f4de43ff700 1 --2- 172.21.15.32:0/2054767469 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4dc006ace0 0x7f4dc006d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc009c60 tx=0x7f4dcc009210 comp rx=0 tx=0).stop 2023-06-20T13:33:59.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.973+0000 7f4de43ff700 1 -- 172.21.15.32:0/2054767469 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4dc8003bc0 msgr2=0x7f4ddc15b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:33:59.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.973+0000 7f4de43ff700 1 --2- 172.21.15.32:0/2054767469 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4dc8003bc0 0x7f4ddc15b710 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4dd800c3c0 tx=0x7f4dd80012d0 comp rx=0 tx=0).stop 2023-06-20T13:33:59.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.973+0000 7f4de43ff700 1 -- 172.21.15.32:0/2054767469 shutdown_connections 2023-06-20T13:33:59.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.973+0000 7f4de43ff700 1 --2- 172.21.15.32:0/2054767469 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f4dc006ace0 0x7f4dc006d190 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:59.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.973+0000 7f4de43ff700 1 --2- 172.21.15.32:0/2054767469 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4ddc1e66a0 0x7f4ddc1e6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:59.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.973+0000 7f4de43ff700 1 --2- 172.21.15.32:0/2054767469 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f4dc8003bc0 0x7f4ddc15b710 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:59.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.973+0000 7f4de43ff700 1 --2- 172.21.15.32:0/2054767469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4ddc0c9240 0x7f4ddc157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:33:59.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.973+0000 7f4de43ff700 1 -- 172.21.15.32:0/2054767469 >> 172.21.15.32:0/2054767469 conn(0x7f4ddc071660 msgr2=0x7f4ddc0b7090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:33:59.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.973+0000 7f4de43ff700 1 -- 172.21.15.32:0/2054767469 shutdown_connections 2023-06-20T13:33:59.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:33:59.973+0000 7f4de43ff700 1 -- 172.21.15.32:0/2054767469 wait complete. 2023-06-20T13:33:59.994 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:34:00.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.195+0000 7fa425fff700 1 Processor -- start 2023-06-20T13:34:00.197 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.195+0000 7fa425fff700 1 -- start start 2023-06-20T13:34:00.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.196+0000 7fa425fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa420157f10 0x7fa42006a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:00.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.196+0000 7fa425fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa420070a50 0x7fa420070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:00.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.196+0000 7fa425fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42015e210 con 0x7fa420070340 2023-06-20T13:34:00.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.196+0000 7fa425fff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42006d900 con 0x7fa420157f10 2023-06-20T13:34:00.199 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.196+0000 7fa425fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4200713b0 con 0x7fa420070a50 2023-06-20T13:34:00.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.196+0000 7fa41f7fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa420157f10 0x7fa42006a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:00.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.196+0000 7fa41f7fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fa420157f10 0x7fa42006a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54312/0 (socket says 172.21.15.32:54312) 2023-06-20T13:34:00.200 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.196+0000 7fa41f7fe700 1 -- 172.21.15.32:0/1534038276 learned_addr learned my addr 172.21.15.32:0/1534038276 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:00.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.196+0000 7fa41ffff700 1 --2- 172.21.15.32:0/1534038276 >> v2:172.21.15.115:3300/0 conn(0x7fa420070a50 0x7fa420070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:00.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.197+0000 7fa41f7fe700 1 -- 172.21.15.32:0/1534038276 >> v2:172.21.15.115:3300/0 conn(0x7fa420070a50 msgr2=0x7fa420070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:00.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.197+0000 7fa41f7fe700 1 --2- 172.21.15.32:0/1534038276 >> v2:172.21.15.115:3300/0 conn(0x7fa420070a50 0x7fa420070e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:00.201 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.197+0000 7fa41f7fe700 1 -- 172.21.15.32:0/1534038276 >> v1:172.21.15.115:6789/0 conn(0x7fa420070340 legacy=0x7fa42015e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:00.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.197+0000 7fa41f7fe700 1 -- 172.21.15.32:0/1534038276 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42015dee0 con 0x7fa420157f10 2023-06-20T13:34:00.202 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.197+0000 7fa41ffff700 1 --2- 172.21.15.32:0/1534038276 >> v2:172.21.15.115:3300/0 conn(0x7fa420070a50 0x7fa420070e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:34:00.207 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.197+0000 7fa41f7fe700 1 --2- 172.21.15.32:0/1534038276 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa420157f10 0x7fa42006a940 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa4200add00 tx=0x7fa410009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e813858b144572 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:00.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.197+0000 7fa41effd700 1 -- 172.21.15.32:0/1534038276 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41000b870 con 0x7fa420157f10 2023-06-20T13:34:00.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.197+0000 7fa41effd700 1 -- 172.21.15.32:0/1534038276 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41000b9d0 con 0x7fa420157f10 2023-06-20T13:34:00.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.197+0000 7fa41effd700 1 -- 172.21.15.32:0/1534038276 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41000bd60 con 0x7fa420157f10 2023-06-20T13:34:00.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.198+0000 7fa425fff700 1 -- 172.21.15.32:0/1534038276 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa420157f10 msgr2=0x7fa42006a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:00.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.198+0000 7fa425fff700 1 --2- 172.21.15.32:0/1534038276 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa420157f10 0x7fa42006a940 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa4200add00 tx=0x7fa410009bd0 comp rx=0 tx=0).stop 2023-06-20T13:34:00.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.198+0000 7fa425fff700 1 -- 172.21.15.32:0/1534038276 shutdown_connections 2023-06-20T13:34:00.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.198+0000 7fa425fff700 1 --2- 172.21.15.32:0/1534038276 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa420157f10 0x7fa42006a940 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:00.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.198+0000 7fa425fff700 1 --2- 172.21.15.32:0/1534038276 >> v2:172.21.15.115:3300/0 conn(0x7fa420070a50 0x7fa420070e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:00.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.198+0000 7fa425fff700 1 -- 172.21.15.32:0/1534038276 >> 172.21.15.32:0/1534038276 conn(0x7fa4200b0390 msgr2=0x7fa4200b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:00.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.198+0000 7fa425fff700 1 -- 172.21.15.32:0/1534038276 shutdown_connections 2023-06-20T13:34:00.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.198+0000 7fa425fff700 1 -- 172.21.15.32:0/1534038276 wait complete. 2023-06-20T13:34:00.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.200+0000 7fa425fff700 1 Processor -- start 2023-06-20T13:34:00.211 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.200+0000 7fa425fff700 1 -- start start 2023-06-20T13:34:00.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.201+0000 7fa425fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa420070340 0x7fa4200c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:00.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.201+0000 7fa425fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa420070a50 0x7fa42015a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:00.212 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.201+0000 7fa425fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa420157f10 0x7fa42015aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:00.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.201+0000 7fa425fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4200cc390 con 0x7fa420070340 2023-06-20T13:34:00.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.201+0000 7fa425fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4200cc5e0 con 0x7fa420157f10 2023-06-20T13:34:00.213 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.201+0000 7fa425fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4200cc8c0 con 0x7fa420070a50 2023-06-20T13:34:00.214 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.201+0000 7fa41f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa420070340 0x7fa4200c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:00.214 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.201+0000 7fa41f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa420070340 0x7fa4200c8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54318/0 (socket says 172.21.15.32:54318) 2023-06-20T13:34:00.214 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.201+0000 7fa41f7fe700 1 -- 172.21.15.32:0/3236807730 learned_addr learned my addr 172.21.15.32:0/3236807730 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:00.214 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.202+0000 7fa417fff700 1 --2- 172.21.15.32:0/3236807730 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa420070a50 0x7fa42015a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:00.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.202+0000 7fa41ffff700 1 --2- 172.21.15.32:0/3236807730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa420157f10 0x7fa42015aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:00.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.202+0000 7fa41f7fe700 1 -- 172.21.15.32:0/3236807730 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa420070a50 msgr2=0x7fa42015a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:00.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.202+0000 7fa41f7fe700 1 --2- 172.21.15.32:0/3236807730 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa420070a50 0x7fa42015a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:00.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.202+0000 7fa41f7fe700 1 -- 172.21.15.32:0/3236807730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa420157f10 msgr2=0x7fa42015aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:00.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.202+0000 7fa41f7fe700 1 --2- 172.21.15.32:0/3236807730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa420157f10 0x7fa42015aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:00.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.202+0000 7fa41f7fe700 1 -- 172.21.15.32:0/3236807730 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa410009550 con 0x7fa420070340 2023-06-20T13:34:00.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.202+0000 7fa41f7fe700 1 --2- 172.21.15.32:0/3236807730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa420070340 0x7fa4200c8060 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa410000c00 tx=0x7fa410004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:00.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.202+0000 7fa41cff9700 1 -- 172.21.15.32:0/3236807730 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa410004540 con 0x7fa420070340 2023-06-20T13:34:00.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.203+0000 7fa41cff9700 1 -- 172.21.15.32:0/3236807730 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4100036a0 con 0x7fa420070340 2023-06-20T13:34:00.217 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.203+0000 7fa41cff9700 1 -- 172.21.15.32:0/3236807730 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa410003a30 con 0x7fa420070340 2023-06-20T13:34:00.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.203+0000 7fa425fff700 1 -- 172.21.15.32:0/3236807730 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4200ccba0 con 0x7fa420070340 2023-06-20T13:34:00.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.203+0000 7fa425fff700 1 -- 172.21.15.32:0/3236807730 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42015cc80 con 0x7fa420070340 2023-06-20T13:34:00.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.204+0000 7fa425fff700 1 -- 172.21.15.32:0/3236807730 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42004ea60 con 0x7fa420070340 2023-06-20T13:34:00.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.205+0000 7fa41cff9700 1 -- 172.21.15.32:0/3236807730 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa410021070 con 0x7fa420070340 2023-06-20T13:34:00.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.206+0000 7fa41cff9700 1 --2- 172.21.15.32:0/3236807730 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa40006ace0 0x7fa40006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:00.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.206+0000 7fa41cff9700 1 -- 172.21.15.32:0/3236807730 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fa41008a840 con 0x7fa420070340 2023-06-20T13:34:00.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.206+0000 7fa417fff700 1 --2- 172.21.15.32:0/3236807730 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa40006ace0 0x7fa40006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:00.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.207+0000 7fa417fff700 1 --2- 172.21.15.32:0/3236807730 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa40006ace0 0x7fa40006d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa42015b1b0 tx=0x7fa408009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:00.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.210+0000 7fa41cff9700 1 -- 172.21.15.32:0/3236807730 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa410055b90 con 0x7fa420070340 2023-06-20T13:34:00.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.419+0000 7fa425fff700 1 -- 172.21.15.32:0/3236807730 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4200c20d0 con 0x7fa420070340 2023-06-20T13:34:00.421 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.420+0000 7fa41cff9700 1 -- 172.21.15.32:0/3236807730 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+14820 (secure 0 0 0) 0x7fa4100591b0 con 0x7fa420070340 2023-06-20T13:34:00.422 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:34:00.422 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":37,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:33:56.233692+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:34:00.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.422+0000 7fa425fff700 1 -- 172.21.15.32:0/3236807730 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa40006ace0 msgr2=0x7fa40006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:00.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.422+0000 7fa425fff700 1 --2- 172.21.15.32:0/3236807730 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa40006ace0 0x7fa40006d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa42015b1b0 tx=0x7fa408009040 comp rx=0 tx=0).stop 2023-06-20T13:34:00.424 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.422+0000 7fa425fff700 1 -- 172.21.15.32:0/3236807730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa420070340 msgr2=0x7fa4200c8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:00.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.422+0000 7fa425fff700 1 --2- 172.21.15.32:0/3236807730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa420070340 0x7fa4200c8060 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa410000c00 tx=0x7fa410004750 comp rx=0 tx=0).stop 2023-06-20T13:34:00.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.422+0000 7fa425fff700 1 -- 172.21.15.32:0/3236807730 shutdown_connections 2023-06-20T13:34:00.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.422+0000 7fa425fff700 1 --2- 172.21.15.32:0/3236807730 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fa40006ace0 0x7fa40006d190 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:00.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.422+0000 7fa425fff700 1 --2- 172.21.15.32:0/3236807730 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa420157f10 0x7fa42015aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:00.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.422+0000 7fa425fff700 1 --2- 172.21.15.32:0/3236807730 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fa420070340 0x7fa4200c8060 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:00.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.422+0000 7fa425fff700 1 --2- 172.21.15.32:0/3236807730 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa420070a50 0x7fa42015a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:00.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.422+0000 7fa425fff700 1 -- 172.21.15.32:0/3236807730 >> 172.21.15.32:0/3236807730 conn(0x7fa4200b0390 msgr2=0x7fa4200af510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:00.425 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.422+0000 7fa425fff700 1 -- 172.21.15.32:0/3236807730 shutdown_connections 2023-06-20T13:34:00.426 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.422+0000 7fa425fff700 1 -- 172.21.15.32:0/3236807730 wait complete. 2023-06-20T13:34:00.442 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-20T13:32:05.308022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-20T13:32:12.857161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-20T13:34:00.443 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-20T13:34:00.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.644+0000 7f2d03fff700 1 Processor -- start 2023-06-20T13:34:00.647 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.645+0000 7f2d03fff700 1 -- start start 2023-06-20T13:34:00.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.646+0000 7f2d03fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2cfc15c690 0x7f2cfc0adc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:00.648 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.646+0000 7f2d03fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2cfc0ca1f0 0x7f2cfc0ca690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:00.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.646+0000 7f2d03fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cfc0c9750 con 0x7f2cfc0cd0a0 2023-06-20T13:34:00.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.646+0000 7f2d03fff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cfc0cabd0 con 0x7f2cfc15c690 2023-06-20T13:34:00.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.646+0000 7f2d03fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cfc0cf1c0 con 0x7f2cfc0ca1f0 2023-06-20T13:34:00.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.646+0000 7f2d01d9b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2cfc15c690 0x7f2cfc0adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:00.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.646+0000 7f2d01d9b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2cfc15c690 0x7f2cfc0adc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54322/0 (socket says 172.21.15.32:54322) 2023-06-20T13:34:00.649 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.646+0000 7f2d01d9b700 1 -- 172.21.15.32:0/3808894507 learned_addr learned my addr 172.21.15.32:0/3808894507 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:00.650 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.647+0000 7f2d0259c700 1 --2- 172.21.15.32:0/3808894507 >> v2:172.21.15.115:3300/0 conn(0x7f2cfc0ca1f0 0x7f2cfc0ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:00.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.647+0000 7f2d01d9b700 1 -- 172.21.15.32:0/3808894507 >> v2:172.21.15.115:3300/0 conn(0x7f2cfc0ca1f0 msgr2=0x7f2cfc0ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:00.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.647+0000 7f2d01d9b700 1 --2- 172.21.15.32:0/3808894507 >> v2:172.21.15.115:3300/0 conn(0x7f2cfc0ca1f0 0x7f2cfc0ca690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:00.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.647+0000 7f2d01d9b700 1 -- 172.21.15.32:0/3808894507 >> v1:172.21.15.115:6789/0 conn(0x7f2cfc0cd0a0 legacy=0x7f2cfc06c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:00.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.647+0000 7f2d01d9b700 1 -- 172.21.15.32:0/3808894507 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cfc0cd610 con 0x7f2cfc15c690 2023-06-20T13:34:00.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.647+0000 7f2d0259c700 1 --2- 172.21.15.32:0/3808894507 >> v2:172.21.15.115:3300/0 conn(0x7f2cfc0ca1f0 0x7f2cfc0ca690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:34:00.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.647+0000 7f2d01d9b700 1 --2- 172.21.15.32:0/3808894507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cfc15c690 0x7f2cfc0adc60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc0ada00 tx=0x7f2cf8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8048050def9024d server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:00.651 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.647+0000 7f2d00d99700 1 -- 172.21.15.32:0/3808894507 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8004230 con 0x7f2cfc15c690 2023-06-20T13:34:00.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.647+0000 7f2d00d99700 1 -- 172.21.15.32:0/3808894507 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf8004390 con 0x7f2cfc15c690 2023-06-20T13:34:00.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.647+0000 7f2d00d99700 1 -- 172.21.15.32:0/3808894507 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf80036a0 con 0x7f2cfc15c690 2023-06-20T13:34:00.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.648+0000 7f2d03fff700 1 -- 172.21.15.32:0/3808894507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cfc15c690 msgr2=0x7f2cfc0adc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:00.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.648+0000 7f2d03fff700 1 --2- 172.21.15.32:0/3808894507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cfc15c690 0x7f2cfc0adc60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc0ada00 tx=0x7f2cf8009bd0 comp rx=0 tx=0).stop 2023-06-20T13:34:00.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.648+0000 7f2d03fff700 1 -- 172.21.15.32:0/3808894507 shutdown_connections 2023-06-20T13:34:00.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.648+0000 7f2d03fff700 1 --2- 172.21.15.32:0/3808894507 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cfc15c690 0x7f2cfc0adc60 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:00.652 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.648+0000 7f2d03fff700 1 --2- 172.21.15.32:0/3808894507 >> v2:172.21.15.115:3300/0 conn(0x7f2cfc0ca1f0 0x7f2cfc0ca690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:00.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.648+0000 7f2d03fff700 1 -- 172.21.15.32:0/3808894507 >> 172.21.15.32:0/3808894507 conn(0x7f2cfc0b0fd0 msgr2=0x7f2cfc0ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:00.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.648+0000 7f2d03fff700 1 -- 172.21.15.32:0/3808894507 shutdown_connections 2023-06-20T13:34:00.653 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.648+0000 7f2d03fff700 1 -- 172.21.15.32:0/3808894507 wait complete. 2023-06-20T13:34:00.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.650+0000 7f2d03fff700 1 Processor -- start 2023-06-20T13:34:00.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.650+0000 7f2d03fff700 1 -- start start 2023-06-20T13:34:00.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.651+0000 7f2d03fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2cfc0ca1f0 0x7f2cfc157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:00.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.651+0000 7f2d03fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cfc0cd0a0 0x7f2cfc0c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:00.655 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.651+0000 7f2d03fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cfc15c690 0x7f2cfc0c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:00.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.651+0000 7f2d03fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc157ba0 con 0x7f2cfc15c690 2023-06-20T13:34:00.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.651+0000 7f2d03fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc0c79c0 con 0x7f2cfc0cd0a0 2023-06-20T13:34:00.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.651+0000 7f2d03fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc0c6040 con 0x7f2cfc0ca1f0 2023-06-20T13:34:00.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.651+0000 7f2d0259c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cfc15c690 0x7f2cfc0c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:00.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.651+0000 7f2d0259c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cfc15c690 0x7f2cfc0c7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54328/0 (socket says 172.21.15.32:54328) 2023-06-20T13:34:00.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.651+0000 7f2d0259c700 1 -- 172.21.15.32:0/1315492705 learned_addr learned my addr 172.21.15.32:0/1315492705 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:00.656 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.651+0000 7f2d01d9b700 1 --2- 172.21.15.32:0/1315492705 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2cfc0ca1f0 0x7f2cfc157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:00.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.651+0000 7f2d0159a700 1 --2- 172.21.15.32:0/1315492705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cfc0cd0a0 0x7f2cfc0c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:00.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.652+0000 7f2d0259c700 1 -- 172.21.15.32:0/1315492705 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2cfc0ca1f0 msgr2=0x7f2cfc157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:00.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.652+0000 7f2d0259c700 1 --2- 172.21.15.32:0/1315492705 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2cfc0ca1f0 0x7f2cfc157660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:00.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.652+0000 7f2d0259c700 1 -- 172.21.15.32:0/1315492705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cfc0cd0a0 msgr2=0x7f2cfc0c4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:00.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.652+0000 7f2d0259c700 1 --2- 172.21.15.32:0/1315492705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cfc0cd0a0 0x7f2cfc0c4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:00.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.652+0000 7f2d0259c700 1 -- 172.21.15.32:0/1315492705 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf8009550 con 0x7f2cfc15c690 2023-06-20T13:34:00.657 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.652+0000 7f2d0159a700 1 --2- 172.21.15.32:0/1315492705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cfc0cd0a0 0x7f2cfc0c4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:34:00.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.652+0000 7f2d01d9b700 1 --2- 172.21.15.32:0/1315492705 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2cfc0ca1f0 0x7f2cfc157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:34:00.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.652+0000 7f2d0259c700 1 --2- 172.21.15.32:0/1315492705 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cfc15c690 0x7f2cfc0c7d20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2cf400cd50 tx=0x7f2cf400a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:00.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.652+0000 7f2cf27fc700 1 -- 172.21.15.32:0/1315492705 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf400f480 con 0x7f2cfc15c690 2023-06-20T13:34:00.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.652+0000 7f2cf27fc700 1 -- 172.21.15.32:0/1315492705 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf400f600 con 0x7f2cfc15c690 2023-06-20T13:34:00.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.652+0000 7f2cf27fc700 1 -- 172.21.15.32:0/1315492705 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf400f9b0 con 0x7f2cfc15c690 2023-06-20T13:34:00.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.652+0000 7f2d03fff700 1 -- 172.21.15.32:0/1315492705 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cfc0c7530 con 0x7f2cfc15c690 2023-06-20T13:34:00.658 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.652+0000 7f2d03fff700 1 -- 172.21.15.32:0/1315492705 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cfc0c69d0 con 0x7f2cfc15c690 2023-06-20T13:34:00.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.653+0000 7f2d03fff700 1 -- 172.21.15.32:0/1315492705 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cfc0c76c0 con 0x7f2cfc15c690 2023-06-20T13:34:00.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.654+0000 7f2cf27fc700 1 -- 172.21.15.32:0/1315492705 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2cf400b040 con 0x7f2cfc15c690 2023-06-20T13:34:00.659 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.655+0000 7f2cf27fc700 1 --2- 172.21.15.32:0/1315492705 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f2ce006ace0 0x7f2ce006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:00.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.655+0000 7f2cf27fc700 1 -- 172.21.15.32:0/1315492705 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f2cf4089b00 con 0x7f2cfc15c690 2023-06-20T13:34:00.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.655+0000 7f2d01d9b700 1 --2- 172.21.15.32:0/1315492705 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f2ce006ace0 0x7f2ce006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:00.660 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.656+0000 7f2d01d9b700 1 --2- 172.21.15.32:0/1315492705 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f2ce006ace0 0x7f2ce006d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009130 tx=0x7f2cf8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:00.661 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.659+0000 7f2cf27fc700 1 -- 172.21.15.32:0/1315492705 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2cf408be60 con 0x7f2cfc15c690 2023-06-20T13:34:00.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.866+0000 7f2d03fff700 1 -- 172.21.15.32:0/1315492705 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2cfc066a70 con 0x7f2cfc15c690 2023-06-20T13:34:00.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.866+0000 7f2cf27fc700 1 -- 172.21.15.32:0/1315492705 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2cf401d0a0 con 0x7f2cfc15c690 2023-06-20T13:34:00.869 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-06-20T13:34:00.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.868+0000 7f2d03fff700 1 -- 172.21.15.32:0/1315492705 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f2ce006ace0 msgr2=0x7f2ce006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:00.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.868+0000 7f2d03fff700 1 --2- 172.21.15.32:0/1315492705 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f2ce006ace0 0x7f2ce006d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009130 tx=0x7f2cf8008030 comp rx=0 tx=0).stop 2023-06-20T13:34:00.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.868+0000 7f2d03fff700 1 -- 172.21.15.32:0/1315492705 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cfc15c690 msgr2=0x7f2cfc0c7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:00.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.868+0000 7f2d03fff700 1 --2- 172.21.15.32:0/1315492705 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cfc15c690 0x7f2cfc0c7d20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2cf400cd50 tx=0x7f2cf400a560 comp rx=0 tx=0).stop 2023-06-20T13:34:00.871 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.869+0000 7f2d03fff700 1 -- 172.21.15.32:0/1315492705 shutdown_connections 2023-06-20T13:34:00.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.869+0000 7f2d03fff700 1 --2- 172.21.15.32:0/1315492705 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f2ce006ace0 0x7f2ce006d190 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:00.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.869+0000 7f2d03fff700 1 --2- 172.21.15.32:0/1315492705 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2cfc15c690 0x7f2cfc0c7d20 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:00.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.869+0000 7f2d03fff700 1 --2- 172.21.15.32:0/1315492705 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2cfc0ca1f0 0x7f2cfc157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:00.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.869+0000 7f2d03fff700 1 --2- 172.21.15.32:0/1315492705 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cfc0cd0a0 0x7f2cfc0c4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:00.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.869+0000 7f2d03fff700 1 -- 172.21.15.32:0/1315492705 >> 172.21.15.32:0/1315492705 conn(0x7f2cfc0b0fd0 msgr2=0x7f2cfc070340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:00.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.869+0000 7f2d03fff700 1 -- 172.21.15.32:0/1315492705 shutdown_connections 2023-06-20T13:34:00.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:00.869+0000 7f2d03fff700 1 -- 172.21.15.32:0/1315492705 wait complete. 2023-06-20T13:34:00.889 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-20T13:34:01.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.090+0000 7f74561ff700 1 Processor -- start 2023-06-20T13:34:01.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.091+0000 7f74561ff700 1 -- start start 2023-06-20T13:34:01.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.092+0000 7f74561ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f74500d3730 0x7f74500cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:01.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.092+0000 7f74561ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f74500cfa90 0x7f74500d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:01.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.092+0000 7f74561ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74500d0b20 con 0x7f74500b8430 2023-06-20T13:34:01.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.092+0000 7f74561ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74500cda30 con 0x7f74500d3730 2023-06-20T13:34:01.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.092+0000 7f74561ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74500b8800 con 0x7f74500cfa90 2023-06-20T13:34:01.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.092+0000 7f744effd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f74500d3730 0x7f74500cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:01.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.092+0000 7f744effd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f74500d3730 0x7f74500cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54340/0 (socket says 172.21.15.32:54340) 2023-06-20T13:34:01.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.092+0000 7f744effd700 1 -- 172.21.15.32:0/3727613893 learned_addr learned my addr 172.21.15.32:0/3727613893 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:01.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.092+0000 7f744ffff700 1 --2- 172.21.15.32:0/3727613893 >> v2:172.21.15.115:3300/0 conn(0x7f74500cfa90 0x7f74500d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:01.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.093+0000 7f744effd700 1 -- 172.21.15.32:0/3727613893 >> v2:172.21.15.115:3300/0 conn(0x7f74500cfa90 msgr2=0x7f74500d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:01.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.093+0000 7f744effd700 1 --2- 172.21.15.32:0/3727613893 >> v2:172.21.15.115:3300/0 conn(0x7f74500cfa90 0x7f74500d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:01.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.093+0000 7f744effd700 1 -- 172.21.15.32:0/3727613893 >> v1:172.21.15.115:6789/0 conn(0x7f74500b8430 legacy=0x7f74500cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:01.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.093+0000 7f744effd700 1 -- 172.21.15.32:0/3727613893 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74500cfe90 con 0x7f74500d3730 2023-06-20T13:34:01.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.093+0000 7f744ffff700 1 --2- 172.21.15.32:0/3727613893 >> v2:172.21.15.115:3300/0 conn(0x7f74500cfa90 0x7f74500d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:34:01.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.093+0000 7f744effd700 1 --2- 172.21.15.32:0/3727613893 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74500d3730 0x7f74500cf550 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f74500b2100 tx=0x7f7444009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504abeb8f535256f server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:01.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.093+0000 7f744e7fc700 1 -- 172.21.15.32:0/3727613893 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7444004230 con 0x7f74500d3730 2023-06-20T13:34:01.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.093+0000 7f744e7fc700 1 -- 172.21.15.32:0/3727613893 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7444004390 con 0x7f74500d3730 2023-06-20T13:34:01.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.093+0000 7f744e7fc700 1 -- 172.21.15.32:0/3727613893 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74440036a0 con 0x7f74500d3730 2023-06-20T13:34:01.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.094+0000 7f74561ff700 1 -- 172.21.15.32:0/3727613893 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74500d3730 msgr2=0x7f74500cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:01.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.094+0000 7f74561ff700 1 --2- 172.21.15.32:0/3727613893 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74500d3730 0x7f74500cf550 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f74500b2100 tx=0x7f7444009bd0 comp rx=0 tx=0).stop 2023-06-20T13:34:01.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.094+0000 7f74561ff700 1 -- 172.21.15.32:0/3727613893 shutdown_connections 2023-06-20T13:34:01.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.094+0000 7f74561ff700 1 --2- 172.21.15.32:0/3727613893 >> v2:172.21.15.115:3300/0 conn(0x7f74500cfa90 0x7f74500d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:01.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.094+0000 7f74561ff700 1 --2- 172.21.15.32:0/3727613893 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74500d3730 0x7f74500cf550 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:01.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.094+0000 7f74561ff700 1 -- 172.21.15.32:0/3727613893 >> 172.21.15.32:0/3727613893 conn(0x7f745006b3f0 msgr2=0x7f745006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:01.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.094+0000 7f74561ff700 1 -- 172.21.15.32:0/3727613893 shutdown_connections 2023-06-20T13:34:01.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.094+0000 7f74561ff700 1 -- 172.21.15.32:0/3727613893 wait complete. 2023-06-20T13:34:01.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.096+0000 7f74561ff700 1 Processor -- start 2023-06-20T13:34:01.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.096+0000 7f74561ff700 1 -- start start 2023-06-20T13:34:01.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.097+0000 7f74561ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74500b8430 0x7f74501f1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:01.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.097+0000 7f74561ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74500cfa90 0x7f74501f4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:01.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.097+0000 7f74561ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74500d3730 0x7f74500c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:01.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.097+0000 7f74561ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74501f4f50 con 0x7f74500b8430 2023-06-20T13:34:01.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.097+0000 7f74561ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745015b4a0 con 0x7f74500d3730 2023-06-20T13:34:01.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.097+0000 7f74561ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74500cb010 con 0x7f74500cfa90 2023-06-20T13:34:01.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.097+0000 7f744f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74500b8430 0x7f74501f1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:01.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.097+0000 7f744f7fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74500b8430 0x7f74501f1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54350/0 (socket says 172.21.15.32:54350) 2023-06-20T13:34:01.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.097+0000 7f744f7fe700 1 -- 172.21.15.32:0/2373646285 learned_addr learned my addr 172.21.15.32:0/2373646285 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:01.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.097+0000 7f744ffff700 1 --2- 172.21.15.32:0/2373646285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74500d3730 0x7f74500c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:01.102 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.097+0000 7f744effd700 1 --2- 172.21.15.32:0/2373646285 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74500cfa90 0x7f74501f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:01.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.097+0000 7f744f7fe700 1 -- 172.21.15.32:0/2373646285 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74500cfa90 msgr2=0x7f74501f4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:01.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.097+0000 7f744f7fe700 1 --2- 172.21.15.32:0/2373646285 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74500cfa90 0x7f74501f4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:01.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.097+0000 7f744f7fe700 1 -- 172.21.15.32:0/2373646285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74500d3730 msgr2=0x7f74500c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:01.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.097+0000 7f744f7fe700 1 --2- 172.21.15.32:0/2373646285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74500d3730 0x7f74500c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:01.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.097+0000 7f744f7fe700 1 -- 172.21.15.32:0/2373646285 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7444009550 con 0x7f74500b8430 2023-06-20T13:34:01.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.098+0000 7f744f7fe700 1 --2- 172.21.15.32:0/2373646285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74500b8430 0x7f74501f1b00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f744000c4d0 tx=0x7f744000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:01.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.098+0000 7f7437fff700 1 -- 172.21.15.32:0/2373646285 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7440011790 con 0x7f74500b8430 2023-06-20T13:34:01.103 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.098+0000 7f7437fff700 1 -- 172.21.15.32:0/2373646285 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74400118f0 con 0x7f74500b8430 2023-06-20T13:34:01.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.098+0000 7f74561ff700 1 -- 172.21.15.32:0/2373646285 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74500cb2f0 con 0x7f74500b8430 2023-06-20T13:34:01.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.098+0000 7f7437fff700 1 -- 172.21.15.32:0/2373646285 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7440011ca0 con 0x7f74500b8430 2023-06-20T13:34:01.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.098+0000 7f74561ff700 1 -- 172.21.15.32:0/2373646285 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74500cb8b0 con 0x7f74500b8430 2023-06-20T13:34:01.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.099+0000 7f74561ff700 1 -- 172.21.15.32:0/2373646285 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f745004ea60 con 0x7f74500b8430 2023-06-20T13:34:01.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.100+0000 7f7437fff700 1 -- 172.21.15.32:0/2373646285 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f744001c460 con 0x7f74500b8430 2023-06-20T13:34:01.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.101+0000 7f7437fff700 1 --2- 172.21.15.32:0/2373646285 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f743c06ace0 0x7f743c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:01.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.101+0000 7f7437fff700 1 -- 172.21.15.32:0/2373646285 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f7440089150 con 0x7f74500b8430 2023-06-20T13:34:01.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.101+0000 7f744effd700 1 --2- 172.21.15.32:0/2373646285 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f743c06ace0 0x7f743c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:01.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.102+0000 7f744effd700 1 --2- 172.21.15.32:0/2373646285 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f743c06ace0 0x7f743c06d190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7444009130 tx=0x7f7444008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:01.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.105+0000 7f7437fff700 1 -- 172.21.15.32:0/2373646285 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7440054370 con 0x7f74500b8430 2023-06-20T13:34:01.314 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.312+0000 7f74561ff700 1 -- 172.21.15.32:0/2373646285 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f745006ba10 con 0x7f74500b8430 2023-06-20T13:34:01.315 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.313+0000 7f7437fff700 1 -- 172.21.15.32:0/2373646285 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7440057990 con 0x7f74500b8430 2023-06-20T13:34:01.315 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 8 2023-06-20T13:34:01.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.315+0000 7f74561ff700 1 -- 172.21.15.32:0/2373646285 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f743c06ace0 msgr2=0x7f743c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:01.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.315+0000 7f74561ff700 1 --2- 172.21.15.32:0/2373646285 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f743c06ace0 0x7f743c06d190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7444009130 tx=0x7f7444008030 comp rx=0 tx=0).stop 2023-06-20T13:34:01.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.315+0000 7f74561ff700 1 -- 172.21.15.32:0/2373646285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74500b8430 msgr2=0x7f74501f1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:01.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.315+0000 7f74561ff700 1 --2- 172.21.15.32:0/2373646285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74500b8430 0x7f74501f1b00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f744000c4d0 tx=0x7f744000c890 comp rx=0 tx=0).stop 2023-06-20T13:34:01.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.315+0000 7f74561ff700 1 -- 172.21.15.32:0/2373646285 shutdown_connections 2023-06-20T13:34:01.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.315+0000 7f74561ff700 1 --2- 172.21.15.32:0/2373646285 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f743c06ace0 0x7f743c06d190 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:01.318 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.315+0000 7f74561ff700 1 --2- 172.21.15.32:0/2373646285 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74500d3730 0x7f74500c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:01.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.315+0000 7f74561ff700 1 --2- 172.21.15.32:0/2373646285 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f74500b8430 0x7f74501f1b00 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:01.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.315+0000 7f74561ff700 1 --2- 172.21.15.32:0/2373646285 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74500cfa90 0x7f74501f4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:01.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.315+0000 7f74561ff700 1 -- 172.21.15.32:0/2373646285 >> 172.21.15.32:0/2373646285 conn(0x7f745006b3f0 msgr2=0x7f74500b6060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:01.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.315+0000 7f74561ff700 1 -- 172.21.15.32:0/2373646285 shutdown_connections 2023-06-20T13:34:01.319 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.315+0000 7f74561ff700 1 -- 172.21.15.32:0/2373646285 wait complete. 2023-06-20T13:34:01.336 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-20T13:34:01.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.534+0000 7f201a7ff700 1 Processor -- start 2023-06-20T13:34:01.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.535+0000 7f201a7ff700 1 -- start start 2023-06-20T13:34:01.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.536+0000 7f201a7ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f201415c460 0x7f20140b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:01.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.536+0000 7f201a7ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f20140cf8f0 0x7f201415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:01.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.536+0000 7f201a7ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20140d1790 con 0x7f20140d2640 2023-06-20T13:34:01.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.536+0000 7f201a7ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20140cedd0 con 0x7f20140cf8f0 2023-06-20T13:34:01.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.536+0000 7f201a7ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20140cd950 con 0x7f201415c460 2023-06-20T13:34:01.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.536+0000 7f2018d9c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f20140cf8f0 0x7f201415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:01.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.536+0000 7f2013fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f201415c460 0x7f20140b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:01.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.536+0000 7f2018d9c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f20140cf8f0 0x7f201415fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54352/0 (socket says 172.21.15.32:54352) 2023-06-20T13:34:01.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.536+0000 7f2018d9c700 1 -- 172.21.15.32:0/2647089804 learned_addr learned my addr 172.21.15.32:0/2647089804 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:01.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.537+0000 7f2018d9c700 1 -- 172.21.15.32:0/2647089804 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f201415c460 msgr2=0x7f20140b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:01.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.537+0000 7f2018d9c700 1 --2- 172.21.15.32:0/2647089804 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f201415c460 0x7f20140b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:01.540 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.537+0000 7f2018d9c700 1 -- 172.21.15.32:0/2647089804 >> v1:172.21.15.115:6789/0 conn(0x7f20140d2640 legacy=0x7f20140cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:01.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.537+0000 7f2018d9c700 1 -- 172.21.15.32:0/2647089804 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20140d14b0 con 0x7f20140cf8f0 2023-06-20T13:34:01.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.537+0000 7f2012ffd700 1 -- 172.21.15.32:0/2647089804 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1140285068 0 0) 0x7f20140d1790 con 0x7f20140d2640 2023-06-20T13:34:01.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.537+0000 7f2018d9c700 1 --2- 172.21.15.32:0/2647089804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20140cf8f0 0x7f201415fe20 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f200c009e50 tx=0x7f200c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62bf04664ad42f server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:01.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.537+0000 7f2012ffd700 1 -- 172.21.15.32:0/2647089804 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c00e070 con 0x7f20140cf8f0 2023-06-20T13:34:01.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.537+0000 7f2012ffd700 1 -- 172.21.15.32:0/2647089804 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200c00b910 con 0x7f20140cf8f0 2023-06-20T13:34:01.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.537+0000 7f2012ffd700 1 -- 172.21.15.32:0/2647089804 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c00bcc0 con 0x7f20140cf8f0 2023-06-20T13:34:01.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.538+0000 7f201a7ff700 1 -- 172.21.15.32:0/2647089804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20140cf8f0 msgr2=0x7f201415fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:01.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.538+0000 7f201a7ff700 1 --2- 172.21.15.32:0/2647089804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20140cf8f0 0x7f201415fe20 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f200c009e50 tx=0x7f200c00b330 comp rx=0 tx=0).stop 2023-06-20T13:34:01.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.538+0000 7f201a7ff700 1 -- 172.21.15.32:0/2647089804 shutdown_connections 2023-06-20T13:34:01.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.538+0000 7f201a7ff700 1 --2- 172.21.15.32:0/2647089804 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20140cf8f0 0x7f201415fe20 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:01.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.538+0000 7f201a7ff700 1 --2- 172.21.15.32:0/2647089804 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f201415c460 0x7f20140b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:01.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.538+0000 7f201a7ff700 1 -- 172.21.15.32:0/2647089804 >> 172.21.15.32:0/2647089804 conn(0x7f2014071660 msgr2=0x7f2014071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:01.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.538+0000 7f201a7ff700 1 -- 172.21.15.32:0/2647089804 shutdown_connections 2023-06-20T13:34:01.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.538+0000 7f201a7ff700 1 -- 172.21.15.32:0/2647089804 wait complete. 2023-06-20T13:34:01.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.540+0000 7f201a7ff700 1 Processor -- start 2023-06-20T13:34:01.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.540+0000 7f201a7ff700 1 -- start start 2023-06-20T13:34:01.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.541+0000 7f201a7ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20140cf8f0 0x7f20140c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:01.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.541+0000 7f201a7ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20140d2640 0x7f20140c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:01.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.541+0000 7f201a7ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f201415c460 0x7f20140c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:01.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.541+0000 7f201a7ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20140c77e0 con 0x7f20140cf8f0 2023-06-20T13:34:01.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.541+0000 7f201a7ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20140c6b60 con 0x7f20140d2640 2023-06-20T13:34:01.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.541+0000 7f201a7ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20140c6e40 con 0x7f201415c460 2023-06-20T13:34:01.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.541+0000 7f2013fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20140cf8f0 0x7f20140c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:01.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.541+0000 7f2013fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20140cf8f0 0x7f20140c7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54354/0 (socket says 172.21.15.32:54354) 2023-06-20T13:34:01.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.541+0000 7f2013fff700 1 -- 172.21.15.32:0/350777477 learned_addr learned my addr 172.21.15.32:0/350777477 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:01.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.541+0000 7f20137fe700 1 --2- 172.21.15.32:0/350777477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20140d2640 0x7f20140c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:01.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.541+0000 7f2013fff700 1 -- 172.21.15.32:0/350777477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f201415c460 msgr2=0x7f20140c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:01.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.541+0000 7f2013fff700 1 --2- 172.21.15.32:0/350777477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f201415c460 0x7f20140c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:01.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.541+0000 7f2013fff700 1 -- 172.21.15.32:0/350777477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20140d2640 msgr2=0x7f20140c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:01.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.541+0000 7f2013fff700 1 --2- 172.21.15.32:0/350777477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20140d2640 0x7f20140c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:01.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.542+0000 7f2013fff700 1 -- 172.21.15.32:0/350777477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f200c009b30 con 0x7f20140cf8f0 2023-06-20T13:34:01.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.542+0000 7f20137fe700 1 --2- 172.21.15.32:0/350777477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20140d2640 0x7f20140c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:34:01.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.542+0000 7f2013fff700 1 --2- 172.21.15.32:0/350777477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20140cf8f0 0x7f20140c7c00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f200400e9b0 tx=0x7f200400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:01.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.542+0000 7f2010ff9700 1 -- 172.21.15.32:0/350777477 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2004009710 con 0x7f20140cf8f0 2023-06-20T13:34:01.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.542+0000 7f2010ff9700 1 -- 172.21.15.32:0/350777477 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200400c850 con 0x7f20140cf8f0 2023-06-20T13:34:01.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.542+0000 7f2010ff9700 1 -- 172.21.15.32:0/350777477 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200400cbc0 con 0x7f20140cf8f0 2023-06-20T13:34:01.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.542+0000 7f201a7ff700 1 -- 172.21.15.32:0/350777477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20140c7120 con 0x7f20140cf8f0 2023-06-20T13:34:01.548 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.542+0000 7f201a7ff700 1 -- 172.21.15.32:0/350777477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20140c8140 con 0x7f20140cf8f0 2023-06-20T13:34:01.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.543+0000 7f201a7ff700 1 -- 172.21.15.32:0/350777477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20140c7a50 con 0x7f20140cf8f0 2023-06-20T13:34:01.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.544+0000 7f2010ff9700 1 -- 172.21.15.32:0/350777477 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f200400cd20 con 0x7f20140cf8f0 2023-06-20T13:34:01.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.545+0000 7f2010ff9700 1 --2- 172.21.15.32:0/350777477 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f200006ace0 0x7f200006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:01.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.545+0000 7f2010ff9700 1 -- 172.21.15.32:0/350777477 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f2004089420 con 0x7f20140cf8f0 2023-06-20T13:34:01.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.545+0000 7f20137fe700 1 --2- 172.21.15.32:0/350777477 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f200006ace0 0x7f200006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:01.549 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.546+0000 7f20137fe700 1 --2- 172.21.15.32:0/350777477 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f200006ace0 0x7f200006d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f20141439b0 tx=0x7f2008009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:01.551 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.550+0000 7f2010ff9700 1 -- 172.21.15.32:0/350777477 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f20040580d0 con 0x7f20140cf8f0 2023-06-20T13:34:01.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.759+0000 7f201a7ff700 1 -- 172.21.15.32:0/350777477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f20140b86d0 con 0x7f20140cf8f0 2023-06-20T13:34:01.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.759+0000 7f2010ff9700 1 -- 172.21.15.32:0/350777477 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v37) v1 ==== 84+0+126 (secure 0 0 0) 0x7f2004057c60 con 0x7f20140cf8f0 2023-06-20T13:34:01.762 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:34:01.762 INFO:teuthology.orchestra.run.smithi032.stdout:[ 2023-06-20T13:34:01.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-06-20T13:34:01.762 INFO:teuthology.orchestra.run.smithi032.stdout: "poolnum": 1, 2023-06-20T13:34:01.762 INFO:teuthology.orchestra.run.smithi032.stdout: "poolname": ".mgr" 2023-06-20T13:34:01.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2023-06-20T13:34:01.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2023-06-20T13:34:01.763 INFO:teuthology.orchestra.run.smithi032.stdout: "poolnum": 2, 2023-06-20T13:34:01.763 INFO:teuthology.orchestra.run.smithi032.stdout: "poolname": "rbd" 2023-06-20T13:34:01.763 INFO:teuthology.orchestra.run.smithi032.stdout: } 2023-06-20T13:34:01.763 INFO:teuthology.orchestra.run.smithi032.stdout:] 2023-06-20T13:34:01.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.761+0000 7f201a7ff700 1 -- 172.21.15.32:0/350777477 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f200006ace0 msgr2=0x7f200006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:01.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.761+0000 7f201a7ff700 1 --2- 172.21.15.32:0/350777477 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f200006ace0 0x7f200006d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f20141439b0 tx=0x7f2008009040 comp rx=0 tx=0).stop 2023-06-20T13:34:01.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.761+0000 7f201a7ff700 1 -- 172.21.15.32:0/350777477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20140cf8f0 msgr2=0x7f20140c7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:01.764 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.761+0000 7f201a7ff700 1 --2- 172.21.15.32:0/350777477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20140cf8f0 0x7f20140c7c00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f200400e9b0 tx=0x7f200400ed70 comp rx=0 tx=0).stop 2023-06-20T13:34:01.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.761+0000 7f201a7ff700 1 -- 172.21.15.32:0/350777477 shutdown_connections 2023-06-20T13:34:01.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.761+0000 7f201a7ff700 1 --2- 172.21.15.32:0/350777477 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f200006ace0 0x7f200006d190 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:01.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.761+0000 7f201a7ff700 1 --2- 172.21.15.32:0/350777477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f201415c460 0x7f20140c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:01.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.761+0000 7f201a7ff700 1 --2- 172.21.15.32:0/350777477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f20140cf8f0 0x7f20140c7c00 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:01.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.761+0000 7f201a7ff700 1 --2- 172.21.15.32:0/350777477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20140d2640 0x7f20140c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:01.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.761+0000 7f201a7ff700 1 -- 172.21.15.32:0/350777477 >> 172.21.15.32:0/350777477 conn(0x7f2014071660 msgr2=0x7f201415c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:01.765 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.761+0000 7f201a7ff700 1 -- 172.21.15.32:0/350777477 shutdown_connections 2023-06-20T13:34:01.766 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.762+0000 7f201a7ff700 1 -- 172.21.15.32:0/350777477 wait complete. 2023-06-20T13:34:01.781 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-20T13:34:01.781 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-20T13:34:01.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.986+0000 7ff98dbff700 1 Processor -- start 2023-06-20T13:34:01.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.986+0000 7ff98dbff700 1 -- start start 2023-06-20T13:34:01.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.987+0000 7ff98dbff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff98815a0c0 0x7ff9880b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:01.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.987+0000 7ff98dbff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff9880cbb10 0x7ff98806d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:01.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.987+0000 7ff98dbff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff988071030 0x7ff98806d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:01.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.987+0000 7ff98dbff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9880c8e10 con 0x7ff98815a0c0 2023-06-20T13:34:01.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.987+0000 7ff98dbff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff988070750 con 0x7ff9880cbb10 2023-06-20T13:34:01.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.987+0000 7ff98dbff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff988070a30 con 0x7ff988071030 2023-06-20T13:34:01.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.987+0000 7ff9877fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff98815a0c0 0x7ff9880b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:01.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.987+0000 7ff9877fe700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7ff98815a0c0 0x7ff9880b1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54368/0 (socket says 172.21.15.32:54368) 2023-06-20T13:34:01.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.987+0000 7ff9877fe700 1 -- 172.21.15.32:0/323656343 learned_addr learned my addr 172.21.15.32:0/323656343 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:01.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.988+0000 7ff987fff700 1 --2- 172.21.15.32:0/323656343 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff988071030 0x7ff98806d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:01.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.988+0000 7ff986ffd700 1 --2- 172.21.15.32:0/323656343 >> v2:172.21.15.115:3300/0 conn(0x7ff9880cbb10 0x7ff98806d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:01.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.988+0000 7ff9877fe700 1 -- 172.21.15.32:0/323656343 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff988071030 msgr2=0x7ff98806d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:01.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.988+0000 7ff9877fe700 1 --2- 172.21.15.32:0/323656343 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff988071030 0x7ff98806d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:01.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.988+0000 7ff9877fe700 1 -- 172.21.15.32:0/323656343 >> v2:172.21.15.115:3300/0 conn(0x7ff9880cbb10 msgr2=0x7ff98806d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:01.993 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.988+0000 7ff9877fe700 1 --2- 172.21.15.32:0/323656343 >> v2:172.21.15.115:3300/0 conn(0x7ff9880cbb10 0x7ff98806d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:01.993 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.988+0000 7ff9877fe700 1 -- 172.21.15.32:0/323656343 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9880c9060 con 0x7ff98815a0c0 2023-06-20T13:34:01.993 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.988+0000 7ff986ffd700 1 --2- 172.21.15.32:0/323656343 >> v2:172.21.15.115:3300/0 conn(0x7ff9880cbb10 0x7ff98806d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:34:01.993 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.988+0000 7ff9877fe700 1 --2- 172.21.15.32:0/323656343 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff98815a0c0 0x7ff9880b1690 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff9880ad8c0 tx=0x7ff978009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b373273a4c5f0bac server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:01.993 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.988+0000 7ff9867fc700 1 -- 172.21.15.32:0/323656343 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97800b870 con 0x7ff98815a0c0 2023-06-20T13:34:01.993 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.988+0000 7ff9867fc700 1 -- 172.21.15.32:0/323656343 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97800b9d0 con 0x7ff98815a0c0 2023-06-20T13:34:01.993 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.988+0000 7ff9867fc700 1 -- 172.21.15.32:0/323656343 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97800bd60 con 0x7ff98815a0c0 2023-06-20T13:34:01.993 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.989+0000 7ff98dbff700 1 -- 172.21.15.32:0/323656343 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff98815a0c0 msgr2=0x7ff9880b1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:01.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.989+0000 7ff98dbff700 1 --2- 172.21.15.32:0/323656343 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff98815a0c0 0x7ff9880b1690 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff9880ad8c0 tx=0x7ff978009bd0 comp rx=0 tx=0).stop 2023-06-20T13:34:01.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.989+0000 7ff98dbff700 1 -- 172.21.15.32:0/323656343 shutdown_connections 2023-06-20T13:34:01.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.989+0000 7ff98dbff700 1 --2- 172.21.15.32:0/323656343 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff988071030 0x7ff98806d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:01.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.989+0000 7ff98dbff700 1 --2- 172.21.15.32:0/323656343 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff98815a0c0 0x7ff9880b1690 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:01.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.989+0000 7ff98dbff700 1 --2- 172.21.15.32:0/323656343 >> v2:172.21.15.115:3300/0 conn(0x7ff9880cbb10 0x7ff98806d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:01.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.989+0000 7ff98dbff700 1 -- 172.21.15.32:0/323656343 >> 172.21.15.32:0/323656343 conn(0x7ff9880b0390 msgr2=0x7ff9880b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:01.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.989+0000 7ff98dbff700 1 -- 172.21.15.32:0/323656343 shutdown_connections 2023-06-20T13:34:01.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.989+0000 7ff98dbff700 1 -- 172.21.15.32:0/323656343 wait complete. 2023-06-20T13:34:01.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.991+0000 7ff98dbff700 1 Processor -- start 2023-06-20T13:34:01.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.991+0000 7ff98dbff700 1 -- start start 2023-06-20T13:34:01.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.992+0000 7ff98dbff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff988071030 0x7ff988156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:01.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.992+0000 7ff98dbff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9880cbb10 0x7ff9880a74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:01.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.992+0000 7ff98dbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff98815a0c0 0x7ff9880c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:01.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.992+0000 7ff98dbff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9880c8860 con 0x7ff988071030 2023-06-20T13:34:01.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.992+0000 7ff98dbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9880c7a20 con 0x7ff98815a0c0 2023-06-20T13:34:01.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.992+0000 7ff98dbff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9880c7180 con 0x7ff9880cbb10 2023-06-20T13:34:01.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.992+0000 7ff9877fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff988071030 0x7ff988156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:01.997 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.992+0000 7ff9877fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff988071030 0x7ff988156a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54370/0 (socket says 172.21.15.32:54370) 2023-06-20T13:34:01.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.992+0000 7ff9877fe700 1 -- 172.21.15.32:0/1668440110 learned_addr learned my addr 172.21.15.32:0/1668440110 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:01.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.993+0000 7ff986ffd700 1 --2- 172.21.15.32:0/1668440110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9880cbb10 0x7ff9880a74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:01.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.993+0000 7ff987fff700 1 --2- 172.21.15.32:0/1668440110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff98815a0c0 0x7ff9880c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:01.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.993+0000 7ff9877fe700 1 -- 172.21.15.32:0/1668440110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9880cbb10 msgr2=0x7ff9880a74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:01.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.993+0000 7ff9877fe700 1 --2- 172.21.15.32:0/1668440110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9880cbb10 0x7ff9880a74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:01.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.993+0000 7ff9877fe700 1 -- 172.21.15.32:0/1668440110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff98815a0c0 msgr2=0x7ff9880c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:01.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.993+0000 7ff9877fe700 1 --2- 172.21.15.32:0/1668440110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff98815a0c0 0x7ff9880c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:01.998 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.993+0000 7ff9877fe700 1 -- 172.21.15.32:0/1668440110 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff978009550 con 0x7ff988071030 2023-06-20T13:34:01.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.993+0000 7ff9877fe700 1 --2- 172.21.15.32:0/1668440110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff988071030 0x7ff988156a20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff978000c00 tx=0x7ff978004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:01.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.993+0000 7ff96ffff700 1 -- 172.21.15.32:0/1668440110 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff978004310 con 0x7ff988071030 2023-06-20T13:34:01.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.993+0000 7ff96ffff700 1 -- 172.21.15.32:0/1668440110 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97801e070 con 0x7ff988071030 2023-06-20T13:34:01.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.993+0000 7ff96ffff700 1 -- 172.21.15.32:0/1668440110 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9780036a0 con 0x7ff988071030 2023-06-20T13:34:01.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.994+0000 7ff98dbff700 1 -- 172.21.15.32:0/1668440110 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9880c7460 con 0x7ff988071030 2023-06-20T13:34:01.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.994+0000 7ff98dbff700 1 -- 172.21.15.32:0/1668440110 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9880a9340 con 0x7ff988071030 2023-06-20T13:34:02.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.995+0000 7ff98dbff700 1 -- 172.21.15.32:0/1668440110 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff988074180 con 0x7ff988071030 2023-06-20T13:34:02.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.996+0000 7ff96ffff700 1 -- 172.21.15.32:0/1668440110 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff978020030 con 0x7ff988071030 2023-06-20T13:34:02.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.997+0000 7ff96ffff700 1 --2- 172.21.15.32:0/1668440110 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff97406ace0 0x7ff97406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:02.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.997+0000 7ff96ffff700 1 -- 172.21.15.32:0/1668440110 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ff97808a0c0 con 0x7ff988071030 2023-06-20T13:34:02.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.997+0000 7ff986ffd700 1 --2- 172.21.15.32:0/1668440110 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff97406ace0 0x7ff97406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:02.001 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:01.998+0000 7ff986ffd700 1 --2- 172.21.15.32:0/1668440110 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff97406ace0 0x7ff97406d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff9880c82b0 tx=0x7ff97c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:02.004 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:02.002+0000 7ff96ffff700 1 -- 172.21.15.32:0/1668440110 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff978055370 con 0x7ff988071030 2023-06-20T13:34:02.215 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:02.213+0000 7ff98dbff700 1 -- 172.21.15.32:0/1668440110 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff9881573e0 con 0x7ff988071030 2023-06-20T13:34:02.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:02.983+0000 7ff96ffff700 1 -- 172.21.15.32:0/1668440110 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v38) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff978058990 con 0x7ff988071030 2023-06-20T13:34:02.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:02.988+0000 7ff98dbff700 1 -- 172.21.15.32:0/1668440110 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff97406ace0 msgr2=0x7ff97406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:02.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:02.988+0000 7ff98dbff700 1 --2- 172.21.15.32:0/1668440110 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff97406ace0 0x7ff97406d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff9880c82b0 tx=0x7ff97c008040 comp rx=0 tx=0).stop 2023-06-20T13:34:02.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:02.988+0000 7ff98dbff700 1 -- 172.21.15.32:0/1668440110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff988071030 msgr2=0x7ff988156a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:02.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:02.988+0000 7ff98dbff700 1 --2- 172.21.15.32:0/1668440110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff988071030 0x7ff988156a20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff978000c00 tx=0x7ff978004750 comp rx=0 tx=0).stop 2023-06-20T13:34:02.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:02.989+0000 7ff98dbff700 1 -- 172.21.15.32:0/1668440110 shutdown_connections 2023-06-20T13:34:02.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:02.989+0000 7ff98dbff700 1 --2- 172.21.15.32:0/1668440110 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ff97406ace0 0x7ff97406d190 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:02.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:02.989+0000 7ff98dbff700 1 --2- 172.21.15.32:0/1668440110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff98815a0c0 0x7ff9880c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:02.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:02.989+0000 7ff98dbff700 1 --2- 172.21.15.32:0/1668440110 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ff988071030 0x7ff988156a20 secure :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff978000c00 tx=0x7ff978004750 comp rx=0 tx=0).stop 2023-06-20T13:34:02.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:02.989+0000 7ff98dbff700 1 --2- 172.21.15.32:0/1668440110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9880cbb10 0x7ff9880a74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:02.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:02.989+0000 7ff98dbff700 1 -- 172.21.15.32:0/1668440110 >> 172.21.15.32:0/1668440110 conn(0x7ff9880b0390 msgr2=0x7ff9880af600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:02.993 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:02.990+0000 7ff98dbff700 1 -- 172.21.15.32:0/1668440110 shutdown_connections 2023-06-20T13:34:02.993 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:02.991+0000 7ff98dbff700 1 -- 172.21.15.32:0/1668440110 wait complete. 2023-06-20T13:34:02.996 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_metadata' created 2023-06-20T13:34:03.016 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-20T13:34:03.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.226+0000 7f1d54bff700 1 Processor -- start 2023-06-20T13:34:03.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.226+0000 7f1d54bff700 1 -- start start 2023-06-20T13:34:03.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.227+0000 7f1d54bff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1d500d3730 0x7f1d500cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:03.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.227+0000 7f1d54bff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d500d0b20 con 0x7f1d500cfa90 2023-06-20T13:34:03.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.227+0000 7f1d54bff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d500cfe90 con 0x7f1d500b8430 2023-06-20T13:34:03.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.227+0000 7f1d54bff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d500cda30 con 0x7f1d500d3730 2023-06-20T13:34:03.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.227+0000 7f1d4dd9b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f1d500d3730 0x7f1d500cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:03.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.227+0000 7f1d4ed9d700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f1d500cfa90 0x7f1d500d0fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:51546/0 (socket says 172.21.15.32:51546) 2023-06-20T13:34:03.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.228+0000 7f1d4ed9d700 1 -- 172.21.15.32:0/3229408103 learned_addr learned my addr 172.21.15.32:0/3229408103 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:34:03.231 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.228+0000 7f1d4d59a700 1 -- 172.21.15.32:0/3229408103 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2066028762 0 0) 0x7f1d500d0b20 con 0x7f1d500cfa90 2023-06-20T13:34:03.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.228+0000 7f1d4dd9b700 1 -- 172.21.15.32:0/3229408103 >> v1:172.21.15.115:6789/0 conn(0x7f1d500b8430 legacy=0x7f1d500cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:03.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.228+0000 7f1d4dd9b700 1 -- 172.21.15.32:0/3229408103 >> v1:172.21.15.32:6789/0 conn(0x7f1d500cfa90 legacy=0x7f1d500d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:03.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.228+0000 7f1d4dd9b700 1 -- 172.21.15.32:0/3229408103 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d500b4ee0 con 0x7f1d500d3730 2023-06-20T13:34:03.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.228+0000 7f1d4dd9b700 1 --2- 172.21.15.32:0/3229408103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d500d3730 0x7f1d500cf550 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1d44009840 tx=0x7f1d44009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e3d53021f580a7 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:03.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.228+0000 7f1d4d59a700 1 -- 172.21.15.32:0/3229408103 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d44011830 con 0x7f1d500d3730 2023-06-20T13:34:03.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.229+0000 7f1d4d59a700 1 -- 172.21.15.32:0/3229408103 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d44011990 con 0x7f1d500d3730 2023-06-20T13:34:03.232 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.229+0000 7f1d4d59a700 1 -- 172.21.15.32:0/3229408103 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d44011d20 con 0x7f1d500d3730 2023-06-20T13:34:03.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.229+0000 7f1d54bff700 1 -- 172.21.15.32:0/3229408103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d500d3730 msgr2=0x7f1d500cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:03.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.229+0000 7f1d54bff700 1 --2- 172.21.15.32:0/3229408103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d500d3730 0x7f1d500cf550 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1d44009840 tx=0x7f1d44009b50 comp rx=0 tx=0).stop 2023-06-20T13:34:03.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.229+0000 7f1d54bff700 1 -- 172.21.15.32:0/3229408103 shutdown_connections 2023-06-20T13:34:03.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.229+0000 7f1d54bff700 1 --2- 172.21.15.32:0/3229408103 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d500d3730 0x7f1d500cf550 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:03.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.229+0000 7f1d54bff700 1 -- 172.21.15.32:0/3229408103 >> 172.21.15.32:0/3229408103 conn(0x7f1d5006b3f0 msgr2=0x7f1d5006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:03.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.229+0000 7f1d54bff700 1 -- 172.21.15.32:0/3229408103 shutdown_connections 2023-06-20T13:34:03.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.229+0000 7f1d54bff700 1 -- 172.21.15.32:0/3229408103 wait complete. 2023-06-20T13:34:03.235 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.231+0000 7f1d54bff700 1 Processor -- start 2023-06-20T13:34:03.235 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.231+0000 7f1d54bff700 1 -- start start 2023-06-20T13:34:03.235 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.232+0000 7f1d54bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d500b8430 0x7f1d5015ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:03.235 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.232+0000 7f1d54bff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d500cfa90 0x7f1d500ca620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:03.235 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.232+0000 7f1d54bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d500d3730 0x7f1d50155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:03.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.232+0000 7f1d54bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5015d390 con 0x7f1d500d3730 2023-06-20T13:34:03.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.232+0000 7f1d54bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d500cad20 con 0x7f1d500b8430 2023-06-20T13:34:03.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.232+0000 7f1d54bff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d501555b0 con 0x7f1d500cfa90 2023-06-20T13:34:03.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.232+0000 7f1d4ed9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d500d3730 0x7f1d50155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:03.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.232+0000 7f1d4ed9d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d500d3730 0x7f1d50155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54400/0 (socket says 172.21.15.32:54400) 2023-06-20T13:34:03.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.232+0000 7f1d4ed9d700 1 -- 172.21.15.32:0/3827703567 learned_addr learned my addr 172.21.15.32:0/3827703567 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:03.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.233+0000 7f1d4e59c700 1 --2- 172.21.15.32:0/3827703567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d500b8430 0x7f1d5015ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:03.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.233+0000 7f1d4dd9b700 1 --2- 172.21.15.32:0/3827703567 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d500cfa90 0x7f1d500ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:03.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.233+0000 7f1d4ed9d700 1 -- 172.21.15.32:0/3827703567 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d500cfa90 msgr2=0x7f1d500ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:03.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.233+0000 7f1d4ed9d700 1 --2- 172.21.15.32:0/3827703567 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d500cfa90 0x7f1d500ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:03.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.233+0000 7f1d4ed9d700 1 -- 172.21.15.32:0/3827703567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d500b8430 msgr2=0x7f1d5015ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:03.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.233+0000 7f1d4ed9d700 1 --2- 172.21.15.32:0/3827703567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d500b8430 0x7f1d5015ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:03.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.233+0000 7f1d4ed9d700 1 -- 172.21.15.32:0/3827703567 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d440094a0 con 0x7f1d500d3730 2023-06-20T13:34:03.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.233+0000 7f1d4dd9b700 1 --2- 172.21.15.32:0/3827703567 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d500cfa90 0x7f1d500ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:34:03.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.233+0000 7f1d4ed9d700 1 --2- 172.21.15.32:0/3827703567 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d500d3730 0x7f1d50155070 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1d48002230 tx=0x7f1d4800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:03.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.233+0000 7f1d3effd700 1 -- 172.21.15.32:0/3827703567 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4800ac20 con 0x7f1d500d3730 2023-06-20T13:34:03.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.233+0000 7f1d3effd700 1 -- 172.21.15.32:0/3827703567 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4800ada0 con 0x7f1d500d3730 2023-06-20T13:34:03.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.233+0000 7f1d3effd700 1 -- 172.21.15.32:0/3827703567 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d48007310 con 0x7f1d500d3730 2023-06-20T13:34:03.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.233+0000 7f1d54bff700 1 -- 172.21.15.32:0/3827703567 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d5015ca60 con 0x7f1d500d3730 2023-06-20T13:34:03.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.233+0000 7f1d54bff700 1 -- 172.21.15.32:0/3827703567 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d5015d020 con 0x7f1d500d3730 2023-06-20T13:34:03.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.235+0000 7f1d54bff700 1 -- 172.21.15.32:0/3827703567 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d5004ea60 con 0x7f1d500d3730 2023-06-20T13:34:03.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.237+0000 7f1d3effd700 1 -- 172.21.15.32:0/3827703567 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1d48007470 con 0x7f1d500d3730 2023-06-20T13:34:03.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.238+0000 7f1d3effd700 1 --2- 172.21.15.32:0/3827703567 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1d3006ace0 0x7f1d3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:03.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.238+0000 7f1d3effd700 1 -- 172.21.15.32:0/3827703567 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f1d480892d0 con 0x7f1d500d3730 2023-06-20T13:34:03.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.238+0000 7f1d4e59c700 1 --2- 172.21.15.32:0/3827703567 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1d3006ace0 0x7f1d3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:03.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.239+0000 7f1d4e59c700 1 --2- 172.21.15.32:0/3827703567 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1d3006ace0 0x7f1d3006d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1d500cf700 tx=0x7f1d40009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:03.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.242+0000 7f1d3effd700 1 -- 172.21.15.32:0/3827703567 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1d48054490 con 0x7f1d500d3730 2023-06-20T13:34:03.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.447+0000 7f1d54bff700 1 -- 172.21.15.32:0/3827703567 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1d5015d4d0 con 0x7f1d500d3730 2023-06-20T13:34:03.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.988+0000 7f1d3effd700 1 -- 172.21.15.32:0/3827703567 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v39) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1d480180d0 con 0x7f1d500d3730 2023-06-20T13:34:03.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.996+0000 7f1d54bff700 1 -- 172.21.15.32:0/3827703567 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1d3006ace0 msgr2=0x7f1d3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:03.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.996+0000 7f1d54bff700 1 --2- 172.21.15.32:0/3827703567 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1d3006ace0 0x7f1d3006d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1d500cf700 tx=0x7f1d40009040 comp rx=0 tx=0).stop 2023-06-20T13:34:03.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.996+0000 7f1d54bff700 1 -- 172.21.15.32:0/3827703567 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d500d3730 msgr2=0x7f1d50155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:03.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.996+0000 7f1d54bff700 1 --2- 172.21.15.32:0/3827703567 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d500d3730 0x7f1d50155070 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1d48002230 tx=0x7f1d4800a060 comp rx=0 tx=0).stop 2023-06-20T13:34:03.999 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.996+0000 7f1d54bff700 1 -- 172.21.15.32:0/3827703567 shutdown_connections 2023-06-20T13:34:04.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.996+0000 7f1d54bff700 1 --2- 172.21.15.32:0/3827703567 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f1d3006ace0 0x7f1d3006d190 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:04.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.996+0000 7f1d54bff700 1 --2- 172.21.15.32:0/3827703567 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f1d500d3730 0x7f1d50155070 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:04.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.996+0000 7f1d54bff700 1 --2- 172.21.15.32:0/3827703567 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d500b8430 0x7f1d5015ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:04.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.996+0000 7f1d54bff700 1 --2- 172.21.15.32:0/3827703567 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d500cfa90 0x7f1d500ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:04.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.996+0000 7f1d54bff700 1 -- 172.21.15.32:0/3827703567 >> 172.21.15.32:0/3827703567 conn(0x7f1d5006b3f0 msgr2=0x7f1d500b6030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:04.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.997+0000 7f1d54bff700 1 -- 172.21.15.32:0/3827703567 shutdown_connections 2023-06-20T13:34:04.000 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:03.997+0000 7f1d54bff700 1 -- 172.21.15.32:0/3827703567 wait complete. 2023-06-20T13:34:04.008 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'cephfs_data' created 2023-06-20T13:34:04.030 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-20T13:34:04.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.234+0000 7f4736bff700 1 Processor -- start 2023-06-20T13:34:04.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.234+0000 7f4736bff700 1 -- start start 2023-06-20T13:34:04.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.235+0000 7f4736bff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f47300d3730 0x7f47300cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:04.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.236+0000 7f4736bff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47300cfa90 0x7f47300d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:04.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.236+0000 7f4736bff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47300d0b20 con 0x7f47300b8430 2023-06-20T13:34:04.238 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.236+0000 7f4736bff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47300cda30 con 0x7f47300d3730 2023-06-20T13:34:04.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.236+0000 7f4736bff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47300b8800 con 0x7f47300cfa90 2023-06-20T13:34:04.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.236+0000 7f472ffff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f47300d3730 0x7f47300cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:04.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.236+0000 7f473499b700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f47300b8430 0x7f47300cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:51552/0 (socket says 172.21.15.32:51552) 2023-06-20T13:34:04.239 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.236+0000 7f473499b700 1 -- 172.21.15.32:0/1427039200 learned_addr learned my addr 172.21.15.32:0/1427039200 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:34:04.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.236+0000 7f473519c700 1 --2- 172.21.15.32:0/1427039200 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47300cfa90 0x7f47300d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:04.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.236+0000 7f472ffff700 1 -- 172.21.15.32:0/1427039200 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47300cfa90 msgr2=0x7f47300d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:04.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.236+0000 7f472ffff700 1 --2- 172.21.15.32:0/1427039200 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47300cfa90 0x7f47300d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:04.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.236+0000 7f472ffff700 1 -- 172.21.15.32:0/1427039200 >> v1:172.21.15.32:6789/0 conn(0x7f47300b8430 legacy=0x7f47300cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:04.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.236+0000 7f472ffff700 1 -- 172.21.15.32:0/1427039200 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47300cfeb0 con 0x7f47300d3730 2023-06-20T13:34:04.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.236+0000 7f472f7fe700 1 -- 172.21.15.32:0/1427039200 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920647461 0 0) 0x7f47300d0b20 con 0x7f47300b8430 2023-06-20T13:34:04.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.237+0000 7f472ffff700 1 --2- 172.21.15.32:0/1427039200 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47300d3730 0x7f47300cf550 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f471c009840 tx=0x7f471c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d226d9a2a2ed9e server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:04.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.237+0000 7f472f7fe700 1 -- 172.21.15.32:0/1427039200 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c011830 con 0x7f47300d3730 2023-06-20T13:34:04.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.237+0000 7f472f7fe700 1 -- 172.21.15.32:0/1427039200 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471c011990 con 0x7f47300d3730 2023-06-20T13:34:04.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.237+0000 7f472f7fe700 1 -- 172.21.15.32:0/1427039200 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c011d20 con 0x7f47300d3730 2023-06-20T13:34:04.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.237+0000 7f4736bff700 1 -- 172.21.15.32:0/1427039200 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47300d3730 msgr2=0x7f47300cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:04.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.237+0000 7f4736bff700 1 --2- 172.21.15.32:0/1427039200 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47300d3730 0x7f47300cf550 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f471c009840 tx=0x7f471c009b50 comp rx=0 tx=0).stop 2023-06-20T13:34:04.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.238+0000 7f4736bff700 1 -- 172.21.15.32:0/1427039200 shutdown_connections 2023-06-20T13:34:04.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.238+0000 7f4736bff700 1 --2- 172.21.15.32:0/1427039200 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47300cfa90 0x7f47300d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:04.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.238+0000 7f4736bff700 1 --2- 172.21.15.32:0/1427039200 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47300d3730 0x7f47300cf550 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:04.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.238+0000 7f4736bff700 1 -- 172.21.15.32:0/1427039200 >> 172.21.15.32:0/1427039200 conn(0x7f473006b3f0 msgr2=0x7f473006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:04.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.238+0000 7f4736bff700 1 -- 172.21.15.32:0/1427039200 shutdown_connections 2023-06-20T13:34:04.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.238+0000 7f4736bff700 1 -- 172.21.15.32:0/1427039200 wait complete. 2023-06-20T13:34:04.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.239+0000 7f4736bff700 1 Processor -- start 2023-06-20T13:34:04.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.240+0000 7f4736bff700 1 -- start start 2023-06-20T13:34:04.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.240+0000 7f4736bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47300b8430 0x7f473015f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:04.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.240+0000 7f4736bff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47300cfa90 0x7f47300b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:04.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.240+0000 7f4736bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47300d3730 0x7f473014cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:04.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.240+0000 7f4736bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473015d080 con 0x7f47300d3730 2023-06-20T13:34:04.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.240+0000 7f4736bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4730150a50 con 0x7f47300b8430 2023-06-20T13:34:04.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.240+0000 7f4736bff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47301f1f40 con 0x7f47300cfa90 2023-06-20T13:34:04.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.241+0000 7f473519c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47300d3730 0x7f473014cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:04.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.241+0000 7f473519c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47300d3730 0x7f473014cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54422/0 (socket says 172.21.15.32:54422) 2023-06-20T13:34:04.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.241+0000 7f473519c700 1 -- 172.21.15.32:0/2029134202 learned_addr learned my addr 172.21.15.32:0/2029134202 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:04.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.241+0000 7f472ffff700 1 --2- 172.21.15.32:0/2029134202 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47300cfa90 0x7f47300b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:04.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.241+0000 7f473499b700 1 --2- 172.21.15.32:0/2029134202 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47300b8430 0x7f473015f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:04.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.241+0000 7f473519c700 1 -- 172.21.15.32:0/2029134202 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47300cfa90 msgr2=0x7f47300b7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:04.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.241+0000 7f473519c700 1 --2- 172.21.15.32:0/2029134202 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47300cfa90 0x7f47300b7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:04.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.241+0000 7f473519c700 1 -- 172.21.15.32:0/2029134202 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47300b8430 msgr2=0x7f473015f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:04.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.241+0000 7f473519c700 1 --2- 172.21.15.32:0/2029134202 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47300b8430 0x7f473015f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:04.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.241+0000 7f473519c700 1 -- 172.21.15.32:0/2029134202 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471c0094a0 con 0x7f47300d3730 2023-06-20T13:34:04.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.241+0000 7f473499b700 1 --2- 172.21.15.32:0/2029134202 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47300b8430 0x7f473015f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:34:04.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.241+0000 7f473519c700 1 --2- 172.21.15.32:0/2029134202 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47300d3730 0x7f473014cbc0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f472800efc0 tx=0x7f472800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:04.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.242+0000 7f472d7fa700 1 -- 172.21.15.32:0/2029134202 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4728009ea0 con 0x7f47300d3730 2023-06-20T13:34:04.255 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.242+0000 7f472d7fa700 1 -- 172.21.15.32:0/2029134202 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472800f040 con 0x7f47300d3730 2023-06-20T13:34:04.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.242+0000 7f472d7fa700 1 -- 172.21.15.32:0/2029134202 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4728014480 con 0x7f47300d3730 2023-06-20T13:34:04.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.242+0000 7f4736bff700 1 -- 172.21.15.32:0/2029134202 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47301f2150 con 0x7f47300d3730 2023-06-20T13:34:04.256 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.242+0000 7f4736bff700 1 -- 172.21.15.32:0/2029134202 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47301f2710 con 0x7f47300d3730 2023-06-20T13:34:04.258 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.243+0000 7f4736bff700 1 -- 172.21.15.32:0/2029134202 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f473004ea60 con 0x7f47300d3730 2023-06-20T13:34:04.258 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.244+0000 7f472d7fa700 1 -- 172.21.15.32:0/2029134202 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f47280145e0 con 0x7f47300d3730 2023-06-20T13:34:04.258 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.246+0000 7f472d7fa700 1 --2- 172.21.15.32:0/2029134202 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f471406ace0 0x7f471406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:04.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.246+0000 7f472d7fa700 1 -- 172.21.15.32:0/2029134202 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f4728089e20 con 0x7f47300d3730 2023-06-20T13:34:04.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.246+0000 7f473499b700 1 --2- 172.21.15.32:0/2029134202 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f471406ace0 0x7f471406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:04.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.247+0000 7f473499b700 1 --2- 172.21.15.32:0/2029134202 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f471406ace0 0x7f471406d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4724000f60 tx=0x7f4724007ca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:04.259 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.251+0000 7f472d7fa700 1 -- 172.21.15.32:0/2029134202 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4728054de0 con 0x7f47300d3730 2023-06-20T13:34:04.509 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:04.507+0000 7f4736bff700 1 -- 172.21.15.32:0/2029134202 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f47300cf110 con 0x7f47300d3730 2023-06-20T13:34:05.290 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.286+0000 7f472d7fa700 1 -- 172.21.15.32:0/2029134202 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f47280180c0 con 0x7f47300d3730 2023-06-20T13:34:05.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.292+0000 7f4736bff700 1 -- 172.21.15.32:0/2029134202 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f471406ace0 msgr2=0x7f471406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:05.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.292+0000 7f4736bff700 1 --2- 172.21.15.32:0/2029134202 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f471406ace0 0x7f471406d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4724000f60 tx=0x7f4724007ca0 comp rx=0 tx=0).stop 2023-06-20T13:34:05.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.292+0000 7f4736bff700 1 -- 172.21.15.32:0/2029134202 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47300d3730 msgr2=0x7f473014cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:05.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.292+0000 7f4736bff700 1 --2- 172.21.15.32:0/2029134202 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47300d3730 0x7f473014cbc0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f472800efc0 tx=0x7f472800c3a0 comp rx=0 tx=0).stop 2023-06-20T13:34:05.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.293+0000 7f4736bff700 1 -- 172.21.15.32:0/2029134202 shutdown_connections 2023-06-20T13:34:05.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.293+0000 7f4736bff700 1 --2- 172.21.15.32:0/2029134202 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f471406ace0 0x7f471406d190 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:05.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.293+0000 7f4736bff700 1 --2- 172.21.15.32:0/2029134202 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f47300d3730 0x7f473014cbc0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:05.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.293+0000 7f4736bff700 1 --2- 172.21.15.32:0/2029134202 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47300b8430 0x7f473015f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:05.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.293+0000 7f4736bff700 1 --2- 172.21.15.32:0/2029134202 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f47300cfa90 0x7f47300b7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:05.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.293+0000 7f4736bff700 1 -- 172.21.15.32:0/2029134202 >> 172.21.15.32:0/2029134202 conn(0x7f473006b3f0 msgr2=0x7f47300b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:05.298 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.295+0000 7f4736bff700 1 -- 172.21.15.32:0/2029134202 shutdown_connections 2023-06-20T13:34:05.299 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.295+0000 7f4736bff700 1 -- 172.21.15.32:0/2029134202 wait complete. 2023-06-20T13:34:05.311 INFO:teuthology.orchestra.run.smithi032.stderr:new fs with metadata pool 6 and data pool 7 2023-06-20T13:34:05.330 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:34:05.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.531+0000 7f15a43ff700 1 Processor -- start 2023-06-20T13:34:05.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.531+0000 7f15a43ff700 1 -- start start 2023-06-20T13:34:05.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.532+0000 7f15a43ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f159c15c460 0x7f159c0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:05.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.532+0000 7f15a43ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f159c0d2640 0x7f159c0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:05.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.532+0000 7f15a43ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f159c0d1790 con 0x7f159c0cf720 2023-06-20T13:34:05.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.532+0000 7f15a43ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f159c0cedd0 con 0x7f159c0d2640 2023-06-20T13:34:05.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.532+0000 7f15a43ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f159c0cd950 con 0x7f159c15c460 2023-06-20T13:34:05.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.533+0000 7f15a199a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f159c0d2640 0x7f159c0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:05.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.533+0000 7f15a299c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f159c0cf720 0x7f159c0d2b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:51562/0 (socket says 172.21.15.32:51562) 2023-06-20T13:34:05.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.533+0000 7f15a299c700 1 -- 172.21.15.32:0/3112401843 learned_addr learned my addr 172.21.15.32:0/3112401843 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:34:05.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.533+0000 7f15a219b700 1 --2- 172.21.15.32:0/3112401843 >> v2:172.21.15.115:3300/0 conn(0x7f159c15c460 0x7f159c0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:05.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.533+0000 7f15a199a700 1 -- 172.21.15.32:0/3112401843 >> v2:172.21.15.115:3300/0 conn(0x7f159c15c460 msgr2=0x7f159c0b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:05.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.533+0000 7f15a199a700 1 --2- 172.21.15.32:0/3112401843 >> v2:172.21.15.115:3300/0 conn(0x7f159c15c460 0x7f159c0b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:05.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.533+0000 7f15a199a700 1 -- 172.21.15.32:0/3112401843 >> v1:172.21.15.32:6789/0 conn(0x7f159c0cf720 legacy=0x7f159c0d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:05.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.533+0000 7f15a199a700 1 -- 172.21.15.32:0/3112401843 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159c0d14b0 con 0x7f159c0d2640 2023-06-20T13:34:05.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.533+0000 7f15a219b700 1 --2- 172.21.15.32:0/3112401843 >> v2:172.21.15.115:3300/0 conn(0x7f159c15c460 0x7f159c0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:34:05.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.533+0000 7f15a1199700 1 -- 172.21.15.32:0/3112401843 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4140996846 0 0) 0x7f159c0d1790 con 0x7f159c0cf720 2023-06-20T13:34:05.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.533+0000 7f15a199a700 1 --2- 172.21.15.32:0/3112401843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f159c0d2640 0x7f159c0cf1e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f159c0b4f00 tx=0x7f158c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61718ee1c6f25de1 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:05.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.534+0000 7f15a1199700 1 -- 172.21.15.32:0/3112401843 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c011830 con 0x7f159c0d2640 2023-06-20T13:34:05.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.534+0000 7f15a1199700 1 -- 172.21.15.32:0/3112401843 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158c011990 con 0x7f159c0d2640 2023-06-20T13:34:05.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.534+0000 7f15a1199700 1 -- 172.21.15.32:0/3112401843 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c011d20 con 0x7f159c0d2640 2023-06-20T13:34:05.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.534+0000 7f15a43ff700 1 -- 172.21.15.32:0/3112401843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f159c0d2640 msgr2=0x7f159c0cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:05.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.534+0000 7f15a43ff700 1 --2- 172.21.15.32:0/3112401843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f159c0d2640 0x7f159c0cf1e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f159c0b4f00 tx=0x7f158c009b20 comp rx=0 tx=0).stop 2023-06-20T13:34:05.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.534+0000 7f15a43ff700 1 -- 172.21.15.32:0/3112401843 shutdown_connections 2023-06-20T13:34:05.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.534+0000 7f15a43ff700 1 --2- 172.21.15.32:0/3112401843 >> v2:172.21.15.115:3300/0 conn(0x7f159c15c460 0x7f159c0b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:05.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.534+0000 7f15a43ff700 1 --2- 172.21.15.32:0/3112401843 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f159c0d2640 0x7f159c0cf1e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:05.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.534+0000 7f15a43ff700 1 -- 172.21.15.32:0/3112401843 >> 172.21.15.32:0/3112401843 conn(0x7f159c071660 msgr2=0x7f159c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:05.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.534+0000 7f15a43ff700 1 -- 172.21.15.32:0/3112401843 shutdown_connections 2023-06-20T13:34:05.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.534+0000 7f15a43ff700 1 -- 172.21.15.32:0/3112401843 wait complete. 2023-06-20T13:34:05.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.536+0000 7f15a43ff700 1 Processor -- start 2023-06-20T13:34:05.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.536+0000 7f15a43ff700 1 -- start start 2023-06-20T13:34:05.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.537+0000 7f15a43ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f159c0cf720 0x7f159c15f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:05.541 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.537+0000 7f15a43ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f159c0d2640 0x7f159c14f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:05.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.537+0000 7f15a43ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f159c15c460 0x7f159c15d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:05.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.537+0000 7f15a43ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c0c85a0 con 0x7f159c15c460 2023-06-20T13:34:05.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.537+0000 7f15a43ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c0c8880 con 0x7f159c0d2640 2023-06-20T13:34:05.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.537+0000 7f15a43ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159c0c8b60 con 0x7f159c0cf720 2023-06-20T13:34:05.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.537+0000 7f15a299c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f159c15c460 0x7f159c15d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:05.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.537+0000 7f15a299c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f159c15c460 0x7f159c15d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54446/0 (socket says 172.21.15.32:54446) 2023-06-20T13:34:05.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.537+0000 7f15a299c700 1 -- 172.21.15.32:0/147686055 learned_addr learned my addr 172.21.15.32:0/147686055 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:05.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.537+0000 7f15a219b700 1 --2- 172.21.15.32:0/147686055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f159c0cf720 0x7f159c15f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:05.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.538+0000 7f15a199a700 1 --2- 172.21.15.32:0/147686055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f159c0d2640 0x7f159c14f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:05.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.538+0000 7f15a299c700 1 -- 172.21.15.32:0/147686055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f159c0cf720 msgr2=0x7f159c15f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:05.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.538+0000 7f15a299c700 1 --2- 172.21.15.32:0/147686055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f159c0cf720 0x7f159c15f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:05.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.538+0000 7f15a299c700 1 -- 172.21.15.32:0/147686055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f159c0d2640 msgr2=0x7f159c14f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:05.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.538+0000 7f15a299c700 1 --2- 172.21.15.32:0/147686055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f159c0d2640 0x7f159c14f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:05.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.538+0000 7f15a299c700 1 -- 172.21.15.32:0/147686055 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158c0094a0 con 0x7f159c15c460 2023-06-20T13:34:05.543 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.538+0000 7f15a299c700 1 --2- 172.21.15.32:0/147686055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f159c15c460 0x7f159c15d120 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f159400cba0 tx=0x7f159400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:05.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.538+0000 7f1592ffd700 1 -- 172.21.15.32:0/147686055 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159400aaa0 con 0x7f159c15c460 2023-06-20T13:34:05.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.538+0000 7f1592ffd700 1 -- 172.21.15.32:0/147686055 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159400ac20 con 0x7f159c15c460 2023-06-20T13:34:05.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.538+0000 7f15a43ff700 1 -- 172.21.15.32:0/147686055 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f159c0c8e40 con 0x7f159c15c460 2023-06-20T13:34:05.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.538+0000 7f1592ffd700 1 -- 172.21.15.32:0/147686055 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15940070d0 con 0x7f159c15c460 2023-06-20T13:34:05.544 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.538+0000 7f15a43ff700 1 -- 172.21.15.32:0/147686055 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f159c150780 con 0x7f159c15c460 2023-06-20T13:34:05.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.539+0000 7f15a43ff700 1 -- 172.21.15.32:0/147686055 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f159c04ea60 con 0x7f159c15c460 2023-06-20T13:34:05.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.540+0000 7f1592ffd700 1 -- 172.21.15.32:0/147686055 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1594007230 con 0x7f159c15c460 2023-06-20T13:34:05.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.541+0000 7f1592ffd700 1 --2- 172.21.15.32:0/147686055 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f158006ace0 0x7f158006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:05.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.541+0000 7f1592ffd700 1 -- 172.21.15.32:0/147686055 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f15940890d0 con 0x7f159c15c460 2023-06-20T13:34:05.545 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.542+0000 7f15a219b700 1 --2- 172.21.15.32:0/147686055 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f158006ace0 0x7f158006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:05.546 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.542+0000 7f15a219b700 1 --2- 172.21.15.32:0/147686055 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f158006ace0 0x7f158006d190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1598006fd0 tx=0x7f1598008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:05.547 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.546+0000 7f1592ffd700 1 -- 172.21.15.32:0/147686055 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1594054030 con 0x7f159c15c460 2023-06-20T13:34:05.755 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.753+0000 7f15a43ff700 1 -- 172.21.15.32:0/147686055 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f159c0b4fa0 con 0x7f159c15c460 2023-06-20T13:34:05.756 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.755+0000 7f1592ffd700 1 -- 172.21.15.32:0/147686055 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+18489 (secure 0 0 0) 0x7f1594057650 con 0x7f159c15c460 2023-06-20T13:34:05.757 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:34:05.757 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":40,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:34:04.508736+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-06-20T13:34:02.254258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-06-20T13:34:03.489075+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:34:05.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.757+0000 7f15a43ff700 1 -- 172.21.15.32:0/147686055 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f158006ace0 msgr2=0x7f158006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:05.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.757+0000 7f15a43ff700 1 --2- 172.21.15.32:0/147686055 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f158006ace0 0x7f158006d190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1598006fd0 tx=0x7f1598008040 comp rx=0 tx=0).stop 2023-06-20T13:34:05.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.757+0000 7f15a43ff700 1 -- 172.21.15.32:0/147686055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f159c15c460 msgr2=0x7f159c15d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:05.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.757+0000 7f15a43ff700 1 --2- 172.21.15.32:0/147686055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f159c15c460 0x7f159c15d120 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f159400cba0 tx=0x7f159400ceb0 comp rx=0 tx=0).stop 2023-06-20T13:34:05.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.757+0000 7f15a43ff700 1 -- 172.21.15.32:0/147686055 shutdown_connections 2023-06-20T13:34:05.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.757+0000 7f15a43ff700 1 --2- 172.21.15.32:0/147686055 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f158006ace0 0x7f158006d190 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:05.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.757+0000 7f15a43ff700 1 --2- 172.21.15.32:0/147686055 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f159c15c460 0x7f159c15d120 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:05.760 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.757+0000 7f15a43ff700 1 --2- 172.21.15.32:0/147686055 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f159c0cf720 0x7f159c15f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:05.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.757+0000 7f15a43ff700 1 --2- 172.21.15.32:0/147686055 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f159c0d2640 0x7f159c14f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:05.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.757+0000 7f15a43ff700 1 -- 172.21.15.32:0/147686055 >> 172.21.15.32:0/147686055 conn(0x7f159c071660 msgr2=0x7f159c15fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:05.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.757+0000 7f15a43ff700 1 -- 172.21.15.32:0/147686055 shutdown_connections 2023-06-20T13:34:05.761 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.757+0000 7f15a43ff700 1 -- 172.21.15.32:0/147686055 wait complete. 2023-06-20T13:34:05.778 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:34:05.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.977+0000 7f39ba5ff700 1 Processor -- start 2023-06-20T13:34:05.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.977+0000 7f39ba5ff700 1 -- start start 2023-06-20T13:34:05.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.978+0000 7f39ba5ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39b406c450 0x7f39b406ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:05.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.978+0000 7f39ba5ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b40ce6e0 con 0x7f39b415c1e0 2023-06-20T13:34:05.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.978+0000 7f39ba5ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b40ceb70 con 0x7f39b406bf90 2023-06-20T13:34:05.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.978+0000 7f39ba5ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40d06d0 con 0x7f39b406c450 2023-06-20T13:34:05.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.978+0000 7f39b3fff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f39b415c1e0 0x7f39b40caf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:51566/0 (socket says 172.21.15.32:51566) 2023-06-20T13:34:05.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.978+0000 7f39b3fff700 1 -- 172.21.15.32:0/3967470219 learned_addr learned my addr 172.21.15.32:0/3967470219 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:34:05.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.978+0000 7f39b37fe700 1 --2- 172.21.15.32:0/3967470219 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39b406c450 0x7f39b406ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:05.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.979+0000 7f39b2ffd700 1 -- 172.21.15.32:0/3967470219 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1830710804 0 0) 0x7f39b40ce6e0 con 0x7f39b415c1e0 2023-06-20T13:34:05.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.979+0000 7f39b2ffd700 1 -- 172.21.15.32:0/3967470219 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f399c0035b0 con 0x7f39b415c1e0 2023-06-20T13:34:05.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.979+0000 7f39b2ffd700 1 -- 172.21.15.32:0/3967470219 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1754641033 0 0) 0x7f39b40ceb70 con 0x7f39b406bf90 2023-06-20T13:34:05.982 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.979+0000 7f39b2ffd700 1 -- 172.21.15.32:0/3967470219 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39b40ce6e0 con 0x7f39b406bf90 2023-06-20T13:34:05.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.979+0000 7f39b37fe700 1 -- 172.21.15.32:0/3967470219 >> v1:172.21.15.115:6789/0 conn(0x7f39b406bf90 legacy=0x7f39b40b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:05.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.979+0000 7f39b37fe700 1 -- 172.21.15.32:0/3967470219 >> v1:172.21.15.32:6789/0 conn(0x7f39b415c1e0 legacy=0x7f39b40caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:05.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.979+0000 7f39b37fe700 1 -- 172.21.15.32:0/3967470219 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b4070b60 con 0x7f39b406c450 2023-06-20T13:34:05.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.979+0000 7f39b37fe700 1 --2- 172.21.15.32:0/3967470219 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39b406c450 0x7f39b406ba50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f39a80098a0 tx=0x7f39a8009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e991eecf316fb04 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:05.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.980+0000 7f39b2ffd700 1 -- 172.21.15.32:0/3967470219 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a8011830 con 0x7f39b406c450 2023-06-20T13:34:05.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.980+0000 7f39b2ffd700 1 -- 172.21.15.32:0/3967470219 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a8011990 con 0x7f39b406c450 2023-06-20T13:34:05.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.980+0000 7f39b2ffd700 1 -- 172.21.15.32:0/3967470219 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a8011d20 con 0x7f39b406c450 2023-06-20T13:34:05.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.980+0000 7f39ba5ff700 1 -- 172.21.15.32:0/3967470219 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39b406c450 msgr2=0x7f39b406ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:05.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.980+0000 7f39ba5ff700 1 --2- 172.21.15.32:0/3967470219 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39b406c450 0x7f39b406ba50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f39a80098a0 tx=0x7f39a8009bb0 comp rx=0 tx=0).stop 2023-06-20T13:34:05.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.980+0000 7f39ba5ff700 1 -- 172.21.15.32:0/3967470219 shutdown_connections 2023-06-20T13:34:05.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.980+0000 7f39ba5ff700 1 --2- 172.21.15.32:0/3967470219 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39b406c450 0x7f39b406ba50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:05.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.980+0000 7f39ba5ff700 1 -- 172.21.15.32:0/3967470219 >> 172.21.15.32:0/3967470219 conn(0x7f39b406e550 msgr2=0x7f39b406e920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:05.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.981+0000 7f39ba5ff700 1 -- 172.21.15.32:0/3967470219 shutdown_connections 2023-06-20T13:34:05.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.981+0000 7f39ba5ff700 1 -- 172.21.15.32:0/3967470219 wait complete. 2023-06-20T13:34:05.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.982+0000 7f39ba5ff700 1 Processor -- start 2023-06-20T13:34:05.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.982+0000 7f39ba5ff700 1 -- start start 2023-06-20T13:34:05.987 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.983+0000 7f39ba5ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39b406bf90 0x7f39b40ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:05.987 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.983+0000 7f39ba5ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39b406c450 0x7f39b414ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:05.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.983+0000 7f39ba5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39b415c1e0 0x7f39b41f2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:05.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.983+0000 7f39ba5ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40b2580 con 0x7f39b406bf90 2023-06-20T13:34:05.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.983+0000 7f39ba5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b414e300 con 0x7f39b415c1e0 2023-06-20T13:34:05.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.983+0000 7f39ba5ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40b1900 con 0x7f39b406c450 2023-06-20T13:34:05.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.984+0000 7f39b3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39b406bf90 0x7f39b40ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:05.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.984+0000 7f39b3fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39b406bf90 0x7f39b40ca340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54448/0 (socket says 172.21.15.32:54448) 2023-06-20T13:34:05.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.984+0000 7f39b3fff700 1 -- 172.21.15.32:0/1798424762 learned_addr learned my addr 172.21.15.32:0/1798424762 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:05.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.984+0000 7f39b3fff700 1 -- 172.21.15.32:0/1798424762 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39b406c450 msgr2=0x7f39b414ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:05.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.984+0000 7f39b3fff700 1 --2- 172.21.15.32:0/1798424762 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39b406c450 0x7f39b414ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:05.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.984+0000 7f39b3fff700 1 -- 172.21.15.32:0/1798424762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39b415c1e0 msgr2=0x7f39b41f2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:05.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.984+0000 7f39b3fff700 1 --2- 172.21.15.32:0/1798424762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39b415c1e0 0x7f39b41f2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:05.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.984+0000 7f39b3fff700 1 -- 172.21.15.32:0/1798424762 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a80094a0 con 0x7f39b406bf90 2023-06-20T13:34:05.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.984+0000 7f39b3fff700 1 --2- 172.21.15.32:0/1798424762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39b406bf90 0x7f39b40ca340 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f39a400c4d0 tx=0x7f39a400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:05.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.985+0000 7f39b0ff9700 1 -- 172.21.15.32:0/1798424762 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a4005d70 con 0x7f39b406bf90 2023-06-20T13:34:05.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.985+0000 7f39b0ff9700 1 -- 172.21.15.32:0/1798424762 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a40070d0 con 0x7f39b406bf90 2023-06-20T13:34:05.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.985+0000 7f39b0ff9700 1 -- 172.21.15.32:0/1798424762 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a4007480 con 0x7f39b406bf90 2023-06-20T13:34:05.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.985+0000 7f39ba5ff700 1 -- 172.21.15.32:0/1798424762 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b40b1be0 con 0x7f39b406bf90 2023-06-20T13:34:05.990 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.985+0000 7f39ba5ff700 1 -- 172.21.15.32:0/1798424762 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b40b21a0 con 0x7f39b406bf90 2023-06-20T13:34:05.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.986+0000 7f39ba5ff700 1 -- 172.21.15.32:0/1798424762 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b404ea60 con 0x7f39b406bf90 2023-06-20T13:34:05.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.987+0000 7f39b0ff9700 1 -- 172.21.15.32:0/1798424762 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f39a40075e0 con 0x7f39b406bf90 2023-06-20T13:34:05.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.988+0000 7f39b0ff9700 1 --2- 172.21.15.32:0/1798424762 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f39a006ace0 0x7f39a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:05.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.988+0000 7f39b0ff9700 1 -- 172.21.15.32:0/1798424762 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f39a4088c50 con 0x7f39b406bf90 2023-06-20T13:34:05.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.988+0000 7f39b37fe700 1 --2- 172.21.15.32:0/1798424762 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f39a006ace0 0x7f39a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:05.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.989+0000 7f39b37fe700 1 --2- 172.21.15.32:0/1798424762 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f39a006ace0 0x7f39a006d190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f39b40cdcb0 tx=0x7f39a8010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:05.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:05.992+0000 7f39b0ff9700 1 -- 172.21.15.32:0/1798424762 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f39a4053b20 con 0x7f39b406bf90 2023-06-20T13:34:06.204 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.202+0000 7f39ba5ff700 1 -- 172.21.15.32:0/1798424762 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39b4070710 con 0x7f39b406bf90 2023-06-20T13:34:06.205 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.203+0000 7f39b0ff9700 1 -- 172.21.15.32:0/1798424762 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+18489 (secure 0 0 0) 0x7f39a4057140 con 0x7f39b406bf90 2023-06-20T13:34:06.206 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:34:06.206 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":40,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:34:04.508736+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-06-20T13:34:02.254258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-06-20T13:34:03.489075+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:34:06.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.206+0000 7f39ba5ff700 1 -- 172.21.15.32:0/1798424762 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f39a006ace0 msgr2=0x7f39a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:06.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.206+0000 7f39ba5ff700 1 --2- 172.21.15.32:0/1798424762 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f39a006ace0 0x7f39a006d190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f39b40cdcb0 tx=0x7f39a8010000 comp rx=0 tx=0).stop 2023-06-20T13:34:06.208 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.206+0000 7f39ba5ff700 1 -- 172.21.15.32:0/1798424762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39b406bf90 msgr2=0x7f39b40ca340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:06.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.206+0000 7f39ba5ff700 1 --2- 172.21.15.32:0/1798424762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39b406bf90 0x7f39b40ca340 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f39a400c4d0 tx=0x7f39a400c890 comp rx=0 tx=0).stop 2023-06-20T13:34:06.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.206+0000 7f39ba5ff700 1 -- 172.21.15.32:0/1798424762 shutdown_connections 2023-06-20T13:34:06.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.206+0000 7f39ba5ff700 1 --2- 172.21.15.32:0/1798424762 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f39a006ace0 0x7f39a006d190 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:06.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.206+0000 7f39ba5ff700 1 --2- 172.21.15.32:0/1798424762 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39b415c1e0 0x7f39b41f2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:06.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.206+0000 7f39ba5ff700 1 --2- 172.21.15.32:0/1798424762 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f39b406bf90 0x7f39b40ca340 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:06.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.206+0000 7f39ba5ff700 1 --2- 172.21.15.32:0/1798424762 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f39b406c450 0x7f39b414ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:06.209 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.206+0000 7f39ba5ff700 1 -- 172.21.15.32:0/1798424762 >> 172.21.15.32:0/1798424762 conn(0x7f39b406e550 msgr2=0x7f39b41e5890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:06.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.206+0000 7f39ba5ff700 1 -- 172.21.15.32:0/1798424762 shutdown_connections 2023-06-20T13:34:06.210 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.206+0000 7f39ba5ff700 1 -- 172.21.15.32:0/1798424762 wait complete. 2023-06-20T13:34:06.226 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-20T13:34:06.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.430+0000 7f2fb81ff700 1 Processor -- start 2023-06-20T13:34:06.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.430+0000 7f2fb81ff700 1 -- start start 2023-06-20T13:34:06.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.431+0000 7f2fb81ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2fb015c690 0x7f2fb00adc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:06.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.432+0000 7f2fb81ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fb00ca1f0 0x7f2fb00ca690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:06.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.432+0000 7f2fb81ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb00c9750 con 0x7f2fb00cd0a0 2023-06-20T13:34:06.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.432+0000 7f2fb81ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb00cabd0 con 0x7f2fb015c690 2023-06-20T13:34:06.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.432+0000 7f2fb81ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb00cf1c0 con 0x7f2fb00ca1f0 2023-06-20T13:34:06.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.432+0000 7f2fb5f9b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2fb015c690 0x7f2fb00adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:06.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.432+0000 7f2fb5f9b700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f2fb015c690 0x7f2fb00adc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54454/0 (socket says 172.21.15.32:54454) 2023-06-20T13:34:06.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.432+0000 7f2fb5f9b700 1 -- 172.21.15.32:0/763652433 learned_addr learned my addr 172.21.15.32:0/763652433 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:06.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.432+0000 7f2fb579a700 1 --1- 172.21.15.32:0/763652433 >> v1:172.21.15.32:6789/0 conn(0x7f2fb00cd0a0 0x7f2fb006c4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:51574/0 (socket says 172.21.15.32:51574) 2023-06-20T13:34:06.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.432+0000 7f2fb679c700 1 --2- 172.21.15.32:0/763652433 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fb00ca1f0 0x7f2fb00ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:06.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.432+0000 7f2fb5f9b700 1 -- 172.21.15.32:0/763652433 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fb00ca1f0 msgr2=0x7f2fb00ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:06.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.432+0000 7f2fb5f9b700 1 --2- 172.21.15.32:0/763652433 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fb00ca1f0 0x7f2fb00ca690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:06.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.432+0000 7f2fb5f9b700 1 -- 172.21.15.32:0/763652433 >> v1:172.21.15.32:6789/0 conn(0x7f2fb00cd0a0 legacy=0x7f2fb006c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:06.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.432+0000 7f2fb5f9b700 1 -- 172.21.15.32:0/763652433 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb00cd610 con 0x7f2fb015c690 2023-06-20T13:34:06.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.433+0000 7f2fb5f9b700 1 --2- 172.21.15.32:0/763652433 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fb015c690 0x7f2fb00adc60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2fac00bb90 tx=0x7f2fac00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=556b7bc63169b919 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:06.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.433+0000 7f2fb4f99700 1 -- 172.21.15.32:0/763652433 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac00dd50 con 0x7f2fb015c690 2023-06-20T13:34:06.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.433+0000 7f2fb4f99700 1 -- 172.21.15.32:0/763652433 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fac010470 con 0x7f2fb015c690 2023-06-20T13:34:06.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.433+0000 7f2fb4f99700 1 -- 172.21.15.32:0/763652433 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac010800 con 0x7f2fb015c690 2023-06-20T13:34:06.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.433+0000 7f2fb81ff700 1 -- 172.21.15.32:0/763652433 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fb015c690 msgr2=0x7f2fb00adc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:06.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.433+0000 7f2fb81ff700 1 --2- 172.21.15.32:0/763652433 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fb015c690 0x7f2fb00adc60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2fac00bb90 tx=0x7f2fac00bea0 comp rx=0 tx=0).stop 2023-06-20T13:34:06.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.434+0000 7f2fb81ff700 1 -- 172.21.15.32:0/763652433 shutdown_connections 2023-06-20T13:34:06.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.434+0000 7f2fb81ff700 1 --2- 172.21.15.32:0/763652433 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fb00ca1f0 0x7f2fb00ca690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:06.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.434+0000 7f2fb81ff700 1 --2- 172.21.15.32:0/763652433 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fb015c690 0x7f2fb00adc60 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:06.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.434+0000 7f2fb81ff700 1 -- 172.21.15.32:0/763652433 >> 172.21.15.32:0/763652433 conn(0x7f2fb00b0fd0 msgr2=0x7f2fb00ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:06.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.434+0000 7f2fb81ff700 1 -- 172.21.15.32:0/763652433 shutdown_connections 2023-06-20T13:34:06.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.434+0000 7f2fb81ff700 1 -- 172.21.15.32:0/763652433 wait complete. 2023-06-20T13:34:06.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.435+0000 7f2fb81ff700 1 Processor -- start 2023-06-20T13:34:06.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.436+0000 7f2fb81ff700 1 -- start start 2023-06-20T13:34:06.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.436+0000 7f2fb81ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fb00ca1f0 0x7f2fb01f20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:06.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.437+0000 7f2fb81ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fb00cd0a0 0x7f2fb00ac2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:06.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.437+0000 7f2fb81ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fb015c690 0x7f2fb00b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:06.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.437+0000 7f2fb81ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb00ad260 con 0x7f2fb00ca1f0 2023-06-20T13:34:06.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.437+0000 7f2fb81ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb00acca0 con 0x7f2fb00cd0a0 2023-06-20T13:34:06.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.437+0000 7f2fb81ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb00acf80 con 0x7f2fb015c690 2023-06-20T13:34:06.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.437+0000 7f2fb5f9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fb00ca1f0 0x7f2fb01f20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:06.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.437+0000 7f2fb5f9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fb00ca1f0 0x7f2fb01f20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54462/0 (socket says 172.21.15.32:54462) 2023-06-20T13:34:06.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.437+0000 7f2fb5f9b700 1 -- 172.21.15.32:0/3992423011 learned_addr learned my addr 172.21.15.32:0/3992423011 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:06.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.437+0000 7f2fb679c700 1 --2- 172.21.15.32:0/3992423011 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fb015c690 0x7f2fb00b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:06.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.437+0000 7f2fb579a700 1 --2- 172.21.15.32:0/3992423011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fb00cd0a0 0x7f2fb00ac2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:06.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.437+0000 7f2fb5f9b700 1 -- 172.21.15.32:0/3992423011 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fb015c690 msgr2=0x7f2fb00b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:06.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.437+0000 7f2fb5f9b700 1 --2- 172.21.15.32:0/3992423011 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fb015c690 0x7f2fb00b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:06.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.437+0000 7f2fb5f9b700 1 -- 172.21.15.32:0/3992423011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fb00cd0a0 msgr2=0x7f2fb00ac2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:06.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.437+0000 7f2fb5f9b700 1 --2- 172.21.15.32:0/3992423011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fb00cd0a0 0x7f2fb00ac2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:06.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.437+0000 7f2fb5f9b700 1 -- 172.21.15.32:0/3992423011 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fac00b7f0 con 0x7f2fb00ca1f0 2023-06-20T13:34:06.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.437+0000 7f2fb679c700 1 --2- 172.21.15.32:0/3992423011 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fb015c690 0x7f2fb00b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:34:06.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.437+0000 7f2fb579a700 1 --2- 172.21.15.32:0/3992423011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fb00cd0a0 0x7f2fb00ac2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:34:06.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.437+0000 7f2fb5f9b700 1 --2- 172.21.15.32:0/3992423011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fb00ca1f0 0x7f2fb01f20c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2fac00bee0 tx=0x7f2fac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:06.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.438+0000 7f2fa67fc700 1 -- 172.21.15.32:0/3992423011 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac003b30 con 0x7f2fb00ca1f0 2023-06-20T13:34:06.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.438+0000 7f2fa67fc700 1 -- 172.21.15.32:0/3992423011 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fac003c90 con 0x7f2fb00ca1f0 2023-06-20T13:34:06.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.438+0000 7f2fa67fc700 1 -- 172.21.15.32:0/3992423011 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac0105e0 con 0x7f2fb00ca1f0 2023-06-20T13:34:06.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.438+0000 7f2fb81ff700 1 -- 172.21.15.32:0/3992423011 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb0149a00 con 0x7f2fb00ca1f0 2023-06-20T13:34:06.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.438+0000 7f2fb81ff700 1 -- 172.21.15.32:0/3992423011 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb01f2600 con 0x7f2fb00ca1f0 2023-06-20T13:34:06.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.439+0000 7f2fb81ff700 1 -- 172.21.15.32:0/3992423011 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb0149860 con 0x7f2fb00ca1f0 2023-06-20T13:34:06.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.440+0000 7f2fa67fc700 1 -- 172.21.15.32:0/3992423011 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2fac019400 con 0x7f2fb00ca1f0 2023-06-20T13:34:06.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.441+0000 7f2fa67fc700 1 --2- 172.21.15.32:0/3992423011 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f2f9406ace0 0x7f2f9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:06.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.441+0000 7f2fa67fc700 1 -- 172.21.15.32:0/3992423011 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2fac08aa40 con 0x7f2fb00ca1f0 2023-06-20T13:34:06.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.441+0000 7f2fb579a700 1 --2- 172.21.15.32:0/3992423011 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f2f9406ace0 0x7f2f9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:06.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.442+0000 7f2fb579a700 1 --2- 172.21.15.32:0/3992423011 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f2f9406ace0 0x7f2f9406d190 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0000f60 tx=0x7f2fa0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:06.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.445+0000 7f2fa67fc700 1 -- 172.21.15.32:0/3992423011 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2fb0149860 con 0x7f2fb00ca1f0 2023-06-20T13:34:06.703 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:06.701+0000 7f2fb81ff700 1 -- 172.21.15.32:0/3992423011 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2fb0149f20 con 0x7f2fb00ca1f0 2023-06-20T13:34:07.238 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-06-20T13:34:07.235+0000 7fa4253f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-20T13:34:07.292 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.289+0000 7f2fa67fc700 1 -- 172.21.15.32:0/3992423011 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2fb0149f20 con 0x7f2fb00ca1f0 2023-06-20T13:34:07.294 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.292+0000 7f2fb81ff700 1 -- 172.21.15.32:0/3992423011 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f2f9406ace0 msgr2=0x7f2f9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:07.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.292+0000 7f2fb81ff700 1 --2- 172.21.15.32:0/3992423011 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f2f9406ace0 0x7f2f9406d190 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0000f60 tx=0x7f2fa0009040 comp rx=0 tx=0).stop 2023-06-20T13:34:07.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.292+0000 7f2fb81ff700 1 -- 172.21.15.32:0/3992423011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fb00ca1f0 msgr2=0x7f2fb01f20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:07.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.292+0000 7f2fb81ff700 1 --2- 172.21.15.32:0/3992423011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fb00ca1f0 0x7f2fb01f20c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2fac00bee0 tx=0x7f2fac004750 comp rx=0 tx=0).stop 2023-06-20T13:34:07.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.292+0000 7f2fb81ff700 1 -- 172.21.15.32:0/3992423011 shutdown_connections 2023-06-20T13:34:07.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.292+0000 7f2fb81ff700 1 --2- 172.21.15.32:0/3992423011 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f2f9406ace0 0x7f2f9406d190 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:07.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.292+0000 7f2fb81ff700 1 --2- 172.21.15.32:0/3992423011 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2fb015c690 0x7f2fb00b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:07.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.292+0000 7f2fb81ff700 1 --2- 172.21.15.32:0/3992423011 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f2fb00ca1f0 0x7f2fb01f20c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:07.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.292+0000 7f2fb81ff700 1 --2- 172.21.15.32:0/3992423011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2fb00cd0a0 0x7f2fb00ac2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:07.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.292+0000 7f2fb81ff700 1 -- 172.21.15.32:0/3992423011 >> 172.21.15.32:0/3992423011 conn(0x7f2fb00b0fd0 msgr2=0x7f2fb01563c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:07.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.293+0000 7f2fb81ff700 1 -- 172.21.15.32:0/3992423011 shutdown_connections 2023-06-20T13:34:07.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.293+0000 7f2fb81ff700 1 -- 172.21.15.32:0/3992423011 wait complete. 2023-06-20T13:34:07.316 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-20T13:34:07.316 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-20T13:34:07.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.525+0000 7ffb05fff700 1 Processor -- start 2023-06-20T13:34:07.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.525+0000 7ffb05fff700 1 -- start start 2023-06-20T13:34:07.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.526+0000 7ffb05fff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ffb000b8430 0x7ffb000cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:07.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.526+0000 7ffb05fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffb000d3730 0x7ffb000cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:07.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.526+0000 7ffb05fff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb000d0b20 con 0x7ffb000cfa90 2023-06-20T13:34:07.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.526+0000 7ffb05fff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb000b8800 con 0x7ffb000b8430 2023-06-20T13:34:07.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.526+0000 7ffb05fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb000cfeb0 con 0x7ffb000d3730 2023-06-20T13:34:07.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.526+0000 7ffafffff700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7ffb000cfa90 0x7ffb0015feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:51590/0 (socket says 172.21.15.32:51590) 2023-06-20T13:34:07.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.526+0000 7ffafffff700 1 -- 172.21.15.32:0/1788040392 learned_addr learned my addr 172.21.15.32:0/1788040392 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:34:07.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.526+0000 7ffaff7fe700 1 --2- 172.21.15.32:0/1788040392 >> v2:172.21.15.115:3300/0 conn(0x7ffb000b8430 0x7ffb000cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:07.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.526+0000 7ffaf7fff700 1 --2- 172.21.15.32:0/1788040392 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffb000d3730 0x7ffb000cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:07.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.527+0000 7ffafeffd700 1 -- 172.21.15.32:0/1788040392 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 949802883 0 0) 0x7ffb000d0b20 con 0x7ffb000cfa90 2023-06-20T13:34:07.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.527+0000 7ffafeffd700 1 -- 172.21.15.32:0/1788040392 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffaec0035b0 con 0x7ffb000cfa90 2023-06-20T13:34:07.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.527+0000 7ffaff7fe700 1 -- 172.21.15.32:0/1788040392 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffb000d3730 msgr2=0x7ffb000cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:07.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.527+0000 7ffaff7fe700 1 --2- 172.21.15.32:0/1788040392 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffb000d3730 0x7ffb000cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:07.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.527+0000 7ffaff7fe700 1 -- 172.21.15.32:0/1788040392 >> v1:172.21.15.32:6789/0 conn(0x7ffb000cfa90 legacy=0x7ffb0015feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:07.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.527+0000 7ffaff7fe700 1 -- 172.21.15.32:0/1788040392 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb000b4ee0 con 0x7ffb000b8430 2023-06-20T13:34:07.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.527+0000 7ffaff7fe700 1 --2- 172.21.15.32:0/1788040392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb000b8430 0x7ffb000cd320 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0009840 tx=0x7ffaf0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bab02ead1ed31357 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:07.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.528+0000 7ffafeffd700 1 -- 172.21.15.32:0/1788040392 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0011830 con 0x7ffb000b8430 2023-06-20T13:34:07.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.528+0000 7ffafeffd700 1 -- 172.21.15.32:0/1788040392 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf0011990 con 0x7ffb000b8430 2023-06-20T13:34:07.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.528+0000 7ffafeffd700 1 -- 172.21.15.32:0/1788040392 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0011d20 con 0x7ffb000b8430 2023-06-20T13:34:07.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.528+0000 7ffb05fff700 1 -- 172.21.15.32:0/1788040392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb000b8430 msgr2=0x7ffb000cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:07.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.528+0000 7ffb05fff700 1 --2- 172.21.15.32:0/1788040392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb000b8430 0x7ffb000cd320 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0009840 tx=0x7ffaf0009b50 comp rx=0 tx=0).stop 2023-06-20T13:34:07.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.528+0000 7ffb05fff700 1 -- 172.21.15.32:0/1788040392 shutdown_connections 2023-06-20T13:34:07.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.528+0000 7ffb05fff700 1 --2- 172.21.15.32:0/1788040392 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb000b8430 0x7ffb000cd320 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:07.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.528+0000 7ffb05fff700 1 --2- 172.21.15.32:0/1788040392 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffb000d3730 0x7ffb000cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:07.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.528+0000 7ffb05fff700 1 -- 172.21.15.32:0/1788040392 >> 172.21.15.32:0/1788040392 conn(0x7ffb0006b3f0 msgr2=0x7ffb0006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:07.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.528+0000 7ffb05fff700 1 -- 172.21.15.32:0/1788040392 shutdown_connections 2023-06-20T13:34:07.533 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.528+0000 7ffb05fff700 1 -- 172.21.15.32:0/1788040392 wait complete. 2023-06-20T13:34:07.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.530+0000 7ffb05fff700 1 Processor -- start 2023-06-20T13:34:07.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.530+0000 7ffb05fff700 1 -- start start 2023-06-20T13:34:07.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.531+0000 7ffb05fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffb000b8430 0x7ffb0015d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:07.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.531+0000 7ffb05fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb000cfa90 0x7ffb000cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:07.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.531+0000 7ffb05fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb000d3730 0x7ffb000c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:07.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.531+0000 7ffb05fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb001f5d90 con 0x7ffb000d3730 2023-06-20T13:34:07.535 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.531+0000 7ffb05fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb000c9480 con 0x7ffb000cfa90 2023-06-20T13:34:07.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.531+0000 7ffb05fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb000c6780 con 0x7ffb000b8430 2023-06-20T13:34:07.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.531+0000 7ffafffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb000d3730 0x7ffb000c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:07.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.531+0000 7ffafffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb000d3730 0x7ffb000c8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54474/0 (socket says 172.21.15.32:54474) 2023-06-20T13:34:07.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.531+0000 7ffafffff700 1 -- 172.21.15.32:0/4115478477 learned_addr learned my addr 172.21.15.32:0/4115478477 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:07.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.531+0000 7ffaff7fe700 1 --2- 172.21.15.32:0/4115478477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffb000b8430 0x7ffb0015d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:07.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.531+0000 7ffaf7fff700 1 --2- 172.21.15.32:0/4115478477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb000cfa90 0x7ffb000cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:07.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.532+0000 7ffafffff700 1 -- 172.21.15.32:0/4115478477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffb000b8430 msgr2=0x7ffb0015d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:07.536 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.532+0000 7ffafffff700 1 --2- 172.21.15.32:0/4115478477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffb000b8430 0x7ffb0015d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:07.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.532+0000 7ffafffff700 1 -- 172.21.15.32:0/4115478477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb000cfa90 msgr2=0x7ffb000cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:07.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.532+0000 7ffafffff700 1 --2- 172.21.15.32:0/4115478477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb000cfa90 0x7ffb000cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:07.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.532+0000 7ffafffff700 1 -- 172.21.15.32:0/4115478477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf00094a0 con 0x7ffb000d3730 2023-06-20T13:34:07.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.532+0000 7ffaf7fff700 1 --2- 172.21.15.32:0/4115478477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb000cfa90 0x7ffb000cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:34:07.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.532+0000 7ffafffff700 1 --2- 172.21.15.32:0/4115478477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb000d3730 0x7ffb000c8f40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ffaf800cb70 tx=0x7ffaf800ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:07.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.532+0000 7ffafcff9700 1 -- 172.21.15.32:0/4115478477 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf800aa00 con 0x7ffb000d3730 2023-06-20T13:34:07.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.532+0000 7ffafcff9700 1 -- 172.21.15.32:0/4115478477 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf800ab60 con 0x7ffb000d3730 2023-06-20T13:34:07.537 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.532+0000 7ffafcff9700 1 -- 172.21.15.32:0/4115478477 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8012400 con 0x7ffb000d3730 2023-06-20T13:34:07.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.532+0000 7ffb05fff700 1 -- 172.21.15.32:0/4115478477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0015d930 con 0x7ffb000d3730 2023-06-20T13:34:07.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.532+0000 7ffb05fff700 1 -- 172.21.15.32:0/4115478477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0015def0 con 0x7ffb000d3730 2023-06-20T13:34:07.538 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.533+0000 7ffb05fff700 1 -- 172.21.15.32:0/4115478477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb000c9c10 con 0x7ffb000d3730 2023-06-20T13:34:07.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.534+0000 7ffafcff9700 1 -- 172.21.15.32:0/4115478477 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffaf801b3b0 con 0x7ffb000d3730 2023-06-20T13:34:07.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.535+0000 7ffafcff9700 1 --2- 172.21.15.32:0/4115478477 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ffae006ace0 0x7ffae006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:07.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.536+0000 7ffafcff9700 1 -- 172.21.15.32:0/4115478477 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ffaf8089360 con 0x7ffb000d3730 2023-06-20T13:34:07.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.536+0000 7ffaff7fe700 1 --2- 172.21.15.32:0/4115478477 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ffae006ace0 0x7ffae006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:07.539 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.536+0000 7ffaff7fe700 1 --2- 172.21.15.32:0/4115478477 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ffae006ace0 0x7ffae006d190 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0000c00 tx=0x7ffaf001c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:07.542 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.540+0000 7ffafcff9700 1 -- 172.21.15.32:0/4115478477 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ffaf8054230 con 0x7ffb000d3730 2023-06-20T13:34:07.797 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:07.795+0000 7ffb05fff700 1 -- 172.21.15.32:0/4115478477 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ffb0004ea60 con 0x7ffb000d3730 2023-06-20T13:34:08.293 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.290+0000 7ffafcff9700 1 -- 172.21.15.32:0/4115478477 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7ffaf8057850 con 0x7ffb000d3730 2023-06-20T13:34:08.295 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.293+0000 7ffb05fff700 1 -- 172.21.15.32:0/4115478477 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ffae006ace0 msgr2=0x7ffae006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:08.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.293+0000 7ffb05fff700 1 --2- 172.21.15.32:0/4115478477 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ffae006ace0 0x7ffae006d190 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0000c00 tx=0x7ffaf001c040 comp rx=0 tx=0).stop 2023-06-20T13:34:08.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.293+0000 7ffb05fff700 1 -- 172.21.15.32:0/4115478477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb000d3730 msgr2=0x7ffb000c8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:08.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.293+0000 7ffb05fff700 1 --2- 172.21.15.32:0/4115478477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb000d3730 0x7ffb000c8f40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ffaf800cb70 tx=0x7ffaf800ce80 comp rx=0 tx=0).stop 2023-06-20T13:34:08.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.293+0000 7ffb05fff700 1 -- 172.21.15.32:0/4115478477 shutdown_connections 2023-06-20T13:34:08.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.293+0000 7ffb05fff700 1 --2- 172.21.15.32:0/4115478477 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7ffae006ace0 0x7ffae006d190 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:08.296 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.293+0000 7ffb05fff700 1 --2- 172.21.15.32:0/4115478477 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7ffb000d3730 0x7ffb000c8f40 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:08.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.293+0000 7ffb05fff700 1 --2- 172.21.15.32:0/4115478477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffb000b8430 0x7ffb0015d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:08.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.293+0000 7ffb05fff700 1 --2- 172.21.15.32:0/4115478477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb000cfa90 0x7ffb000cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:08.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.293+0000 7ffb05fff700 1 -- 172.21.15.32:0/4115478477 >> 172.21.15.32:0/4115478477 conn(0x7ffb0006b3f0 msgr2=0x7ffb000b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:08.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.293+0000 7ffb05fff700 1 -- 172.21.15.32:0/4115478477 shutdown_connections 2023-06-20T13:34:08.297 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.294+0000 7ffb05fff700 1 -- 172.21.15.32:0/4115478477 wait complete. 2023-06-20T13:34:08.316 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-20T13:34:08.316 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-20T13:34:08.519 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.517+0000 7fe1d03ff700 1 Processor -- start 2023-06-20T13:34:08.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.517+0000 7fe1d03ff700 1 -- start start 2023-06-20T13:34:08.520 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.518+0000 7fe1d03ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe1c80d2640 0x7fe1c80b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:08.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.518+0000 7fe1d03ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1c80cf8f0 0x7fe1c815fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:08.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.518+0000 7fe1d03ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c80d1790 con 0x7fe1c815c460 2023-06-20T13:34:08.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.518+0000 7fe1d03ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c80cedd0 con 0x7fe1c80d2640 2023-06-20T13:34:08.521 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.518+0000 7fe1d03ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c80cd950 con 0x7fe1c80cf8f0 2023-06-20T13:34:08.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.519+0000 7fe1ce99c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1c80cf8f0 0x7fe1c815fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:08.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.519+0000 7fe1ce99c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1c80cf8f0 0x7fe1c815fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.32:58796/0 (socket says 172.21.15.32:58796) 2023-06-20T13:34:08.522 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.519+0000 7fe1ce99c700 1 -- 172.21.15.32:0/723656977 learned_addr learned my addr 172.21.15.32:0/723656977 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:08.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.519+0000 7fe1cd99a700 1 --2- 172.21.15.32:0/723656977 >> v2:172.21.15.115:3300/0 conn(0x7fe1c80d2640 0x7fe1c80b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:08.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.519+0000 7fe1ce99c700 1 -- 172.21.15.32:0/723656977 >> v2:172.21.15.115:3300/0 conn(0x7fe1c80d2640 msgr2=0x7fe1c80b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:08.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.519+0000 7fe1ce99c700 1 --2- 172.21.15.32:0/723656977 >> v2:172.21.15.115:3300/0 conn(0x7fe1c80d2640 0x7fe1c80b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:08.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.519+0000 7fe1ce99c700 1 -- 172.21.15.32:0/723656977 >> v1:172.21.15.115:6789/0 conn(0x7fe1c815c460 legacy=0x7fe1c80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:08.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.519+0000 7fe1ce99c700 1 -- 172.21.15.32:0/723656977 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c80d14b0 con 0x7fe1c80cf8f0 2023-06-20T13:34:08.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.520+0000 7fe1ce99c700 1 --2- 172.21.15.32:0/723656977 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1c80cf8f0 0x7fe1c815fe20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0009e50 tx=0x7fe1c000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bff661719118530d server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:08.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.520+0000 7fe1cd199700 1 -- 172.21.15.32:0/723656977 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c000e070 con 0x7fe1c80cf8f0 2023-06-20T13:34:08.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.520+0000 7fe1cd199700 1 -- 172.21.15.32:0/723656977 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c000b910 con 0x7fe1c80cf8f0 2023-06-20T13:34:08.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.520+0000 7fe1cd199700 1 -- 172.21.15.32:0/723656977 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c000bcc0 con 0x7fe1c80cf8f0 2023-06-20T13:34:08.524 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.520+0000 7fe1d03ff700 1 -- 172.21.15.32:0/723656977 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1c80cf8f0 msgr2=0x7fe1c815fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:08.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.520+0000 7fe1d03ff700 1 --2- 172.21.15.32:0/723656977 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1c80cf8f0 0x7fe1c815fe20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0009e50 tx=0x7fe1c000b330 comp rx=0 tx=0).stop 2023-06-20T13:34:08.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.521+0000 7fe1d03ff700 1 -- 172.21.15.32:0/723656977 shutdown_connections 2023-06-20T13:34:08.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.521+0000 7fe1d03ff700 1 --2- 172.21.15.32:0/723656977 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1c80cf8f0 0x7fe1c815fe20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:08.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.521+0000 7fe1d03ff700 1 --2- 172.21.15.32:0/723656977 >> v2:172.21.15.115:3300/0 conn(0x7fe1c80d2640 0x7fe1c80b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:08.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.521+0000 7fe1d03ff700 1 -- 172.21.15.32:0/723656977 >> 172.21.15.32:0/723656977 conn(0x7fe1c8071660 msgr2=0x7fe1c8071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:08.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.521+0000 7fe1d03ff700 1 -- 172.21.15.32:0/723656977 shutdown_connections 2023-06-20T13:34:08.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.521+0000 7fe1d03ff700 1 -- 172.21.15.32:0/723656977 wait complete. 2023-06-20T13:34:08.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.522+0000 7fe1d03ff700 1 Processor -- start 2023-06-20T13:34:08.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.523+0000 7fe1d03ff700 1 -- start start 2023-06-20T13:34:08.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.523+0000 7fe1d03ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c80cf8f0 0x7fe1c81e78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:08.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.523+0000 7fe1d03ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1c80d2640 0x7fe1c80cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:08.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.524+0000 7fe1d03ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1c815c460 0x7fe1c80cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:08.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.524+0000 7fe1d03ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c81f1c30 con 0x7fe1c80cf8f0 2023-06-20T13:34:08.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.524+0000 7fe1d03ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c81f2490 con 0x7fe1c815c460 2023-06-20T13:34:08.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.524+0000 7fe1d03ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c81f5f10 con 0x7fe1c80d2640 2023-06-20T13:34:08.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.524+0000 7fe1ce19b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c80cf8f0 0x7fe1c81e78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:08.528 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.524+0000 7fe1ce19b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c80cf8f0 0x7fe1c81e78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54478/0 (socket says 172.21.15.32:54478) 2023-06-20T13:34:08.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.524+0000 7fe1ce19b700 1 -- 172.21.15.32:0/3765737358 learned_addr learned my addr 172.21.15.32:0/3765737358 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:08.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.524+0000 7fe1cd99a700 1 --2- 172.21.15.32:0/3765737358 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1c80d2640 0x7fe1c80cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:08.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.524+0000 7fe1ce19b700 1 -- 172.21.15.32:0/3765737358 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1c80d2640 msgr2=0x7fe1c80cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:08.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.524+0000 7fe1ce19b700 1 --2- 172.21.15.32:0/3765737358 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1c80d2640 0x7fe1c80cafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:08.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.524+0000 7fe1ce19b700 1 -- 172.21.15.32:0/3765737358 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1c815c460 msgr2=0x7fe1c80cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:08.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.524+0000 7fe1ce19b700 1 --2- 172.21.15.32:0/3765737358 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1c815c460 0x7fe1c80cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:08.529 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.524+0000 7fe1ce19b700 1 -- 172.21.15.32:0/3765737358 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c0009b30 con 0x7fe1c80cf8f0 2023-06-20T13:34:08.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.524+0000 7fe1ce19b700 1 --2- 172.21.15.32:0/3765737358 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c80cf8f0 0x7fe1c81e78f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400c4e0 tx=0x7fe1c400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:08.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.525+0000 7fe1beffd700 1 -- 172.21.15.32:0/3765737358 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c40052d0 con 0x7fe1c80cf8f0 2023-06-20T13:34:08.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.525+0000 7fe1beffd700 1 -- 172.21.15.32:0/3765737358 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c4005430 con 0x7fe1c80cf8f0 2023-06-20T13:34:08.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.525+0000 7fe1d03ff700 1 -- 172.21.15.32:0/3765737358 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c81f1e40 con 0x7fe1c80cf8f0 2023-06-20T13:34:08.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.525+0000 7fe1beffd700 1 -- 172.21.15.32:0/3765737358 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c40038c0 con 0x7fe1c80cf8f0 2023-06-20T13:34:08.530 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.525+0000 7fe1d03ff700 1 -- 172.21.15.32:0/3765737358 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c81e7e30 con 0x7fe1c80cf8f0 2023-06-20T13:34:08.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.526+0000 7fe1d03ff700 1 -- 172.21.15.32:0/3765737358 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c80b8570 con 0x7fe1c80cf8f0 2023-06-20T13:34:08.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.527+0000 7fe1beffd700 1 -- 172.21.15.32:0/3765737358 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe1c4003a20 con 0x7fe1c80cf8f0 2023-06-20T13:34:08.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.528+0000 7fe1beffd700 1 --2- 172.21.15.32:0/3765737358 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe1ac06ace0 0x7fe1ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:08.531 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.528+0000 7fe1beffd700 1 -- 172.21.15.32:0/3765737358 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe1c4088b80 con 0x7fe1c80cf8f0 2023-06-20T13:34:08.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.528+0000 7fe1cd99a700 1 --2- 172.21.15.32:0/3765737358 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe1ac06ace0 0x7fe1ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:08.532 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.529+0000 7fe1cd99a700 1 --2- 172.21.15.32:0/3765737358 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe1ac06ace0 0x7fe1ac06d190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe1c815f990 tx=0x7fe1b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:08.534 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.532+0000 7fe1beffd700 1 -- 172.21.15.32:0/3765737358 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe1c4053a50 con 0x7fe1c80cf8f0 2023-06-20T13:34:08.639 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:34:08.644 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:34:08.783 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.781+0000 7fe1d03ff700 1 -- 172.21.15.32:0/3765737358 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1c81e7fc0 con 0x7fe1c80cf8f0 2023-06-20T13:34:08.784 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.781+0000 7fe1beffd700 1 -- 172.21.15.32:0/3765737358 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4674 (secure 0 0 0) 0x7fe1c4057070 con 0x7fe1c80cf8f0 2023-06-20T13:34:08.784 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:34:08.784 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5308,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6836/1522872006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1522872006},{"type":"v1","addr":"172.21.15.32:6836","nonce":1522872006}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5311,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2159621980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":2159621980},{"type":"v1","addr":"172.21.15.115:6834","nonce":2159621980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5379,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/301179143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6835","nonce":301179143},{"type":"v1","addr":"172.21.15.32:6837","nonce":301179143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-20T13:34:04.509058+0000","modified":"2023-06-20T13:34:08.288860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5382":{"gid":5382,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6835/1096571469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":1096571469},{"type":"v1","addr":"172.21.15.115:6835","nonce":1096571469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-20T13:34:08.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.784+0000 7fe1d03ff700 1 -- 172.21.15.32:0/3765737358 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe1ac06ace0 msgr2=0x7fe1ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:08.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.784+0000 7fe1d03ff700 1 --2- 172.21.15.32:0/3765737358 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe1ac06ace0 0x7fe1ac06d190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe1c815f990 tx=0x7fe1b8008040 comp rx=0 tx=0).stop 2023-06-20T13:34:08.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.784+0000 7fe1d03ff700 1 -- 172.21.15.32:0/3765737358 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c80cf8f0 msgr2=0x7fe1c81e78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:08.786 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.784+0000 7fe1d03ff700 1 --2- 172.21.15.32:0/3765737358 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c80cf8f0 0x7fe1c81e78f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400c4e0 tx=0x7fe1c400c8a0 comp rx=0 tx=0).stop 2023-06-20T13:34:08.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.784+0000 7fe1d03ff700 1 -- 172.21.15.32:0/3765737358 shutdown_connections 2023-06-20T13:34:08.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.784+0000 7fe1d03ff700 1 --2- 172.21.15.32:0/3765737358 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe1ac06ace0 0x7fe1ac06d190 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:08.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.784+0000 7fe1d03ff700 1 --2- 172.21.15.32:0/3765737358 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1c815c460 0x7fe1c80cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:08.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.784+0000 7fe1d03ff700 1 --2- 172.21.15.32:0/3765737358 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c80cf8f0 0x7fe1c81e78f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:08.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.784+0000 7fe1d03ff700 1 --2- 172.21.15.32:0/3765737358 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1c80d2640 0x7fe1c80cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:08.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.784+0000 7fe1d03ff700 1 -- 172.21.15.32:0/3765737358 >> 172.21.15.32:0/3765737358 conn(0x7fe1c8071660 msgr2=0x7fe1c815fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:08.787 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.784+0000 7fe1d03ff700 1 -- 172.21.15.32:0/3765737358 shutdown_connections 2023-06-20T13:34:08.788 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:08.784+0000 7fe1d03ff700 1 -- 172.21.15.32:0/3765737358 wait complete. 2023-06-20T13:34:08.788 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 17 2023-06-20T13:34:08.804 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:34:09.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.003+0000 7f485c5ff700 1 Processor -- start 2023-06-20T13:34:09.006 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.004+0000 7f485c5ff700 1 -- start start 2023-06-20T13:34:09.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.005+0000 7f485c5ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f485415c460 0x7f48540b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:09.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.005+0000 7f485c5ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f48540d2640 0x7f48540cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:09.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.005+0000 7f485c5ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48540d1790 con 0x7f48540cf720 2023-06-20T13:34:09.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.005+0000 7f485c5ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48540cedd0 con 0x7f48540d2640 2023-06-20T13:34:09.007 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.005+0000 7f485c5ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48540cd950 con 0x7f485415c460 2023-06-20T13:34:09.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.005+0000 7f4859b9a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f48540d2640 0x7f48540cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:09.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.005+0000 7f485ab9c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f48540cf720 0x7f48540d2b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:51598/0 (socket says 172.21.15.32:51598) 2023-06-20T13:34:09.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.005+0000 7f485ab9c700 1 -- 172.21.15.32:0/584184984 learned_addr learned my addr 172.21.15.32:0/584184984 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:34:09.009 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.005+0000 7f485a39b700 1 --2- 172.21.15.32:0/584184984 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f485415c460 0x7f48540b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:09.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.005+0000 7f4859b9a700 1 -- 172.21.15.32:0/584184984 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f485415c460 msgr2=0x7f48540b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:09.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.006+0000 7f4859b9a700 1 --2- 172.21.15.32:0/584184984 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f485415c460 0x7f48540b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:09.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.006+0000 7f4859b9a700 1 -- 172.21.15.32:0/584184984 >> v1:172.21.15.32:6789/0 conn(0x7f48540cf720 legacy=0x7f48540d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:09.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.006+0000 7f4859b9a700 1 -- 172.21.15.32:0/584184984 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48540d14b0 con 0x7f48540d2640 2023-06-20T13:34:09.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.006+0000 7f4859399700 1 -- 172.21.15.32:0/584184984 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3612196719 0 0) 0x7f48540d1790 con 0x7f48540cf720 2023-06-20T13:34:09.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.006+0000 7f485a39b700 1 --2- 172.21.15.32:0/584184984 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f485415c460 0x7f48540b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:34:09.010 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.006+0000 7f4859b9a700 1 --2- 172.21.15.32:0/584184984 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48540d2640 0x7f48540cf1e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f4844009840 tx=0x7f4844009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb955f48c8f305c5 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:09.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.006+0000 7f4859399700 1 -- 172.21.15.32:0/584184984 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4844011830 con 0x7f48540d2640 2023-06-20T13:34:09.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.006+0000 7f4859399700 1 -- 172.21.15.32:0/584184984 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4844011990 con 0x7f48540d2640 2023-06-20T13:34:09.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.006+0000 7f4859399700 1 -- 172.21.15.32:0/584184984 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4844011d20 con 0x7f48540d2640 2023-06-20T13:34:09.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.007+0000 7f485c5ff700 1 -- 172.21.15.32:0/584184984 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48540d2640 msgr2=0x7f48540cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:09.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.007+0000 7f485c5ff700 1 --2- 172.21.15.32:0/584184984 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48540d2640 0x7f48540cf1e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f4844009840 tx=0x7f4844009b50 comp rx=0 tx=0).stop 2023-06-20T13:34:09.011 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.007+0000 7f485c5ff700 1 -- 172.21.15.32:0/584184984 shutdown_connections 2023-06-20T13:34:09.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.007+0000 7f485c5ff700 1 --2- 172.21.15.32:0/584184984 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f485415c460 0x7f48540b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:09.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.007+0000 7f485c5ff700 1 --2- 172.21.15.32:0/584184984 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48540d2640 0x7f48540cf1e0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:09.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.007+0000 7f485c5ff700 1 -- 172.21.15.32:0/584184984 >> 172.21.15.32:0/584184984 conn(0x7f4854071660 msgr2=0x7f4854071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:09.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.007+0000 7f485c5ff700 1 -- 172.21.15.32:0/584184984 shutdown_connections 2023-06-20T13:34:09.012 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.007+0000 7f485c5ff700 1 -- 172.21.15.32:0/584184984 wait complete. 2023-06-20T13:34:09.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.008+0000 7f485c5ff700 1 Processor -- start 2023-06-20T13:34:09.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.009+0000 7f485c5ff700 1 -- start start 2023-06-20T13:34:09.014 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.009+0000 7f485c5ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48540cf720 0x7f4854151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:09.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.009+0000 7f485c5ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48540d2640 0x7f4854153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:09.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.009+0000 7f485c5ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f485415c460 0x7f48540c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:09.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.010+0000 7f485c5ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48540c8140 con 0x7f48540d2640 2023-06-20T13:34:09.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.010+0000 7f485c5ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4854152300 con 0x7f485415c460 2023-06-20T13:34:09.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.010+0000 7f485c5ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48540c9df0 con 0x7f48540cf720 2023-06-20T13:34:09.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.010+0000 7f4859b9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48540d2640 0x7f4854153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:09.015 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.010+0000 7f4859b9a700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48540d2640 0x7f4854153940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54496/0 (socket says 172.21.15.32:54496) 2023-06-20T13:34:09.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.010+0000 7f4859b9a700 1 -- 172.21.15.32:0/1298392146 learned_addr learned my addr 172.21.15.32:0/1298392146 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:09.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.010+0000 7f485a39b700 1 --2- 172.21.15.32:0/1298392146 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48540cf720 0x7f4854151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:09.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.010+0000 7f485ab9c700 1 --2- 172.21.15.32:0/1298392146 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f485415c460 0x7f48540c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:09.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.010+0000 7f4859b9a700 1 -- 172.21.15.32:0/1298392146 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48540cf720 msgr2=0x7f4854151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:09.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.010+0000 7f4859b9a700 1 --2- 172.21.15.32:0/1298392146 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48540cf720 0x7f4854151dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:09.016 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.010+0000 7f4859b9a700 1 -- 172.21.15.32:0/1298392146 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f485415c460 msgr2=0x7f48540c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:09.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.010+0000 7f4859b9a700 1 --2- 172.21.15.32:0/1298392146 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f485415c460 0x7f48540c75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:09.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.010+0000 7f4859b9a700 1 -- 172.21.15.32:0/1298392146 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48440094a0 con 0x7f48540d2640 2023-06-20T13:34:09.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.010+0000 7f485ab9c700 1 --2- 172.21.15.32:0/1298392146 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f485415c460 0x7f48540c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:34:09.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.011+0000 7f4859b9a700 1 --2- 172.21.15.32:0/1298392146 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48540d2640 0x7f4854153940 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f48440090b0 tx=0x7f4844004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:09.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.011+0000 7f484affd700 1 -- 172.21.15.32:0/1298392146 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48440036a0 con 0x7f48540d2640 2023-06-20T13:34:09.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.011+0000 7f484affd700 1 -- 172.21.15.32:0/1298392146 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484401e070 con 0x7f48540d2640 2023-06-20T13:34:09.017 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.011+0000 7f485c5ff700 1 -- 172.21.15.32:0/1298392146 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48540ca0d0 con 0x7f48540d2640 2023-06-20T13:34:09.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.011+0000 7f484affd700 1 -- 172.21.15.32:0/1298392146 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4844003a20 con 0x7f48540d2640 2023-06-20T13:34:09.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.011+0000 7f485c5ff700 1 -- 172.21.15.32:0/1298392146 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48540ca690 con 0x7f48540d2640 2023-06-20T13:34:09.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.012+0000 7f485c5ff700 1 -- 172.21.15.32:0/1298392146 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48540ca880 con 0x7f48540d2640 2023-06-20T13:34:09.018 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.013+0000 7f484affd700 1 -- 172.21.15.32:0/1298392146 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4844003b80 con 0x7f48540d2640 2023-06-20T13:34:09.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.014+0000 7f484affd700 1 --2- 172.21.15.32:0/1298392146 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f483806ace0 0x7f483806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:09.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.014+0000 7f484affd700 1 -- 172.21.15.32:0/1298392146 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f484408a720 con 0x7f48540d2640 2023-06-20T13:34:09.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.014+0000 7f485a39b700 1 --2- 172.21.15.32:0/1298392146 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f483806ace0 0x7f483806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:09.019 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.015+0000 7f485a39b700 1 --2- 172.21.15.32:0/1298392146 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f483806ace0 0x7f483806d190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4850006fd0 tx=0x7f4850008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:09.020 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.019+0000 7f484affd700 1 -- 172.21.15.32:0/1298392146 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4844055680 con 0x7f48540d2640 2023-06-20T13:34:09.231 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.229+0000 7f485c5ff700 1 -- 172.21.15.32:0/1298392146 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f485404ea60 con 0x7f48540d2640 2023-06-20T13:34:09.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.231+0000 7f484affd700 1 -- 172.21.15.32:0/1298392146 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18476 (secure 0 0 0) 0x7f4844058ca0 con 0x7f48540d2640 2023-06-20T13:34:09.233 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:34:09.233 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":41,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:34:06.269950+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-06-20T13:34:02.254258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-06-20T13:34:03.489075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:34:09.235 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.233+0000 7f485c5ff700 1 -- 172.21.15.32:0/1298392146 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f483806ace0 msgr2=0x7f483806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:09.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.233+0000 7f485c5ff700 1 --2- 172.21.15.32:0/1298392146 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f483806ace0 0x7f483806d190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4850006fd0 tx=0x7f4850008040 comp rx=0 tx=0).stop 2023-06-20T13:34:09.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.233+0000 7f485c5ff700 1 -- 172.21.15.32:0/1298392146 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48540d2640 msgr2=0x7f4854153940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:09.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.233+0000 7f485c5ff700 1 --2- 172.21.15.32:0/1298392146 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48540d2640 0x7f4854153940 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f48440090b0 tx=0x7f4844004750 comp rx=0 tx=0).stop 2023-06-20T13:34:09.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.233+0000 7f485c5ff700 1 -- 172.21.15.32:0/1298392146 shutdown_connections 2023-06-20T13:34:09.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.233+0000 7f485c5ff700 1 --2- 172.21.15.32:0/1298392146 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f483806ace0 0x7f483806d190 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:09.236 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.233+0000 7f485c5ff700 1 --2- 172.21.15.32:0/1298392146 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f485415c460 0x7f48540c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:09.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.233+0000 7f485c5ff700 1 --2- 172.21.15.32:0/1298392146 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48540cf720 0x7f4854151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:09.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.233+0000 7f485c5ff700 1 --2- 172.21.15.32:0/1298392146 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f48540d2640 0x7f4854153940 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:09.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.233+0000 7f485c5ff700 1 -- 172.21.15.32:0/1298392146 >> 172.21.15.32:0/1298392146 conn(0x7f4854071660 msgr2=0x7f4854071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:09.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.233+0000 7f485c5ff700 1 -- 172.21.15.32:0/1298392146 shutdown_connections 2023-06-20T13:34:09.237 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.234+0000 7f485c5ff700 1 -- 172.21.15.32:0/1298392146 wait complete. 2023-06-20T13:34:09.254 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-20T13:34:09.255 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-20T13:34:09.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.454+0000 7f8ab4bff700 1 Processor -- start 2023-06-20T13:34:09.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.454+0000 7f8ab4bff700 1 -- start start 2023-06-20T13:34:09.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.456+0000 7f8ab4bff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8ab015c460 0x7f8ab00b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:09.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.456+0000 7f8ab4bff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ab00d2640 0x7f8ab00cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:09.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.456+0000 7f8ab4bff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8ab00cf720 0x7f8ab00cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:09.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.456+0000 7f8ab4bff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab00cedd0 con 0x7f8ab00cf720 2023-06-20T13:34:09.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.456+0000 7f8ab4bff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab00d1790 con 0x7f8ab015c460 2023-06-20T13:34:09.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.456+0000 7f8ab4bff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab00cd950 con 0x7f8ab00d2640 2023-06-20T13:34:09.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.456+0000 7f8aaed9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8ab00cf720 0x7f8ab00cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:09.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.456+0000 7f8aaed9d700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f8ab00cf720 0x7f8ab00cfbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54502/0 (socket says 172.21.15.32:54502) 2023-06-20T13:34:09.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.456+0000 7f8aaed9d700 1 -- 172.21.15.32:0/558798562 learned_addr learned my addr 172.21.15.32:0/558798562 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:09.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.456+0000 7f8aadd9b700 1 --2- 172.21.15.32:0/558798562 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ab00d2640 0x7f8ab00cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:09.460 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.456+0000 7f8aae59c700 1 --2- 172.21.15.32:0/558798562 >> v2:172.21.15.115:3300/0 conn(0x7f8ab015c460 0x7f8ab00b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:09.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.456+0000 7f8aaed9d700 1 -- 172.21.15.32:0/558798562 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ab00d2640 msgr2=0x7f8ab00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:09.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.456+0000 7f8aaed9d700 1 --2- 172.21.15.32:0/558798562 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ab00d2640 0x7f8ab00cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:09.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.456+0000 7f8aaed9d700 1 -- 172.21.15.32:0/558798562 >> v2:172.21.15.115:3300/0 conn(0x7f8ab015c460 msgr2=0x7f8ab00b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:09.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.456+0000 7f8aaed9d700 1 --2- 172.21.15.32:0/558798562 >> v2:172.21.15.115:3300/0 conn(0x7f8ab015c460 0x7f8ab00b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:09.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.456+0000 7f8aaed9d700 1 -- 172.21.15.32:0/558798562 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab00d14b0 con 0x7f8ab00cf720 2023-06-20T13:34:09.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.456+0000 7f8aadd9b700 1 --2- 172.21.15.32:0/558798562 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ab00d2640 0x7f8ab00cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:34:09.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.457+0000 7f8aaed9d700 1 --2- 172.21.15.32:0/558798562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ab00cf720 0x7f8ab00cfbc0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8ab00b4f00 tx=0x7f8aa800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446aabba5cb71e8a server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:09.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.457+0000 7f8aad59a700 1 -- 172.21.15.32:0/558798562 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa800e070 con 0x7f8ab00cf720 2023-06-20T13:34:09.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.457+0000 7f8aad59a700 1 -- 172.21.15.32:0/558798562 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa800b9c0 con 0x7f8ab00cf720 2023-06-20T13:34:09.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.457+0000 7f8aad59a700 1 -- 172.21.15.32:0/558798562 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa800bd70 con 0x7f8ab00cf720 2023-06-20T13:34:09.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.457+0000 7f8ab4bff700 1 -- 172.21.15.32:0/558798562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ab00cf720 msgr2=0x7f8ab00cfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:09.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.457+0000 7f8ab4bff700 1 --2- 172.21.15.32:0/558798562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ab00cf720 0x7f8ab00cfbc0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8ab00b4f00 tx=0x7f8aa800b330 comp rx=0 tx=0).stop 2023-06-20T13:34:09.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.457+0000 7f8ab4bff700 1 -- 172.21.15.32:0/558798562 shutdown_connections 2023-06-20T13:34:09.462 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.457+0000 7f8ab4bff700 1 --2- 172.21.15.32:0/558798562 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ab00cf720 0x7f8ab00cfbc0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:09.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.457+0000 7f8ab4bff700 1 --2- 172.21.15.32:0/558798562 >> v2:172.21.15.115:3300/0 conn(0x7f8ab015c460 0x7f8ab00b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:09.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.457+0000 7f8ab4bff700 1 --2- 172.21.15.32:0/558798562 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ab00d2640 0x7f8ab00cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:09.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.457+0000 7f8ab4bff700 1 -- 172.21.15.32:0/558798562 >> 172.21.15.32:0/558798562 conn(0x7f8ab0071660 msgr2=0x7f8ab0071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:09.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.458+0000 7f8ab4bff700 1 -- 172.21.15.32:0/558798562 shutdown_connections 2023-06-20T13:34:09.463 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.458+0000 7f8ab4bff700 1 -- 172.21.15.32:0/558798562 wait complete. 2023-06-20T13:34:09.464 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.460+0000 7f8ab4bff700 1 Processor -- start 2023-06-20T13:34:09.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.460+0000 7f8ab4bff700 1 -- start start 2023-06-20T13:34:09.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.461+0000 7f8ab4bff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ab00cf720 0x7f8ab01f15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:09.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.461+0000 7f8ab4bff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ab00d2640 0x7f8ab0159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:09.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.461+0000 7f8ab4bff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ab015c460 0x7f8ab015d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:09.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.461+0000 7f8ab4bff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab00c9c50 con 0x7f8ab00cf720 2023-06-20T13:34:09.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.461+0000 7f8ab4bff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab00a95f0 con 0x7f8ab015c460 2023-06-20T13:34:09.465 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.461+0000 7f8ab4bff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab00ca760 con 0x7f8ab00d2640 2023-06-20T13:34:09.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.462+0000 7f8aae59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ab00cf720 0x7f8ab01f15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:09.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.462+0000 7f8aae59c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ab00cf720 0x7f8ab01f15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:54508/0 (socket says 172.21.15.32:54508) 2023-06-20T13:34:09.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.462+0000 7f8aae59c700 1 -- 172.21.15.32:0/3659536850 learned_addr learned my addr 172.21.15.32:0/3659536850 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:09.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.462+0000 7f8aadd9b700 1 --2- 172.21.15.32:0/3659536850 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ab00d2640 0x7f8ab0159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:09.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.462+0000 7f8aaed9d700 1 --2- 172.21.15.32:0/3659536850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ab015c460 0x7f8ab015d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:09.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.462+0000 7f8aae59c700 1 -- 172.21.15.32:0/3659536850 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ab00d2640 msgr2=0x7f8ab0159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:09.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.462+0000 7f8aae59c700 1 --2- 172.21.15.32:0/3659536850 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ab00d2640 0x7f8ab0159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:09.466 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.462+0000 7f8aae59c700 1 -- 172.21.15.32:0/3659536850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ab015c460 msgr2=0x7f8ab015d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:09.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.462+0000 7f8aae59c700 1 --2- 172.21.15.32:0/3659536850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ab015c460 0x7f8ab015d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:09.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.462+0000 7f8aae59c700 1 -- 172.21.15.32:0/3659536850 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa8009b30 con 0x7f8ab00cf720 2023-06-20T13:34:09.467 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.463+0000 7f8aae59c700 1 --2- 172.21.15.32:0/3659536850 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ab00cf720 0x7f8ab01f15e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8aa000d800 tx=0x7f8aa000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:09.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.463+0000 7f8a9effd700 1 -- 172.21.15.32:0/3659536850 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa00125f0 con 0x7f8ab00cf720 2023-06-20T13:34:09.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.463+0000 7f8a9effd700 1 -- 172.21.15.32:0/3659536850 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa0012750 con 0x7f8ab00cf720 2023-06-20T13:34:09.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.463+0000 7f8a9effd700 1 -- 172.21.15.32:0/3659536850 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa0012b00 con 0x7f8ab00cf720 2023-06-20T13:34:09.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.463+0000 7f8ab4bff700 1 -- 172.21.15.32:0/3659536850 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab00c9e30 con 0x7f8ab00cf720 2023-06-20T13:34:09.468 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.463+0000 7f8ab4bff700 1 -- 172.21.15.32:0/3659536850 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab00ca3f0 con 0x7f8ab00cf720 2023-06-20T13:34:09.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.464+0000 7f8ab4bff700 1 -- 172.21.15.32:0/3659536850 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab004ea60 con 0x7f8ab00cf720 2023-06-20T13:34:09.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.465+0000 7f8a9effd700 1 -- 172.21.15.32:0/3659536850 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8aa0012c60 con 0x7f8ab00cf720 2023-06-20T13:34:09.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.466+0000 7f8a9effd700 1 --2- 172.21.15.32:0/3659536850 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8a9006ace0 0x7f8a9006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:09.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.466+0000 7f8a9effd700 1 -- 172.21.15.32:0/3659536850 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8aa00896a0 con 0x7f8ab00cf720 2023-06-20T13:34:09.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.466+0000 7f8aadd9b700 1 --2- 172.21.15.32:0/3659536850 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8a9006ace0 0x7f8a9006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:09.469 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.466+0000 7f8aadd9b700 1 --2- 172.21.15.32:0/3659536850 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8a9006ace0 0x7f8a9006d190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8ab015ae90 tx=0x7f8aa4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:09.472 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.470+0000 7f8a9effd700 1 -- 172.21.15.32:0/3659536850 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8aa0054570 con 0x7f8ab00cf720 2023-06-20T13:34:09.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.670+0000 7f8ab4bff700 1 -- 172.21.15.32:0/3659536850 --> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8ab00cd5e0 con 0x7f8a9006ace0 2023-06-20T13:34:09.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.681+0000 7f8a9effd700 1 -- 172.21.15.32:0/3659536850 <== mgr.4101 v2:172.21.15.32:6832/1136488437 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310667 (secure 0 0 0) 0x7f8aa4004240 con 0x7f8a9006ace0 2023-06-20T13:34:09.687 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:34:09.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.685+0000 7f8ab4bff700 1 -- 172.21.15.32:0/3659536850 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8a9006ace0 msgr2=0x7f8a9006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:09.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.685+0000 7f8ab4bff700 1 --2- 172.21.15.32:0/3659536850 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8a9006ace0 0x7f8a9006d190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8ab015ae90 tx=0x7f8aa4008040 comp rx=0 tx=0).stop 2023-06-20T13:34:09.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.685+0000 7f8ab4bff700 1 -- 172.21.15.32:0/3659536850 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ab00cf720 msgr2=0x7f8ab01f15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:09.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.685+0000 7f8ab4bff700 1 --2- 172.21.15.32:0/3659536850 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ab00cf720 0x7f8ab01f15e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8aa000d800 tx=0x7f8aa000db10 comp rx=0 tx=0).stop 2023-06-20T13:34:09.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.685+0000 7f8ab4bff700 1 -- 172.21.15.32:0/3659536850 shutdown_connections 2023-06-20T13:34:09.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.685+0000 7f8ab4bff700 1 --2- 172.21.15.32:0/3659536850 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8a9006ace0 0x7f8a9006d190 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:09.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.685+0000 7f8ab4bff700 1 --2- 172.21.15.32:0/3659536850 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8ab015c460 0x7f8ab015d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:09.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.685+0000 7f8ab4bff700 1 --2- 172.21.15.32:0/3659536850 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8ab00cf720 0x7f8ab01f15e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:09.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.685+0000 7f8ab4bff700 1 --2- 172.21.15.32:0/3659536850 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8ab00d2640 0x7f8ab0159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:09.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.685+0000 7f8ab4bff700 1 -- 172.21.15.32:0/3659536850 >> 172.21.15.32:0/3659536850 conn(0x7f8ab0071660 msgr2=0x7f8ab006b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:09.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.685+0000 7f8ab4bff700 1 -- 172.21.15.32:0/3659536850 shutdown_connections 2023-06-20T13:34:09.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.685+0000 7f8ab4bff700 1 -- 172.21.15.32:0/3659536850 wait complete. 2023-06-20T13:34:09.691 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-06-20T13:34:09.706 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2023-06-20T13:34:09.285235+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220352,"kb_used_data":4736,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754368,"statfs":{"total":773094113280,"available":772868472832,"internally_reserved":0,"allocated":4849664,"data_stored":2797873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001974"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.276102+0000","last_change":"2023-06-20T13:34:05.287157+0000","last_active":"2023-06-20T13:34:06.276102+0000","last_peered":"2023-06-20T13:34:06.276102+0000","last_clean":"2023-06-20T13:34:06.276102+0000","last_became_active":"2023-06-20T13:34:05.286909+0000","last_became_peered":"2023-06-20T13:34:05.286909+0000","last_unstale":"2023-06-20T13:34:06.276102+0000","last_undegraded":"2023-06-20T13:34:06.276102+0000","last_fullsized":"2023-06-20T13:34:06.276102+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:58:40.836663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275241+0000","last_change":"2023-06-20T13:34:05.304354+0000","last_active":"2023-06-20T13:34:06.275241+0000","last_peered":"2023-06-20T13:34:06.275241+0000","last_clean":"2023-06-20T13:34:06.275241+0000","last_became_active":"2023-06-20T13:34:05.303027+0000","last_became_peered":"2023-06-20T13:34:05.303027+0000","last_unstale":"2023-06-20T13:34:06.275241+0000","last_undegraded":"2023-06-20T13:34:06.275241+0000","last_fullsized":"2023-06-20T13:34:06.275241+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:26:40.688211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.291589+0000","last_change":"2023-06-20T13:34:05.286112+0000","last_active":"2023-06-20T13:34:05.291589+0000","last_peered":"2023-06-20T13:34:05.291589+0000","last_clean":"2023-06-20T13:34:05.291589+0000","last_became_active":"2023-06-20T13:34:05.285813+0000","last_became_peered":"2023-06-20T13:34:05.285813+0000","last_unstale":"2023-06-20T13:34:05.291589+0000","last_undegraded":"2023-06-20T13:34:05.291589+0000","last_fullsized":"2023-06-20T13:34:05.291589+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:13:20.663107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.314026+0000","last_change":"2023-06-20T13:34:05.310038+0000","last_active":"2023-06-20T13:34:05.314026+0000","last_peered":"2023-06-20T13:34:05.314026+0000","last_clean":"2023-06-20T13:34:05.314026+0000","last_became_active":"2023-06-20T13:34:05.309768+0000","last_became_peered":"2023-06-20T13:34:05.309768+0000","last_unstale":"2023-06-20T13:34:05.314026+0000","last_undegraded":"2023-06-20T13:34:05.314026+0000","last_fullsized":"2023-06-20T13:34:05.314026+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:56:02.585426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275299+0000","last_change":"2023-06-20T13:34:05.303491+0000","last_active":"2023-06-20T13:34:06.275299+0000","last_peered":"2023-06-20T13:34:06.275299+0000","last_clean":"2023-06-20T13:34:06.275299+0000","last_became_active":"2023-06-20T13:34:05.303216+0000","last_became_peered":"2023-06-20T13:34:05.303216+0000","last_unstale":"2023-06-20T13:34:06.275299+0000","last_undegraded":"2023-06-20T13:34:06.275299+0000","last_fullsized":"2023-06-20T13:34:06.275299+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:56:31.373999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.281147+0000","last_change":"2023-06-20T13:34:05.280017+0000","last_active":"2023-06-20T13:34:05.281147+0000","last_peered":"2023-06-20T13:34:05.281147+0000","last_clean":"2023-06-20T13:34:05.281147+0000","last_became_active":"2023-06-20T13:34:05.279740+0000","last_became_peered":"2023-06-20T13:34:05.279740+0000","last_unstale":"2023-06-20T13:34:05.281147+0000","last_undegraded":"2023-06-20T13:34:05.281147+0000","last_fullsized":"2023-06-20T13:34:05.281147+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:19:40.158650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.276412+0000","last_change":"2023-06-20T13:34:05.290959+0000","last_active":"2023-06-20T13:34:06.276412+0000","last_peered":"2023-06-20T13:34:06.276412+0000","last_clean":"2023-06-20T13:34:06.276412+0000","last_became_active":"2023-06-20T13:34:05.290704+0000","last_became_peered":"2023-06-20T13:34:05.290704+0000","last_unstale":"2023-06-20T13:34:06.276412+0000","last_undegraded":"2023-06-20T13:34:06.276412+0000","last_fullsized":"2023-06-20T13:34:06.276412+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:13:12.988006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.318400+0000","last_change":"2023-06-20T13:34:05.312084+0000","last_active":"2023-06-20T13:34:05.318400+0000","last_peered":"2023-06-20T13:34:05.318400+0000","last_clean":"2023-06-20T13:34:05.318400+0000","last_became_active":"2023-06-20T13:34:05.311604+0000","last_became_peered":"2023-06-20T13:34:05.311604+0000","last_unstale":"2023-06-20T13:34:05.318400+0000","last_undegraded":"2023-06-20T13:34:05.318400+0000","last_fullsized":"2023-06-20T13:34:05.318400+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T13:43:05.944883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.318039+0000","last_change":"2023-06-20T13:34:05.313566+0000","last_active":"2023-06-20T13:34:05.318039+0000","last_peered":"2023-06-20T13:34:05.318039+0000","last_clean":"2023-06-20T13:34:05.318039+0000","last_became_active":"2023-06-20T13:34:05.313266+0000","last_became_peered":"2023-06-20T13:34:05.313266+0000","last_unstale":"2023-06-20T13:34:05.318039+0000","last_undegraded":"2023-06-20T13:34:05.318039+0000","last_fullsized":"2023-06-20T13:34:05.318039+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:40:07.072491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.318146+0000","last_change":"2023-06-20T13:34:05.311949+0000","last_active":"2023-06-20T13:34:05.318146+0000","last_peered":"2023-06-20T13:34:05.318146+0000","last_clean":"2023-06-20T13:34:05.318146+0000","last_became_active":"2023-06-20T13:34:05.311474+0000","last_became_peered":"2023-06-20T13:34:05.311474+0000","last_unstale":"2023-06-20T13:34:05.318146+0000","last_undegraded":"2023-06-20T13:34:05.318146+0000","last_fullsized":"2023-06-20T13:34:05.318146+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:20:17.188648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.318170+0000","last_change":"2023-06-20T13:34:05.314214+0000","last_active":"2023-06-20T13:34:05.318170+0000","last_peered":"2023-06-20T13:34:05.318170+0000","last_clean":"2023-06-20T13:34:05.318170+0000","last_became_active":"2023-06-20T13:34:05.313892+0000","last_became_peered":"2023-06-20T13:34:05.313892+0000","last_unstale":"2023-06-20T13:34:05.318170+0000","last_undegraded":"2023-06-20T13:34:05.318170+0000","last_fullsized":"2023-06-20T13:34:05.318170+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:10:41.088988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275281+0000","last_change":"2023-06-20T13:34:05.296517+0000","last_active":"2023-06-20T13:34:06.275281+0000","last_peered":"2023-06-20T13:34:06.275281+0000","last_clean":"2023-06-20T13:34:06.275281+0000","last_became_active":"2023-06-20T13:34:05.296086+0000","last_became_peered":"2023-06-20T13:34:05.296086+0000","last_unstale":"2023-06-20T13:34:06.275281+0000","last_undegraded":"2023-06-20T13:34:06.275281+0000","last_fullsized":"2023-06-20T13:34:06.275281+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T01:23:59.127989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.315859+0000","last_change":"2023-06-20T13:34:05.314723+0000","last_active":"2023-06-20T13:34:05.315859+0000","last_peered":"2023-06-20T13:34:05.315859+0000","last_clean":"2023-06-20T13:34:05.315859+0000","last_became_active":"2023-06-20T13:34:05.314423+0000","last_became_peered":"2023-06-20T13:34:05.314423+0000","last_unstale":"2023-06-20T13:34:05.315859+0000","last_undegraded":"2023-06-20T13:34:05.315859+0000","last_fullsized":"2023-06-20T13:34:05.315859+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:57:44.965669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.318174+0000","last_change":"2023-06-20T13:34:05.313533+0000","last_active":"2023-06-20T13:34:05.318174+0000","last_peered":"2023-06-20T13:34:05.318174+0000","last_clean":"2023-06-20T13:34:05.318174+0000","last_became_active":"2023-06-20T13:34:05.313201+0000","last_became_peered":"2023-06-20T13:34:05.313201+0000","last_unstale":"2023-06-20T13:34:05.318174+0000","last_undegraded":"2023-06-20T13:34:05.318174+0000","last_fullsized":"2023-06-20T13:34:05.318174+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T13:48:44.537113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.300757+0000","last_change":"2023-06-20T13:34:05.287456+0000","last_active":"2023-06-20T13:34:05.300757+0000","last_peered":"2023-06-20T13:34:05.300757+0000","last_clean":"2023-06-20T13:34:05.300757+0000","last_became_active":"2023-06-20T13:34:05.287165+0000","last_became_peered":"2023-06-20T13:34:05.287165+0000","last_unstale":"2023-06-20T13:34:05.300757+0000","last_undegraded":"2023-06-20T13:34:05.300757+0000","last_fullsized":"2023-06-20T13:34:05.300757+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:54:26.875652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.304834+0000","last_change":"2023-06-20T13:34:05.301885+0000","last_active":"2023-06-20T13:34:05.304834+0000","last_peered":"2023-06-20T13:34:05.304834+0000","last_clean":"2023-06-20T13:34:05.304834+0000","last_became_active":"2023-06-20T13:34:05.301654+0000","last_became_peered":"2023-06-20T13:34:05.301654+0000","last_unstale":"2023-06-20T13:34:05.304834+0000","last_undegraded":"2023-06-20T13:34:05.304834+0000","last_fullsized":"2023-06-20T13:34:05.304834+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:04:00.033985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.294055+0000","last_change":"2023-06-20T13:34:05.290947+0000","last_active":"2023-06-20T13:34:05.294055+0000","last_peered":"2023-06-20T13:34:05.294055+0000","last_clean":"2023-06-20T13:34:05.294055+0000","last_became_active":"2023-06-20T13:34:05.290663+0000","last_became_peered":"2023-06-20T13:34:05.290663+0000","last_unstale":"2023-06-20T13:34:05.294055+0000","last_undegraded":"2023-06-20T13:34:05.294055+0000","last_fullsized":"2023-06-20T13:34:05.294055+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:00:01.834452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.304425+0000","last_change":"2023-06-20T13:34:05.299084+0000","last_active":"2023-06-20T13:34:05.304425+0000","last_peered":"2023-06-20T13:34:05.304425+0000","last_clean":"2023-06-20T13:34:05.304425+0000","last_became_active":"2023-06-20T13:34:05.298816+0000","last_became_peered":"2023-06-20T13:34:05.298816+0000","last_unstale":"2023-06-20T13:34:05.304425+0000","last_undegraded":"2023-06-20T13:34:05.304425+0000","last_fullsized":"2023-06-20T13:34:05.304425+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:50:14.435877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.304085+0000","last_change":"2023-06-20T13:34:05.299470+0000","last_active":"2023-06-20T13:34:05.304085+0000","last_peered":"2023-06-20T13:34:05.304085+0000","last_clean":"2023-06-20T13:34:05.304085+0000","last_became_active":"2023-06-20T13:34:05.299044+0000","last_became_peered":"2023-06-20T13:34:05.299044+0000","last_unstale":"2023-06-20T13:34:05.304085+0000","last_undegraded":"2023-06-20T13:34:05.304085+0000","last_fullsized":"2023-06-20T13:34:05.304085+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:31:15.592652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.311763+0000","last_change":"2023-06-20T13:34:05.302290+0000","last_active":"2023-06-20T13:34:05.311763+0000","last_peered":"2023-06-20T13:34:05.311763+0000","last_clean":"2023-06-20T13:34:05.311763+0000","last_became_active":"2023-06-20T13:34:05.301975+0000","last_became_peered":"2023-06-20T13:34:05.301975+0000","last_unstale":"2023-06-20T13:34:05.311763+0000","last_undegraded":"2023-06-20T13:34:05.311763+0000","last_fullsized":"2023-06-20T13:34:05.311763+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:04:00.033985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.303834+0000","last_change":"2023-06-20T13:34:05.283409+0000","last_active":"2023-06-20T13:34:05.303834+0000","last_peered":"2023-06-20T13:34:05.303834+0000","last_clean":"2023-06-20T13:34:05.303834+0000","last_became_active":"2023-06-20T13:34:05.283089+0000","last_became_peered":"2023-06-20T13:34:05.283089+0000","last_unstale":"2023-06-20T13:34:05.303834+0000","last_undegraded":"2023-06-20T13:34:05.303834+0000","last_fullsized":"2023-06-20T13:34:05.303834+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:01:09.946087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.313644+0000","last_change":"2023-06-20T13:34:05.309364+0000","last_active":"2023-06-20T13:34:05.313644+0000","last_peered":"2023-06-20T13:34:05.313644+0000","last_clean":"2023-06-20T13:34:05.313644+0000","last_became_active":"2023-06-20T13:34:05.309078+0000","last_became_peered":"2023-06-20T13:34:05.309078+0000","last_unstale":"2023-06-20T13:34:05.313644+0000","last_undegraded":"2023-06-20T13:34:05.313644+0000","last_fullsized":"2023-06-20T13:34:05.313644+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:48:24.154671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.301164+0000","last_change":"2023-06-20T13:34:05.293848+0000","last_active":"2023-06-20T13:34:05.301164+0000","last_peered":"2023-06-20T13:34:05.301164+0000","last_clean":"2023-06-20T13:34:05.301164+0000","last_became_active":"2023-06-20T13:34:05.293474+0000","last_became_peered":"2023-06-20T13:34:05.293474+0000","last_unstale":"2023-06-20T13:34:05.301164+0000","last_undegraded":"2023-06-20T13:34:05.301164+0000","last_fullsized":"2023-06-20T13:34:05.301164+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:29:51.889953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.303766+0000","last_change":"2023-06-20T13:34:05.300196+0000","last_active":"2023-06-20T13:34:05.303766+0000","last_peered":"2023-06-20T13:34:05.303766+0000","last_clean":"2023-06-20T13:34:05.303766+0000","last_became_active":"2023-06-20T13:34:05.299948+0000","last_became_peered":"2023-06-20T13:34:05.299948+0000","last_unstale":"2023-06-20T13:34:05.303766+0000","last_undegraded":"2023-06-20T13:34:05.303766+0000","last_fullsized":"2023-06-20T13:34:05.303766+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:32:58.554744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.300132+0000","last_change":"2023-06-20T13:34:05.295193+0000","last_active":"2023-06-20T13:34:05.300132+0000","last_peered":"2023-06-20T13:34:05.300132+0000","last_clean":"2023-06-20T13:34:05.300132+0000","last_became_active":"2023-06-20T13:34:05.293195+0000","last_became_peered":"2023-06-20T13:34:05.293195+0000","last_unstale":"2023-06-20T13:34:05.300132+0000","last_undegraded":"2023-06-20T13:34:05.300132+0000","last_fullsized":"2023-06-20T13:34:05.300132+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:34:08.431231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.314171+0000","last_change":"2023-06-20T13:34:05.303026+0000","last_active":"2023-06-20T13:34:05.314171+0000","last_peered":"2023-06-20T13:34:05.314171+0000","last_clean":"2023-06-20T13:34:05.314171+0000","last_became_active":"2023-06-20T13:34:05.302657+0000","last_became_peered":"2023-06-20T13:34:05.302657+0000","last_unstale":"2023-06-20T13:34:05.314171+0000","last_undegraded":"2023-06-20T13:34:05.314171+0000","last_fullsized":"2023-06-20T13:34:05.314171+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:45:39.528624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.294069+0000","last_change":"2023-06-20T13:34:05.291481+0000","last_active":"2023-06-20T13:34:05.294069+0000","last_peered":"2023-06-20T13:34:05.294069+0000","last_clean":"2023-06-20T13:34:05.294069+0000","last_became_active":"2023-06-20T13:34:05.291226+0000","last_became_peered":"2023-06-20T13:34:05.291226+0000","last_unstale":"2023-06-20T13:34:05.294069+0000","last_undegraded":"2023-06-20T13:34:05.294069+0000","last_fullsized":"2023-06-20T13:34:05.294069+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T01:21:10.506594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275095+0000","last_change":"2023-06-20T13:34:05.296345+0000","last_active":"2023-06-20T13:34:06.275095+0000","last_peered":"2023-06-20T13:34:06.275095+0000","last_clean":"2023-06-20T13:34:06.275095+0000","last_became_active":"2023-06-20T13:34:05.295711+0000","last_became_peered":"2023-06-20T13:34:05.295711+0000","last_unstale":"2023-06-20T13:34:06.275095+0000","last_undegraded":"2023-06-20T13:34:06.275095+0000","last_fullsized":"2023-06-20T13:34:06.275095+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:59:05.675608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.299677+0000","last_change":"2023-06-20T13:34:05.292695+0000","last_active":"2023-06-20T13:34:05.299677+0000","last_peered":"2023-06-20T13:34:05.299677+0000","last_clean":"2023-06-20T13:34:05.299677+0000","last_became_active":"2023-06-20T13:34:05.292298+0000","last_became_peered":"2023-06-20T13:34:05.292298+0000","last_unstale":"2023-06-20T13:34:05.299677+0000","last_undegraded":"2023-06-20T13:34:05.299677+0000","last_fullsized":"2023-06-20T13:34:05.299677+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:45:39.528624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.290591+0000","last_change":"2023-06-20T13:34:05.287380+0000","last_active":"2023-06-20T13:34:05.290591+0000","last_peered":"2023-06-20T13:34:05.290591+0000","last_clean":"2023-06-20T13:34:05.290591+0000","last_became_active":"2023-06-20T13:34:05.287100+0000","last_became_peered":"2023-06-20T13:34:05.287100+0000","last_unstale":"2023-06-20T13:34:05.290591+0000","last_undegraded":"2023-06-20T13:34:05.290591+0000","last_fullsized":"2023-06-20T13:34:05.290591+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:06:15.510138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.303418+0000","last_change":"2023-06-20T13:34:05.290628+0000","last_active":"2023-06-20T13:34:05.303418+0000","last_peered":"2023-06-20T13:34:05.303418+0000","last_clean":"2023-06-20T13:34:05.303418+0000","last_became_active":"2023-06-20T13:34:05.290345+0000","last_became_peered":"2023-06-20T13:34:05.290345+0000","last_unstale":"2023-06-20T13:34:05.303418+0000","last_undegraded":"2023-06-20T13:34:05.303418+0000","last_fullsized":"2023-06-20T13:34:05.303418+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:38:50.504294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.295802+0000","last_change":"2023-06-20T13:34:05.290776+0000","last_active":"2023-06-20T13:34:05.295802+0000","last_peered":"2023-06-20T13:34:05.295802+0000","last_clean":"2023-06-20T13:34:05.295802+0000","last_became_active":"2023-06-20T13:34:05.290510+0000","last_became_peered":"2023-06-20T13:34:05.290510+0000","last_unstale":"2023-06-20T13:34:05.295802+0000","last_undegraded":"2023-06-20T13:34:05.295802+0000","last_fullsized":"2023-06-20T13:34:05.295802+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:20:09.788686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.297509+0000","last_change":"2023-06-20T13:34:05.291657+0000","last_active":"2023-06-20T13:34:05.297509+0000","last_peered":"2023-06-20T13:34:05.297509+0000","last_clean":"2023-06-20T13:34:05.297509+0000","last_became_active":"2023-06-20T13:34:05.291342+0000","last_became_peered":"2023-06-20T13:34:05.291342+0000","last_unstale":"2023-06-20T13:34:05.297509+0000","last_undegraded":"2023-06-20T13:34:05.297509+0000","last_fullsized":"2023-06-20T13:34:05.297509+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:50:18.082545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"40'4","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.315865+0000","last_change":"2023-06-20T13:34:04.002643+0000","last_active":"2023-06-20T13:34:05.315865+0000","last_peered":"2023-06-20T13:34:05.315865+0000","last_clean":"2023-06-20T13:34:05.315865+0000","last_became_active":"2023-06-20T13:34:04.002373+0000","last_became_peered":"2023-06-20T13:34:04.002373+0000","last_unstale":"2023-06-20T13:34:05.315865+0000","last_undegraded":"2023-06-20T13:34:05.315865+0000","last_fullsized":"2023-06-20T13:34:05.315865+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:46:21.718492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.300113+0000","last_change":"2023-06-20T13:34:05.294724+0000","last_active":"2023-06-20T13:34:05.300113+0000","last_peered":"2023-06-20T13:34:05.300113+0000","last_clean":"2023-06-20T13:34:05.300113+0000","last_became_active":"2023-06-20T13:34:05.293181+0000","last_became_peered":"2023-06-20T13:34:05.293181+0000","last_unstale":"2023-06-20T13:34:05.300113+0000","last_undegraded":"2023-06-20T13:34:05.300113+0000","last_fullsized":"2023-06-20T13:34:05.300113+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:07:50.944154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.305097+0000","last_change":"2023-06-20T13:34:04.014888+0000","last_active":"2023-06-20T13:34:05.305097+0000","last_peered":"2023-06-20T13:34:05.305097+0000","last_clean":"2023-06-20T13:34:05.305097+0000","last_became_active":"2023-06-20T13:34:04.014562+0000","last_became_peered":"2023-06-20T13:34:04.014562+0000","last_unstale":"2023-06-20T13:34:05.305097+0000","last_undegraded":"2023-06-20T13:34:05.305097+0000","last_fullsized":"2023-06-20T13:34:05.305097+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:28:26.894866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275209+0000","last_change":"2023-06-20T13:34:05.304790+0000","last_active":"2023-06-20T13:34:06.275209+0000","last_peered":"2023-06-20T13:34:06.275209+0000","last_clean":"2023-06-20T13:34:06.275209+0000","last_became_active":"2023-06-20T13:34:05.304502+0000","last_became_peered":"2023-06-20T13:34:05.304502+0000","last_unstale":"2023-06-20T13:34:06.275209+0000","last_undegraded":"2023-06-20T13:34:06.275209+0000","last_fullsized":"2023-06-20T13:34:06.275209+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:47:29.411419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.318855+0000","last_change":"2023-06-20T13:34:04.008898+0000","last_active":"2023-06-20T13:34:05.318855+0000","last_peered":"2023-06-20T13:34:05.318855+0000","last_clean":"2023-06-20T13:34:05.318855+0000","last_became_active":"2023-06-20T13:34:04.008603+0000","last_became_peered":"2023-06-20T13:34:04.008603+0000","last_unstale":"2023-06-20T13:34:05.318855+0000","last_undegraded":"2023-06-20T13:34:05.318855+0000","last_fullsized":"2023-06-20T13:34:05.318855+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:25:01.290812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.304152+0000","last_change":"2023-06-20T13:34:05.292574+0000","last_active":"2023-06-20T13:34:05.304152+0000","last_peered":"2023-06-20T13:34:05.304152+0000","last_clean":"2023-06-20T13:34:05.304152+0000","last_became_active":"2023-06-20T13:34:05.291993+0000","last_became_peered":"2023-06-20T13:34:05.291993+0000","last_unstale":"2023-06-20T13:34:05.304152+0000","last_undegraded":"2023-06-20T13:34:05.304152+0000","last_fullsized":"2023-06-20T13:34:05.304152+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:48:24.154671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.276100+0000","last_change":"2023-06-20T13:34:04.003885+0000","last_active":"2023-06-20T13:34:06.276100+0000","last_peered":"2023-06-20T13:34:06.276100+0000","last_clean":"2023-06-20T13:34:06.276100+0000","last_became_active":"2023-06-20T13:34:04.003607+0000","last_became_peered":"2023-06-20T13:34:04.003607+0000","last_unstale":"2023-06-20T13:34:06.276100+0000","last_undegraded":"2023-06-20T13:34:06.276100+0000","last_fullsized":"2023-06-20T13:34:06.276100+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:19:53.723497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.298522+0000","last_change":"2023-06-20T13:34:05.294600+0000","last_active":"2023-06-20T13:34:05.298522+0000","last_peered":"2023-06-20T13:34:05.298522+0000","last_clean":"2023-06-20T13:34:05.298522+0000","last_became_active":"2023-06-20T13:34:05.294310+0000","last_became_peered":"2023-06-20T13:34:05.294310+0000","last_unstale":"2023-06-20T13:34:05.298522+0000","last_undegraded":"2023-06-20T13:34:05.298522+0000","last_fullsized":"2023-06-20T13:34:05.298522+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:08:24.054294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.312345+0000","last_change":"2023-06-20T13:34:03.999158+0000","last_active":"2023-06-20T13:34:05.312345+0000","last_peered":"2023-06-20T13:34:05.312345+0000","last_clean":"2023-06-20T13:34:05.312345+0000","last_became_active":"2023-06-20T13:34:03.998855+0000","last_became_peered":"2023-06-20T13:34:03.998855+0000","last_unstale":"2023-06-20T13:34:05.312345+0000","last_undegraded":"2023-06-20T13:34:05.312345+0000","last_fullsized":"2023-06-20T13:34:05.312345+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:31:02.979746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.302138+0000","last_change":"2023-06-20T13:34:05.300500+0000","last_active":"2023-06-20T13:34:05.302138+0000","last_peered":"2023-06-20T13:34:05.302138+0000","last_clean":"2023-06-20T13:34:05.302138+0000","last_became_active":"2023-06-20T13:34:05.300211+0000","last_became_peered":"2023-06-20T13:34:05.300211+0000","last_unstale":"2023-06-20T13:34:05.302138+0000","last_undegraded":"2023-06-20T13:34:05.302138+0000","last_fullsized":"2023-06-20T13:34:05.302138+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:44:26.638704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.306426+0000","last_change":"2023-06-20T13:34:04.012841+0000","last_active":"2023-06-20T13:34:05.306426+0000","last_peered":"2023-06-20T13:34:05.306426+0000","last_clean":"2023-06-20T13:34:05.306426+0000","last_became_active":"2023-06-20T13:34:04.012571+0000","last_became_peered":"2023-06-20T13:34:04.012571+0000","last_unstale":"2023-06-20T13:34:05.306426+0000","last_undegraded":"2023-06-20T13:34:05.306426+0000","last_fullsized":"2023-06-20T13:34:05.306426+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T01:03:14.507581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.318383+0000","last_change":"2023-06-20T13:34:05.311873+0000","last_active":"2023-06-20T13:34:05.318383+0000","last_peered":"2023-06-20T13:34:05.318383+0000","last_clean":"2023-06-20T13:34:05.318383+0000","last_became_active":"2023-06-20T13:34:05.311230+0000","last_became_peered":"2023-06-20T13:34:05.311230+0000","last_unstale":"2023-06-20T13:34:05.318383+0000","last_undegraded":"2023-06-20T13:34:05.318383+0000","last_fullsized":"2023-06-20T13:34:05.318383+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:11:49.500789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275015+0000","last_change":"2023-06-20T13:34:04.010790+0000","last_active":"2023-06-20T13:34:06.275015+0000","last_peered":"2023-06-20T13:34:06.275015+0000","last_clean":"2023-06-20T13:34:06.275015+0000","last_became_active":"2023-06-20T13:34:04.010431+0000","last_became_peered":"2023-06-20T13:34:04.010431+0000","last_unstale":"2023-06-20T13:34:06.275015+0000","last_undegraded":"2023-06-20T13:34:06.275015+0000","last_fullsized":"2023-06-20T13:34:06.275015+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:11:59.130810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.300075+0000","last_change":"2023-06-20T13:34:05.294328+0000","last_active":"2023-06-20T13:34:05.300075+0000","last_peered":"2023-06-20T13:34:05.300075+0000","last_clean":"2023-06-20T13:34:05.300075+0000","last_became_active":"2023-06-20T13:34:05.294080+0000","last_became_peered":"2023-06-20T13:34:05.294080+0000","last_unstale":"2023-06-20T13:34:05.300075+0000","last_undegraded":"2023-06-20T13:34:05.300075+0000","last_fullsized":"2023-06-20T13:34:05.300075+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:55:10.304175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.295764+0000","last_change":"2023-06-20T13:34:04.012982+0000","last_active":"2023-06-20T13:34:05.295764+0000","last_peered":"2023-06-20T13:34:05.295764+0000","last_clean":"2023-06-20T13:34:05.295764+0000","last_became_active":"2023-06-20T13:34:04.012561+0000","last_became_peered":"2023-06-20T13:34:04.012561+0000","last_unstale":"2023-06-20T13:34:05.295764+0000","last_undegraded":"2023-06-20T13:34:05.295764+0000","last_fullsized":"2023-06-20T13:34:05.295764+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:36:12.442396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.305737+0000","last_change":"2023-06-20T13:34:05.302336+0000","last_active":"2023-06-20T13:34:05.305737+0000","last_peered":"2023-06-20T13:34:05.305737+0000","last_clean":"2023-06-20T13:34:05.305737+0000","last_became_active":"2023-06-20T13:34:05.302019+0000","last_became_peered":"2023-06-20T13:34:05.302019+0000","last_unstale":"2023-06-20T13:34:05.305737+0000","last_undegraded":"2023-06-20T13:34:05.305737+0000","last_fullsized":"2023-06-20T13:34:05.305737+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:25:25.124742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.274492+0000","last_change":"2023-06-20T13:34:04.010233+0000","last_active":"2023-06-20T13:34:05.274492+0000","last_peered":"2023-06-20T13:34:05.274492+0000","last_clean":"2023-06-20T13:34:05.274492+0000","last_became_active":"2023-06-20T13:34:04.009959+0000","last_became_peered":"2023-06-20T13:34:04.009959+0000","last_unstale":"2023-06-20T13:34:05.274492+0000","last_undegraded":"2023-06-20T13:34:05.274492+0000","last_fullsized":"2023-06-20T13:34:05.274492+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:45:51.614218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.276541+0000","last_change":"2023-06-20T13:34:05.291017+0000","last_active":"2023-06-20T13:34:06.276541+0000","last_peered":"2023-06-20T13:34:06.276541+0000","last_clean":"2023-06-20T13:34:06.276541+0000","last_became_active":"2023-06-20T13:34:05.290618+0000","last_became_peered":"2023-06-20T13:34:05.290618+0000","last_unstale":"2023-06-20T13:34:06.276541+0000","last_undegraded":"2023-06-20T13:34:06.276541+0000","last_fullsized":"2023-06-20T13:34:06.276541+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:18:46.653024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.295429+0000","last_change":"2023-06-20T13:34:04.016438+0000","last_active":"2023-06-20T13:34:05.295429+0000","last_peered":"2023-06-20T13:34:05.295429+0000","last_clean":"2023-06-20T13:34:05.295429+0000","last_became_active":"2023-06-20T13:34:04.016159+0000","last_became_peered":"2023-06-20T13:34:04.016159+0000","last_unstale":"2023-06-20T13:34:05.295429+0000","last_undegraded":"2023-06-20T13:34:05.295429+0000","last_fullsized":"2023-06-20T13:34:05.295429+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:22:53.604110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.303649+0000","last_change":"2023-06-20T13:34:05.284830+0000","last_active":"2023-06-20T13:34:05.303649+0000","last_peered":"2023-06-20T13:34:05.303649+0000","last_clean":"2023-06-20T13:34:05.303649+0000","last_became_active":"2023-06-20T13:34:05.284549+0000","last_became_peered":"2023-06-20T13:34:05.284549+0000","last_unstale":"2023-06-20T13:34:05.303649+0000","last_undegraded":"2023-06-20T13:34:05.303649+0000","last_fullsized":"2023-06-20T13:34:05.303649+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:55:12.654445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"40'3","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.276139+0000","last_change":"2023-06-20T13:34:04.003077+0000","last_active":"2023-06-20T13:34:06.276139+0000","last_peered":"2023-06-20T13:34:06.276139+0000","last_clean":"2023-06-20T13:34:06.276139+0000","last_became_active":"2023-06-20T13:34:04.002777+0000","last_became_peered":"2023-06-20T13:34:04.002777+0000","last_unstale":"2023-06-20T13:34:06.276139+0000","last_undegraded":"2023-06-20T13:34:06.276139+0000","last_fullsized":"2023-06-20T13:34:06.276139+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:12:49.748128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275845+0000","last_change":"2023-06-20T13:34:05.290701+0000","last_active":"2023-06-20T13:34:06.275845+0000","last_peered":"2023-06-20T13:34:06.275845+0000","last_clean":"2023-06-20T13:34:06.275845+0000","last_became_active":"2023-06-20T13:34:05.290395+0000","last_became_peered":"2023-06-20T13:34:05.290395+0000","last_unstale":"2023-06-20T13:34:06.275845+0000","last_undegraded":"2023-06-20T13:34:06.275845+0000","last_fullsized":"2023-06-20T13:34:06.275845+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:56:31.373999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"40'6","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.317782+0000","last_change":"2023-06-20T13:34:04.012166+0000","last_active":"2023-06-20T13:34:05.317782+0000","last_peered":"2023-06-20T13:34:05.317782+0000","last_clean":"2023-06-20T13:34:05.317782+0000","last_became_active":"2023-06-20T13:34:04.011852+0000","last_became_peered":"2023-06-20T13:34:04.011852+0000","last_unstale":"2023-06-20T13:34:05.317782+0000","last_undegraded":"2023-06-20T13:34:05.317782+0000","last_fullsized":"2023-06-20T13:34:05.317782+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:07:49.941563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.304837+0000","last_change":"2023-06-20T13:34:05.301965+0000","last_active":"2023-06-20T13:34:05.304837+0000","last_peered":"2023-06-20T13:34:05.304837+0000","last_clean":"2023-06-20T13:34:05.304837+0000","last_became_active":"2023-06-20T13:34:05.301697+0000","last_became_peered":"2023-06-20T13:34:05.301697+0000","last_unstale":"2023-06-20T13:34:05.304837+0000","last_undegraded":"2023-06-20T13:34:05.304837+0000","last_fullsized":"2023-06-20T13:34:05.304837+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:00:12.639892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.315761+0000","last_change":"2023-06-20T13:34:04.014540+0000","last_active":"2023-06-20T13:34:05.315761+0000","last_peered":"2023-06-20T13:34:05.315761+0000","last_clean":"2023-06-20T13:34:05.315761+0000","last_became_active":"2023-06-20T13:34:04.014269+0000","last_became_peered":"2023-06-20T13:34:04.014269+0000","last_unstale":"2023-06-20T13:34:05.315761+0000","last_undegraded":"2023-06-20T13:34:05.315761+0000","last_fullsized":"2023-06-20T13:34:05.315761+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:41:24.858200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.301494+0000","last_change":"2023-06-20T13:34:05.299167+0000","last_active":"2023-06-20T13:34:05.301494+0000","last_peered":"2023-06-20T13:34:05.301494+0000","last_clean":"2023-06-20T13:34:05.301494+0000","last_became_active":"2023-06-20T13:34:05.298855+0000","last_became_peered":"2023-06-20T13:34:05.298855+0000","last_unstale":"2023-06-20T13:34:05.301494+0000","last_undegraded":"2023-06-20T13:34:05.301494+0000","last_fullsized":"2023-06-20T13:34:05.301494+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:50:18.082545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.276491+0000","last_change":"2023-06-20T13:34:04.002691+0000","last_active":"2023-06-20T13:34:06.276491+0000","last_peered":"2023-06-20T13:34:06.276491+0000","last_clean":"2023-06-20T13:34:06.276491+0000","last_became_active":"2023-06-20T13:34:04.002361+0000","last_became_peered":"2023-06-20T13:34:04.002361+0000","last_unstale":"2023-06-20T13:34:06.276491+0000","last_undegraded":"2023-06-20T13:34:06.276491+0000","last_fullsized":"2023-06-20T13:34:06.276491+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:23:07.057589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.300708+0000","last_change":"2023-06-20T13:34:05.285729+0000","last_active":"2023-06-20T13:34:05.300708+0000","last_peered":"2023-06-20T13:34:05.300708+0000","last_clean":"2023-06-20T13:34:05.300708+0000","last_became_active":"2023-06-20T13:34:05.285299+0000","last_became_peered":"2023-06-20T13:34:05.285299+0000","last_unstale":"2023-06-20T13:34:05.300708+0000","last_undegraded":"2023-06-20T13:34:05.300708+0000","last_fullsized":"2023-06-20T13:34:05.300708+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T13:39:37.647301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.272871+0000","last_change":"2023-06-20T13:34:04.014639+0000","last_active":"2023-06-20T13:34:05.272871+0000","last_peered":"2023-06-20T13:34:05.272871+0000","last_clean":"2023-06-20T13:34:05.272871+0000","last_became_active":"2023-06-20T13:34:04.014379+0000","last_became_peered":"2023-06-20T13:34:04.014379+0000","last_unstale":"2023-06-20T13:34:05.272871+0000","last_undegraded":"2023-06-20T13:34:05.272871+0000","last_fullsized":"2023-06-20T13:34:05.272871+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:53:55.455897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.276457+0000","last_change":"2023-06-20T13:34:05.293575+0000","last_active":"2023-06-20T13:34:06.276457+0000","last_peered":"2023-06-20T13:34:06.276457+0000","last_clean":"2023-06-20T13:34:06.276457+0000","last_became_active":"2023-06-20T13:34:05.293298+0000","last_became_peered":"2023-06-20T13:34:05.293298+0000","last_unstale":"2023-06-20T13:34:06.276457+0000","last_undegraded":"2023-06-20T13:34:06.276457+0000","last_fullsized":"2023-06-20T13:34:06.276457+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:36:59.986859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"40'8","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.318324+0000","last_change":"2023-06-20T13:34:04.012811+0000","last_active":"2023-06-20T13:34:05.318324+0000","last_peered":"2023-06-20T13:34:05.318324+0000","last_clean":"2023-06-20T13:34:05.318324+0000","last_became_active":"2023-06-20T13:34:04.012275+0000","last_became_peered":"2023-06-20T13:34:04.012275+0000","last_unstale":"2023-06-20T13:34:05.318324+0000","last_undegraded":"2023-06-20T13:34:05.318324+0000","last_fullsized":"2023-06-20T13:34:05.318324+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:49:31.499103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.296328+0000","last_change":"2023-06-20T13:34:05.293050+0000","last_active":"2023-06-20T13:34:05.296328+0000","last_peered":"2023-06-20T13:34:05.296328+0000","last_clean":"2023-06-20T13:34:05.296328+0000","last_became_active":"2023-06-20T13:34:05.292767+0000","last_became_peered":"2023-06-20T13:34:05.292767+0000","last_unstale":"2023-06-20T13:34:05.296328+0000","last_undegraded":"2023-06-20T13:34:05.296328+0000","last_fullsized":"2023-06-20T13:34:05.296328+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:34:08.431231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.318587+0000","last_change":"2023-06-20T13:34:04.004296+0000","last_active":"2023-06-20T13:34:05.318587+0000","last_peered":"2023-06-20T13:34:05.318587+0000","last_clean":"2023-06-20T13:34:05.318587+0000","last_became_active":"2023-06-20T13:34:04.004012+0000","last_became_peered":"2023-06-20T13:34:04.004012+0000","last_unstale":"2023-06-20T13:34:05.318587+0000","last_undegraded":"2023-06-20T13:34:05.318587+0000","last_fullsized":"2023-06-20T13:34:05.318587+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:31:14.590062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.311238+0000","last_change":"2023-06-20T13:34:05.302567+0000","last_active":"2023-06-20T13:34:05.311238+0000","last_peered":"2023-06-20T13:34:05.311238+0000","last_clean":"2023-06-20T13:34:05.311238+0000","last_became_active":"2023-06-20T13:34:05.302302+0000","last_became_peered":"2023-06-20T13:34:05.302302+0000","last_unstale":"2023-06-20T13:34:05.311238+0000","last_undegraded":"2023-06-20T13:34:05.311238+0000","last_fullsized":"2023-06-20T13:34:05.311238+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:58:57.434684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.309997+0000","last_change":"2023-06-20T13:34:04.011616+0000","last_active":"2023-06-20T13:34:05.309997+0000","last_peered":"2023-06-20T13:34:05.309997+0000","last_clean":"2023-06-20T13:34:05.309997+0000","last_became_active":"2023-06-20T13:34:04.011277+0000","last_became_peered":"2023-06-20T13:34:04.011277+0000","last_unstale":"2023-06-20T13:34:05.309997+0000","last_undegraded":"2023-06-20T13:34:05.309997+0000","last_fullsized":"2023-06-20T13:34:05.309997+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:06:17.597764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.308511+0000","last_change":"2023-06-20T13:34:05.305868+0000","last_active":"2023-06-20T13:34:05.308511+0000","last_peered":"2023-06-20T13:34:05.308511+0000","last_clean":"2023-06-20T13:34:05.308511+0000","last_became_active":"2023-06-20T13:34:05.305588+0000","last_became_peered":"2023-06-20T13:34:05.305588+0000","last_unstale":"2023-06-20T13:34:05.308511+0000","last_undegraded":"2023-06-20T13:34:05.308511+0000","last_fullsized":"2023-06-20T13:34:05.308511+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:20:09.788686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275871+0000","last_change":"2023-06-20T13:34:04.009671+0000","last_active":"2023-06-20T13:34:06.275871+0000","last_peered":"2023-06-20T13:34:06.275871+0000","last_clean":"2023-06-20T13:34:06.275871+0000","last_became_active":"2023-06-20T13:34:04.009367+0000","last_became_peered":"2023-06-20T13:34:04.009367+0000","last_unstale":"2023-06-20T13:34:06.275871+0000","last_undegraded":"2023-06-20T13:34:06.275871+0000","last_fullsized":"2023-06-20T13:34:06.275871+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:19:53.723497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.304104+0000","last_change":"2023-06-20T13:34:05.300466+0000","last_active":"2023-06-20T13:34:05.304104+0000","last_peered":"2023-06-20T13:34:05.304104+0000","last_clean":"2023-06-20T13:34:05.304104+0000","last_became_active":"2023-06-20T13:34:05.300195+0000","last_became_peered":"2023-06-20T13:34:05.300195+0000","last_unstale":"2023-06-20T13:34:05.304104+0000","last_undegraded":"2023-06-20T13:34:05.304104+0000","last_fullsized":"2023-06-20T13:34:05.304104+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:57:44.965669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.273222+0000","last_change":"2023-06-20T13:34:04.002052+0000","last_active":"2023-06-20T13:34:05.273222+0000","last_peered":"2023-06-20T13:34:05.273222+0000","last_clean":"2023-06-20T13:34:05.273222+0000","last_became_active":"2023-06-20T13:34:04.001740+0000","last_became_peered":"2023-06-20T13:34:04.001740+0000","last_unstale":"2023-06-20T13:34:05.273222+0000","last_undegraded":"2023-06-20T13:34:05.273222+0000","last_fullsized":"2023-06-20T13:34:05.273222+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:28:42.654890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.300664+0000","last_change":"2023-06-20T13:34:05.284236+0000","last_active":"2023-06-20T13:34:05.300664+0000","last_peered":"2023-06-20T13:34:05.300664+0000","last_clean":"2023-06-20T13:34:05.300664+0000","last_became_active":"2023-06-20T13:34:05.283872+0000","last_became_peered":"2023-06-20T13:34:05.283872+0000","last_unstale":"2023-06-20T13:34:05.300664+0000","last_undegraded":"2023-06-20T13:34:05.300664+0000","last_fullsized":"2023-06-20T13:34:05.300664+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T01:21:00.445856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.312459+0000","last_change":"2023-06-20T13:34:03.999175+0000","last_active":"2023-06-20T13:34:05.312459+0000","last_peered":"2023-06-20T13:34:05.312459+0000","last_clean":"2023-06-20T13:34:05.312459+0000","last_became_active":"2023-06-20T13:34:03.998871+0000","last_became_peered":"2023-06-20T13:34:03.998871+0000","last_unstale":"2023-06-20T13:34:05.312459+0000","last_undegraded":"2023-06-20T13:34:05.312459+0000","last_fullsized":"2023-06-20T13:34:05.312459+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:38:59.588526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.312392+0000","last_change":"2023-06-20T13:34:05.293150+0000","last_active":"2023-06-20T13:34:05.312392+0000","last_peered":"2023-06-20T13:34:05.312392+0000","last_clean":"2023-06-20T13:34:05.312392+0000","last_became_active":"2023-06-20T13:34:05.292872+0000","last_became_peered":"2023-06-20T13:34:05.292872+0000","last_unstale":"2023-06-20T13:34:05.312392+0000","last_undegraded":"2023-06-20T13:34:05.312392+0000","last_fullsized":"2023-06-20T13:34:05.312392+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:10:41.088988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275651+0000","last_change":"2023-06-20T13:34:04.009463+0000","last_active":"2023-06-20T13:34:06.275651+0000","last_peered":"2023-06-20T13:34:06.275651+0000","last_clean":"2023-06-20T13:34:06.275651+0000","last_became_active":"2023-06-20T13:34:04.009105+0000","last_became_peered":"2023-06-20T13:34:04.009105+0000","last_unstale":"2023-06-20T13:34:06.275651+0000","last_undegraded":"2023-06-20T13:34:06.275651+0000","last_fullsized":"2023-06-20T13:34:06.275651+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:58:39.834072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.301566+0000","last_change":"2023-06-20T13:34:05.295695+0000","last_active":"2023-06-20T13:34:05.301566+0000","last_peered":"2023-06-20T13:34:05.301566+0000","last_clean":"2023-06-20T13:34:05.301566+0000","last_became_active":"2023-06-20T13:34:05.295349+0000","last_became_peered":"2023-06-20T13:34:05.295349+0000","last_unstale":"2023-06-20T13:34:05.301566+0000","last_undegraded":"2023-06-20T13:34:05.301566+0000","last_fullsized":"2023-06-20T13:34:05.301566+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:55:10.304175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.284386+0000","last_change":"2023-06-20T13:34:04.013560+0000","last_active":"2023-06-20T13:34:05.284386+0000","last_peered":"2023-06-20T13:34:05.284386+0000","last_clean":"2023-06-20T13:34:05.284386+0000","last_became_active":"2023-06-20T13:34:04.013313+0000","last_became_peered":"2023-06-20T13:34:04.013313+0000","last_unstale":"2023-06-20T13:34:05.284386+0000","last_undegraded":"2023-06-20T13:34:05.284386+0000","last_fullsized":"2023-06-20T13:34:05.284386+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:41:10.832533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.318123+0000","last_change":"2023-06-20T13:34:05.313428+0000","last_active":"2023-06-20T13:34:05.318123+0000","last_peered":"2023-06-20T13:34:05.318123+0000","last_clean":"2023-06-20T13:34:05.318123+0000","last_became_active":"2023-06-20T13:34:05.313206+0000","last_became_peered":"2023-06-20T13:34:05.313206+0000","last_unstale":"2023-06-20T13:34:05.318123+0000","last_undegraded":"2023-06-20T13:34:05.318123+0000","last_fullsized":"2023-06-20T13:34:05.318123+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:54:32.987214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275681+0000","last_change":"2023-06-20T13:34:04.002370+0000","last_active":"2023-06-20T13:34:06.275681+0000","last_peered":"2023-06-20T13:34:06.275681+0000","last_clean":"2023-06-20T13:34:06.275681+0000","last_became_active":"2023-06-20T13:34:04.002074+0000","last_became_peered":"2023-06-20T13:34:04.002074+0000","last_unstale":"2023-06-20T13:34:06.275681+0000","last_undegraded":"2023-06-20T13:34:06.275681+0000","last_fullsized":"2023-06-20T13:34:06.275681+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:26:39.685620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.285429+0000","last_change":"2023-06-20T13:34:05.282160+0000","last_active":"2023-06-20T13:34:05.285429+0000","last_peered":"2023-06-20T13:34:05.285429+0000","last_clean":"2023-06-20T13:34:05.285429+0000","last_became_active":"2023-06-20T13:34:05.281934+0000","last_became_peered":"2023-06-20T13:34:05.281934+0000","last_unstale":"2023-06-20T13:34:05.285429+0000","last_undegraded":"2023-06-20T13:34:05.285429+0000","last_fullsized":"2023-06-20T13:34:05.285429+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:23:56.450392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.295907+0000","last_change":"2023-06-20T13:34:04.010348+0000","last_active":"2023-06-20T13:34:05.295907+0000","last_peered":"2023-06-20T13:34:05.295907+0000","last_clean":"2023-06-20T13:34:05.295907+0000","last_became_active":"2023-06-20T13:34:04.009924+0000","last_became_peered":"2023-06-20T13:34:04.009924+0000","last_unstale":"2023-06-20T13:34:05.295907+0000","last_undegraded":"2023-06-20T13:34:05.295907+0000","last_fullsized":"2023-06-20T13:34:05.295907+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:34:03.978064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.278611+0000","last_change":"2023-06-20T13:32:14.847834+0000","last_active":"2023-06-20T13:34:05.278611+0000","last_peered":"2023-06-20T13:34:05.278611+0000","last_clean":"2023-06-20T13:34:05.278611+0000","last_became_active":"2023-06-20T13:32:14.847518+0000","last_became_peered":"2023-06-20T13:32:14.847518+0000","last_unstale":"2023-06-20T13:34:05.278611+0000","last_undegraded":"2023-06-20T13:34:05.278611+0000","last_fullsized":"2023-06-20T13:34:05.278611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:38:16.046090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.304510+0000","last_change":"2023-06-20T13:34:05.298772+0000","last_active":"2023-06-20T13:34:05.304510+0000","last_peered":"2023-06-20T13:34:05.304510+0000","last_clean":"2023-06-20T13:34:05.304510+0000","last_became_active":"2023-06-20T13:34:05.298506+0000","last_became_peered":"2023-06-20T13:34:05.298506+0000","last_unstale":"2023-06-20T13:34:05.304510+0000","last_undegraded":"2023-06-20T13:34:05.304510+0000","last_fullsized":"2023-06-20T13:34:05.304510+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:20:33.511734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.273385+0000","last_change":"2023-06-20T13:34:04.012135+0000","last_active":"2023-06-20T13:34:05.273385+0000","last_peered":"2023-06-20T13:34:05.273385+0000","last_clean":"2023-06-20T13:34:05.273385+0000","last_became_active":"2023-06-20T13:34:04.011817+0000","last_became_peered":"2023-06-20T13:34:04.011817+0000","last_unstale":"2023-06-20T13:34:05.273385+0000","last_undegraded":"2023-06-20T13:34:05.273385+0000","last_fullsized":"2023-06-20T13:34:05.273385+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:58:44.112846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275815+0000","last_change":"2023-06-20T13:32:13.979189+0000","last_active":"2023-06-20T13:34:06.275815+0000","last_peered":"2023-06-20T13:34:06.275815+0000","last_clean":"2023-06-20T13:34:06.275815+0000","last_became_active":"2023-06-20T13:32:13.978675+0000","last_became_peered":"2023-06-20T13:32:13.978675+0000","last_unstale":"2023-06-20T13:34:06.275815+0000","last_undegraded":"2023-06-20T13:34:06.275815+0000","last_fullsized":"2023-06-20T13:34:06.275815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:10:59.724317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.300799+0000","last_change":"2023-06-20T13:34:05.298507+0000","last_active":"2023-06-20T13:34:05.300799+0000","last_peered":"2023-06-20T13:34:05.300799+0000","last_clean":"2023-06-20T13:34:05.300799+0000","last_became_active":"2023-06-20T13:34:05.298086+0000","last_became_peered":"2023-06-20T13:34:05.298086+0000","last_unstale":"2023-06-20T13:34:05.300799+0000","last_undegraded":"2023-06-20T13:34:05.300799+0000","last_fullsized":"2023-06-20T13:34:05.300799+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:25:02.293403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.276260+0000","last_change":"2023-06-20T13:34:04.003215+0000","last_active":"2023-06-20T13:34:06.276260+0000","last_peered":"2023-06-20T13:34:06.276260+0000","last_clean":"2023-06-20T13:34:06.276260+0000","last_became_active":"2023-06-20T13:34:04.002900+0000","last_became_peered":"2023-06-20T13:34:04.002900+0000","last_unstale":"2023-06-20T13:34:06.276260+0000","last_undegraded":"2023-06-20T13:34:06.276260+0000","last_fullsized":"2023-06-20T13:34:06.276260+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:18:32.310258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.280618+0000","last_change":"2023-06-20T13:32:14.567022+0000","last_active":"2023-06-20T13:34:05.280618+0000","last_peered":"2023-06-20T13:34:05.280618+0000","last_clean":"2023-06-20T13:34:05.280618+0000","last_became_active":"2023-06-20T13:32:14.566671+0000","last_became_peered":"2023-06-20T13:32:14.566671+0000","last_unstale":"2023-06-20T13:34:05.280618+0000","last_undegraded":"2023-06-20T13:34:05.280618+0000","last_fullsized":"2023-06-20T13:34:05.280618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:58:21.613491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.299125+0000","last_change":"2023-06-20T13:34:05.297148+0000","last_active":"2023-06-20T13:34:05.299125+0000","last_peered":"2023-06-20T13:34:05.299125+0000","last_clean":"2023-06-20T13:34:05.299125+0000","last_became_active":"2023-06-20T13:34:05.296780+0000","last_became_peered":"2023-06-20T13:34:05.296780+0000","last_unstale":"2023-06-20T13:34:05.299125+0000","last_undegraded":"2023-06-20T13:34:05.299125+0000","last_fullsized":"2023-06-20T13:34:05.299125+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T01:27:20.911888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275619+0000","last_change":"2023-06-20T13:34:04.009007+0000","last_active":"2023-06-20T13:34:06.275619+0000","last_peered":"2023-06-20T13:34:06.275619+0000","last_clean":"2023-06-20T13:34:06.275619+0000","last_became_active":"2023-06-20T13:34:04.008690+0000","last_became_peered":"2023-06-20T13:34:04.008690+0000","last_unstale":"2023-06-20T13:34:06.275619+0000","last_undegraded":"2023-06-20T13:34:06.275619+0000","last_fullsized":"2023-06-20T13:34:06.275619+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:12:48.749776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275421+0000","last_change":"2023-06-20T13:32:13.978856+0000","last_active":"2023-06-20T13:34:06.275421+0000","last_peered":"2023-06-20T13:34:06.275421+0000","last_clean":"2023-06-20T13:34:06.275421+0000","last_became_active":"2023-06-20T13:32:13.978454+0000","last_became_peered":"2023-06-20T13:32:13.978454+0000","last_unstale":"2023-06-20T13:34:06.275421+0000","last_undegraded":"2023-06-20T13:34:06.275421+0000","last_fullsized":"2023-06-20T13:34:06.275421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:02:35.180276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":212,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275835+0000","last_change":"2023-06-20T13:32:06.907663+0000","last_active":"2023-06-20T13:34:06.275835+0000","last_peered":"2023-06-20T13:34:06.275835+0000","last_clean":"2023-06-20T13:34:06.275835+0000","last_became_active":"2023-06-20T13:32:06.906687+0000","last_became_peered":"2023-06-20T13:32:06.906687+0000","last_unstale":"2023-06-20T13:34:06.275835+0000","last_undegraded":"2023-06-20T13:34:06.275835+0000","last_fullsized":"2023-06-20T13:34:06.275835+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:05.521263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:05.521263+0000","last_clean_scrub_stamp":"2023-06-20T13:32:05.521263+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T01:22:00.666949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.276061+0000","last_change":"2023-06-20T13:34:05.283176+0000","last_active":"2023-06-20T13:34:06.276061+0000","last_peered":"2023-06-20T13:34:06.276061+0000","last_clean":"2023-06-20T13:34:06.276061+0000","last_became_active":"2023-06-20T13:34:05.282851+0000","last_became_peered":"2023-06-20T13:34:05.282851+0000","last_unstale":"2023-06-20T13:34:06.276061+0000","last_undegraded":"2023-06-20T13:34:06.276061+0000","last_fullsized":"2023-06-20T13:34:06.276061+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:12:49.752367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.278518+0000","last_change":"2023-06-20T13:34:04.011337+0000","last_active":"2023-06-20T13:34:05.278518+0000","last_peered":"2023-06-20T13:34:05.278518+0000","last_clean":"2023-06-20T13:34:05.278518+0000","last_became_active":"2023-06-20T13:34:04.011042+0000","last_became_peered":"2023-06-20T13:34:04.011042+0000","last_unstale":"2023-06-20T13:34:05.278518+0000","last_undegraded":"2023-06-20T13:34:05.278518+0000","last_fullsized":"2023-06-20T13:34:05.278518+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:41:10.832533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275878+0000","last_change":"2023-06-20T13:32:13.977027+0000","last_active":"2023-06-20T13:34:06.275878+0000","last_peered":"2023-06-20T13:34:06.275878+0000","last_clean":"2023-06-20T13:34:06.275878+0000","last_became_active":"2023-06-20T13:32:13.975895+0000","last_became_peered":"2023-06-20T13:32:13.975895+0000","last_unstale":"2023-06-20T13:34:06.275878+0000","last_undegraded":"2023-06-20T13:34:06.275878+0000","last_fullsized":"2023-06-20T13:34:06.275878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:02:35.180276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.274947+0000","last_change":"2023-06-20T13:34:05.292678+0000","last_active":"2023-06-20T13:34:06.274947+0000","last_peered":"2023-06-20T13:34:06.274947+0000","last_clean":"2023-06-20T13:34:06.274947+0000","last_became_active":"2023-06-20T13:34:05.292365+0000","last_became_peered":"2023-06-20T13:34:05.292365+0000","last_unstale":"2023-06-20T13:34:06.274947+0000","last_undegraded":"2023-06-20T13:34:06.274947+0000","last_fullsized":"2023-06-20T13:34:06.274947+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:37:06.755037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.281088+0000","last_change":"2023-06-20T13:34:04.007188+0000","last_active":"2023-06-20T13:34:05.281088+0000","last_peered":"2023-06-20T13:34:05.281088+0000","last_clean":"2023-06-20T13:34:05.281088+0000","last_became_active":"2023-06-20T13:34:04.006894+0000","last_became_peered":"2023-06-20T13:34:04.006894+0000","last_unstale":"2023-06-20T13:34:05.281088+0000","last_undegraded":"2023-06-20T13:34:05.281088+0000","last_fullsized":"2023-06-20T13:34:05.281088+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:56:01.582835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.276261+0000","last_change":"2023-06-20T13:32:14.848215+0000","last_active":"2023-06-20T13:34:06.276261+0000","last_peered":"2023-06-20T13:34:06.276261+0000","last_clean":"2023-06-20T13:34:06.276261+0000","last_became_active":"2023-06-20T13:32:14.847950+0000","last_became_peered":"2023-06-20T13:32:14.847950+0000","last_unstale":"2023-06-20T13:34:06.276261+0000","last_undegraded":"2023-06-20T13:34:06.276261+0000","last_fullsized":"2023-06-20T13:34:06.276261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T01:22:50.221677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.303868+0000","last_change":"2023-06-20T13:34:05.285614+0000","last_active":"2023-06-20T13:34:05.303868+0000","last_peered":"2023-06-20T13:34:05.303868+0000","last_clean":"2023-06-20T13:34:05.303868+0000","last_became_active":"2023-06-20T13:34:05.285309+0000","last_became_peered":"2023-06-20T13:34:05.285309+0000","last_unstale":"2023-06-20T13:34:05.303868+0000","last_undegraded":"2023-06-20T13:34:05.303868+0000","last_fullsized":"2023-06-20T13:34:05.303868+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:10:57.756555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.275353+0000","last_change":"2023-06-20T13:34:04.011850+0000","last_active":"2023-06-20T13:34:05.275353+0000","last_peered":"2023-06-20T13:34:05.275353+0000","last_clean":"2023-06-20T13:34:05.275353+0000","last_became_active":"2023-06-20T13:34:04.011479+0000","last_became_peered":"2023-06-20T13:34:04.011479+0000","last_unstale":"2023-06-20T13:34:05.275353+0000","last_undegraded":"2023-06-20T13:34:05.275353+0000","last_fullsized":"2023-06-20T13:34:05.275353+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:28:31.382471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.281342+0000","last_change":"2023-06-20T13:32:13.978089+0000","last_active":"2023-06-20T13:34:05.281342+0000","last_peered":"2023-06-20T13:34:05.281342+0000","last_clean":"2023-06-20T13:34:05.281342+0000","last_became_active":"2023-06-20T13:32:13.977748+0000","last_became_peered":"2023-06-20T13:32:13.977748+0000","last_unstale":"2023-06-20T13:34:05.281342+0000","last_undegraded":"2023-06-20T13:34:05.281342+0000","last_fullsized":"2023-06-20T13:34:05.281342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:42:35.612303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.303365+0000","last_change":"2023-06-20T13:34:05.291732+0000","last_active":"2023-06-20T13:34:05.303365+0000","last_peered":"2023-06-20T13:34:05.303365+0000","last_clean":"2023-06-20T13:34:05.303365+0000","last_became_active":"2023-06-20T13:34:05.291471+0000","last_became_peered":"2023-06-20T13:34:05.291471+0000","last_unstale":"2023-06-20T13:34:05.303365+0000","last_undegraded":"2023-06-20T13:34:05.303365+0000","last_fullsized":"2023-06-20T13:34:05.303365+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:18:31.586225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.276378+0000","last_change":"2023-06-20T13:34:04.003250+0000","last_active":"2023-06-20T13:34:06.276378+0000","last_peered":"2023-06-20T13:34:06.276378+0000","last_clean":"2023-06-20T13:34:06.276378+0000","last_became_active":"2023-06-20T13:34:04.002920+0000","last_became_peered":"2023-06-20T13:34:04.002920+0000","last_unstale":"2023-06-20T13:34:06.276378+0000","last_undegraded":"2023-06-20T13:34:06.276378+0000","last_fullsized":"2023-06-20T13:34:06.276378+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:58:25.924475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.284030+0000","last_change":"2023-06-20T13:32:13.977875+0000","last_active":"2023-06-20T13:34:05.284030+0000","last_peered":"2023-06-20T13:34:05.284030+0000","last_clean":"2023-06-20T13:34:05.284030+0000","last_became_active":"2023-06-20T13:32:13.977589+0000","last_became_peered":"2023-06-20T13:32:13.977589+0000","last_unstale":"2023-06-20T13:34:05.284030+0000","last_undegraded":"2023-06-20T13:34:05.284030+0000","last_fullsized":"2023-06-20T13:34:05.284030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:07:46.842944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":1069056,"data_stored":802126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jun 20 13:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.60599999999999998}]},{"osd":1,"last update":"Tue Jun 20 13:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.51100000000000001}]},{"osd":2,"last update":"Tue Jun 20 13:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":4.4790000000000001,"5min":4.4790000000000001,"15min":4.4790000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":4.6829999999999998,"5min":4.6829999999999998,"15min":4.6829999999999998},"last":0.62}]},{"osd":3,"last update":"Tue Jun 20 13:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.77500000000000002}]},{"osd":4,"last update":"Tue Jun 20 13:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.64000000000000001}]},{"osd":5,"last update":"Tue Jun 20 13:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.66400000000000003}]},{"osd":6,"last update":"Tue Jun 20 13:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1,"5min":1,"15min":1},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.754}]}]},{"osd":6,"up_from":14,"seq":60129542171,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":205367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jun 20 13:33:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.6549999999999998,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":0.58199999999999996}]},{"osd":1,"last update":"Tue Jun 20 13:33:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.626}]},{"osd":2,"last update":"Tue Jun 20 13:33:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.74099999999999999}]},{"osd":3,"last update":"Tue Jun 20 13:33:09 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.754}]},{"osd":4,"last update":"Tue Jun 20 13:33:09 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.68100000000000005}]},{"osd":5,"last update":"Tue Jun 20 13:33:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.79700000000000004}]},{"osd":7,"last update":"Tue Jun 20 13:33:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.81399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":446464,"data_stored":197247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jun 20 13:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.313},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.40600000000000003}]},{"osd":2,"last update":"Tue Jun 20 13:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.497}]},{"osd":3,"last update":"Tue Jun 20 13:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.41999999999999998}]},{"osd":4,"last update":"Tue Jun 20 13:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.58399999999999996}]},{"osd":5,"last update":"Tue Jun 20 13:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.626}]},{"osd":6,"last update":"Tue Jun 20 13:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.65900000000000003}]},{"osd":7,"last update":"Tue Jun 20 13:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.67500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":1040384,"data_stored":787615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jun 20 13:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":9.4719999999999995,"5min":9.4719999999999995,"15min":9.4719999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":9.2349999999999994,"5min":9.2349999999999994,"15min":9.2349999999999994},"last":0.33300000000000002}]},{"osd":2,"last update":"Tue Jun 20 13:33:04 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":20.012,"5min":20.012,"15min":20.012},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":0.36799999999999999}]},{"osd":3,"last update":"Tue Jun 20 13:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.497},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":9.5180000000000007,"5min":9.5180000000000007,"15min":9.5180000000000007},"last":0.48399999999999999}]},{"osd":4,"last update":"Tue Jun 20 13:33:09 2023","interfaces":[{"interface":"back","average":{"1min":1.639,"5min":1.639,"15min":1.639},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":19.945,"5min":19.945,"15min":19.945},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.73799999999999999}]},{"osd":5,"last update":"Tue Jun 20 13:33:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":3.9319999999999999,"5min":3.9319999999999999,"15min":3.9319999999999999},"last":0.81100000000000005}]},{"osd":6,"last update":"Tue Jun 20 13:33:09 2023","interfaces":[{"interface":"back","average":{"1min":1.671,"5min":1.671,"15min":1.671},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":19.98,"5min":19.98,"15min":19.98},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.76200000000000001}]},{"osd":7,"last update":"Tue Jun 20 13:33:09 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":3.895,"5min":3.895,"15min":3.895},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":19.902000000000001,"5min":19.902000000000001,"15min":19.902000000000001},"last":0.70799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":446464,"data_stored":197247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jun 20 13:33:05 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":16.605,"5min":16.605,"15min":16.605},"last":0.47199999999999998},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":11.242000000000001,"5min":11.242000000000001,"15min":11.242000000000001},"last":0.45400000000000001}]},{"osd":1,"last update":"Tue Jun 20 13:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":4.9630000000000001,"5min":4.9630000000000001,"15min":4.9630000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.536,"5min":2.536,"15min":2.536},"last":0.54600000000000004}]},{"osd":3,"last update":"Tue Jun 20 13:33:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":11.201000000000001,"5min":11.201000000000001,"15min":11.201000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":4.9989999999999997,"5min":4.9989999999999997,"15min":4.9989999999999997},"last":0.49099999999999999}]},{"osd":4,"last update":"Tue Jun 20 13:33:11 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":12.941000000000001,"5min":12.941000000000001,"15min":12.941000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":11.134,"5min":11.134,"15min":11.134},"last":0.75800000000000001}]},{"osd":5,"last update":"Tue Jun 20 13:33:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":4.8310000000000004,"5min":4.8310000000000004,"15min":4.8310000000000004},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":12.898,"5min":12.898,"15min":12.898},"last":0.747}]},{"osd":6,"last update":"Tue Jun 20 13:33:11 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":11.076000000000001,"5min":11.076000000000001,"15min":11.076000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":4.9249999999999998,"5min":4.9249999999999998,"15min":4.9249999999999998},"last":0.67600000000000005}]},{"osd":7,"last update":"Tue Jun 20 13:33:11 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":11.167999999999999,"5min":11.167999999999999,"15min":11.167999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":4.8849999999999998,"5min":4.8849999999999998,"15min":4.8849999999999998},"last":0.81699999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":446464,"data_stored":197247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jun 20 13:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.42799999999999999}]},{"osd":1,"last update":"Tue Jun 20 13:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.38800000000000001}]},{"osd":2,"last update":"Tue Jun 20 13:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.41699999999999998}]},{"osd":4,"last update":"Tue Jun 20 13:33:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.64900000000000002}]},{"osd":5,"last update":"Tue Jun 20 13:33:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.66200000000000003}]},{"osd":6,"last update":"Tue Jun 20 13:33:10 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.58699999999999997}]},{"osd":7,"last update":"Tue Jun 20 13:33:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.622},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.70799999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542171,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":471040,"data_stored":206259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jun 20 13:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":5.7009999999999996,"5min":5.7009999999999996,"15min":5.7009999999999996},"last":0.755}]},{"osd":1,"last update":"Tue Jun 20 13:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.74399999999999999}]},{"osd":2,"last update":"Tue Jun 20 13:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":6.6059999999999999,"5min":6.6059999999999999,"15min":6.6059999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.82999999999999996}]},{"osd":3,"last update":"Tue Jun 20 13:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.72799999999999998}]},{"osd":5,"last update":"Tue Jun 20 13:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.623},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.55500000000000005}]},{"osd":6,"last update":"Tue Jun 20 13:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.80500000000000005}]},{"osd":7,"last update":"Tue Jun 20 13:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.58199999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542171,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":462848,"data_stored":204765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jun 20 13:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.53400000000000003}]},{"osd":1,"last update":"Tue Jun 20 13:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.627},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.78600000000000003}]},{"osd":2,"last update":"Tue Jun 20 13:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.68000000000000005}]},{"osd":3,"last update":"Tue Jun 20 13:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.74199999999999999}]},{"osd":4,"last update":"Tue Jun 20 13:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.82799999999999996}]},{"osd":6,"last update":"Tue Jun 20 13:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.93500000000000005}]},{"osd":7,"last update":"Tue Jun 20 13:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.86499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-20T13:34:09.713 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-20T13:34:09.946 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.944+0000 7f95affff700 1 Processor -- start 2023-06-20T13:34:09.947 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.944+0000 7f95affff700 1 -- start start 2023-06-20T13:34:09.948 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.945+0000 7f95affff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95a815c460 0x7f95a80b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:09.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.945+0000 7f95affff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f95a80d2640 0x7f95a80cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:09.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.945+0000 7f95affff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f95a80cf720 0x7f95a80cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:09.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.945+0000 7f95affff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a80cedd0 con 0x7f95a80d2640 2023-06-20T13:34:09.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.945+0000 7f95affff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a80d1790 con 0x7f95a80cf720 2023-06-20T13:34:09.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.946+0000 7f95affff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a80cd950 con 0x7f95a815c460 2023-06-20T13:34:09.949 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.946+0000 7f95ad59a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f95a80d2640 0x7f95a80cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:09.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.946+0000 7f95ad59a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f95a80d2640 0x7f95a80cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39644/0 (socket says 172.21.15.32:39644) 2023-06-20T13:34:09.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.946+0000 7f95ad59a700 1 -- 172.21.15.32:0/694476007 learned_addr learned my addr 172.21.15.32:0/694476007 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:09.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.946+0000 7f95add9b700 1 --2- 172.21.15.32:0/694476007 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95a815c460 0x7f95a80b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:09.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.946+0000 7f95ae59c700 1 --2- 172.21.15.32:0/694476007 >> v2:172.21.15.115:3300/0 conn(0x7f95a80cf720 0x7f95a80cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:09.950 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.946+0000 7f95ad59a700 1 -- 172.21.15.32:0/694476007 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95a815c460 msgr2=0x7f95a80b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:09.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.946+0000 7f95ad59a700 1 --2- 172.21.15.32:0/694476007 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95a815c460 0x7f95a80b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:09.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.946+0000 7f95ad59a700 1 -- 172.21.15.32:0/694476007 >> v2:172.21.15.115:3300/0 conn(0x7f95a80cf720 msgr2=0x7f95a80cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:09.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.946+0000 7f95ad59a700 1 --2- 172.21.15.32:0/694476007 >> v2:172.21.15.115:3300/0 conn(0x7f95a80cf720 0x7f95a80cfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:09.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.946+0000 7f95ad59a700 1 -- 172.21.15.32:0/694476007 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a80d14b0 con 0x7f95a80d2640 2023-06-20T13:34:09.951 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.946+0000 7f95ad59a700 1 --2- 172.21.15.32:0/694476007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95a80d2640 0x7f95a80cf1e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f95a808bf90 tx=0x7f9598009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f404613ec94016 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:09.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.947+0000 7f95acd99700 1 -- 172.21.15.32:0/694476007 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959800b870 con 0x7f95a80d2640 2023-06-20T13:34:09.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.947+0000 7f95acd99700 1 -- 172.21.15.32:0/694476007 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959800b9d0 con 0x7f95a80d2640 2023-06-20T13:34:09.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.947+0000 7f95acd99700 1 -- 172.21.15.32:0/694476007 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959800bd60 con 0x7f95a80d2640 2023-06-20T13:34:09.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.947+0000 7f95affff700 1 -- 172.21.15.32:0/694476007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95a80d2640 msgr2=0x7f95a80cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:09.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.947+0000 7f95affff700 1 --2- 172.21.15.32:0/694476007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95a80d2640 0x7f95a80cf1e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f95a808bf90 tx=0x7f9598009bd0 comp rx=0 tx=0).stop 2023-06-20T13:34:09.955 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.947+0000 7f95affff700 1 -- 172.21.15.32:0/694476007 shutdown_connections 2023-06-20T13:34:09.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.947+0000 7f95affff700 1 --2- 172.21.15.32:0/694476007 >> v2:172.21.15.115:3300/0 conn(0x7f95a80cf720 0x7f95a80cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:09.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.947+0000 7f95affff700 1 --2- 172.21.15.32:0/694476007 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95a815c460 0x7f95a80b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:09.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.947+0000 7f95affff700 1 --2- 172.21.15.32:0/694476007 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95a80d2640 0x7f95a80cf1e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:09.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.947+0000 7f95affff700 1 -- 172.21.15.32:0/694476007 >> 172.21.15.32:0/694476007 conn(0x7f95a8071660 msgr2=0x7f95a8071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:09.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.947+0000 7f95affff700 1 -- 172.21.15.32:0/694476007 shutdown_connections 2023-06-20T13:34:09.956 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.947+0000 7f95affff700 1 -- 172.21.15.32:0/694476007 wait complete. 2023-06-20T13:34:09.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.949+0000 7f95affff700 1 Processor -- start 2023-06-20T13:34:09.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.949+0000 7f95affff700 1 -- start start 2023-06-20T13:34:09.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.950+0000 7f95affff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95a80cf720 0x7f95a815ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:09.957 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.950+0000 7f95affff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95a80d2640 0x7f95a81e6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:09.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.950+0000 7f95affff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95a815c460 0x7f95a81e7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:09.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.950+0000 7f95affff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a815b770 con 0x7f95a80cf720 2023-06-20T13:34:09.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.950+0000 7f95affff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a81e6b90 con 0x7f95a815c460 2023-06-20T13:34:09.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.950+0000 7f95affff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a8147ad0 con 0x7f95a80d2640 2023-06-20T13:34:09.958 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.951+0000 7f95add9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95a80cf720 0x7f95a815ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:09.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.951+0000 7f95add9b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95a80cf720 0x7f95a815ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39654/0 (socket says 172.21.15.32:39654) 2023-06-20T13:34:09.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.951+0000 7f95add9b700 1 -- 172.21.15.32:0/1057256065 learned_addr learned my addr 172.21.15.32:0/1057256065 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:09.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.951+0000 7f95ad59a700 1 --2- 172.21.15.32:0/1057256065 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95a80d2640 0x7f95a81e6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:09.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.951+0000 7f95ae59c700 1 --2- 172.21.15.32:0/1057256065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95a815c460 0x7f95a81e7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:09.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.951+0000 7f95add9b700 1 -- 172.21.15.32:0/1057256065 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95a80d2640 msgr2=0x7f95a81e6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:09.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.951+0000 7f95add9b700 1 --2- 172.21.15.32:0/1057256065 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95a80d2640 0x7f95a81e6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:09.959 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.951+0000 7f95add9b700 1 -- 172.21.15.32:0/1057256065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95a815c460 msgr2=0x7f95a81e7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:09.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.951+0000 7f95add9b700 1 --2- 172.21.15.32:0/1057256065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95a815c460 0x7f95a81e7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:09.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.951+0000 7f95add9b700 1 -- 172.21.15.32:0/1057256065 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9598009550 con 0x7f95a80cf720 2023-06-20T13:34:09.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.951+0000 7f95ae59c700 1 --2- 172.21.15.32:0/1057256065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95a815c460 0x7f95a81e7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:34:09.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.951+0000 7f95add9b700 1 --2- 172.21.15.32:0/1057256065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95a80cf720 0x7f95a815ae60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f95a400d800 tx=0x7f95a400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:09.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.952+0000 7f959e7fc700 1 -- 172.21.15.32:0/1057256065 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a40125f0 con 0x7f95a80cf720 2023-06-20T13:34:09.960 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.952+0000 7f959e7fc700 1 -- 172.21.15.32:0/1057256065 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a4012750 con 0x7f95a80cf720 2023-06-20T13:34:09.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.952+0000 7f959e7fc700 1 -- 172.21.15.32:0/1057256065 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4012b00 con 0x7f95a80cf720 2023-06-20T13:34:09.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.952+0000 7f95affff700 1 -- 172.21.15.32:0/1057256065 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a80cba50 con 0x7f95a80cf720 2023-06-20T13:34:09.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.952+0000 7f95affff700 1 -- 172.21.15.32:0/1057256065 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a80cbf80 con 0x7f95a80cf720 2023-06-20T13:34:09.961 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.953+0000 7f95affff700 1 -- 172.21.15.32:0/1057256065 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a80cc8b0 con 0x7f95a80cf720 2023-06-20T13:34:09.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.954+0000 7f959e7fc700 1 -- 172.21.15.32:0/1057256065 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f95a4012c60 con 0x7f95a80cf720 2023-06-20T13:34:09.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.955+0000 7f959e7fc700 1 --2- 172.21.15.32:0/1057256065 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f958c06ace0 0x7f958c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:09.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.955+0000 7f959e7fc700 1 -- 172.21.15.32:0/1057256065 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f95a4089a40 con 0x7f95a80cf720 2023-06-20T13:34:09.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.955+0000 7f95ad59a700 1 --2- 172.21.15.32:0/1057256065 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f958c06ace0 0x7f958c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:09.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.956+0000 7f95ad59a700 1 --2- 172.21.15.32:0/1057256065 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f958c06ace0 0x7f958c06d190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9598014040 tx=0x7f9598008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:09.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:09.959+0000 7f959e7fc700 1 -- 172.21.15.32:0/1057256065 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f95a4054910 con 0x7f95a80cf720 2023-06-20T13:34:10.165 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.163+0000 7f95affff700 1 -- 172.21.15.32:0/1057256065 --> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f95a80cd5e0 con 0x7f958c06ace0 2023-06-20T13:34:10.174 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.172+0000 7f959e7fc700 1 -- 172.21.15.32:0/1057256065 <== mgr.4101 v2:172.21.15.32:6832/1136488437 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310667 (secure 0 0 0) 0x7f959800bb40 con 0x7f958c06ace0 2023-06-20T13:34:10.178 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:34:10.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.176+0000 7f95affff700 1 -- 172.21.15.32:0/1057256065 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f958c06ace0 msgr2=0x7f958c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:10.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.176+0000 7f95affff700 1 --2- 172.21.15.32:0/1057256065 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f958c06ace0 0x7f958c06d190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9598014040 tx=0x7f9598008030 comp rx=0 tx=0).stop 2023-06-20T13:34:10.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.176+0000 7f95affff700 1 -- 172.21.15.32:0/1057256065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95a80cf720 msgr2=0x7f95a815ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:10.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.176+0000 7f95affff700 1 --2- 172.21.15.32:0/1057256065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95a80cf720 0x7f95a815ae60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f95a400d800 tx=0x7f95a400dbc0 comp rx=0 tx=0).stop 2023-06-20T13:34:10.180 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.176+0000 7f95affff700 1 -- 172.21.15.32:0/1057256065 shutdown_connections 2023-06-20T13:34:10.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.176+0000 7f95affff700 1 --2- 172.21.15.32:0/1057256065 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f958c06ace0 0x7f958c06d190 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:10.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.176+0000 7f95affff700 1 --2- 172.21.15.32:0/1057256065 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95a815c460 0x7f95a81e7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:10.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.176+0000 7f95affff700 1 --2- 172.21.15.32:0/1057256065 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f95a80cf720 0x7f95a815ae60 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:10.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.176+0000 7f95affff700 1 --2- 172.21.15.32:0/1057256065 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f95a80d2640 0x7f95a81e6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:10.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.176+0000 7f95affff700 1 -- 172.21.15.32:0/1057256065 >> 172.21.15.32:0/1057256065 conn(0x7f95a8071660 msgr2=0x7f95a80b70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:10.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.176+0000 7f95affff700 1 -- 172.21.15.32:0/1057256065 shutdown_connections 2023-06-20T13:34:10.181 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.176+0000 7f95affff700 1 -- 172.21.15.32:0/1057256065 wait complete. 2023-06-20T13:34:10.182 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2023-06-20T13:34:10.196 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2023-06-20T13:34:09.285235+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220352,"kb_used_data":4736,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754368,"statfs":{"total":773094113280,"available":772868472832,"internally_reserved":0,"allocated":4849664,"data_stored":2797873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001974"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.276102+0000","last_change":"2023-06-20T13:34:05.287157+0000","last_active":"2023-06-20T13:34:06.276102+0000","last_peered":"2023-06-20T13:34:06.276102+0000","last_clean":"2023-06-20T13:34:06.276102+0000","last_became_active":"2023-06-20T13:34:05.286909+0000","last_became_peered":"2023-06-20T13:34:05.286909+0000","last_unstale":"2023-06-20T13:34:06.276102+0000","last_undegraded":"2023-06-20T13:34:06.276102+0000","last_fullsized":"2023-06-20T13:34:06.276102+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:58:40.836663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275241+0000","last_change":"2023-06-20T13:34:05.304354+0000","last_active":"2023-06-20T13:34:06.275241+0000","last_peered":"2023-06-20T13:34:06.275241+0000","last_clean":"2023-06-20T13:34:06.275241+0000","last_became_active":"2023-06-20T13:34:05.303027+0000","last_became_peered":"2023-06-20T13:34:05.303027+0000","last_unstale":"2023-06-20T13:34:06.275241+0000","last_undegraded":"2023-06-20T13:34:06.275241+0000","last_fullsized":"2023-06-20T13:34:06.275241+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:26:40.688211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.291589+0000","last_change":"2023-06-20T13:34:05.286112+0000","last_active":"2023-06-20T13:34:05.291589+0000","last_peered":"2023-06-20T13:34:05.291589+0000","last_clean":"2023-06-20T13:34:05.291589+0000","last_became_active":"2023-06-20T13:34:05.285813+0000","last_became_peered":"2023-06-20T13:34:05.285813+0000","last_unstale":"2023-06-20T13:34:05.291589+0000","last_undegraded":"2023-06-20T13:34:05.291589+0000","last_fullsized":"2023-06-20T13:34:05.291589+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:13:20.663107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.314026+0000","last_change":"2023-06-20T13:34:05.310038+0000","last_active":"2023-06-20T13:34:05.314026+0000","last_peered":"2023-06-20T13:34:05.314026+0000","last_clean":"2023-06-20T13:34:05.314026+0000","last_became_active":"2023-06-20T13:34:05.309768+0000","last_became_peered":"2023-06-20T13:34:05.309768+0000","last_unstale":"2023-06-20T13:34:05.314026+0000","last_undegraded":"2023-06-20T13:34:05.314026+0000","last_fullsized":"2023-06-20T13:34:05.314026+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:56:02.585426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275299+0000","last_change":"2023-06-20T13:34:05.303491+0000","last_active":"2023-06-20T13:34:06.275299+0000","last_peered":"2023-06-20T13:34:06.275299+0000","last_clean":"2023-06-20T13:34:06.275299+0000","last_became_active":"2023-06-20T13:34:05.303216+0000","last_became_peered":"2023-06-20T13:34:05.303216+0000","last_unstale":"2023-06-20T13:34:06.275299+0000","last_undegraded":"2023-06-20T13:34:06.275299+0000","last_fullsized":"2023-06-20T13:34:06.275299+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:56:31.373999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.281147+0000","last_change":"2023-06-20T13:34:05.280017+0000","last_active":"2023-06-20T13:34:05.281147+0000","last_peered":"2023-06-20T13:34:05.281147+0000","last_clean":"2023-06-20T13:34:05.281147+0000","last_became_active":"2023-06-20T13:34:05.279740+0000","last_became_peered":"2023-06-20T13:34:05.279740+0000","last_unstale":"2023-06-20T13:34:05.281147+0000","last_undegraded":"2023-06-20T13:34:05.281147+0000","last_fullsized":"2023-06-20T13:34:05.281147+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:19:40.158650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.276412+0000","last_change":"2023-06-20T13:34:05.290959+0000","last_active":"2023-06-20T13:34:06.276412+0000","last_peered":"2023-06-20T13:34:06.276412+0000","last_clean":"2023-06-20T13:34:06.276412+0000","last_became_active":"2023-06-20T13:34:05.290704+0000","last_became_peered":"2023-06-20T13:34:05.290704+0000","last_unstale":"2023-06-20T13:34:06.276412+0000","last_undegraded":"2023-06-20T13:34:06.276412+0000","last_fullsized":"2023-06-20T13:34:06.276412+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:13:12.988006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.318400+0000","last_change":"2023-06-20T13:34:05.312084+0000","last_active":"2023-06-20T13:34:05.318400+0000","last_peered":"2023-06-20T13:34:05.318400+0000","last_clean":"2023-06-20T13:34:05.318400+0000","last_became_active":"2023-06-20T13:34:05.311604+0000","last_became_peered":"2023-06-20T13:34:05.311604+0000","last_unstale":"2023-06-20T13:34:05.318400+0000","last_undegraded":"2023-06-20T13:34:05.318400+0000","last_fullsized":"2023-06-20T13:34:05.318400+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T13:43:05.944883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.318039+0000","last_change":"2023-06-20T13:34:05.313566+0000","last_active":"2023-06-20T13:34:05.318039+0000","last_peered":"2023-06-20T13:34:05.318039+0000","last_clean":"2023-06-20T13:34:05.318039+0000","last_became_active":"2023-06-20T13:34:05.313266+0000","last_became_peered":"2023-06-20T13:34:05.313266+0000","last_unstale":"2023-06-20T13:34:05.318039+0000","last_undegraded":"2023-06-20T13:34:05.318039+0000","last_fullsized":"2023-06-20T13:34:05.318039+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:40:07.072491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.318146+0000","last_change":"2023-06-20T13:34:05.311949+0000","last_active":"2023-06-20T13:34:05.318146+0000","last_peered":"2023-06-20T13:34:05.318146+0000","last_clean":"2023-06-20T13:34:05.318146+0000","last_became_active":"2023-06-20T13:34:05.311474+0000","last_became_peered":"2023-06-20T13:34:05.311474+0000","last_unstale":"2023-06-20T13:34:05.318146+0000","last_undegraded":"2023-06-20T13:34:05.318146+0000","last_fullsized":"2023-06-20T13:34:05.318146+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:20:17.188648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.318170+0000","last_change":"2023-06-20T13:34:05.314214+0000","last_active":"2023-06-20T13:34:05.318170+0000","last_peered":"2023-06-20T13:34:05.318170+0000","last_clean":"2023-06-20T13:34:05.318170+0000","last_became_active":"2023-06-20T13:34:05.313892+0000","last_became_peered":"2023-06-20T13:34:05.313892+0000","last_unstale":"2023-06-20T13:34:05.318170+0000","last_undegraded":"2023-06-20T13:34:05.318170+0000","last_fullsized":"2023-06-20T13:34:05.318170+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:10:41.088988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275281+0000","last_change":"2023-06-20T13:34:05.296517+0000","last_active":"2023-06-20T13:34:06.275281+0000","last_peered":"2023-06-20T13:34:06.275281+0000","last_clean":"2023-06-20T13:34:06.275281+0000","last_became_active":"2023-06-20T13:34:05.296086+0000","last_became_peered":"2023-06-20T13:34:05.296086+0000","last_unstale":"2023-06-20T13:34:06.275281+0000","last_undegraded":"2023-06-20T13:34:06.275281+0000","last_fullsized":"2023-06-20T13:34:06.275281+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T01:23:59.127989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.315859+0000","last_change":"2023-06-20T13:34:05.314723+0000","last_active":"2023-06-20T13:34:05.315859+0000","last_peered":"2023-06-20T13:34:05.315859+0000","last_clean":"2023-06-20T13:34:05.315859+0000","last_became_active":"2023-06-20T13:34:05.314423+0000","last_became_peered":"2023-06-20T13:34:05.314423+0000","last_unstale":"2023-06-20T13:34:05.315859+0000","last_undegraded":"2023-06-20T13:34:05.315859+0000","last_fullsized":"2023-06-20T13:34:05.315859+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:57:44.965669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.318174+0000","last_change":"2023-06-20T13:34:05.313533+0000","last_active":"2023-06-20T13:34:05.318174+0000","last_peered":"2023-06-20T13:34:05.318174+0000","last_clean":"2023-06-20T13:34:05.318174+0000","last_became_active":"2023-06-20T13:34:05.313201+0000","last_became_peered":"2023-06-20T13:34:05.313201+0000","last_unstale":"2023-06-20T13:34:05.318174+0000","last_undegraded":"2023-06-20T13:34:05.318174+0000","last_fullsized":"2023-06-20T13:34:05.318174+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T13:48:44.537113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.300757+0000","last_change":"2023-06-20T13:34:05.287456+0000","last_active":"2023-06-20T13:34:05.300757+0000","last_peered":"2023-06-20T13:34:05.300757+0000","last_clean":"2023-06-20T13:34:05.300757+0000","last_became_active":"2023-06-20T13:34:05.287165+0000","last_became_peered":"2023-06-20T13:34:05.287165+0000","last_unstale":"2023-06-20T13:34:05.300757+0000","last_undegraded":"2023-06-20T13:34:05.300757+0000","last_fullsized":"2023-06-20T13:34:05.300757+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:54:26.875652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.304834+0000","last_change":"2023-06-20T13:34:05.301885+0000","last_active":"2023-06-20T13:34:05.304834+0000","last_peered":"2023-06-20T13:34:05.304834+0000","last_clean":"2023-06-20T13:34:05.304834+0000","last_became_active":"2023-06-20T13:34:05.301654+0000","last_became_peered":"2023-06-20T13:34:05.301654+0000","last_unstale":"2023-06-20T13:34:05.304834+0000","last_undegraded":"2023-06-20T13:34:05.304834+0000","last_fullsized":"2023-06-20T13:34:05.304834+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:04:00.033985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.294055+0000","last_change":"2023-06-20T13:34:05.290947+0000","last_active":"2023-06-20T13:34:05.294055+0000","last_peered":"2023-06-20T13:34:05.294055+0000","last_clean":"2023-06-20T13:34:05.294055+0000","last_became_active":"2023-06-20T13:34:05.290663+0000","last_became_peered":"2023-06-20T13:34:05.290663+0000","last_unstale":"2023-06-20T13:34:05.294055+0000","last_undegraded":"2023-06-20T13:34:05.294055+0000","last_fullsized":"2023-06-20T13:34:05.294055+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:00:01.834452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.304425+0000","last_change":"2023-06-20T13:34:05.299084+0000","last_active":"2023-06-20T13:34:05.304425+0000","last_peered":"2023-06-20T13:34:05.304425+0000","last_clean":"2023-06-20T13:34:05.304425+0000","last_became_active":"2023-06-20T13:34:05.298816+0000","last_became_peered":"2023-06-20T13:34:05.298816+0000","last_unstale":"2023-06-20T13:34:05.304425+0000","last_undegraded":"2023-06-20T13:34:05.304425+0000","last_fullsized":"2023-06-20T13:34:05.304425+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:50:14.435877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.304085+0000","last_change":"2023-06-20T13:34:05.299470+0000","last_active":"2023-06-20T13:34:05.304085+0000","last_peered":"2023-06-20T13:34:05.304085+0000","last_clean":"2023-06-20T13:34:05.304085+0000","last_became_active":"2023-06-20T13:34:05.299044+0000","last_became_peered":"2023-06-20T13:34:05.299044+0000","last_unstale":"2023-06-20T13:34:05.304085+0000","last_undegraded":"2023-06-20T13:34:05.304085+0000","last_fullsized":"2023-06-20T13:34:05.304085+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:31:15.592652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.311763+0000","last_change":"2023-06-20T13:34:05.302290+0000","last_active":"2023-06-20T13:34:05.311763+0000","last_peered":"2023-06-20T13:34:05.311763+0000","last_clean":"2023-06-20T13:34:05.311763+0000","last_became_active":"2023-06-20T13:34:05.301975+0000","last_became_peered":"2023-06-20T13:34:05.301975+0000","last_unstale":"2023-06-20T13:34:05.311763+0000","last_undegraded":"2023-06-20T13:34:05.311763+0000","last_fullsized":"2023-06-20T13:34:05.311763+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:04:00.033985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.303834+0000","last_change":"2023-06-20T13:34:05.283409+0000","last_active":"2023-06-20T13:34:05.303834+0000","last_peered":"2023-06-20T13:34:05.303834+0000","last_clean":"2023-06-20T13:34:05.303834+0000","last_became_active":"2023-06-20T13:34:05.283089+0000","last_became_peered":"2023-06-20T13:34:05.283089+0000","last_unstale":"2023-06-20T13:34:05.303834+0000","last_undegraded":"2023-06-20T13:34:05.303834+0000","last_fullsized":"2023-06-20T13:34:05.303834+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:01:09.946087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.313644+0000","last_change":"2023-06-20T13:34:05.309364+0000","last_active":"2023-06-20T13:34:05.313644+0000","last_peered":"2023-06-20T13:34:05.313644+0000","last_clean":"2023-06-20T13:34:05.313644+0000","last_became_active":"2023-06-20T13:34:05.309078+0000","last_became_peered":"2023-06-20T13:34:05.309078+0000","last_unstale":"2023-06-20T13:34:05.313644+0000","last_undegraded":"2023-06-20T13:34:05.313644+0000","last_fullsized":"2023-06-20T13:34:05.313644+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:48:24.154671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.301164+0000","last_change":"2023-06-20T13:34:05.293848+0000","last_active":"2023-06-20T13:34:05.301164+0000","last_peered":"2023-06-20T13:34:05.301164+0000","last_clean":"2023-06-20T13:34:05.301164+0000","last_became_active":"2023-06-20T13:34:05.293474+0000","last_became_peered":"2023-06-20T13:34:05.293474+0000","last_unstale":"2023-06-20T13:34:05.301164+0000","last_undegraded":"2023-06-20T13:34:05.301164+0000","last_fullsized":"2023-06-20T13:34:05.301164+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:29:51.889953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.303766+0000","last_change":"2023-06-20T13:34:05.300196+0000","last_active":"2023-06-20T13:34:05.303766+0000","last_peered":"2023-06-20T13:34:05.303766+0000","last_clean":"2023-06-20T13:34:05.303766+0000","last_became_active":"2023-06-20T13:34:05.299948+0000","last_became_peered":"2023-06-20T13:34:05.299948+0000","last_unstale":"2023-06-20T13:34:05.303766+0000","last_undegraded":"2023-06-20T13:34:05.303766+0000","last_fullsized":"2023-06-20T13:34:05.303766+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:32:58.554744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.300132+0000","last_change":"2023-06-20T13:34:05.295193+0000","last_active":"2023-06-20T13:34:05.300132+0000","last_peered":"2023-06-20T13:34:05.300132+0000","last_clean":"2023-06-20T13:34:05.300132+0000","last_became_active":"2023-06-20T13:34:05.293195+0000","last_became_peered":"2023-06-20T13:34:05.293195+0000","last_unstale":"2023-06-20T13:34:05.300132+0000","last_undegraded":"2023-06-20T13:34:05.300132+0000","last_fullsized":"2023-06-20T13:34:05.300132+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:34:08.431231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.314171+0000","last_change":"2023-06-20T13:34:05.303026+0000","last_active":"2023-06-20T13:34:05.314171+0000","last_peered":"2023-06-20T13:34:05.314171+0000","last_clean":"2023-06-20T13:34:05.314171+0000","last_became_active":"2023-06-20T13:34:05.302657+0000","last_became_peered":"2023-06-20T13:34:05.302657+0000","last_unstale":"2023-06-20T13:34:05.314171+0000","last_undegraded":"2023-06-20T13:34:05.314171+0000","last_fullsized":"2023-06-20T13:34:05.314171+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:45:39.528624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.294069+0000","last_change":"2023-06-20T13:34:05.291481+0000","last_active":"2023-06-20T13:34:05.294069+0000","last_peered":"2023-06-20T13:34:05.294069+0000","last_clean":"2023-06-20T13:34:05.294069+0000","last_became_active":"2023-06-20T13:34:05.291226+0000","last_became_peered":"2023-06-20T13:34:05.291226+0000","last_unstale":"2023-06-20T13:34:05.294069+0000","last_undegraded":"2023-06-20T13:34:05.294069+0000","last_fullsized":"2023-06-20T13:34:05.294069+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T01:21:10.506594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275095+0000","last_change":"2023-06-20T13:34:05.296345+0000","last_active":"2023-06-20T13:34:06.275095+0000","last_peered":"2023-06-20T13:34:06.275095+0000","last_clean":"2023-06-20T13:34:06.275095+0000","last_became_active":"2023-06-20T13:34:05.295711+0000","last_became_peered":"2023-06-20T13:34:05.295711+0000","last_unstale":"2023-06-20T13:34:06.275095+0000","last_undegraded":"2023-06-20T13:34:06.275095+0000","last_fullsized":"2023-06-20T13:34:06.275095+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:59:05.675608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.299677+0000","last_change":"2023-06-20T13:34:05.292695+0000","last_active":"2023-06-20T13:34:05.299677+0000","last_peered":"2023-06-20T13:34:05.299677+0000","last_clean":"2023-06-20T13:34:05.299677+0000","last_became_active":"2023-06-20T13:34:05.292298+0000","last_became_peered":"2023-06-20T13:34:05.292298+0000","last_unstale":"2023-06-20T13:34:05.299677+0000","last_undegraded":"2023-06-20T13:34:05.299677+0000","last_fullsized":"2023-06-20T13:34:05.299677+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:45:39.528624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.290591+0000","last_change":"2023-06-20T13:34:05.287380+0000","last_active":"2023-06-20T13:34:05.290591+0000","last_peered":"2023-06-20T13:34:05.290591+0000","last_clean":"2023-06-20T13:34:05.290591+0000","last_became_active":"2023-06-20T13:34:05.287100+0000","last_became_peered":"2023-06-20T13:34:05.287100+0000","last_unstale":"2023-06-20T13:34:05.290591+0000","last_undegraded":"2023-06-20T13:34:05.290591+0000","last_fullsized":"2023-06-20T13:34:05.290591+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T15:06:15.510138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.303418+0000","last_change":"2023-06-20T13:34:05.290628+0000","last_active":"2023-06-20T13:34:05.303418+0000","last_peered":"2023-06-20T13:34:05.303418+0000","last_clean":"2023-06-20T13:34:05.303418+0000","last_became_active":"2023-06-20T13:34:05.290345+0000","last_became_peered":"2023-06-20T13:34:05.290345+0000","last_unstale":"2023-06-20T13:34:05.303418+0000","last_undegraded":"2023-06-20T13:34:05.303418+0000","last_fullsized":"2023-06-20T13:34:05.303418+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:38:50.504294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.295802+0000","last_change":"2023-06-20T13:34:05.290776+0000","last_active":"2023-06-20T13:34:05.295802+0000","last_peered":"2023-06-20T13:34:05.295802+0000","last_clean":"2023-06-20T13:34:05.295802+0000","last_became_active":"2023-06-20T13:34:05.290510+0000","last_became_peered":"2023-06-20T13:34:05.290510+0000","last_unstale":"2023-06-20T13:34:05.295802+0000","last_undegraded":"2023-06-20T13:34:05.295802+0000","last_fullsized":"2023-06-20T13:34:05.295802+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:20:09.788686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.297509+0000","last_change":"2023-06-20T13:34:05.291657+0000","last_active":"2023-06-20T13:34:05.297509+0000","last_peered":"2023-06-20T13:34:05.297509+0000","last_clean":"2023-06-20T13:34:05.297509+0000","last_became_active":"2023-06-20T13:34:05.291342+0000","last_became_peered":"2023-06-20T13:34:05.291342+0000","last_unstale":"2023-06-20T13:34:05.297509+0000","last_undegraded":"2023-06-20T13:34:05.297509+0000","last_fullsized":"2023-06-20T13:34:05.297509+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:50:18.082545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"40'4","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.315865+0000","last_change":"2023-06-20T13:34:04.002643+0000","last_active":"2023-06-20T13:34:05.315865+0000","last_peered":"2023-06-20T13:34:05.315865+0000","last_clean":"2023-06-20T13:34:05.315865+0000","last_became_active":"2023-06-20T13:34:04.002373+0000","last_became_peered":"2023-06-20T13:34:04.002373+0000","last_unstale":"2023-06-20T13:34:05.315865+0000","last_undegraded":"2023-06-20T13:34:05.315865+0000","last_fullsized":"2023-06-20T13:34:05.315865+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:46:21.718492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.300113+0000","last_change":"2023-06-20T13:34:05.294724+0000","last_active":"2023-06-20T13:34:05.300113+0000","last_peered":"2023-06-20T13:34:05.300113+0000","last_clean":"2023-06-20T13:34:05.300113+0000","last_became_active":"2023-06-20T13:34:05.293181+0000","last_became_peered":"2023-06-20T13:34:05.293181+0000","last_unstale":"2023-06-20T13:34:05.300113+0000","last_undegraded":"2023-06-20T13:34:05.300113+0000","last_fullsized":"2023-06-20T13:34:05.300113+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:07:50.944154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.305097+0000","last_change":"2023-06-20T13:34:04.014888+0000","last_active":"2023-06-20T13:34:05.305097+0000","last_peered":"2023-06-20T13:34:05.305097+0000","last_clean":"2023-06-20T13:34:05.305097+0000","last_became_active":"2023-06-20T13:34:04.014562+0000","last_became_peered":"2023-06-20T13:34:04.014562+0000","last_unstale":"2023-06-20T13:34:05.305097+0000","last_undegraded":"2023-06-20T13:34:05.305097+0000","last_fullsized":"2023-06-20T13:34:05.305097+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:28:26.894866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275209+0000","last_change":"2023-06-20T13:34:05.304790+0000","last_active":"2023-06-20T13:34:06.275209+0000","last_peered":"2023-06-20T13:34:06.275209+0000","last_clean":"2023-06-20T13:34:06.275209+0000","last_became_active":"2023-06-20T13:34:05.304502+0000","last_became_peered":"2023-06-20T13:34:05.304502+0000","last_unstale":"2023-06-20T13:34:06.275209+0000","last_undegraded":"2023-06-20T13:34:06.275209+0000","last_fullsized":"2023-06-20T13:34:06.275209+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:47:29.411419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.318855+0000","last_change":"2023-06-20T13:34:04.008898+0000","last_active":"2023-06-20T13:34:05.318855+0000","last_peered":"2023-06-20T13:34:05.318855+0000","last_clean":"2023-06-20T13:34:05.318855+0000","last_became_active":"2023-06-20T13:34:04.008603+0000","last_became_peered":"2023-06-20T13:34:04.008603+0000","last_unstale":"2023-06-20T13:34:05.318855+0000","last_undegraded":"2023-06-20T13:34:05.318855+0000","last_fullsized":"2023-06-20T13:34:05.318855+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:25:01.290812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.304152+0000","last_change":"2023-06-20T13:34:05.292574+0000","last_active":"2023-06-20T13:34:05.304152+0000","last_peered":"2023-06-20T13:34:05.304152+0000","last_clean":"2023-06-20T13:34:05.304152+0000","last_became_active":"2023-06-20T13:34:05.291993+0000","last_became_peered":"2023-06-20T13:34:05.291993+0000","last_unstale":"2023-06-20T13:34:05.304152+0000","last_undegraded":"2023-06-20T13:34:05.304152+0000","last_fullsized":"2023-06-20T13:34:05.304152+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:48:24.154671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.276100+0000","last_change":"2023-06-20T13:34:04.003885+0000","last_active":"2023-06-20T13:34:06.276100+0000","last_peered":"2023-06-20T13:34:06.276100+0000","last_clean":"2023-06-20T13:34:06.276100+0000","last_became_active":"2023-06-20T13:34:04.003607+0000","last_became_peered":"2023-06-20T13:34:04.003607+0000","last_unstale":"2023-06-20T13:34:06.276100+0000","last_undegraded":"2023-06-20T13:34:06.276100+0000","last_fullsized":"2023-06-20T13:34:06.276100+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:19:53.723497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.298522+0000","last_change":"2023-06-20T13:34:05.294600+0000","last_active":"2023-06-20T13:34:05.298522+0000","last_peered":"2023-06-20T13:34:05.298522+0000","last_clean":"2023-06-20T13:34:05.298522+0000","last_became_active":"2023-06-20T13:34:05.294310+0000","last_became_peered":"2023-06-20T13:34:05.294310+0000","last_unstale":"2023-06-20T13:34:05.298522+0000","last_undegraded":"2023-06-20T13:34:05.298522+0000","last_fullsized":"2023-06-20T13:34:05.298522+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:08:24.054294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.312345+0000","last_change":"2023-06-20T13:34:03.999158+0000","last_active":"2023-06-20T13:34:05.312345+0000","last_peered":"2023-06-20T13:34:05.312345+0000","last_clean":"2023-06-20T13:34:05.312345+0000","last_became_active":"2023-06-20T13:34:03.998855+0000","last_became_peered":"2023-06-20T13:34:03.998855+0000","last_unstale":"2023-06-20T13:34:05.312345+0000","last_undegraded":"2023-06-20T13:34:05.312345+0000","last_fullsized":"2023-06-20T13:34:05.312345+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:31:02.979746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.302138+0000","last_change":"2023-06-20T13:34:05.300500+0000","last_active":"2023-06-20T13:34:05.302138+0000","last_peered":"2023-06-20T13:34:05.302138+0000","last_clean":"2023-06-20T13:34:05.302138+0000","last_became_active":"2023-06-20T13:34:05.300211+0000","last_became_peered":"2023-06-20T13:34:05.300211+0000","last_unstale":"2023-06-20T13:34:05.302138+0000","last_undegraded":"2023-06-20T13:34:05.302138+0000","last_fullsized":"2023-06-20T13:34:05.302138+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:44:26.638704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.306426+0000","last_change":"2023-06-20T13:34:04.012841+0000","last_active":"2023-06-20T13:34:05.306426+0000","last_peered":"2023-06-20T13:34:05.306426+0000","last_clean":"2023-06-20T13:34:05.306426+0000","last_became_active":"2023-06-20T13:34:04.012571+0000","last_became_peered":"2023-06-20T13:34:04.012571+0000","last_unstale":"2023-06-20T13:34:05.306426+0000","last_undegraded":"2023-06-20T13:34:05.306426+0000","last_fullsized":"2023-06-20T13:34:05.306426+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T01:03:14.507581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.318383+0000","last_change":"2023-06-20T13:34:05.311873+0000","last_active":"2023-06-20T13:34:05.318383+0000","last_peered":"2023-06-20T13:34:05.318383+0000","last_clean":"2023-06-20T13:34:05.318383+0000","last_became_active":"2023-06-20T13:34:05.311230+0000","last_became_peered":"2023-06-20T13:34:05.311230+0000","last_unstale":"2023-06-20T13:34:05.318383+0000","last_undegraded":"2023-06-20T13:34:05.318383+0000","last_fullsized":"2023-06-20T13:34:05.318383+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:11:49.500789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275015+0000","last_change":"2023-06-20T13:34:04.010790+0000","last_active":"2023-06-20T13:34:06.275015+0000","last_peered":"2023-06-20T13:34:06.275015+0000","last_clean":"2023-06-20T13:34:06.275015+0000","last_became_active":"2023-06-20T13:34:04.010431+0000","last_became_peered":"2023-06-20T13:34:04.010431+0000","last_unstale":"2023-06-20T13:34:06.275015+0000","last_undegraded":"2023-06-20T13:34:06.275015+0000","last_fullsized":"2023-06-20T13:34:06.275015+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:11:59.130810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.300075+0000","last_change":"2023-06-20T13:34:05.294328+0000","last_active":"2023-06-20T13:34:05.300075+0000","last_peered":"2023-06-20T13:34:05.300075+0000","last_clean":"2023-06-20T13:34:05.300075+0000","last_became_active":"2023-06-20T13:34:05.294080+0000","last_became_peered":"2023-06-20T13:34:05.294080+0000","last_unstale":"2023-06-20T13:34:05.300075+0000","last_undegraded":"2023-06-20T13:34:05.300075+0000","last_fullsized":"2023-06-20T13:34:05.300075+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:55:10.304175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.295764+0000","last_change":"2023-06-20T13:34:04.012982+0000","last_active":"2023-06-20T13:34:05.295764+0000","last_peered":"2023-06-20T13:34:05.295764+0000","last_clean":"2023-06-20T13:34:05.295764+0000","last_became_active":"2023-06-20T13:34:04.012561+0000","last_became_peered":"2023-06-20T13:34:04.012561+0000","last_unstale":"2023-06-20T13:34:05.295764+0000","last_undegraded":"2023-06-20T13:34:05.295764+0000","last_fullsized":"2023-06-20T13:34:05.295764+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:36:12.442396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.305737+0000","last_change":"2023-06-20T13:34:05.302336+0000","last_active":"2023-06-20T13:34:05.305737+0000","last_peered":"2023-06-20T13:34:05.305737+0000","last_clean":"2023-06-20T13:34:05.305737+0000","last_became_active":"2023-06-20T13:34:05.302019+0000","last_became_peered":"2023-06-20T13:34:05.302019+0000","last_unstale":"2023-06-20T13:34:05.305737+0000","last_undegraded":"2023-06-20T13:34:05.305737+0000","last_fullsized":"2023-06-20T13:34:05.305737+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:25:25.124742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.274492+0000","last_change":"2023-06-20T13:34:04.010233+0000","last_active":"2023-06-20T13:34:05.274492+0000","last_peered":"2023-06-20T13:34:05.274492+0000","last_clean":"2023-06-20T13:34:05.274492+0000","last_became_active":"2023-06-20T13:34:04.009959+0000","last_became_peered":"2023-06-20T13:34:04.009959+0000","last_unstale":"2023-06-20T13:34:05.274492+0000","last_undegraded":"2023-06-20T13:34:05.274492+0000","last_fullsized":"2023-06-20T13:34:05.274492+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:45:51.614218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.276541+0000","last_change":"2023-06-20T13:34:05.291017+0000","last_active":"2023-06-20T13:34:06.276541+0000","last_peered":"2023-06-20T13:34:06.276541+0000","last_clean":"2023-06-20T13:34:06.276541+0000","last_became_active":"2023-06-20T13:34:05.290618+0000","last_became_peered":"2023-06-20T13:34:05.290618+0000","last_unstale":"2023-06-20T13:34:06.276541+0000","last_undegraded":"2023-06-20T13:34:06.276541+0000","last_fullsized":"2023-06-20T13:34:06.276541+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:18:46.653024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.295429+0000","last_change":"2023-06-20T13:34:04.016438+0000","last_active":"2023-06-20T13:34:05.295429+0000","last_peered":"2023-06-20T13:34:05.295429+0000","last_clean":"2023-06-20T13:34:05.295429+0000","last_became_active":"2023-06-20T13:34:04.016159+0000","last_became_peered":"2023-06-20T13:34:04.016159+0000","last_unstale":"2023-06-20T13:34:05.295429+0000","last_undegraded":"2023-06-20T13:34:05.295429+0000","last_fullsized":"2023-06-20T13:34:05.295429+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:22:53.604110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.303649+0000","last_change":"2023-06-20T13:34:05.284830+0000","last_active":"2023-06-20T13:34:05.303649+0000","last_peered":"2023-06-20T13:34:05.303649+0000","last_clean":"2023-06-20T13:34:05.303649+0000","last_became_active":"2023-06-20T13:34:05.284549+0000","last_became_peered":"2023-06-20T13:34:05.284549+0000","last_unstale":"2023-06-20T13:34:05.303649+0000","last_undegraded":"2023-06-20T13:34:05.303649+0000","last_fullsized":"2023-06-20T13:34:05.303649+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:55:12.654445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"40'3","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.276139+0000","last_change":"2023-06-20T13:34:04.003077+0000","last_active":"2023-06-20T13:34:06.276139+0000","last_peered":"2023-06-20T13:34:06.276139+0000","last_clean":"2023-06-20T13:34:06.276139+0000","last_became_active":"2023-06-20T13:34:04.002777+0000","last_became_peered":"2023-06-20T13:34:04.002777+0000","last_unstale":"2023-06-20T13:34:06.276139+0000","last_undegraded":"2023-06-20T13:34:06.276139+0000","last_fullsized":"2023-06-20T13:34:06.276139+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:12:49.748128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275845+0000","last_change":"2023-06-20T13:34:05.290701+0000","last_active":"2023-06-20T13:34:06.275845+0000","last_peered":"2023-06-20T13:34:06.275845+0000","last_clean":"2023-06-20T13:34:06.275845+0000","last_became_active":"2023-06-20T13:34:05.290395+0000","last_became_peered":"2023-06-20T13:34:05.290395+0000","last_unstale":"2023-06-20T13:34:06.275845+0000","last_undegraded":"2023-06-20T13:34:06.275845+0000","last_fullsized":"2023-06-20T13:34:06.275845+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:56:31.373999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"40'6","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.317782+0000","last_change":"2023-06-20T13:34:04.012166+0000","last_active":"2023-06-20T13:34:05.317782+0000","last_peered":"2023-06-20T13:34:05.317782+0000","last_clean":"2023-06-20T13:34:05.317782+0000","last_became_active":"2023-06-20T13:34:04.011852+0000","last_became_peered":"2023-06-20T13:34:04.011852+0000","last_unstale":"2023-06-20T13:34:05.317782+0000","last_undegraded":"2023-06-20T13:34:05.317782+0000","last_fullsized":"2023-06-20T13:34:05.317782+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:07:49.941563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.304837+0000","last_change":"2023-06-20T13:34:05.301965+0000","last_active":"2023-06-20T13:34:05.304837+0000","last_peered":"2023-06-20T13:34:05.304837+0000","last_clean":"2023-06-20T13:34:05.304837+0000","last_became_active":"2023-06-20T13:34:05.301697+0000","last_became_peered":"2023-06-20T13:34:05.301697+0000","last_unstale":"2023-06-20T13:34:05.304837+0000","last_undegraded":"2023-06-20T13:34:05.304837+0000","last_fullsized":"2023-06-20T13:34:05.304837+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:00:12.639892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.315761+0000","last_change":"2023-06-20T13:34:04.014540+0000","last_active":"2023-06-20T13:34:05.315761+0000","last_peered":"2023-06-20T13:34:05.315761+0000","last_clean":"2023-06-20T13:34:05.315761+0000","last_became_active":"2023-06-20T13:34:04.014269+0000","last_became_peered":"2023-06-20T13:34:04.014269+0000","last_unstale":"2023-06-20T13:34:05.315761+0000","last_undegraded":"2023-06-20T13:34:05.315761+0000","last_fullsized":"2023-06-20T13:34:05.315761+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:41:24.858200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.301494+0000","last_change":"2023-06-20T13:34:05.299167+0000","last_active":"2023-06-20T13:34:05.301494+0000","last_peered":"2023-06-20T13:34:05.301494+0000","last_clean":"2023-06-20T13:34:05.301494+0000","last_became_active":"2023-06-20T13:34:05.298855+0000","last_became_peered":"2023-06-20T13:34:05.298855+0000","last_unstale":"2023-06-20T13:34:05.301494+0000","last_undegraded":"2023-06-20T13:34:05.301494+0000","last_fullsized":"2023-06-20T13:34:05.301494+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:50:18.082545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.276491+0000","last_change":"2023-06-20T13:34:04.002691+0000","last_active":"2023-06-20T13:34:06.276491+0000","last_peered":"2023-06-20T13:34:06.276491+0000","last_clean":"2023-06-20T13:34:06.276491+0000","last_became_active":"2023-06-20T13:34:04.002361+0000","last_became_peered":"2023-06-20T13:34:04.002361+0000","last_unstale":"2023-06-20T13:34:06.276491+0000","last_undegraded":"2023-06-20T13:34:06.276491+0000","last_fullsized":"2023-06-20T13:34:06.276491+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:23:07.057589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.300708+0000","last_change":"2023-06-20T13:34:05.285729+0000","last_active":"2023-06-20T13:34:05.300708+0000","last_peered":"2023-06-20T13:34:05.300708+0000","last_clean":"2023-06-20T13:34:05.300708+0000","last_became_active":"2023-06-20T13:34:05.285299+0000","last_became_peered":"2023-06-20T13:34:05.285299+0000","last_unstale":"2023-06-20T13:34:05.300708+0000","last_undegraded":"2023-06-20T13:34:05.300708+0000","last_fullsized":"2023-06-20T13:34:05.300708+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T13:39:37.647301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.272871+0000","last_change":"2023-06-20T13:34:04.014639+0000","last_active":"2023-06-20T13:34:05.272871+0000","last_peered":"2023-06-20T13:34:05.272871+0000","last_clean":"2023-06-20T13:34:05.272871+0000","last_became_active":"2023-06-20T13:34:04.014379+0000","last_became_peered":"2023-06-20T13:34:04.014379+0000","last_unstale":"2023-06-20T13:34:05.272871+0000","last_undegraded":"2023-06-20T13:34:05.272871+0000","last_fullsized":"2023-06-20T13:34:05.272871+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:53:55.455897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.276457+0000","last_change":"2023-06-20T13:34:05.293575+0000","last_active":"2023-06-20T13:34:06.276457+0000","last_peered":"2023-06-20T13:34:06.276457+0000","last_clean":"2023-06-20T13:34:06.276457+0000","last_became_active":"2023-06-20T13:34:05.293298+0000","last_became_peered":"2023-06-20T13:34:05.293298+0000","last_unstale":"2023-06-20T13:34:06.276457+0000","last_undegraded":"2023-06-20T13:34:06.276457+0000","last_fullsized":"2023-06-20T13:34:06.276457+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:36:59.986859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"40'8","reported_seq":19,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.318324+0000","last_change":"2023-06-20T13:34:04.012811+0000","last_active":"2023-06-20T13:34:05.318324+0000","last_peered":"2023-06-20T13:34:05.318324+0000","last_clean":"2023-06-20T13:34:05.318324+0000","last_became_active":"2023-06-20T13:34:04.012275+0000","last_became_peered":"2023-06-20T13:34:04.012275+0000","last_unstale":"2023-06-20T13:34:05.318324+0000","last_undegraded":"2023-06-20T13:34:05.318324+0000","last_fullsized":"2023-06-20T13:34:05.318324+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:49:31.499103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.296328+0000","last_change":"2023-06-20T13:34:05.293050+0000","last_active":"2023-06-20T13:34:05.296328+0000","last_peered":"2023-06-20T13:34:05.296328+0000","last_clean":"2023-06-20T13:34:05.296328+0000","last_became_active":"2023-06-20T13:34:05.292767+0000","last_became_peered":"2023-06-20T13:34:05.292767+0000","last_unstale":"2023-06-20T13:34:05.296328+0000","last_undegraded":"2023-06-20T13:34:05.296328+0000","last_fullsized":"2023-06-20T13:34:05.296328+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:34:08.431231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.318587+0000","last_change":"2023-06-20T13:34:04.004296+0000","last_active":"2023-06-20T13:34:05.318587+0000","last_peered":"2023-06-20T13:34:05.318587+0000","last_clean":"2023-06-20T13:34:05.318587+0000","last_became_active":"2023-06-20T13:34:04.004012+0000","last_became_peered":"2023-06-20T13:34:04.004012+0000","last_unstale":"2023-06-20T13:34:05.318587+0000","last_undegraded":"2023-06-20T13:34:05.318587+0000","last_fullsized":"2023-06-20T13:34:05.318587+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:31:14.590062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.311238+0000","last_change":"2023-06-20T13:34:05.302567+0000","last_active":"2023-06-20T13:34:05.311238+0000","last_peered":"2023-06-20T13:34:05.311238+0000","last_clean":"2023-06-20T13:34:05.311238+0000","last_became_active":"2023-06-20T13:34:05.302302+0000","last_became_peered":"2023-06-20T13:34:05.302302+0000","last_unstale":"2023-06-20T13:34:05.311238+0000","last_undegraded":"2023-06-20T13:34:05.311238+0000","last_fullsized":"2023-06-20T13:34:05.311238+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:58:57.434684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.309997+0000","last_change":"2023-06-20T13:34:04.011616+0000","last_active":"2023-06-20T13:34:05.309997+0000","last_peered":"2023-06-20T13:34:05.309997+0000","last_clean":"2023-06-20T13:34:05.309997+0000","last_became_active":"2023-06-20T13:34:04.011277+0000","last_became_peered":"2023-06-20T13:34:04.011277+0000","last_unstale":"2023-06-20T13:34:05.309997+0000","last_undegraded":"2023-06-20T13:34:05.309997+0000","last_fullsized":"2023-06-20T13:34:05.309997+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:06:17.597764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.308511+0000","last_change":"2023-06-20T13:34:05.305868+0000","last_active":"2023-06-20T13:34:05.308511+0000","last_peered":"2023-06-20T13:34:05.308511+0000","last_clean":"2023-06-20T13:34:05.308511+0000","last_became_active":"2023-06-20T13:34:05.305588+0000","last_became_peered":"2023-06-20T13:34:05.305588+0000","last_unstale":"2023-06-20T13:34:05.308511+0000","last_undegraded":"2023-06-20T13:34:05.308511+0000","last_fullsized":"2023-06-20T13:34:05.308511+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:20:09.788686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275871+0000","last_change":"2023-06-20T13:34:04.009671+0000","last_active":"2023-06-20T13:34:06.275871+0000","last_peered":"2023-06-20T13:34:06.275871+0000","last_clean":"2023-06-20T13:34:06.275871+0000","last_became_active":"2023-06-20T13:34:04.009367+0000","last_became_peered":"2023-06-20T13:34:04.009367+0000","last_unstale":"2023-06-20T13:34:06.275871+0000","last_undegraded":"2023-06-20T13:34:06.275871+0000","last_fullsized":"2023-06-20T13:34:06.275871+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:19:53.723497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.304104+0000","last_change":"2023-06-20T13:34:05.300466+0000","last_active":"2023-06-20T13:34:05.304104+0000","last_peered":"2023-06-20T13:34:05.304104+0000","last_clean":"2023-06-20T13:34:05.304104+0000","last_became_active":"2023-06-20T13:34:05.300195+0000","last_became_peered":"2023-06-20T13:34:05.300195+0000","last_unstale":"2023-06-20T13:34:05.304104+0000","last_undegraded":"2023-06-20T13:34:05.304104+0000","last_fullsized":"2023-06-20T13:34:05.304104+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T16:57:44.965669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.273222+0000","last_change":"2023-06-20T13:34:04.002052+0000","last_active":"2023-06-20T13:34:05.273222+0000","last_peered":"2023-06-20T13:34:05.273222+0000","last_clean":"2023-06-20T13:34:05.273222+0000","last_became_active":"2023-06-20T13:34:04.001740+0000","last_became_peered":"2023-06-20T13:34:04.001740+0000","last_unstale":"2023-06-20T13:34:05.273222+0000","last_undegraded":"2023-06-20T13:34:05.273222+0000","last_fullsized":"2023-06-20T13:34:05.273222+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:28:42.654890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.300664+0000","last_change":"2023-06-20T13:34:05.284236+0000","last_active":"2023-06-20T13:34:05.300664+0000","last_peered":"2023-06-20T13:34:05.300664+0000","last_clean":"2023-06-20T13:34:05.300664+0000","last_became_active":"2023-06-20T13:34:05.283872+0000","last_became_peered":"2023-06-20T13:34:05.283872+0000","last_unstale":"2023-06-20T13:34:05.300664+0000","last_undegraded":"2023-06-20T13:34:05.300664+0000","last_fullsized":"2023-06-20T13:34:05.300664+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T01:21:00.445856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.312459+0000","last_change":"2023-06-20T13:34:03.999175+0000","last_active":"2023-06-20T13:34:05.312459+0000","last_peered":"2023-06-20T13:34:05.312459+0000","last_clean":"2023-06-20T13:34:05.312459+0000","last_became_active":"2023-06-20T13:34:03.998871+0000","last_became_peered":"2023-06-20T13:34:03.998871+0000","last_unstale":"2023-06-20T13:34:05.312459+0000","last_undegraded":"2023-06-20T13:34:05.312459+0000","last_fullsized":"2023-06-20T13:34:05.312459+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:38:59.588526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.312392+0000","last_change":"2023-06-20T13:34:05.293150+0000","last_active":"2023-06-20T13:34:05.312392+0000","last_peered":"2023-06-20T13:34:05.312392+0000","last_clean":"2023-06-20T13:34:05.312392+0000","last_became_active":"2023-06-20T13:34:05.292872+0000","last_became_peered":"2023-06-20T13:34:05.292872+0000","last_unstale":"2023-06-20T13:34:05.312392+0000","last_undegraded":"2023-06-20T13:34:05.312392+0000","last_fullsized":"2023-06-20T13:34:05.312392+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:10:41.088988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275651+0000","last_change":"2023-06-20T13:34:04.009463+0000","last_active":"2023-06-20T13:34:06.275651+0000","last_peered":"2023-06-20T13:34:06.275651+0000","last_clean":"2023-06-20T13:34:06.275651+0000","last_became_active":"2023-06-20T13:34:04.009105+0000","last_became_peered":"2023-06-20T13:34:04.009105+0000","last_unstale":"2023-06-20T13:34:06.275651+0000","last_undegraded":"2023-06-20T13:34:06.275651+0000","last_fullsized":"2023-06-20T13:34:06.275651+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:58:39.834072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.301566+0000","last_change":"2023-06-20T13:34:05.295695+0000","last_active":"2023-06-20T13:34:05.301566+0000","last_peered":"2023-06-20T13:34:05.301566+0000","last_clean":"2023-06-20T13:34:05.301566+0000","last_became_active":"2023-06-20T13:34:05.295349+0000","last_became_peered":"2023-06-20T13:34:05.295349+0000","last_unstale":"2023-06-20T13:34:05.301566+0000","last_undegraded":"2023-06-20T13:34:05.301566+0000","last_fullsized":"2023-06-20T13:34:05.301566+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:55:10.304175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.284386+0000","last_change":"2023-06-20T13:34:04.013560+0000","last_active":"2023-06-20T13:34:05.284386+0000","last_peered":"2023-06-20T13:34:05.284386+0000","last_clean":"2023-06-20T13:34:05.284386+0000","last_became_active":"2023-06-20T13:34:04.013313+0000","last_became_peered":"2023-06-20T13:34:04.013313+0000","last_unstale":"2023-06-20T13:34:05.284386+0000","last_undegraded":"2023-06-20T13:34:05.284386+0000","last_fullsized":"2023-06-20T13:34:05.284386+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:41:10.832533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.318123+0000","last_change":"2023-06-20T13:34:05.313428+0000","last_active":"2023-06-20T13:34:05.318123+0000","last_peered":"2023-06-20T13:34:05.318123+0000","last_clean":"2023-06-20T13:34:05.318123+0000","last_became_active":"2023-06-20T13:34:05.313206+0000","last_became_peered":"2023-06-20T13:34:05.313206+0000","last_unstale":"2023-06-20T13:34:05.318123+0000","last_undegraded":"2023-06-20T13:34:05.318123+0000","last_fullsized":"2023-06-20T13:34:05.318123+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:54:32.987214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275681+0000","last_change":"2023-06-20T13:34:04.002370+0000","last_active":"2023-06-20T13:34:06.275681+0000","last_peered":"2023-06-20T13:34:06.275681+0000","last_clean":"2023-06-20T13:34:06.275681+0000","last_became_active":"2023-06-20T13:34:04.002074+0000","last_became_peered":"2023-06-20T13:34:04.002074+0000","last_unstale":"2023-06-20T13:34:06.275681+0000","last_undegraded":"2023-06-20T13:34:06.275681+0000","last_fullsized":"2023-06-20T13:34:06.275681+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:26:39.685620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.285429+0000","last_change":"2023-06-20T13:34:05.282160+0000","last_active":"2023-06-20T13:34:05.285429+0000","last_peered":"2023-06-20T13:34:05.285429+0000","last_clean":"2023-06-20T13:34:05.285429+0000","last_became_active":"2023-06-20T13:34:05.281934+0000","last_became_peered":"2023-06-20T13:34:05.281934+0000","last_unstale":"2023-06-20T13:34:05.285429+0000","last_undegraded":"2023-06-20T13:34:05.285429+0000","last_fullsized":"2023-06-20T13:34:05.285429+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:23:56.450392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.295907+0000","last_change":"2023-06-20T13:34:04.010348+0000","last_active":"2023-06-20T13:34:05.295907+0000","last_peered":"2023-06-20T13:34:05.295907+0000","last_clean":"2023-06-20T13:34:05.295907+0000","last_became_active":"2023-06-20T13:34:04.009924+0000","last_became_peered":"2023-06-20T13:34:04.009924+0000","last_unstale":"2023-06-20T13:34:05.295907+0000","last_undegraded":"2023-06-20T13:34:05.295907+0000","last_fullsized":"2023-06-20T13:34:05.295907+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:34:03.978064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.278611+0000","last_change":"2023-06-20T13:32:14.847834+0000","last_active":"2023-06-20T13:34:05.278611+0000","last_peered":"2023-06-20T13:34:05.278611+0000","last_clean":"2023-06-20T13:34:05.278611+0000","last_became_active":"2023-06-20T13:32:14.847518+0000","last_became_peered":"2023-06-20T13:32:14.847518+0000","last_unstale":"2023-06-20T13:34:05.278611+0000","last_undegraded":"2023-06-20T13:34:05.278611+0000","last_fullsized":"2023-06-20T13:34:05.278611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T23:38:16.046090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.304510+0000","last_change":"2023-06-20T13:34:05.298772+0000","last_active":"2023-06-20T13:34:05.304510+0000","last_peered":"2023-06-20T13:34:05.304510+0000","last_clean":"2023-06-20T13:34:05.304510+0000","last_became_active":"2023-06-20T13:34:05.298506+0000","last_became_peered":"2023-06-20T13:34:05.298506+0000","last_unstale":"2023-06-20T13:34:05.304510+0000","last_undegraded":"2023-06-20T13:34:05.304510+0000","last_fullsized":"2023-06-20T13:34:05.304510+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:20:33.511734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.273385+0000","last_change":"2023-06-20T13:34:04.012135+0000","last_active":"2023-06-20T13:34:05.273385+0000","last_peered":"2023-06-20T13:34:05.273385+0000","last_clean":"2023-06-20T13:34:05.273385+0000","last_became_active":"2023-06-20T13:34:04.011817+0000","last_became_peered":"2023-06-20T13:34:04.011817+0000","last_unstale":"2023-06-20T13:34:05.273385+0000","last_undegraded":"2023-06-20T13:34:05.273385+0000","last_fullsized":"2023-06-20T13:34:05.273385+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T14:58:44.112846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275815+0000","last_change":"2023-06-20T13:32:13.979189+0000","last_active":"2023-06-20T13:34:06.275815+0000","last_peered":"2023-06-20T13:34:06.275815+0000","last_clean":"2023-06-20T13:34:06.275815+0000","last_became_active":"2023-06-20T13:32:13.978675+0000","last_became_peered":"2023-06-20T13:32:13.978675+0000","last_unstale":"2023-06-20T13:34:06.275815+0000","last_undegraded":"2023-06-20T13:34:06.275815+0000","last_fullsized":"2023-06-20T13:34:06.275815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:10:59.724317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.300799+0000","last_change":"2023-06-20T13:34:05.298507+0000","last_active":"2023-06-20T13:34:05.300799+0000","last_peered":"2023-06-20T13:34:05.300799+0000","last_clean":"2023-06-20T13:34:05.300799+0000","last_became_active":"2023-06-20T13:34:05.298086+0000","last_became_peered":"2023-06-20T13:34:05.298086+0000","last_unstale":"2023-06-20T13:34:05.300799+0000","last_undegraded":"2023-06-20T13:34:05.300799+0000","last_fullsized":"2023-06-20T13:34:05.300799+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:25:02.293403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.276260+0000","last_change":"2023-06-20T13:34:04.003215+0000","last_active":"2023-06-20T13:34:06.276260+0000","last_peered":"2023-06-20T13:34:06.276260+0000","last_clean":"2023-06-20T13:34:06.276260+0000","last_became_active":"2023-06-20T13:34:04.002900+0000","last_became_peered":"2023-06-20T13:34:04.002900+0000","last_unstale":"2023-06-20T13:34:06.276260+0000","last_undegraded":"2023-06-20T13:34:06.276260+0000","last_fullsized":"2023-06-20T13:34:06.276260+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T19:18:32.310258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.280618+0000","last_change":"2023-06-20T13:32:14.567022+0000","last_active":"2023-06-20T13:34:05.280618+0000","last_peered":"2023-06-20T13:34:05.280618+0000","last_clean":"2023-06-20T13:34:05.280618+0000","last_became_active":"2023-06-20T13:32:14.566671+0000","last_became_peered":"2023-06-20T13:32:14.566671+0000","last_unstale":"2023-06-20T13:34:05.280618+0000","last_undegraded":"2023-06-20T13:34:05.280618+0000","last_fullsized":"2023-06-20T13:34:05.280618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T17:58:21.613491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.299125+0000","last_change":"2023-06-20T13:34:05.297148+0000","last_active":"2023-06-20T13:34:05.299125+0000","last_peered":"2023-06-20T13:34:05.299125+0000","last_clean":"2023-06-20T13:34:05.299125+0000","last_became_active":"2023-06-20T13:34:05.296780+0000","last_became_peered":"2023-06-20T13:34:05.296780+0000","last_unstale":"2023-06-20T13:34:05.299125+0000","last_undegraded":"2023-06-20T13:34:05.299125+0000","last_fullsized":"2023-06-20T13:34:05.299125+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T01:27:20.911888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275619+0000","last_change":"2023-06-20T13:34:04.009007+0000","last_active":"2023-06-20T13:34:06.275619+0000","last_peered":"2023-06-20T13:34:06.275619+0000","last_clean":"2023-06-20T13:34:06.275619+0000","last_became_active":"2023-06-20T13:34:04.008690+0000","last_became_peered":"2023-06-20T13:34:04.008690+0000","last_unstale":"2023-06-20T13:34:06.275619+0000","last_undegraded":"2023-06-20T13:34:06.275619+0000","last_fullsized":"2023-06-20T13:34:06.275619+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:12:48.749776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275421+0000","last_change":"2023-06-20T13:32:13.978856+0000","last_active":"2023-06-20T13:34:06.275421+0000","last_peered":"2023-06-20T13:34:06.275421+0000","last_clean":"2023-06-20T13:34:06.275421+0000","last_became_active":"2023-06-20T13:32:13.978454+0000","last_became_peered":"2023-06-20T13:32:13.978454+0000","last_unstale":"2023-06-20T13:34:06.275421+0000","last_undegraded":"2023-06-20T13:34:06.275421+0000","last_fullsized":"2023-06-20T13:34:06.275421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:02:35.180276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":212,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275835+0000","last_change":"2023-06-20T13:32:06.907663+0000","last_active":"2023-06-20T13:34:06.275835+0000","last_peered":"2023-06-20T13:34:06.275835+0000","last_clean":"2023-06-20T13:34:06.275835+0000","last_became_active":"2023-06-20T13:32:06.906687+0000","last_became_peered":"2023-06-20T13:32:06.906687+0000","last_unstale":"2023-06-20T13:34:06.275835+0000","last_undegraded":"2023-06-20T13:34:06.275835+0000","last_fullsized":"2023-06-20T13:34:06.275835+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:05.521263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:05.521263+0000","last_clean_scrub_stamp":"2023-06-20T13:32:05.521263+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T01:22:00.666949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.276061+0000","last_change":"2023-06-20T13:34:05.283176+0000","last_active":"2023-06-20T13:34:06.276061+0000","last_peered":"2023-06-20T13:34:06.276061+0000","last_clean":"2023-06-20T13:34:06.276061+0000","last_became_active":"2023-06-20T13:34:05.282851+0000","last_became_peered":"2023-06-20T13:34:05.282851+0000","last_unstale":"2023-06-20T13:34:06.276061+0000","last_undegraded":"2023-06-20T13:34:06.276061+0000","last_fullsized":"2023-06-20T13:34:06.276061+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:12:49.752367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.278518+0000","last_change":"2023-06-20T13:34:04.011337+0000","last_active":"2023-06-20T13:34:05.278518+0000","last_peered":"2023-06-20T13:34:05.278518+0000","last_clean":"2023-06-20T13:34:05.278518+0000","last_became_active":"2023-06-20T13:34:04.011042+0000","last_became_peered":"2023-06-20T13:34:04.011042+0000","last_unstale":"2023-06-20T13:34:05.278518+0000","last_undegraded":"2023-06-20T13:34:05.278518+0000","last_fullsized":"2023-06-20T13:34:05.278518+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T18:41:10.832533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.275878+0000","last_change":"2023-06-20T13:32:13.977027+0000","last_active":"2023-06-20T13:34:06.275878+0000","last_peered":"2023-06-20T13:34:06.275878+0000","last_clean":"2023-06-20T13:34:06.275878+0000","last_became_active":"2023-06-20T13:32:13.975895+0000","last_became_peered":"2023-06-20T13:32:13.975895+0000","last_unstale":"2023-06-20T13:34:06.275878+0000","last_undegraded":"2023-06-20T13:34:06.275878+0000","last_fullsized":"2023-06-20T13:34:06.275878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:02:35.180276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.274947+0000","last_change":"2023-06-20T13:34:05.292678+0000","last_active":"2023-06-20T13:34:06.274947+0000","last_peered":"2023-06-20T13:34:06.274947+0000","last_clean":"2023-06-20T13:34:06.274947+0000","last_became_active":"2023-06-20T13:34:05.292365+0000","last_became_peered":"2023-06-20T13:34:05.292365+0000","last_unstale":"2023-06-20T13:34:06.274947+0000","last_undegraded":"2023-06-20T13:34:06.274947+0000","last_fullsized":"2023-06-20T13:34:06.274947+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T20:37:06.755037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.281088+0000","last_change":"2023-06-20T13:34:04.007188+0000","last_active":"2023-06-20T13:34:05.281088+0000","last_peered":"2023-06-20T13:34:05.281088+0000","last_clean":"2023-06-20T13:34:05.281088+0000","last_became_active":"2023-06-20T13:34:04.006894+0000","last_became_peered":"2023-06-20T13:34:04.006894+0000","last_unstale":"2023-06-20T13:34:05.281088+0000","last_undegraded":"2023-06-20T13:34:05.281088+0000","last_fullsized":"2023-06-20T13:34:05.281088+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:56:01.582835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.276261+0000","last_change":"2023-06-20T13:32:14.848215+0000","last_active":"2023-06-20T13:34:06.276261+0000","last_peered":"2023-06-20T13:34:06.276261+0000","last_clean":"2023-06-20T13:34:06.276261+0000","last_became_active":"2023-06-20T13:32:14.847950+0000","last_became_peered":"2023-06-20T13:32:14.847950+0000","last_unstale":"2023-06-20T13:34:06.276261+0000","last_undegraded":"2023-06-20T13:34:06.276261+0000","last_fullsized":"2023-06-20T13:34:06.276261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T01:22:50.221677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.303868+0000","last_change":"2023-06-20T13:34:05.285614+0000","last_active":"2023-06-20T13:34:05.303868+0000","last_peered":"2023-06-20T13:34:05.303868+0000","last_clean":"2023-06-20T13:34:05.303868+0000","last_became_active":"2023-06-20T13:34:05.285309+0000","last_became_peered":"2023-06-20T13:34:05.285309+0000","last_unstale":"2023-06-20T13:34:05.303868+0000","last_undegraded":"2023-06-20T13:34:05.303868+0000","last_fullsized":"2023-06-20T13:34:05.303868+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T21:10:57.756555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.275353+0000","last_change":"2023-06-20T13:34:04.011850+0000","last_active":"2023-06-20T13:34:05.275353+0000","last_peered":"2023-06-20T13:34:05.275353+0000","last_clean":"2023-06-20T13:34:05.275353+0000","last_became_active":"2023-06-20T13:34:04.011479+0000","last_became_peered":"2023-06-20T13:34:04.011479+0000","last_unstale":"2023-06-20T13:34:05.275353+0000","last_undegraded":"2023-06-20T13:34:05.275353+0000","last_fullsized":"2023-06-20T13:34:05.275353+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-21T22:28:31.382471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.281342+0000","last_change":"2023-06-20T13:32:13.978089+0000","last_active":"2023-06-20T13:34:05.281342+0000","last_peered":"2023-06-20T13:34:05.281342+0000","last_clean":"2023-06-20T13:34:05.281342+0000","last_became_active":"2023-06-20T13:32:13.977748+0000","last_became_peered":"2023-06-20T13:32:13.977748+0000","last_unstale":"2023-06-20T13:34:05.281342+0000","last_undegraded":"2023-06-20T13:34:05.281342+0000","last_fullsized":"2023-06-20T13:34:05.281342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:42:35.612303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.303365+0000","last_change":"2023-06-20T13:34:05.291732+0000","last_active":"2023-06-20T13:34:05.303365+0000","last_peered":"2023-06-20T13:34:05.303365+0000","last_clean":"2023-06-20T13:34:05.303365+0000","last_became_active":"2023-06-20T13:34:05.291471+0000","last_became_peered":"2023-06-20T13:34:05.291471+0000","last_unstale":"2023-06-20T13:34:05.303365+0000","last_undegraded":"2023-06-20T13:34:05.303365+0000","last_fullsized":"2023-06-20T13:34:05.303365+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:03.982303+0000","last_clean_scrub_stamp":"2023-06-20T13:34:03.982303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:18:31.586225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-20T13:34:06.276378+0000","last_change":"2023-06-20T13:34:04.003250+0000","last_active":"2023-06-20T13:34:06.276378+0000","last_peered":"2023-06-20T13:34:06.276378+0000","last_clean":"2023-06-20T13:34:06.276378+0000","last_became_active":"2023-06-20T13:34:04.002920+0000","last_became_peered":"2023-06-20T13:34:04.002920+0000","last_unstale":"2023-06-20T13:34:06.276378+0000","last_undegraded":"2023-06-20T13:34:06.276378+0000","last_fullsized":"2023-06-20T13:34:06.276378+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:34:02.979712+0000","last_clean_scrub_stamp":"2023-06-20T13:34:02.979712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:58:25.924475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-06-20T13:34:05.284030+0000","last_change":"2023-06-20T13:32:13.977875+0000","last_active":"2023-06-20T13:34:05.284030+0000","last_peered":"2023-06-20T13:34:05.284030+0000","last_clean":"2023-06-20T13:34:05.284030+0000","last_became_active":"2023-06-20T13:32:13.977589+0000","last_became_peered":"2023-06-20T13:32:13.977589+0000","last_unstale":"2023-06-20T13:34:05.284030+0000","last_undegraded":"2023-06-20T13:34:05.284030+0000","last_fullsized":"2023-06-20T13:34:05.284030+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-20T13:32:12.955902+0000","last_clean_scrub_stamp":"2023-06-20T13:32:12.955902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-22T00:07:46.842944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":1069056,"data_stored":802126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jun 20 13:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.60599999999999998}]},{"osd":1,"last update":"Tue Jun 20 13:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.51100000000000001}]},{"osd":2,"last update":"Tue Jun 20 13:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":4.4790000000000001,"5min":4.4790000000000001,"15min":4.4790000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":4.6829999999999998,"5min":4.6829999999999998,"15min":4.6829999999999998},"last":0.62}]},{"osd":3,"last update":"Tue Jun 20 13:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.77500000000000002}]},{"osd":4,"last update":"Tue Jun 20 13:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.64000000000000001}]},{"osd":5,"last update":"Tue Jun 20 13:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.66400000000000003}]},{"osd":6,"last update":"Tue Jun 20 13:33:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1,"5min":1,"15min":1},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.754}]}]},{"osd":6,"up_from":14,"seq":60129542171,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":205367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jun 20 13:33:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.6549999999999998,"5min":2.6549999999999998,"15min":2.6549999999999998},"last":0.58199999999999996}]},{"osd":1,"last update":"Tue Jun 20 13:33:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.626}]},{"osd":2,"last update":"Tue Jun 20 13:33:09 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.74099999999999999}]},{"osd":3,"last update":"Tue Jun 20 13:33:09 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.754}]},{"osd":4,"last update":"Tue Jun 20 13:33:09 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.68100000000000005}]},{"osd":5,"last update":"Tue Jun 20 13:33:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.79700000000000004}]},{"osd":7,"last update":"Tue Jun 20 13:33:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.81399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":446464,"data_stored":197247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jun 20 13:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.313},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.40600000000000003}]},{"osd":2,"last update":"Tue Jun 20 13:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.497}]},{"osd":3,"last update":"Tue Jun 20 13:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.41999999999999998}]},{"osd":4,"last update":"Tue Jun 20 13:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.58399999999999996}]},{"osd":5,"last update":"Tue Jun 20 13:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.626}]},{"osd":6,"last update":"Tue Jun 20 13:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.65900000000000003}]},{"osd":7,"last update":"Tue Jun 20 13:33:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.67500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":1040384,"data_stored":787615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jun 20 13:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":9.4719999999999995,"5min":9.4719999999999995,"15min":9.4719999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":9.2349999999999994,"5min":9.2349999999999994,"15min":9.2349999999999994},"last":0.33300000000000002}]},{"osd":2,"last update":"Tue Jun 20 13:33:04 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":20.012,"5min":20.012,"15min":20.012},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":0.36799999999999999}]},{"osd":3,"last update":"Tue Jun 20 13:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.497},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":9.5180000000000007,"5min":9.5180000000000007,"15min":9.5180000000000007},"last":0.48399999999999999}]},{"osd":4,"last update":"Tue Jun 20 13:33:09 2023","interfaces":[{"interface":"back","average":{"1min":1.639,"5min":1.639,"15min":1.639},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":19.945,"5min":19.945,"15min":19.945},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.73799999999999999}]},{"osd":5,"last update":"Tue Jun 20 13:33:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":3.9319999999999999,"5min":3.9319999999999999,"15min":3.9319999999999999},"last":0.81100000000000005}]},{"osd":6,"last update":"Tue Jun 20 13:33:09 2023","interfaces":[{"interface":"back","average":{"1min":1.671,"5min":1.671,"15min":1.671},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":19.98,"5min":19.98,"15min":19.98},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.76200000000000001}]},{"osd":7,"last update":"Tue Jun 20 13:33:09 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":3.895,"5min":3.895,"15min":3.895},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":19.902000000000001,"5min":19.902000000000001,"15min":19.902000000000001},"last":0.70799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":446464,"data_stored":197247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jun 20 13:33:05 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":16.605,"5min":16.605,"15min":16.605},"last":0.47199999999999998},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":11.242000000000001,"5min":11.242000000000001,"15min":11.242000000000001},"last":0.45400000000000001}]},{"osd":1,"last update":"Tue Jun 20 13:33:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":4.9630000000000001,"5min":4.9630000000000001,"15min":4.9630000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.536,"5min":2.536,"15min":2.536},"last":0.54600000000000004}]},{"osd":3,"last update":"Tue Jun 20 13:33:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":11.201000000000001,"5min":11.201000000000001,"15min":11.201000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":4.9989999999999997,"5min":4.9989999999999997,"15min":4.9989999999999997},"last":0.49099999999999999}]},{"osd":4,"last update":"Tue Jun 20 13:33:11 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":12.941000000000001,"5min":12.941000000000001,"15min":12.941000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":11.134,"5min":11.134,"15min":11.134},"last":0.75800000000000001}]},{"osd":5,"last update":"Tue Jun 20 13:33:11 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":4.8310000000000004,"5min":4.8310000000000004,"15min":4.8310000000000004},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":12.898,"5min":12.898,"15min":12.898},"last":0.747}]},{"osd":6,"last update":"Tue Jun 20 13:33:11 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.212,"15min":1.212},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":11.076000000000001,"5min":11.076000000000001,"15min":11.076000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":4.9249999999999998,"5min":4.9249999999999998,"15min":4.9249999999999998},"last":0.67600000000000005}]},{"osd":7,"last update":"Tue Jun 20 13:33:11 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":11.167999999999999,"5min":11.167999999999999,"15min":11.167999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":4.8849999999999998,"5min":4.8849999999999998,"15min":4.8849999999999998},"last":0.81699999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":446464,"data_stored":197247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jun 20 13:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.42799999999999999}]},{"osd":1,"last update":"Tue Jun 20 13:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.38800000000000001}]},{"osd":2,"last update":"Tue Jun 20 13:33:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.41699999999999998}]},{"osd":4,"last update":"Tue Jun 20 13:33:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.64900000000000002}]},{"osd":5,"last update":"Tue Jun 20 13:33:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.66200000000000003}]},{"osd":6,"last update":"Tue Jun 20 13:33:10 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.58699999999999997}]},{"osd":7,"last update":"Tue Jun 20 13:33:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.622},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.70799999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542171,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":471040,"data_stored":206259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jun 20 13:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":5.7009999999999996,"5min":5.7009999999999996,"15min":5.7009999999999996},"last":0.755}]},{"osd":1,"last update":"Tue Jun 20 13:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.74399999999999999}]},{"osd":2,"last update":"Tue Jun 20 13:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":6.6059999999999999,"5min":6.6059999999999999,"15min":6.6059999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.82999999999999996}]},{"osd":3,"last update":"Tue Jun 20 13:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.72799999999999998}]},{"osd":5,"last update":"Tue Jun 20 13:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.623},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.55500000000000005}]},{"osd":6,"last update":"Tue Jun 20 13:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.80500000000000005}]},{"osd":7,"last update":"Tue Jun 20 13:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.58199999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542171,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":462848,"data_stored":204765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jun 20 13:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.53400000000000003}]},{"osd":1,"last update":"Tue Jun 20 13:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.627},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.78600000000000003}]},{"osd":2,"last update":"Tue Jun 20 13:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.68000000000000005}]},{"osd":3,"last update":"Tue Jun 20 13:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.74199999999999999}]},{"osd":4,"last update":"Tue Jun 20 13:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.82799999999999996}]},{"osd":6,"last update":"Tue Jun 20 13:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.93500000000000005}]},{"osd":7,"last update":"Tue Jun 20 13:33:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.86499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-20T13:34:10.204 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-20T13:34:10.204 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-06-20T13:34:10.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.444+0000 7f690cfff700 1 Processor -- start 2023-06-20T13:34:10.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.445+0000 7f690cfff700 1 -- start start 2023-06-20T13:34:10.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.446+0000 7f690cfff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f69080d3730 0x7f69080cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:10.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.446+0000 7f690cfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69080cfa90 0x7f69080d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:10.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.446+0000 7f690cfff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69080d0b20 con 0x7f69080b8430 2023-06-20T13:34:10.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.446+0000 7f690cfff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69080cda30 con 0x7f69080d3730 2023-06-20T13:34:10.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.446+0000 7f690cfff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69080b8800 con 0x7f69080cfa90 2023-06-20T13:34:10.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.446+0000 7f690659c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f69080b8430 0x7f69080cd320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38952/0 (socket says 172.21.15.32:38952) 2023-06-20T13:34:10.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.446+0000 7f690659c700 1 -- 172.21.15.32:0/3494862660 learned_addr learned my addr 172.21.15.32:0/3494862660 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:34:10.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.446+0000 7f68fffff700 1 --2- 172.21.15.32:0/3494862660 >> v2:172.21.15.32:3300/0 conn(0x7f69080d3730 0x7f69080cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:10.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.446+0000 7f6906d9d700 1 --2- 172.21.15.32:0/3494862660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69080cfa90 0x7f69080d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:10.450 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.446+0000 7f6905d9b700 1 -- 172.21.15.32:0/3494862660 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 383368412 0 0) 0x7f69080d0b20 con 0x7f69080b8430 2023-06-20T13:34:10.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.446+0000 7f6905d9b700 1 -- 172.21.15.32:0/3494862660 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68f40035b0 con 0x7f69080b8430 2023-06-20T13:34:10.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.447+0000 7f68fffff700 1 -- 172.21.15.32:0/3494862660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69080cfa90 msgr2=0x7f69080d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:10.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.447+0000 7f68fffff700 1 --2- 172.21.15.32:0/3494862660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69080cfa90 0x7f69080d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:10.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.447+0000 7f68fffff700 1 -- 172.21.15.32:0/3494862660 >> v1:172.21.15.32:6789/0 conn(0x7f69080b8430 legacy=0x7f69080cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:10.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.447+0000 7f68fffff700 1 -- 172.21.15.32:0/3494862660 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69080cfeb0 con 0x7f69080d3730 2023-06-20T13:34:10.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.447+0000 7f68fffff700 1 --2- 172.21.15.32:0/3494862660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69080d3730 0x7f69080cf550 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f68f0009840 tx=0x7f68f0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa54a8748eaf0b15 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:10.451 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.447+0000 7f6905d9b700 1 -- 172.21.15.32:0/3494862660 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f0011830 con 0x7f69080d3730 2023-06-20T13:34:10.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.447+0000 7f6905d9b700 1 -- 172.21.15.32:0/3494862660 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f0011990 con 0x7f69080d3730 2023-06-20T13:34:10.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.447+0000 7f6905d9b700 1 -- 172.21.15.32:0/3494862660 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f0011d20 con 0x7f69080d3730 2023-06-20T13:34:10.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.448+0000 7f690cfff700 1 -- 172.21.15.32:0/3494862660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69080d3730 msgr2=0x7f69080cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:10.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.448+0000 7f690cfff700 1 --2- 172.21.15.32:0/3494862660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69080d3730 0x7f69080cf550 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f68f0009840 tx=0x7f68f0009b50 comp rx=0 tx=0).stop 2023-06-20T13:34:10.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.448+0000 7f690cfff700 1 -- 172.21.15.32:0/3494862660 shutdown_connections 2023-06-20T13:34:10.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.448+0000 7f690cfff700 1 --2- 172.21.15.32:0/3494862660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69080cfa90 0x7f69080d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:10.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.448+0000 7f690cfff700 1 --2- 172.21.15.32:0/3494862660 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69080d3730 0x7f69080cf550 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:10.452 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.448+0000 7f690cfff700 1 -- 172.21.15.32:0/3494862660 >> 172.21.15.32:0/3494862660 conn(0x7f690806b3f0 msgr2=0x7f690806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:10.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.448+0000 7f690cfff700 1 -- 172.21.15.32:0/3494862660 shutdown_connections 2023-06-20T13:34:10.453 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.448+0000 7f690cfff700 1 -- 172.21.15.32:0/3494862660 wait complete. 2023-06-20T13:34:10.454 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.450+0000 7f690cfff700 1 Processor -- start 2023-06-20T13:34:10.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.450+0000 7f690cfff700 1 -- start start 2023-06-20T13:34:10.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.451+0000 7f690cfff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69080b8430 0x7f69080b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:10.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.451+0000 7f690cfff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69080cfa90 0x7f69080b72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:10.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.451+0000 7f690cfff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69080d3730 0x7f690815c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:10.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.451+0000 7f690cfff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69080c8600 con 0x7f69080b8430 2023-06-20T13:34:10.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.451+0000 7f690cfff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69081f1a00 con 0x7f69080d3730 2023-06-20T13:34:10.455 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.451+0000 7f690cfff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69080c79f0 con 0x7f69080cfa90 2023-06-20T13:34:10.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.451+0000 7f690659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69080b8430 0x7f69080b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:10.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.451+0000 7f690659c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69080b8430 0x7f69080b6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39684/0 (socket says 172.21.15.32:39684) 2023-06-20T13:34:10.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.451+0000 7f690659c700 1 -- 172.21.15.32:0/2082790494 learned_addr learned my addr 172.21.15.32:0/2082790494 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:10.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.451+0000 7f68fffff700 1 --2- 172.21.15.32:0/2082790494 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69080cfa90 0x7f69080b72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:10.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.451+0000 7f6906d9d700 1 --2- 172.21.15.32:0/2082790494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69080d3730 0x7f690815c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:10.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.451+0000 7f690659c700 1 -- 172.21.15.32:0/2082790494 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69080cfa90 msgr2=0x7f69080b72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:10.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.451+0000 7f690659c700 1 --2- 172.21.15.32:0/2082790494 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69080cfa90 0x7f69080b72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:10.456 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.451+0000 7f690659c700 1 -- 172.21.15.32:0/2082790494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69080d3730 msgr2=0x7f690815c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:10.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.451+0000 7f690659c700 1 --2- 172.21.15.32:0/2082790494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69080d3730 0x7f690815c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:10.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.451+0000 7f690659c700 1 -- 172.21.15.32:0/2082790494 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f00094a0 con 0x7f69080b8430 2023-06-20T13:34:10.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.452+0000 7f690659c700 1 --2- 172.21.15.32:0/2082790494 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69080b8430 0x7f69080b6d90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f68f800c700 tx=0x7f68f800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:10.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.452+0000 7f68feffd700 1 -- 172.21.15.32:0/2082790494 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f8005d70 con 0x7f69080b8430 2023-06-20T13:34:10.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.452+0000 7f68feffd700 1 -- 172.21.15.32:0/2082790494 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f80070d0 con 0x7f69080b8430 2023-06-20T13:34:10.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.452+0000 7f68feffd700 1 -- 172.21.15.32:0/2082790494 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f8007440 con 0x7f69080b8430 2023-06-20T13:34:10.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.452+0000 7f690cfff700 1 -- 172.21.15.32:0/2082790494 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69080c7cd0 con 0x7f69080b8430 2023-06-20T13:34:10.457 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.452+0000 7f690cfff700 1 -- 172.21.15.32:0/2082790494 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69080c8290 con 0x7f69080b8430 2023-06-20T13:34:10.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.453+0000 7f690cfff700 1 -- 172.21.15.32:0/2082790494 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f690804ea60 con 0x7f69080b8430 2023-06-20T13:34:10.458 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.454+0000 7f68feffd700 1 -- 172.21.15.32:0/2082790494 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f68f80075a0 con 0x7f69080b8430 2023-06-20T13:34:10.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.455+0000 7f68feffd700 1 --2- 172.21.15.32:0/2082790494 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f68e806ace0 0x7f68e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:10.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.455+0000 7f68feffd700 1 -- 172.21.15.32:0/2082790494 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f68f8088a00 con 0x7f69080b8430 2023-06-20T13:34:10.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.455+0000 7f68fffff700 1 --2- 172.21.15.32:0/2082790494 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f68e806ace0 0x7f68e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:10.459 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.456+0000 7f68fffff700 1 --2- 172.21.15.32:0/2082790494 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f68e806ace0 0x7f68e806d190 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f68f0000c00 tx=0x7f68f001c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:10.461 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.459+0000 7f68feffd700 1 -- 172.21.15.32:0/2082790494 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f68f8053980 con 0x7f69080b8430 2023-06-20T13:34:10.750 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.748+0000 7f690cfff700 1 -- 172.21.15.32:0/2082790494 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f69080b1eb0 con 0x7f69080b8430 2023-06-20T13:34:10.754 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.752+0000 7f68feffd700 1 -- 172.21.15.32:0/2082790494 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7f68f8056fa0 con 0x7f69080b8430 2023-06-20T13:34:10.757 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.754+0000 7f690cfff700 1 -- 172.21.15.32:0/2082790494 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f68e806ace0 msgr2=0x7f68e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:10.757 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.754+0000 7f690cfff700 1 --2- 172.21.15.32:0/2082790494 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f68e806ace0 0x7f68e806d190 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f68f0000c00 tx=0x7f68f001c040 comp rx=0 tx=0).stop 2023-06-20T13:34:10.757 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.754+0000 7f690cfff700 1 -- 172.21.15.32:0/2082790494 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69080b8430 msgr2=0x7f69080b6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:10.757 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.754+0000 7f690cfff700 1 --2- 172.21.15.32:0/2082790494 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69080b8430 0x7f69080b6d90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f68f800c700 tx=0x7f68f800ca10 comp rx=0 tx=0).stop 2023-06-20T13:34:10.758 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.755+0000 7f690cfff700 1 -- 172.21.15.32:0/2082790494 shutdown_connections 2023-06-20T13:34:10.758 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.755+0000 7f690cfff700 1 --2- 172.21.15.32:0/2082790494 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f68e806ace0 0x7f68e806d190 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:10.758 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.755+0000 7f690cfff700 1 --2- 172.21.15.32:0/2082790494 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f69080d3730 0x7f690815c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:10.758 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.755+0000 7f690cfff700 1 --2- 172.21.15.32:0/2082790494 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f69080b8430 0x7f69080b6d90 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:10.758 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.755+0000 7f690cfff700 1 --2- 172.21.15.32:0/2082790494 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f69080cfa90 0x7f69080b72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:10.758 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.755+0000 7f690cfff700 1 -- 172.21.15.32:0/2082790494 >> 172.21.15.32:0/2082790494 conn(0x7f690806b3f0 msgr2=0x7f69080d1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:10.758 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.755+0000 7f690cfff700 1 -- 172.21.15.32:0/2082790494 shutdown_connections 2023-06-20T13:34:10.759 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.755+0000 7f690cfff700 1 -- 172.21.15.32:0/2082790494 wait complete. 2023-06-20T13:34:10.759 INFO:teuthology.orchestra.run.smithi032.stderr:updated caps for client.0 2023-06-20T13:34:10.775 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-20T13:34:10.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.973+0000 7f12399ff700 1 Processor -- start 2023-06-20T13:34:10.975 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.973+0000 7f12399ff700 1 -- start start 2023-06-20T13:34:10.976 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.974+0000 7f12399ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f123415c460 0x7f12340b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:10.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.974+0000 7f12399ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12340d2640 0x7f12340cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:10.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.974+0000 7f12399ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12340d1790 con 0x7f12340cf720 2023-06-20T13:34:10.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.974+0000 7f12399ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12340cedd0 con 0x7f123415c460 2023-06-20T13:34:10.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.974+0000 7f12399ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12340cd950 con 0x7f12340d2640 2023-06-20T13:34:10.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.974+0000 7f1232ffd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f123415c460 0x7f12340b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:10.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.975+0000 7f1232ffd700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f123415c460 0x7f12340b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39694/0 (socket says 172.21.15.32:39694) 2023-06-20T13:34:10.977 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.975+0000 7f1232ffd700 1 -- 172.21.15.32:0/1579152466 learned_addr learned my addr 172.21.15.32:0/1579152466 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:10.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.975+0000 7f12327fc700 1 --2- 172.21.15.32:0/1579152466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12340d2640 0x7f12340cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:10.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.975+0000 7f1232ffd700 1 -- 172.21.15.32:0/1579152466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12340d2640 msgr2=0x7f12340cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:10.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.975+0000 7f1232ffd700 1 --2- 172.21.15.32:0/1579152466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12340d2640 0x7f12340cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:10.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.975+0000 7f1232ffd700 1 -- 172.21.15.32:0/1579152466 >> v1:172.21.15.115:6789/0 conn(0x7f12340cf720 legacy=0x7f12340d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:10.979 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.975+0000 7f1232ffd700 1 -- 172.21.15.32:0/1579152466 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12340d14b0 con 0x7f123415c460 2023-06-20T13:34:10.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.975+0000 7f12327fc700 1 --2- 172.21.15.32:0/1579152466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12340d2640 0x7f12340cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:34:10.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.975+0000 7f1232ffd700 1 --2- 172.21.15.32:0/1579152466 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f123415c460 0x7f12340b59d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f12240098f0 tx=0x7f1224009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db48b9a99a11c57 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:10.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.976+0000 7f1231ffb700 1 -- 172.21.15.32:0/1579152466 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122400b8a0 con 0x7f123415c460 2023-06-20T13:34:10.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.976+0000 7f1231ffb700 1 -- 172.21.15.32:0/1579152466 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122400ba00 con 0x7f123415c460 2023-06-20T13:34:10.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.976+0000 7f1231ffb700 1 -- 172.21.15.32:0/1579152466 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122400bd90 con 0x7f123415c460 2023-06-20T13:34:10.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.976+0000 7f12399ff700 1 -- 172.21.15.32:0/1579152466 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f123415c460 msgr2=0x7f12340b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:10.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.976+0000 7f12399ff700 1 --2- 172.21.15.32:0/1579152466 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f123415c460 0x7f12340b59d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f12240098f0 tx=0x7f1224009c00 comp rx=0 tx=0).stop 2023-06-20T13:34:10.980 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.976+0000 7f12399ff700 1 -- 172.21.15.32:0/1579152466 shutdown_connections 2023-06-20T13:34:10.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.976+0000 7f12399ff700 1 --2- 172.21.15.32:0/1579152466 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f123415c460 0x7f12340b59d0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:10.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.976+0000 7f12399ff700 1 --2- 172.21.15.32:0/1579152466 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12340d2640 0x7f12340cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:10.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.976+0000 7f12399ff700 1 -- 172.21.15.32:0/1579152466 >> 172.21.15.32:0/1579152466 conn(0x7f1234071660 msgr2=0x7f1234071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:10.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.976+0000 7f12399ff700 1 -- 172.21.15.32:0/1579152466 shutdown_connections 2023-06-20T13:34:10.981 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.976+0000 7f12399ff700 1 -- 172.21.15.32:0/1579152466 wait complete. 2023-06-20T13:34:10.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.978+0000 7f12399ff700 1 Processor -- start 2023-06-20T13:34:10.983 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.978+0000 7f12399ff700 1 -- start start 2023-06-20T13:34:10.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.979+0000 7f12399ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12340cf720 0x7f12340cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:10.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.979+0000 7f12399ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12340d2640 0x7f123414d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:10.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.979+0000 7f12399ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f123415c460 0x7f12340cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:10.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.979+0000 7f12399ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12340cad60 con 0x7f12340d2640 2023-06-20T13:34:10.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.979+0000 7f12399ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12340ca0e0 con 0x7f123415c460 2023-06-20T13:34:10.984 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.979+0000 7f12399ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12340ca3c0 con 0x7f12340cf720 2023-06-20T13:34:10.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.979+0000 7f12327fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12340d2640 0x7f123414d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:10.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.979+0000 7f12327fc700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12340d2640 0x7f123414d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39710/0 (socket says 172.21.15.32:39710) 2023-06-20T13:34:10.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.979+0000 7f12327fc700 1 -- 172.21.15.32:0/2815260942 learned_addr learned my addr 172.21.15.32:0/2815260942 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:10.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.980+0000 7f1232ffd700 1 --2- 172.21.15.32:0/2815260942 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12340cf720 0x7f12340cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:10.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.980+0000 7f12337fe700 1 --2- 172.21.15.32:0/2815260942 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f123415c460 0x7f12340cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:10.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.980+0000 7f12327fc700 1 -- 172.21.15.32:0/2815260942 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12340cf720 msgr2=0x7f12340cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:10.985 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.980+0000 7f12327fc700 1 --2- 172.21.15.32:0/2815260942 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12340cf720 0x7f12340cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:10.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.980+0000 7f12327fc700 1 -- 172.21.15.32:0/2815260942 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f123415c460 msgr2=0x7f12340cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:10.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.980+0000 7f12327fc700 1 --2- 172.21.15.32:0/2815260942 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f123415c460 0x7f12340cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:10.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.980+0000 7f12327fc700 1 -- 172.21.15.32:0/2815260942 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1224009550 con 0x7f12340d2640 2023-06-20T13:34:10.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.980+0000 7f12327fc700 1 --2- 172.21.15.32:0/2815260942 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12340d2640 0x7f123414d950 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f122800c7f0 tx=0x7f122800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:10.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.980+0000 7f121bfff700 1 -- 172.21.15.32:0/2815260942 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1228011800 con 0x7f12340d2640 2023-06-20T13:34:10.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.980+0000 7f121bfff700 1 -- 172.21.15.32:0/2815260942 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1228011960 con 0x7f12340d2640 2023-06-20T13:34:10.986 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.980+0000 7f12399ff700 1 -- 172.21.15.32:0/2815260942 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12340ca6a0 con 0x7f12340d2640 2023-06-20T13:34:10.987 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.980+0000 7f121bfff700 1 -- 172.21.15.32:0/2815260942 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1228011cf0 con 0x7f12340d2640 2023-06-20T13:34:10.987 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.980+0000 7f12399ff700 1 -- 172.21.15.32:0/2815260942 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123414de90 con 0x7f12340d2640 2023-06-20T13:34:10.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.981+0000 7f12399ff700 1 -- 172.21.15.32:0/2815260942 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123404ea60 con 0x7f12340d2640 2023-06-20T13:34:10.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.982+0000 7f121bfff700 1 -- 172.21.15.32:0/2815260942 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1228018360 con 0x7f12340d2640 2023-06-20T13:34:10.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.983+0000 7f121bfff700 1 --2- 172.21.15.32:0/2815260942 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f122006ace0 0x7f122006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:10.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.983+0000 7f121bfff700 1 -- 172.21.15.32:0/2815260942 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1228089580 con 0x7f12340d2640 2023-06-20T13:34:10.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.984+0000 7f1232ffd700 1 --2- 172.21.15.32:0/2815260942 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f122006ace0 0x7f122006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:10.988 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.984+0000 7f1232ffd700 1 --2- 172.21.15.32:0/2815260942 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f122006ace0 0x7f122006d190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1224000c00 tx=0x7f1224008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:10.989 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:10.988+0000 7f121bfff700 1 -- 172.21.15.32:0/2815260942 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1228054460 con 0x7f12340d2640 2023-06-20T13:34:11.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.238+0000 7f12399ff700 1 -- 172.21.15.32:0/2815260942 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12340b4fa0 con 0x7f12340d2640 2023-06-20T13:34:11.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.238+0000 7f121bfff700 1 -- 172.21.15.32:0/2815260942 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f1228057a80 con 0x7f12340d2640 2023-06-20T13:34:11.241 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:34:11.241 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5308,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6836/1522872006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6834","nonce":1522872006},{"type":"v1","addr":"172.21.15.32:6836","nonce":1522872006}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5311,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6834/2159621980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6833","nonce":2159621980},{"type":"v1","addr":"172.21.15.115:6834","nonce":2159621980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5379,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.32:6837/301179143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6835","nonce":301179143},{"type":"v1","addr":"172.21.15.32:6837","nonce":301179143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-20T13:34:04.509058+0000","modified":"2023-06-20T13:34:08.288860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5382},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5382":{"gid":5382,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6835/1096571469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":1096571469},{"type":"v1","addr":"172.21.15.115:6835","nonce":1096571469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-20T13:34:11.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.241+0000 7f12399ff700 1 -- 172.21.15.32:0/2815260942 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f122006ace0 msgr2=0x7f122006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:11.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.241+0000 7f12399ff700 1 --2- 172.21.15.32:0/2815260942 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f122006ace0 0x7f122006d190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1224000c00 tx=0x7f1224008030 comp rx=0 tx=0).stop 2023-06-20T13:34:11.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.241+0000 7f12399ff700 1 -- 172.21.15.32:0/2815260942 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12340d2640 msgr2=0x7f123414d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:11.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.241+0000 7f12399ff700 1 --2- 172.21.15.32:0/2815260942 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12340d2640 0x7f123414d950 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f122800c7f0 tx=0x7f122800cb00 comp rx=0 tx=0).stop 2023-06-20T13:34:11.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.241+0000 7f12399ff700 1 -- 172.21.15.32:0/2815260942 shutdown_connections 2023-06-20T13:34:11.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.241+0000 7f12399ff700 1 --2- 172.21.15.32:0/2815260942 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f122006ace0 0x7f122006d190 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.241+0000 7f12399ff700 1 --2- 172.21.15.32:0/2815260942 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f123415c460 0x7f12340cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.241+0000 7f12399ff700 1 --2- 172.21.15.32:0/2815260942 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f12340cf720 0x7f12340cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.241+0000 7f12399ff700 1 --2- 172.21.15.32:0/2815260942 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f12340d2640 0x7f123414d950 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.241+0000 7f12399ff700 1 -- 172.21.15.32:0/2815260942 >> 172.21.15.32:0/2815260942 conn(0x7f1234071660 msgr2=0x7f123415c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:11.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.241+0000 7f12399ff700 1 -- 172.21.15.32:0/2815260942 shutdown_connections 2023-06-20T13:34:11.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.241+0000 7f12399ff700 1 -- 172.21.15.32:0/2815260942 wait complete. 2023-06-20T13:34:11.246 INFO:teuthology.orchestra.run.smithi032.stderr:dumped fsmap epoch 17 2023-06-20T13:34:11.664 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-20T13:34:04.509058+0000', 'modified': '2023-06-20T13:34:08.288860+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5382}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5382': {'gid': 5382, 'name': 'd', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.115:6835/1096571469', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6832', 'nonce': 1096571469}, {'type': 'v1', 'addr': '172.21.15.115:6835', 'nonce': 1096571469}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-20T13:34:11.665 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-20T13:34:11.665 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-06-20T13:34:11.868 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.866+0000 7fafeb3ff700 1 Processor -- start 2023-06-20T13:34:11.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.866+0000 7fafeb3ff700 1 -- start start 2023-06-20T13:34:11.869 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.867+0000 7fafeb3ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fafe40d2640 0x7fafe40b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:11.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.867+0000 7fafeb3ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fafe40cf8f0 0x7fafe415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:11.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.867+0000 7fafeb3ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe40d1790 con 0x7fafe415c460 2023-06-20T13:34:11.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.867+0000 7fafeb3ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe40cedd0 con 0x7fafe40d2640 2023-06-20T13:34:11.870 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.867+0000 7fafeb3ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe40cd950 con 0x7fafe40cf8f0 2023-06-20T13:34:11.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.868+0000 7fafe899a700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7fafe40d2640 0x7fafe40b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:11.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.868+0000 7fafe919b700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fafe415c460 0x7fafe40cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38962/0 (socket says 172.21.15.32:38962) 2023-06-20T13:34:11.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.868+0000 7fafe919b700 1 -- 172.21.15.32:0/1956108988 learned_addr learned my addr 172.21.15.32:0/1956108988 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:34:11.872 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.868+0000 7fafe999c700 1 --2- 172.21.15.32:0/1956108988 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fafe40cf8f0 0x7fafe415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:11.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.868+0000 7fafe899a700 1 -- 172.21.15.32:0/1956108988 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fafe40cf8f0 msgr2=0x7fafe415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:11.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.868+0000 7fafe899a700 1 --2- 172.21.15.32:0/1956108988 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fafe40cf8f0 0x7fafe415fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.868+0000 7fafe899a700 1 -- 172.21.15.32:0/1956108988 >> v1:172.21.15.32:6789/0 conn(0x7fafe415c460 legacy=0x7fafe40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:11.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.868+0000 7fafe899a700 1 -- 172.21.15.32:0/1956108988 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe40d14b0 con 0x7fafe40d2640 2023-06-20T13:34:11.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.868+0000 7fafdbfff700 1 -- 172.21.15.32:0/1956108988 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2385169325 0 0) 0x7fafe40d1790 con 0x7fafe415c460 2023-06-20T13:34:11.873 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.869+0000 7fafe899a700 1 --2- 172.21.15.32:0/1956108988 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fafe40d2640 0x7fafe40b59d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fafd4009840 tx=0x7fafd4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5395472d8c9437fc server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:11.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.869+0000 7fafdbfff700 1 -- 172.21.15.32:0/1956108988 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd4011830 con 0x7fafe40d2640 2023-06-20T13:34:11.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.869+0000 7fafdbfff700 1 -- 172.21.15.32:0/1956108988 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd4011990 con 0x7fafe40d2640 2023-06-20T13:34:11.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.869+0000 7fafdbfff700 1 -- 172.21.15.32:0/1956108988 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd4011d20 con 0x7fafe40d2640 2023-06-20T13:34:11.874 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.869+0000 7fafeb3ff700 1 -- 172.21.15.32:0/1956108988 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fafe40d2640 msgr2=0x7fafe40b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:11.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.869+0000 7fafeb3ff700 1 --2- 172.21.15.32:0/1956108988 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fafe40d2640 0x7fafe40b59d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fafd4009840 tx=0x7fafd4009b50 comp rx=0 tx=0).stop 2023-06-20T13:34:11.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.869+0000 7fafeb3ff700 1 -- 172.21.15.32:0/1956108988 shutdown_connections 2023-06-20T13:34:11.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.869+0000 7fafeb3ff700 1 --2- 172.21.15.32:0/1956108988 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fafe40cf8f0 0x7fafe415fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.869+0000 7fafeb3ff700 1 --2- 172.21.15.32:0/1956108988 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fafe40d2640 0x7fafe40b59d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.875 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.869+0000 7fafeb3ff700 1 -- 172.21.15.32:0/1956108988 >> 172.21.15.32:0/1956108988 conn(0x7fafe4071660 msgr2=0x7fafe4071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:11.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.869+0000 7fafeb3ff700 1 -- 172.21.15.32:0/1956108988 shutdown_connections 2023-06-20T13:34:11.876 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.870+0000 7fafeb3ff700 1 -- 172.21.15.32:0/1956108988 wait complete. 2023-06-20T13:34:11.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.871+0000 7fafeb3ff700 1 Processor -- start 2023-06-20T13:34:11.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.871+0000 7fafeb3ff700 1 -- start start 2023-06-20T13:34:11.878 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.872+0000 7fafeb3ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fafe40cf8f0 0x7fafe415b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:11.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.872+0000 7fafeb3ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fafe40d2640 0x7fafe4158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:11.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.872+0000 7fafeb3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fafe415c460 0x7fafe414a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:11.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.872+0000 7fafeb3ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe41592c0 con 0x7fafe40cf8f0 2023-06-20T13:34:11.879 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.872+0000 7fafeb3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe41595a0 con 0x7fafe415c460 2023-06-20T13:34:11.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.872+0000 7fafeb3ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe4159880 con 0x7fafe40d2640 2023-06-20T13:34:11.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.873+0000 7fafe919b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fafe40cf8f0 0x7fafe415b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:11.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.873+0000 7fafe919b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fafe40cf8f0 0x7fafe415b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39730/0 (socket says 172.21.15.32:39730) 2023-06-20T13:34:11.880 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.873+0000 7fafe919b700 1 -- 172.21.15.32:0/3896999587 learned_addr learned my addr 172.21.15.32:0/3896999587 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:11.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.873+0000 7fafe999c700 1 --2- 172.21.15.32:0/3896999587 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fafe415c460 0x7fafe414a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:11.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.873+0000 7fafe899a700 1 --2- 172.21.15.32:0/3896999587 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fafe40d2640 0x7fafe4158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:11.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.873+0000 7fafe919b700 1 -- 172.21.15.32:0/3896999587 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fafe40d2640 msgr2=0x7fafe4158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:11.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.873+0000 7fafe919b700 1 --2- 172.21.15.32:0/3896999587 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fafe40d2640 0x7fafe4158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.873+0000 7fafe919b700 1 -- 172.21.15.32:0/3896999587 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fafe415c460 msgr2=0x7fafe414a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:11.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.873+0000 7fafe919b700 1 --2- 172.21.15.32:0/3896999587 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fafe415c460 0x7fafe414a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.873+0000 7fafe919b700 1 -- 172.21.15.32:0/3896999587 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd40094a0 con 0x7fafe40cf8f0 2023-06-20T13:34:11.881 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.873+0000 7fafe999c700 1 --2- 172.21.15.32:0/3896999587 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fafe415c460 0x7fafe414a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:34:11.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.873+0000 7fafe899a700 1 --2- 172.21.15.32:0/3896999587 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fafe40d2640 0x7fafe4158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:34:11.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.873+0000 7fafe919b700 1 --2- 172.21.15.32:0/3896999587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fafe40cf8f0 0x7fafe415b270 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fafe000c550 tx=0x7fafe000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:11.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.873+0000 7fafd9ffb700 1 -- 172.21.15.32:0/3896999587 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe0004c80 con 0x7fafe40cf8f0 2023-06-20T13:34:11.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.874+0000 7fafd9ffb700 1 -- 172.21.15.32:0/3896999587 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe0004e00 con 0x7fafe40cf8f0 2023-06-20T13:34:11.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.874+0000 7fafeb3ff700 1 -- 172.21.15.32:0/3896999587 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe4159b60 con 0x7fafe40cf8f0 2023-06-20T13:34:11.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.874+0000 7fafd9ffb700 1 -- 172.21.15.32:0/3896999587 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe0007310 con 0x7fafe40cf8f0 2023-06-20T13:34:11.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.874+0000 7fafeb3ff700 1 -- 172.21.15.32:0/3896999587 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe415a360 con 0x7fafe40cf8f0 2023-06-20T13:34:11.882 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.876+0000 7fafd9ffb700 1 -- 172.21.15.32:0/3896999587 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fafe0007470 con 0x7fafe40cf8f0 2023-06-20T13:34:11.885 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.877+0000 7fafd9ffb700 1 --2- 172.21.15.32:0/3896999587 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fafc806ace0 0x7fafc806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:11.885 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.877+0000 7fafd9ffb700 1 -- 172.21.15.32:0/3896999587 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fafe00892e0 con 0x7fafe40cf8f0 2023-06-20T13:34:11.885 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.877+0000 7fafe899a700 1 --2- 172.21.15.32:0/3896999587 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fafc806ace0 0x7fafc806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:11.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.878+0000 7fafe899a700 1 --2- 172.21.15.32:0/3896999587 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fafc806ace0 0x7fafc806d190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fafd40090b0 tx=0x7fafd401c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:11.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.879+0000 7faffedcab80 1 Processor -- start 2023-06-20T13:34:11.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.879+0000 7faffedcab80 1 -- start start 2023-06-20T13:34:11.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.879+0000 7faffedcab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fe6ba3f320 0x55fe6ba3f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:11.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.880+0000 7faffedcab80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55fe6ba126d0 0x55fe6ba15500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:11.886 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.880+0000 7faffedcab80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fe6ba105b0 0x55fe6ba3c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:11.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.880+0000 7faffedcab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe6b989ea0 con 0x55fe6ba3f320 2023-06-20T13:34:11.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.880+0000 7faffedcab80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe6b8fd600 con 0x55fe6ba105b0 2023-06-20T13:34:11.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.880+0000 7faffedcab80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fe6b96c910 con 0x55fe6ba126d0 2023-06-20T13:34:11.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.880+0000 7fafe919b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fe6ba3f320 0x55fe6ba3f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:11.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.880+0000 7fafe919b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fe6ba3f320 0x55fe6ba3f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39738/0 (socket says 172.21.15.32:39738) 2023-06-20T13:34:11.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.880+0000 7fafe919b700 1 -- 172.21.15.32:0/3896887019 learned_addr learned my addr 172.21.15.32:0/3896887019 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:11.887 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.880+0000 7fafe999c700 1 --2- 172.21.15.32:0/3896887019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fe6ba105b0 0x55fe6ba3c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:11.888 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.880+0000 7fafe899a700 1 --2- 172.21.15.32:0/3896887019 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55fe6ba126d0 0x55fe6ba15500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:11.888 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.880+0000 7fafe919b700 1 -- 172.21.15.32:0/3896887019 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55fe6ba126d0 msgr2=0x55fe6ba15500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:11.888 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.880+0000 7fafe919b700 1 --2- 172.21.15.32:0/3896887019 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55fe6ba126d0 0x55fe6ba15500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.888 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.880+0000 7fafe919b700 1 -- 172.21.15.32:0/3896887019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fe6ba105b0 msgr2=0x55fe6ba3c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:11.888 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.880+0000 7fafe919b700 1 --2- 172.21.15.32:0/3896887019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fe6ba105b0 0x55fe6ba3c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.888 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.880+0000 7fafe919b700 1 -- 172.21.15.32:0/3896887019 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe6b759790 con 0x55fe6ba3f320 2023-06-20T13:34:11.889 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.880+0000 7fafe919b700 1 --2- 172.21.15.32:0/3896887019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fe6ba3f320 0x55fe6ba3f6f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fafe0001eb0 tx=0x7fafe0057b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bcd39702db79a9a server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:11.889 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.881+0000 7fafceffd700 1 -- 172.21.15.32:0/3896887019 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe00890d0 con 0x55fe6ba3f320 2023-06-20T13:34:11.889 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.881+0000 7fafceffd700 1 -- 172.21.15.32:0/3896887019 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe00562a0 con 0x55fe6ba3f320 2023-06-20T13:34:11.889 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.881+0000 7fafceffd700 1 -- 172.21.15.32:0/3896887019 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe00575f0 con 0x55fe6ba3f320 2023-06-20T13:34:11.889 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.881+0000 7faffedcab80 1 -- 172.21.15.32:0/3896887019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fe6ba3f320 msgr2=0x55fe6ba3f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:11.889 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.881+0000 7faffedcab80 1 --2- 172.21.15.32:0/3896887019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fe6ba3f320 0x55fe6ba3f6f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fafe0001eb0 tx=0x7fafe0057b40 comp rx=0 tx=0).stop 2023-06-20T13:34:11.889 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.881+0000 7faffedcab80 1 -- 172.21.15.32:0/3896887019 shutdown_connections 2023-06-20T13:34:11.889 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.881+0000 7faffedcab80 1 --2- 172.21.15.32:0/3896887019 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fe6ba105b0 0x55fe6ba3c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.881+0000 7faffedcab80 1 --2- 172.21.15.32:0/3896887019 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fe6ba3f320 0x55fe6ba3f6f0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.881+0000 7faffedcab80 1 --2- 172.21.15.32:0/3896887019 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55fe6ba126d0 0x55fe6ba15500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.881+0000 7faffedcab80 1 -- 172.21.15.32:0/3896887019 >> 172.21.15.32:0/3896887019 conn(0x55fe6ba09dd0 msgr2=0x55fe6ba5a130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:11.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.881+0000 7faffedcab80 1 -- 172.21.15.32:0/3896887019 shutdown_connections 2023-06-20T13:34:11.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.882+0000 7faffedcab80 1 -- 172.21.15.32:0/3896887019 wait complete. 2023-06-20T13:34:11.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.882+0000 7faffedcab80 1 -- start start 2023-06-20T13:34:11.890 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.883+0000 7faffedcab80 1 Processor -- start 2023-06-20T13:34:11.893 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.884+0000 7faffedcab80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fe6ba105b0 0x55fe6ba2cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:11.894 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.884+0000 7faffedcab80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55fe6ba126d0 0x55fe6ba402d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:11.894 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.884+0000 7faffedcab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fe6ba3f320 0x55fe6ba5d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:11.894 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.884+0000 7faffedcab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe6b965be0 con 0x55fe6ba3f320 2023-06-20T13:34:11.894 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.884+0000 7faffedcab80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe6b9235b0 con 0x55fe6ba105b0 2023-06-20T13:34:11.894 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.884+0000 7faffedcab80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fe6b909910 con 0x55fe6ba126d0 2023-06-20T13:34:11.894 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.885+0000 7faffedcab80 10 client.0 _ll_register_callbacks cb 0x55fe6b921b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-20T13:34:11.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.885+0000 7fafe999c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fe6ba3f320 0x55fe6ba5d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:11.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.885+0000 7fafe999c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fe6ba3f320 0x55fe6ba5d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39748/0 (socket says 172.21.15.32:39748) 2023-06-20T13:34:11.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.885+0000 7fafe999c700 1 -- 172.21.15.32:0/3230448905 learned_addr learned my addr 172.21.15.32:0/3230448905 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:11.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.885+0000 7fafe919b700 1 --2- 172.21.15.32:0/3230448905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fe6ba105b0 0x55fe6ba2cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:11.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.885+0000 7fafe999c700 1 -- 172.21.15.32:0/3230448905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55fe6ba126d0 msgr2=0x55fe6ba402d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:11.895 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.885+0000 7fafe899a700 1 --2- 172.21.15.32:0/3230448905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55fe6ba126d0 0x55fe6ba402d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:11.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.885+0000 7fafe999c700 1 --2- 172.21.15.32:0/3230448905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55fe6ba126d0 0x55fe6ba402d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.885+0000 7fafe999c700 1 -- 172.21.15.32:0/3230448905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fe6ba105b0 msgr2=0x55fe6ba2cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:11.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.885+0000 7fafe999c700 1 --2- 172.21.15.32:0/3230448905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fe6ba105b0 0x55fe6ba2cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.885+0000 7fafe999c700 1 -- 172.21.15.32:0/3230448905 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe415a360 con 0x55fe6ba3f320 2023-06-20T13:34:11.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.885+0000 7fafe919b700 1 --2- 172.21.15.32:0/3230448905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fe6ba105b0 0x55fe6ba2cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:34:11.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.885+0000 7fafe899a700 1 --2- 172.21.15.32:0/3230448905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55fe6ba126d0 0x55fe6ba402d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:34:11.896 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.885+0000 7fafe999c700 1 --2- 172.21.15.32:0/3230448905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fe6ba3f320 0x55fe6ba5d050 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fafdc007a00 tx=0x7fafdc007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0e16f7c5d4a0b4 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:11.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.885+0000 7fafc3fff700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-06-20T13:34:11.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.886+0000 7fafc3fff700 1 -- 172.21.15.32:0/3230448905 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc0118d0 con 0x55fe6ba3f320 2023-06-20T13:34:11.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.886+0000 7faffedcab80 1 -- 172.21.15.32:0/3230448905 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fe6ba073e0 con 0x55fe6ba3f320 2023-06-20T13:34:11.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.886+0000 7fafc3fff700 1 -- 172.21.15.32:0/3230448905 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fafdc011a30 con 0x55fe6ba3f320 2023-06-20T13:34:11.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.886+0000 7fafc3fff700 1 -- 172.21.15.32:0/3230448905 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fafdc011bf0 con 0x55fe6ba3f320 2023-06-20T13:34:11.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.886+0000 7faffedcab80 10 client.5571 fetch_fsmap learned FSMap version 17 2023-06-20T13:34:11.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.886+0000 7faffedcab80 1 -- 172.21.15.32:0/3230448905 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55fe6b8460a0 con 0x55fe6ba3f320 2023-06-20T13:34:11.897 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.886+0000 7fafc3fff700 1 -- 172.21.15.32:0/3230448905 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fe6ba073e0 con 0x55fe6ba3f320 2023-06-20T13:34:11.898 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.886+0000 7fafc3fff700 1 -- 172.21.15.32:0/3230448905 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fafdc014070 con 0x55fe6ba3f320 2023-06-20T13:34:11.898 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.886+0000 7faffedcab80 10 client.5571 fetch_fsmap finished waiting for FSMap version 17 2023-06-20T13:34:11.898 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.886+0000 7faffedcab80 10 client.5571 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-20T13:34:11.898 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.886+0000 7faffedcab80 20 client.5571 populate_metadata read hostname 'smithi032' 2023-06-20T13:34:11.898 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.886+0000 7faffedcab80 1 --2- 172.21.15.32:0/3230448905 >> [v2:172.21.15.115:6832/1096571469,v1:172.21.15.115:6835/1096571469] conn(0x55fe6ba42cb0 0x55fe6ba2d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:11.898 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.886+0000 7faffedcab80 4 client.5571 mds_command: new command op to 5382 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-20T13:34:11.898 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.886+0000 7faffedcab80 1 -- 172.21.15.32:0/3230448905 --> [v2:172.21.15.115:6832/1096571469,v1:172.21.15.115:6835/1096571469] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fe6b9e3a50 con 0x55fe6ba42cb0 2023-06-20T13:34:11.898 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.887+0000 7fafe919b700 1 --2- 172.21.15.32:0/3230448905 >> [v2:172.21.15.115:6832/1096571469,v1:172.21.15.115:6835/1096571469] conn(0x55fe6ba42cb0 0x55fe6ba2d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:11.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.887+0000 7fafe919b700 1 --2- 172.21.15.32:0/3230448905 >> [v2:172.21.15.115:6832/1096571469,v1:172.21.15.115:6835/1096571469] conn(0x55fe6ba42cb0 0x55fe6ba2d530 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=546d626960fbcc32 server_cookie=6681f37421266cec in_seq=0 out_seq=0 2023-06-20T13:34:11.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.887+0000 7fafc3fff700 10 client.5571 ms_handle_connect on v2:172.21.15.115:6832/1096571469 2023-06-20T13:34:11.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.888+0000 7fafc3fff700 1 -- 172.21.15.32:0/3230448905 <== mds.0 v2:172.21.15.115:6832/1096571469 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55fe6b9e3a50 con 0x55fe6ba42cb0 2023-06-20T13:34:11.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.888+0000 7fafc3fff700 10 client.5571 handle_command_reply: tid=0 2023-06-20T13:34:11.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.888+0000 7faffedcab80 1 client.5571 shutdown 2023-06-20T13:34:11.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.888+0000 7faffedcab80 1 -- 172.21.15.32:0/3230448905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fe6ba3f320 msgr2=0x55fe6ba5d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:11.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.888+0000 7faffedcab80 1 --2- 172.21.15.32:0/3230448905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fe6ba3f320 0x55fe6ba5d050 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fafdc007a00 tx=0x7fafdc007dc0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.899 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.889+0000 7faffedcab80 1 -- 172.21.15.32:0/3230448905 shutdown_connections 2023-06-20T13:34:11.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.889+0000 7faffedcab80 1 --2- 172.21.15.32:0/3230448905 >> [v2:172.21.15.115:6832/1096571469,v1:172.21.15.115:6835/1096571469] conn(0x55fe6ba42cb0 0x55fe6ba2d530 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.889+0000 7faffedcab80 1 --2- 172.21.15.32:0/3230448905 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fe6ba3f320 0x55fe6ba5d050 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.889+0000 7faffedcab80 1 --2- 172.21.15.32:0/3230448905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fe6ba105b0 0x55fe6ba2cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.889+0000 7fafc3fff700 0 client.5571 ms_handle_reset on v2:172.21.15.115:6832/1096571469 2023-06-20T13:34:11.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.889+0000 7faffedcab80 1 --2- 172.21.15.32:0/3230448905 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55fe6ba126d0 0x55fe6ba402d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.889+0000 7faffedcab80 1 -- 172.21.15.32:0/3230448905 >> 172.21.15.32:0/3230448905 conn(0x55fe6ba09dd0 msgr2=0x55fe6ba14980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:11.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.889+0000 7faffedcab80 1 -- 172.21.15.32:0/3230448905 shutdown_connections 2023-06-20T13:34:11.900 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.889+0000 7faffedcab80 1 -- 172.21.15.32:0/3230448905 wait complete. 2023-06-20T13:34:11.901 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.889+0000 7faffedcab80 20 client.5571 trim_cache size 0 max 16384 2023-06-20T13:34:11.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.907+0000 7faffedcab80 1 Processor -- start 2023-06-20T13:34:11.909 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.907+0000 7faffedcab80 1 -- start start 2023-06-20T13:34:11.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.908+0000 7faffedcab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fe6ba105b0 0x55fe6ba162a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:11.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.908+0000 7faffedcab80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55fe6ba126d0 0x55fe6ba3de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:11.910 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.908+0000 7faffedcab80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fe6ba3f320 0x55fe6ba68850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:11.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.908+0000 7faffedcab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe6b75a390 con 0x55fe6ba105b0 2023-06-20T13:34:11.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.908+0000 7faffedcab80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe6ba2c610 con 0x55fe6ba3f320 2023-06-20T13:34:11.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.908+0000 7faffedcab80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fe6ba42620 con 0x55fe6ba126d0 2023-06-20T13:34:11.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.908+0000 7fafe919b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fe6ba105b0 0x55fe6ba162a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:11.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.908+0000 7fafe919b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fe6ba105b0 0x55fe6ba162a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39752/0 (socket says 172.21.15.32:39752) 2023-06-20T13:34:11.911 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.908+0000 7fafe919b700 1 -- 172.21.15.32:0/2450416419 learned_addr learned my addr 172.21.15.32:0/2450416419 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:11.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.909+0000 7fafe899a700 1 --2- 172.21.15.32:0/2450416419 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55fe6ba126d0 0x55fe6ba3de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:11.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.909+0000 7fafe999c700 1 --2- 172.21.15.32:0/2450416419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fe6ba3f320 0x55fe6ba68850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:11.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.909+0000 7fafe919b700 1 -- 172.21.15.32:0/2450416419 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55fe6ba126d0 msgr2=0x55fe6ba3de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:11.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.909+0000 7fafe919b700 1 --2- 172.21.15.32:0/2450416419 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55fe6ba126d0 0x55fe6ba3de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.913 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.909+0000 7fafe919b700 1 -- 172.21.15.32:0/2450416419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fe6ba3f320 msgr2=0x55fe6ba68850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:11.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.909+0000 7fafe919b700 1 --2- 172.21.15.32:0/2450416419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fe6ba3f320 0x55fe6ba68850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.909+0000 7fafe919b700 1 -- 172.21.15.32:0/2450416419 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe6b92bb10 con 0x55fe6ba105b0 2023-06-20T13:34:11.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.909+0000 7fafe899a700 1 --2- 172.21.15.32:0/2450416419 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55fe6ba126d0 0x55fe6ba3de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-20T13:34:11.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.909+0000 7fafe919b700 1 --2- 172.21.15.32:0/2450416419 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fe6ba105b0 0x55fe6ba162a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fafe005fd20 tx=0x7fafe001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be45e1ecc2d265df server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:11.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.909+0000 7fafcf7fe700 1 -- 172.21.15.32:0/2450416419 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe0074070 con 0x55fe6ba105b0 2023-06-20T13:34:11.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.909+0000 7fafcf7fe700 1 -- 172.21.15.32:0/2450416419 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe0087240 con 0x55fe6ba105b0 2023-06-20T13:34:11.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.909+0000 7fafcf7fe700 1 -- 172.21.15.32:0/2450416419 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe0056040 con 0x55fe6ba105b0 2023-06-20T13:34:11.914 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.910+0000 7faffedcab80 1 -- 172.21.15.32:0/2450416419 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fe6ba105b0 msgr2=0x55fe6ba162a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:11.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.910+0000 7faffedcab80 1 --2- 172.21.15.32:0/2450416419 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fe6ba105b0 0x55fe6ba162a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fafe005fd20 tx=0x7fafe001e000 comp rx=0 tx=0).stop 2023-06-20T13:34:11.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.910+0000 7faffedcab80 1 -- 172.21.15.32:0/2450416419 shutdown_connections 2023-06-20T13:34:11.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.910+0000 7faffedcab80 1 --2- 172.21.15.32:0/2450416419 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fe6ba3f320 0x55fe6ba68850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.910+0000 7faffedcab80 1 --2- 172.21.15.32:0/2450416419 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fe6ba105b0 0x55fe6ba162a0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.910+0000 7faffedcab80 1 --2- 172.21.15.32:0/2450416419 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55fe6ba126d0 0x55fe6ba3de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.915 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.910+0000 7faffedcab80 1 -- 172.21.15.32:0/2450416419 >> 172.21.15.32:0/2450416419 conn(0x55fe6ba09dd0 msgr2=0x55fe6ba148c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:11.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.910+0000 7faffedcab80 1 -- 172.21.15.32:0/2450416419 shutdown_connections 2023-06-20T13:34:11.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.910+0000 7faffedcab80 1 -- 172.21.15.32:0/2450416419 wait complete. 2023-06-20T13:34:11.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.910+0000 7faffedcab80 1 -- start start 2023-06-20T13:34:11.916 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.911+0000 7faffedcab80 1 Processor -- start 2023-06-20T13:34:11.918 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.912+0000 7faffedcab80 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fe6ba105b0 0x55fe6bac04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:11.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.912+0000 7faffedcab80 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55fe6ba126d0 0x55fe6ba12aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:11.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.912+0000 7faffedcab80 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fe6ba3f320 0x55fe6ba12fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:11.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.912+0000 7faffedcab80 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe6ba11590 con 0x55fe6ba105b0 2023-06-20T13:34:11.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.912+0000 7faffedcab80 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe6ba56de0 con 0x55fe6ba3f320 2023-06-20T13:34:11.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.912+0000 7faffedcab80 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fe6ba41120 con 0x55fe6ba126d0 2023-06-20T13:34:11.919 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.912+0000 7faffedcab80 10 client.0 _ll_register_callbacks cb 0x7fafdc007560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-20T13:34:11.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.912+0000 7fafe919b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fe6ba105b0 0x55fe6bac04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:11.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.912+0000 7fafe919b700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fe6ba105b0 0x55fe6bac04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39762/0 (socket says 172.21.15.32:39762) 2023-06-20T13:34:11.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.912+0000 7fafe919b700 1 -- 172.21.15.32:0/3272074823 learned_addr learned my addr 172.21.15.32:0/3272074823 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:11.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.912+0000 7fafe999c700 1 --2- 172.21.15.32:0/3272074823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fe6ba3f320 0x55fe6ba12fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:11.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.912+0000 7fafe899a700 1 --2- 172.21.15.32:0/3272074823 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55fe6ba126d0 0x55fe6ba12aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:11.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.912+0000 7fafe919b700 1 -- 172.21.15.32:0/3272074823 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55fe6ba126d0 msgr2=0x55fe6ba12aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:11.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.912+0000 7fafe919b700 1 --2- 172.21.15.32:0/3272074823 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55fe6ba126d0 0x55fe6ba12aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.920 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.912+0000 7fafe919b700 1 -- 172.21.15.32:0/3272074823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fe6ba3f320 msgr2=0x55fe6ba12fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:11.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.912+0000 7fafe919b700 1 --2- 172.21.15.32:0/3272074823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fe6ba3f320 0x55fe6ba12fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.912+0000 7fafe919b700 1 -- 172.21.15.32:0/3272074823 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fe6b759790 con 0x55fe6ba105b0 2023-06-20T13:34:11.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.912+0000 7fafe999c700 1 --2- 172.21.15.32:0/3272074823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fe6ba3f320 0x55fe6ba12fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:34:11.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.913+0000 7fafe919b700 1 --2- 172.21.15.32:0/3272074823 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fe6ba105b0 0x55fe6bac04b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fafe0054400 tx=0x7fafe0054370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d20811c6d7716074 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:11.921 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.913+0000 7fafc3fff700 10 client.0 ms_handle_connect on v2:172.21.15.32:3300/0 2023-06-20T13:34:11.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.913+0000 7fafc3fff700 1 -- 172.21.15.32:0/3272074823 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe0074040 con 0x55fe6ba105b0 2023-06-20T13:34:11.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.913+0000 7fafc3fff700 1 -- 172.21.15.32:0/3272074823 <== mon.0 v2:172.21.15.32:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fafe005fdc0 con 0x55fe6ba105b0 2023-06-20T13:34:11.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.913+0000 7faffedcab80 1 -- 172.21.15.32:0/3272074823 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fafe00562a0 con 0x55fe6ba105b0 2023-06-20T13:34:11.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.913+0000 7fafc3fff700 1 -- 172.21.15.32:0/3272074823 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fafe0056100 con 0x55fe6ba105b0 2023-06-20T13:34:11.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.913+0000 7faffedcab80 10 client.5577 fetch_fsmap learned FSMap version 17 2023-06-20T13:34:11.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.913+0000 7faffedcab80 1 -- 172.21.15.32:0/3272074823 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55fe6b7ba1d0 con 0x55fe6ba105b0 2023-06-20T13:34:11.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.913+0000 7fafc3fff700 1 -- 172.21.15.32:0/3272074823 <== mon.0 v2:172.21.15.32:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe00562a0 con 0x55fe6ba105b0 2023-06-20T13:34:11.922 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.913+0000 7fafc3fff700 1 -- 172.21.15.32:0/3272074823 <== mon.0 v2:172.21.15.32:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fafe00811a0 con 0x55fe6ba105b0 2023-06-20T13:34:11.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.913+0000 7faffedcab80 10 client.5577 fetch_fsmap finished waiting for FSMap version 17 2023-06-20T13:34:11.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.913+0000 7faffedcab80 10 client.5577 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-20T13:34:11.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.913+0000 7faffedcab80 20 client.5577 populate_metadata read hostname 'smithi032' 2023-06-20T13:34:11.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.913+0000 7faffedcab80 1 --2- 172.21.15.32:0/3272074823 >> [v2:172.21.15.115:6832/1096571469,v1:172.21.15.115:6835/1096571469] conn(0x55fe6ba42570 0x55fe6bac0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:11.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.913+0000 7faffedcab80 4 client.5577 mds_command: new command op to 5382 tid=0[{"prefix": "status"}] 2023-06-20T13:34:11.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.913+0000 7faffedcab80 1 -- 172.21.15.32:0/3272074823 --> [v2:172.21.15.115:6832/1096571469,v1:172.21.15.115:6835/1096571469] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fe6b95ed20 con 0x55fe6ba42570 2023-06-20T13:34:11.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.914+0000 7fafe899a700 1 --2- 172.21.15.32:0/3272074823 >> [v2:172.21.15.115:6832/1096571469,v1:172.21.15.115:6835/1096571469] conn(0x55fe6ba42570 0x55fe6bac0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:11.923 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.914+0000 7fafe899a700 1 --2- 172.21.15.32:0/3272074823 >> [v2:172.21.15.115:6832/1096571469,v1:172.21.15.115:6835/1096571469] conn(0x55fe6ba42570 0x55fe6bac0e90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1779a6f10997ee65 server_cookie=fae50c3abb7b8d8c in_seq=0 out_seq=0 2023-06-20T13:34:11.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.914+0000 7fafc3fff700 10 client.5577 ms_handle_connect on v2:172.21.15.115:6832/1096571469 2023-06-20T13:34:11.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.915+0000 7fafc3fff700 1 -- 172.21.15.32:0/3272074823 <== mds.0 v2:172.21.15.115:6832/1096571469 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55fe6b95ed20 con 0x55fe6ba42570 2023-06-20T13:34:11.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.915+0000 7fafc3fff700 10 client.5577 handle_command_reply: tid=0 2023-06-20T13:34:11.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.915+0000 7faffedcab80 1 client.5577 shutdown 2023-06-20T13:34:11.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.915+0000 7faffedcab80 1 -- 172.21.15.32:0/3272074823 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fe6ba105b0 msgr2=0x55fe6bac04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:11.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.915+0000 7faffedcab80 1 --2- 172.21.15.32:0/3272074823 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fe6ba105b0 0x55fe6bac04b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fafe0054400 tx=0x7fafe0054370 comp rx=0 tx=0).stop 2023-06-20T13:34:11.924 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.915+0000 7faffedcab80 1 -- 172.21.15.32:0/3272074823 shutdown_connections 2023-06-20T13:34:11.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.915+0000 7faffedcab80 1 --2- 172.21.15.32:0/3272074823 >> [v2:172.21.15.115:6832/1096571469,v1:172.21.15.115:6835/1096571469] conn(0x55fe6ba42570 0x55fe6bac0e90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.915+0000 7faffedcab80 1 --2- 172.21.15.32:0/3272074823 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fe6ba3f320 0x55fe6ba12fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.915+0000 7faffedcab80 1 --2- 172.21.15.32:0/3272074823 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x55fe6ba105b0 0x55fe6bac04b0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.915+0000 7faffedcab80 1 --2- 172.21.15.32:0/3272074823 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55fe6ba126d0 0x55fe6ba12aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.915+0000 7fafc3fff700 0 client.5577 ms_handle_reset on v2:172.21.15.115:6832/1096571469 2023-06-20T13:34:11.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.915+0000 7faffedcab80 1 -- 172.21.15.32:0/3272074823 >> 172.21.15.32:0/3272074823 conn(0x55fe6ba09dd0 msgr2=0x55fe6ba3de50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:11.925 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.915+0000 7faffedcab80 1 -- 172.21.15.32:0/3272074823 shutdown_connections 2023-06-20T13:34:11.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.915+0000 7faffedcab80 1 -- 172.21.15.32:0/3272074823 wait complete. 2023-06-20T13:34:11.926 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.915+0000 7faffedcab80 20 client.5577 trim_cache size 0 max 16384 2023-06-20T13:34:11.926 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2023-06-20T13:34:11.926 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_fsid": "8ec09bdb-4968-488f-bf51-7b0f1e92355f", 2023-06-20T13:34:11.927 INFO:teuthology.orchestra.run.smithi032.stdout: "whoami": 0, 2023-06-20T13:34:11.927 INFO:teuthology.orchestra.run.smithi032.stdout: "id": 5382, 2023-06-20T13:34:11.927 INFO:teuthology.orchestra.run.smithi032.stdout: "want_state": "up:active", 2023-06-20T13:34:11.927 INFO:teuthology.orchestra.run.smithi032.stdout: "state": "up:active", 2023-06-20T13:34:11.927 INFO:teuthology.orchestra.run.smithi032.stdout: "fs_name": "cephfs", 2023-06-20T13:34:11.927 INFO:teuthology.orchestra.run.smithi032.stdout: "rank_uptime": 6.6306989319999996, 2023-06-20T13:34:11.927 INFO:teuthology.orchestra.run.smithi032.stdout: "mdsmap_epoch": 17, 2023-06-20T13:34:11.927 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch": 41, 2023-06-20T13:34:11.928 INFO:teuthology.orchestra.run.smithi032.stdout: "osdmap_epoch_barrier": 41, 2023-06-20T13:34:11.928 INFO:teuthology.orchestra.run.smithi032.stdout: "uptime": 16.429958761999998 2023-06-20T13:34:11.928 INFO:teuthology.orchestra.run.smithi032.stdout:} 2023-06-20T13:34:11.928 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.916+0000 7fafeb3ff700 1 -- 172.21.15.32:0/3896999587 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fafc806ace0 msgr2=0x7fafc806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:11.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.916+0000 7fafeb3ff700 1 --2- 172.21.15.32:0/3896999587 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fafc806ace0 0x7fafc806d190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fafd40090b0 tx=0x7fafd401c040 comp rx=0 tx=0).stop 2023-06-20T13:34:11.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.916+0000 7fafeb3ff700 1 -- 172.21.15.32:0/3896999587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fafe40cf8f0 msgr2=0x7fafe415b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:11.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.916+0000 7fafeb3ff700 1 --2- 172.21.15.32:0/3896999587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fafe40cf8f0 0x7fafe415b270 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fafe000c550 tx=0x7fafe000c910 comp rx=0 tx=0).stop 2023-06-20T13:34:11.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.916+0000 7fafeb3ff700 1 -- 172.21.15.32:0/3896999587 shutdown_connections 2023-06-20T13:34:11.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.916+0000 7fafeb3ff700 1 --2- 172.21.15.32:0/3896999587 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fafc806ace0 0x7fafc806d190 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.916+0000 7fafeb3ff700 1 --2- 172.21.15.32:0/3896999587 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fafe415c460 0x7fafe414a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.929 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.916+0000 7fafeb3ff700 1 --2- 172.21.15.32:0/3896999587 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fafe40cf8f0 0x7fafe415b270 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.916+0000 7fafeb3ff700 1 --2- 172.21.15.32:0/3896999587 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fafe40d2640 0x7fafe4158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:11.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.916+0000 7fafeb3ff700 1 -- 172.21.15.32:0/3896999587 >> 172.21.15.32:0/3896999587 conn(0x7fafe4071660 msgr2=0x7fafe40d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:11.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.916+0000 7fafeb3ff700 1 -- 172.21.15.32:0/3896999587 shutdown_connections 2023-06-20T13:34:11.930 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:11.916+0000 7fafeb3ff700 1 -- 172.21.15.32:0/3896999587 wait complete. 2023-06-20T13:34:11.935 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-20T13:34:12.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.135+0000 7fe1de3ff700 1 Processor -- start 2023-06-20T13:34:12.138 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.135+0000 7fe1de3ff700 1 -- start start 2023-06-20T13:34:12.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.136+0000 7fe1de3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe1d8157f10 0x7fe1d806a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:12.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.136+0000 7fe1de3ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1d8070340 0x7fe1d815e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:12.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.136+0000 7fe1de3ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d815e210 con 0x7fe1d8070a50 2023-06-20T13:34:12.139 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.136+0000 7fe1de3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1d806d900 con 0x7fe1d8157f10 2023-06-20T13:34:12.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.136+0000 7fe1de3ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d815dee0 con 0x7fe1d8070340 2023-06-20T13:34:12.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.137+0000 7fe1dc99c700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7fe1d8070a50 0x7fe1d815a7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:38966/0 (socket says 172.21.15.32:38966) 2023-06-20T13:34:12.140 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.137+0000 7fe1dc99c700 1 -- 172.21.15.32:0/2353307978 learned_addr learned my addr 172.21.15.32:0/2353307978 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:34:12.142 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.137+0000 7fe1d6ffd700 1 -- 172.21.15.32:0/2353307978 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3243462147 0 0) 0x7fe1d815e210 con 0x7fe1d8070a50 2023-06-20T13:34:12.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.137+0000 7fe1d6ffd700 1 -- 172.21.15.32:0/2353307978 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1c00035b0 con 0x7fe1d8070a50 2023-06-20T13:34:12.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.137+0000 7fe1d7fff700 1 --2- 172.21.15.32:0/2353307978 >> v2:172.21.15.115:3300/0 conn(0x7fe1d8157f10 0x7fe1d806a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:12.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.137+0000 7fe1d77fe700 1 --2- 172.21.15.32:0/2353307978 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1d8070340 0x7fe1d815e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:12.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.137+0000 7fe1d6ffd700 1 -- 172.21.15.32:0/2353307978 <== mon.0 v1:172.21.15.32:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1229398459 0 0) 0x7fe1c00035b0 con 0x7fe1d8070a50 2023-06-20T13:34:12.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.138+0000 7fe1d6ffd700 1 -- 172.21.15.32:0/2353307978 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1d8070340 msgr2=0x7fe1d815e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:12.143 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.138+0000 7fe1d6ffd700 1 --2- 172.21.15.32:0/2353307978 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1d8070340 0x7fe1d815e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:12.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.138+0000 7fe1d6ffd700 1 -- 172.21.15.32:0/2353307978 >> v2:172.21.15.115:3300/0 conn(0x7fe1d8157f10 msgr2=0x7fe1d806a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:12.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.138+0000 7fe1d6ffd700 1 --2- 172.21.15.32:0/2353307978 >> v2:172.21.15.115:3300/0 conn(0x7fe1d8157f10 0x7fe1d806a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:12.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.138+0000 7fe1d6ffd700 1 -- 172.21.15.32:0/2353307978 --> v1:172.21.15.32:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d80c8f40 con 0x7fe1d8070a50 2023-06-20T13:34:12.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.138+0000 7fe1d6ffd700 1 -- 172.21.15.32:0/2353307978 <== mon.0 v1:172.21.15.32:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3380058562 0 0) 0x7fe1d00019f0 con 0x7fe1d8070a50 2023-06-20T13:34:12.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.138+0000 7fe1d6ffd700 1 -- 172.21.15.32:0/2353307978 >> v1:172.21.15.32:6789/0 conn(0x7fe1d8070a50 legacy=0x7fe1d815a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:12.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.138+0000 7fe1d6ffd700 1 --2- 172.21.15.32:0/2353307978 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1d8070340 0x7fe1c0003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:12.144 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.138+0000 7fe1d6ffd700 1 --2- 172.21.15.32:0/2353307978 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c0003fd0 0x7fe1c0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:12.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.138+0000 7fe1d6ffd700 1 --2- 172.21.15.32:0/2353307978 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1c0004d90 0x7fe1c0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:12.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.138+0000 7fe1d6ffd700 1 -- 172.21.15.32:0/2353307978 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d806d900 con 0x7fe1c0003fd0 2023-06-20T13:34:12.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.138+0000 7fe1d6ffd700 1 -- 172.21.15.32:0/2353307978 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d815dee0 con 0x7fe1c0004d90 2023-06-20T13:34:12.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.138+0000 7fe1d6ffd700 1 -- 172.21.15.32:0/2353307978 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c000bb40 con 0x7fe1d8070340 2023-06-20T13:34:12.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.138+0000 7fe1d77fe700 1 --2- 172.21.15.32:0/2353307978 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c0003fd0 0x7fe1c0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:12.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.138+0000 7fe1d7fff700 1 --2- 172.21.15.32:0/2353307978 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1d8070340 0x7fe1c0003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:12.145 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.138+0000 7fe1dc99c700 1 --2- 172.21.15.32:0/2353307978 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1c0004d90 0x7fe1c0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:12.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.138+0000 7fe1d77fe700 1 -- 172.21.15.32:0/2353307978 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1d8070340 msgr2=0x7fe1c0003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:12.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.138+0000 7fe1d77fe700 1 --2- 172.21.15.32:0/2353307978 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1d8070340 0x7fe1c0003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:12.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.138+0000 7fe1d77fe700 1 -- 172.21.15.32:0/2353307978 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1c0004d90 msgr2=0x7fe1c0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:34:12.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.138+0000 7fe1d77fe700 1 --2- 172.21.15.32:0/2353307978 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1c0004d90 0x7fe1c0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:12.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.138+0000 7fe1d77fe700 1 -- 172.21.15.32:0/2353307978 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c00035b0 con 0x7fe1c0003fd0 2023-06-20T13:34:12.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.138+0000 7fe1dc99c700 1 --2- 172.21.15.32:0/2353307978 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1c0004d90 0x7fe1c0005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:34:12.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.139+0000 7fe1d77fe700 1 --2- 172.21.15.32:0/2353307978 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c0003fd0 0x7fe1c0004850 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0096f0 tx=0x7fe1c0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4bb3e648f103d20 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:12.146 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.139+0000 7fe1d6ffd700 1 -- 172.21.15.32:0/2353307978 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc00e6c0 con 0x7fe1c0003fd0 2023-06-20T13:34:12.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.139+0000 7fe1d6ffd700 1 -- 172.21.15.32:0/2353307978 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1cc00e820 con 0x7fe1c0003fd0 2023-06-20T13:34:12.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.139+0000 7fe1d6ffd700 1 -- 172.21.15.32:0/2353307978 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc00ebb0 con 0x7fe1c0003fd0 2023-06-20T13:34:12.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.139+0000 7fe1de3ff700 1 -- 172.21.15.32:0/2353307978 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c0003fd0 msgr2=0x7fe1c0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:12.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.139+0000 7fe1de3ff700 1 --2- 172.21.15.32:0/2353307978 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1c0003fd0 0x7fe1c0004850 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0096f0 tx=0x7fe1c0005880 comp rx=0 tx=0).stop 2023-06-20T13:34:12.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.139+0000 7fe1dc99c700 1 -- 172.21.15.32:0/2353307978 reap_dead start 2023-06-20T13:34:12.147 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.139+0000 7fe1de3ff700 1 -- 172.21.15.32:0/2353307978 shutdown_connections 2023-06-20T13:34:12.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.140+0000 7fe1de3ff700 1 -- 172.21.15.32:0/2353307978 >> 172.21.15.32:0/2353307978 conn(0x7fe1d80b0390 msgr2=0x7fe1d80b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:12.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.140+0000 7fe1de3ff700 1 -- 172.21.15.32:0/2353307978 shutdown_connections 2023-06-20T13:34:12.148 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.140+0000 7fe1de3ff700 1 -- 172.21.15.32:0/2353307978 wait complete. 2023-06-20T13:34:12.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.141+0000 7fe1de3ff700 1 Processor -- start 2023-06-20T13:34:12.150 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.142+0000 7fe1de3ff700 1 -- start start 2023-06-20T13:34:12.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.142+0000 7fe1de3ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1c0003fd0 0x7fe1d80cd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:12.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.142+0000 7fe1de3ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1d80cdca0 0x7fe1d80b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:12.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.142+0000 7fe1de3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1d80b2050 0x7fe1d8151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:12.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.142+0000 7fe1de3ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d8153750 con 0x7fe1d80cdca0 2023-06-20T13:34:12.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.142+0000 7fe1de3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d8152db0 con 0x7fe1d80b2050 2023-06-20T13:34:12.151 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.142+0000 7fe1de3ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d8153090 con 0x7fe1c0003fd0 2023-06-20T13:34:12.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.143+0000 7fe1d77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1d80cdca0 0x7fe1d80b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:12.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.143+0000 7fe1d77fe700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1d80cdca0 0x7fe1d80b1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:39784/0 (socket says 172.21.15.32:39784) 2023-06-20T13:34:12.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.143+0000 7fe1d77fe700 1 -- 172.21.15.32:0/1399289423 learned_addr learned my addr 172.21.15.32:0/1399289423 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:34:12.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.143+0000 7fe1d7fff700 1 --2- 172.21.15.32:0/1399289423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1c0003fd0 0x7fe1d80cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:12.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.143+0000 7fe1dc99c700 1 --2- 172.21.15.32:0/1399289423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1d80b2050 0x7fe1d8151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:12.152 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.143+0000 7fe1d77fe700 1 -- 172.21.15.32:0/1399289423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1c0003fd0 msgr2=0x7fe1d80cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:12.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.143+0000 7fe1d77fe700 1 --2- 172.21.15.32:0/1399289423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1c0003fd0 0x7fe1d80cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:12.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.143+0000 7fe1d77fe700 1 -- 172.21.15.32:0/1399289423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1d80b2050 msgr2=0x7fe1d8151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:12.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.143+0000 7fe1d77fe700 1 --2- 172.21.15.32:0/1399289423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1d80b2050 0x7fe1d8151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:12.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.143+0000 7fe1d77fe700 1 -- 172.21.15.32:0/1399289423 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d8153370 con 0x7fe1d80cdca0 2023-06-20T13:34:12.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.143+0000 7fe1dc99c700 1 --2- 172.21.15.32:0/1399289423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1d80b2050 0x7fe1d8151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:34:12.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.143+0000 7fe1d77fe700 1 --2- 172.21.15.32:0/1399289423 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1d80cdca0 0x7fe1d80b1b10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0090b0 tx=0x7fe1cc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:12.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.144+0000 7fe1d4ff9700 1 -- 172.21.15.32:0/1399289423 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc00e6c0 con 0x7fe1d80cdca0 2023-06-20T13:34:12.153 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.144+0000 7fe1d4ff9700 1 -- 172.21.15.32:0/1399289423 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1cc0038c0 con 0x7fe1d80cdca0 2023-06-20T13:34:12.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.144+0000 7fe1d4ff9700 1 -- 172.21.15.32:0/1399289423 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc006e60 con 0x7fe1d80cdca0 2023-06-20T13:34:12.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.144+0000 7fe1de3ff700 1 -- 172.21.15.32:0/1399289423 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d815cc00 con 0x7fe1d80cdca0 2023-06-20T13:34:12.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.144+0000 7fe1de3ff700 1 -- 172.21.15.32:0/1399289423 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d8152190 con 0x7fe1d80cdca0 2023-06-20T13:34:12.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.145+0000 7fe1de3ff700 1 -- 172.21.15.32:0/1399289423 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1d81539c0 con 0x7fe1d80cdca0 2023-06-20T13:34:12.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.146+0000 7fe1d4ff9700 1 -- 172.21.15.32:0/1399289423 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe1cc022040 con 0x7fe1d80cdca0 2023-06-20T13:34:12.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.147+0000 7fe1d4ff9700 1 --2- 172.21.15.32:0/1399289423 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe1c406ace0 0x7fe1c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:34:12.154 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.147+0000 7fe1d4ff9700 1 -- 172.21.15.32:0/1399289423 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe1cc08dea0 con 0x7fe1d80cdca0 2023-06-20T13:34:12.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.147+0000 7fe1d7fff700 1 --2- 172.21.15.32:0/1399289423 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe1c406ace0 0x7fe1c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:34:12.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.147+0000 7fe1d7fff700 1 --2- 172.21.15.32:0/1399289423 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe1c406ace0 0x7fe1c406d190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8009ce0 tx=0x7fe1c8009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:34:12.155 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.151+0000 7fe1d4ff9700 1 -- 172.21.15.32:0/1399289423 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe1cc058f20 con 0x7fe1d80cdca0 2023-06-20T13:34:12.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.405+0000 7fe1de3ff700 1 -- 172.21.15.32:0/1399289423 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe1d804ea60 con 0x7fe1d80cdca0 2023-06-20T13:34:12.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.405+0000 7fe1d4ff9700 1 -- 172.21.15.32:0/1399289423 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe1cc020060 con 0x7fe1d80cdca0 2023-06-20T13:34:12.408 INFO:teuthology.orchestra.run.smithi032.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-20T13:34:12.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.408+0000 7fe1de3ff700 1 -- 172.21.15.32:0/1399289423 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe1c406ace0 msgr2=0x7fe1c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:12.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.408+0000 7fe1de3ff700 1 --2- 172.21.15.32:0/1399289423 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe1c406ace0 0x7fe1c406d190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8009ce0 tx=0x7fe1c8009210 comp rx=0 tx=0).stop 2023-06-20T13:34:12.410 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.408+0000 7fe1de3ff700 1 -- 172.21.15.32:0/1399289423 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1d80cdca0 msgr2=0x7fe1d80b1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:34:12.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.408+0000 7fe1de3ff700 1 --2- 172.21.15.32:0/1399289423 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1d80cdca0 0x7fe1d80b1b10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0090b0 tx=0x7fe1cc0047c0 comp rx=0 tx=0).stop 2023-06-20T13:34:12.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.408+0000 7fe1de3ff700 1 -- 172.21.15.32:0/1399289423 shutdown_connections 2023-06-20T13:34:12.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.408+0000 7fe1de3ff700 1 --2- 172.21.15.32:0/1399289423 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7fe1c406ace0 0x7fe1c406d190 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:12.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.408+0000 7fe1de3ff700 1 --2- 172.21.15.32:0/1399289423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe1d80b2050 0x7fe1d8151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:12.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.408+0000 7fe1de3ff700 1 --2- 172.21.15.32:0/1399289423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe1c0003fd0 0x7fe1d80cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:12.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.408+0000 7fe1de3ff700 1 --2- 172.21.15.32:0/1399289423 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7fe1d80cdca0 0x7fe1d80b1b10 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:34:12.411 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.408+0000 7fe1de3ff700 1 -- 172.21.15.32:0/1399289423 >> 172.21.15.32:0/1399289423 conn(0x7fe1d80b0390 msgr2=0x7fe1d80ae630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:34:12.412 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.408+0000 7fe1de3ff700 1 -- 172.21.15.32:0/1399289423 shutdown_connections 2023-06-20T13:34:12.412 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:34:12.408+0000 7fe1de3ff700 1 -- 172.21.15.32:0/1399289423 wait complete. 2023-06-20T13:34:12.428 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-06-20T13:34:12.428 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-20T13:34:12.429 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi032.front.sepia.ceph.com 2023-06-20T13:34:12.429 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-20T13:34:12.429 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-20T13:34:12.429 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-06-20T13:34:12.430 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-06-20T13:34:12.430 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-20T13:34:12.430 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-20T13:34:12.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:34:12.431 DEBUG:teuthology.orchestra.run.smithi032:> ip addr 2023-06-20T13:34:12.477 INFO:teuthology.orchestra.run.smithi032.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-20T13:34:12.478 INFO:teuthology.orchestra.run.smithi032.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-20T13:34:12.478 INFO:teuthology.orchestra.run.smithi032.stdout: inet 127.0.0.1/8 scope host lo 2023-06-20T13:34:12.478 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:34:12.478 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 ::1/128 scope host 2023-06-20T13:34:12.478 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:34:12.479 INFO:teuthology.orchestra.run.smithi032.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-20T13:34:12.479 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0c brd ff:ff:ff:ff:ff:ff 2023-06-20T13:34:12.479 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f0 2023-06-20T13:34:12.479 INFO:teuthology.orchestra.run.smithi032.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-20T13:34:12.479 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 0c:c4:7a:6b:fd:0d brd ff:ff:ff:ff:ff:ff 2023-06-20T13:34:12.479 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp7s0f1 2023-06-20T13:34:12.479 INFO:teuthology.orchestra.run.smithi032.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-20T13:34:12.479 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:02 brd ff:ff:ff:ff:ff:ff 2023-06-20T13:34:12.480 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f0 2023-06-20T13:34:12.480 INFO:teuthology.orchestra.run.smithi032.stdout: inet 172.21.15.32/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-06-20T13:34:12.480 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft 41997sec preferred_lft 41997sec 2023-06-20T13:34:12.480 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::ae1f:6bff:fef8:2602/64 scope link 2023-06-20T13:34:12.480 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:34:12.480 INFO:teuthology.orchestra.run.smithi032.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-20T13:34:12.480 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether ac:1f:6b:f8:26:03 brd ff:ff:ff:ff:ff:ff 2023-06-20T13:34:12.481 INFO:teuthology.orchestra.run.smithi032.stdout: altname enp1s0f1 2023-06-20T13:34:12.481 INFO:teuthology.orchestra.run.smithi032.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-20T13:34:12.481 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 22:b0:3d:6a:82:8a brd ff:ff:ff:ff:ff:ff 2023-06-20T13:34:12.481 INFO:teuthology.orchestra.run.smithi032.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-20T13:34:12.481 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:34:12.481 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::f8d6:73ff:fef6:470b/64 scope link 2023-06-20T13:34:12.481 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:34:12.481 INFO:teuthology.orchestra.run.smithi032.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-20T13:34:12.482 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether 22:b0:3d:6a:82:8a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-20T13:34:12.482 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::20b0:3dff:fe6a:828a/64 scope link 2023-06-20T13:34:12.482 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:34:12.482 INFO:teuthology.orchestra.run.smithi032.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-20T13:34:12.482 INFO:teuthology.orchestra.run.smithi032.stdout: link/ether da:fb:03:8c:26:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-20T13:34:12.482 INFO:teuthology.orchestra.run.smithi032.stdout: inet6 fe80::d8fb:3ff:fe8c:2675/64 scope link 2023-06-20T13:34:12.482 INFO:teuthology.orchestra.run.smithi032.stdout: valid_lft forever preferred_lft forever 2023-06-20T13:34:12.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:34:12.484 DEBUG:teuthology.orchestra.run.smithi032:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-20T13:34:12.551 INFO:teuthology.orchestra.run.smithi032.stdout:1 2023-06-20T13:34:12.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:34:12.554 DEBUG:teuthology.orchestra.run.smithi032:> route 2023-06-20T13:34:12.602 INFO:teuthology.orchestra.run.smithi032.stdout:Kernel IP routing table 2023-06-20T13:34:12.603 INFO:teuthology.orchestra.run.smithi032.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-20T13:34:12.603 INFO:teuthology.orchestra.run.smithi032.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-06-20T13:34:12.603 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-06-20T13:34:12.603 INFO:teuthology.orchestra.run.smithi032.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-20T13:34:12.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:34:12.605 DEBUG:teuthology.orchestra.run.smithi032:> (cd / && exec bash -c ' 2023-06-20T13:34:12.605 DEBUG:teuthology.orchestra.run.smithi032:> set -e 2023-06-20T13:34:12.605 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-20T13:34:12.606 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-20T13:34:12.606 DEBUG:teuthology.orchestra.run.smithi032:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-20T13:34:12.606 DEBUG:teuthology.orchestra.run.smithi032:> ') 2023-06-20T13:34:12.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:34:12.777 DEBUG:teuthology.orchestra.run.smithi032:> ip netns list 2023-06-20T13:34:12.823 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-06-20T13:34:12.823 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-20T13:34:12.824 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-20T13:34:12.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:34:12.825 DEBUG:teuthology.orchestra.run.smithi032:> sudo ip link set brx.0 up 2023-06-20T13:34:12.935 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-20T13:34:12.935 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-20T13:34:12.981 INFO:teuthology.orchestra.run.smithi032.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-20T13:34:12.981 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-20T13:34:12.982 DEBUG:teuthology.orchestra.run.smithi032:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-20T13:34:13.067 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-06-20T13:34:13.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:34:13.069 DEBUG:teuthology.orchestra.run.smithi032:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-20T13:34:13.213 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-20T13:34:13.213 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-20T13:34:13.240 INFO:teuthology.orchestra.run.smithi032.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-20T13:34:13.241 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-20T13:34:13.241 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: resolved to: "172.21.15.32:3300,172.21.15.115:3300,172.21.15.115:3301" 2023-06-20T13:34:13.241 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: trying mount with new device syntax: 0@8ec09bdb-4968-488f-bf51-7b0f1e92355f.cephfs=/ 2023-06-20T13:34:13.241 INFO:teuthology.orchestra.run.smithi032.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.32:3300/172.21.15.115:3300/172.21.15.115:3301" will pass to kernel 2023-06-20T13:34:13.245 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-20T13:34:13.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:34:13.246 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-20T13:34:13.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:34:13.322 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-20T13:34:13.441 INFO:teuthology.orchestra.run.smithi032.stdout:client5434 2023-06-20T13:34:13.441 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:34:13.442 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-20T13:34:13.488 DEBUG:teuthology.orchestra.run.smithi032:> mktemp -d --suffix=xfstests-dev 2023-06-20T13:34:13.573 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.LENcwP3t9bxfstests-dev 2023-06-20T13:34:13.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:34:13.574 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.LENcwP3t9bxfstests-dev) 2023-06-20T13:34:13.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:34:13.688 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.LENcwP3t9bxfstests-dev) 2023-06-20T13:34:13.742 INFO:teuthology.orchestra.run.smithi032.stderr:Cloning into '/tmp/tmp.LENcwP3t9bxfstests-dev'... 2023-06-20T13:34:14.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:34:14.607 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-06-20T13:34:14.665 DEBUG:teuthology.orchestra.run.smithi032:> mktemp -d --suffix=test 2023-06-20T13:34:14.710 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.smRYDztNNFtest 2023-06-20T13:34:14.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:34:14.711 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-06-20T13:34:14.800 DEBUG:teuthology.orchestra.run.smithi032:> mktemp -d --suffix=scratch 2023-06-20T13:34:14.845 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:34:14.846 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "8". 2023-06-20T13:34:14.846 DEBUG:teuthology.orchestra.run.smithi032:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python2 sqlite xfsprogs-qa-devel 2023-06-20T13:34:15.929 INFO:teuthology.orchestra.run.smithi032.stdout:Last metadata expiration check: 0:09:31 ago on Tue 20 Jun 2023 01:24:44 PM UTC. 2023-06-20T13:34:17.210 INFO:teuthology.orchestra.run.smithi032.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-06-20T13:34:17.211 INFO:teuthology.orchestra.run.smithi032.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-06-20T13:34:17.212 INFO:teuthology.orchestra.run.smithi032.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-06-20T13:34:17.213 INFO:teuthology.orchestra.run.smithi032.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-06-20T13:34:17.214 INFO:teuthology.orchestra.run.smithi032.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-06-20T13:34:17.216 INFO:teuthology.orchestra.run.smithi032.stdout:Package e2fsprogs-1.45.6-5.el8.x86_64 is already installed. 2023-06-20T13:34:17.218 INFO:teuthology.orchestra.run.smithi032.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-06-20T13:34:17.219 INFO:teuthology.orchestra.run.smithi032.stdout:Package gcc-8.5.0-19.el8.x86_64 is already installed. 2023-06-20T13:34:17.221 INFO:teuthology.orchestra.run.smithi032.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-06-20T13:34:17.222 INFO:teuthology.orchestra.run.smithi032.stdout:Package lvm2-8:2.03.14-9.el8.x86_64 is already installed. 2023-06-20T13:34:17.223 INFO:teuthology.orchestra.run.smithi032.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-06-20T13:34:17.224 INFO:teuthology.orchestra.run.smithi032.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-06-20T13:34:17.225 INFO:teuthology.orchestra.run.smithi032.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-06-20T13:34:17.226 INFO:teuthology.orchestra.run.smithi032.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-06-20T13:34:17.227 INFO:teuthology.orchestra.run.smithi032.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-06-20T13:34:17.228 INFO:teuthology.orchestra.run.smithi032.stdout:Package xfsprogs-5.0.0-12.el8.x86_64 is already installed. 2023-06-20T13:34:17.229 INFO:teuthology.orchestra.run.smithi032.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-06-20T13:34:17.230 INFO:teuthology.orchestra.run.smithi032.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-06-20T13:34:17.231 INFO:teuthology.orchestra.run.smithi032.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-06-20T13:34:17.232 INFO:teuthology.orchestra.run.smithi032.stdout:Package libuuid-devel-2.32.1-42.el8.x86_64 is already installed. 2023-06-20T13:34:17.233 INFO:teuthology.orchestra.run.smithi032.stdout:Package xfsprogs-devel-5.0.0-12.el8.x86_64 is already installed. 2023-06-20T13:34:17.235 INFO:teuthology.orchestra.run.smithi032.stdout:Package sqlite-3.26.0-17.el8.x86_64 is already installed. 2023-06-20T13:34:17.240 INFO:teuthology.orchestra.run.smithi032.stdout:Package xfsprogs-5.0.0-12.el8.x86_64 is already installed. 2023-06-20T13:34:17.419 INFO:teuthology.orchestra.run.smithi032.stdout:Dependencies resolved. 2023-06-20T13:34:17.422 INFO:teuthology.orchestra.run.smithi032.stdout:======================================================================================= 2023-06-20T13:34:17.422 INFO:teuthology.orchestra.run.smithi032.stdout: Package Arch Version Repo Size 2023-06-20T13:34:17.422 INFO:teuthology.orchestra.run.smithi032.stdout:======================================================================================= 2023-06-20T13:34:17.422 INFO:teuthology.orchestra.run.smithi032.stdout:Installing: 2023-06-20T13:34:17.422 INFO:teuthology.orchestra.run.smithi032.stdout: dump x86_64 1:0.4-0.36.b46.el8 baseos 164 k 2023-06-20T13:34:17.422 INFO:teuthology.orchestra.run.smithi032.stdout: fio x86_64 3.19-4.el8 appstream 538 k 2023-06-20T13:34:17.423 INFO:teuthology.orchestra.run.smithi032.stdout: indent x86_64 2.2.13-2.el8 epel 187 k 2023-06-20T13:34:17.423 INFO:teuthology.orchestra.run.smithi032.stdout: python2 x86_64 2.7.18-12.module_el8+299+aa6e9afa appstream 110 k 2023-06-20T13:34:17.423 INFO:teuthology.orchestra.run.smithi032.stdout:Upgrading: 2023-06-20T13:34:17.423 INFO:teuthology.orchestra.run.smithi032.stdout: sqlite x86_64 3.26.0-18.el8 baseos 668 k 2023-06-20T13:34:17.423 INFO:teuthology.orchestra.run.smithi032.stdout: sqlite-libs x86_64 3.26.0-18.el8 baseos 581 k 2023-06-20T13:34:17.423 INFO:teuthology.orchestra.run.smithi032.stdout:Installing dependencies: 2023-06-20T13:34:17.423 INFO:teuthology.orchestra.run.smithi032.stdout: daxctl-libs x86_64 71.1-7.el8 baseos 42 k 2023-06-20T13:34:17.424 INFO:teuthology.orchestra.run.smithi032.stdout: libpmemblk x86_64 1.6.1-1.el8 appstream 92 k 2023-06-20T13:34:17.424 INFO:teuthology.orchestra.run.smithi032.stdout: ndctl-libs x86_64 71.1-7.el8 baseos 80 k 2023-06-20T13:34:17.424 INFO:teuthology.orchestra.run.smithi032.stdout: python2-libs x86_64 2.7.18-12.module_el8+299+aa6e9afa appstream 6.5 M 2023-06-20T13:34:17.424 INFO:teuthology.orchestra.run.smithi032.stdout: python2-pip-wheel noarch 9.0.3-19.module_el8+299+aa6e9afa appstream 892 k 2023-06-20T13:34:17.424 INFO:teuthology.orchestra.run.smithi032.stdout: python2-setuptools-wheel noarch 39.0.1-13.module_el8+299+aa6e9afa appstream 287 k 2023-06-20T13:34:17.424 INFO:teuthology.orchestra.run.smithi032.stdout: python2-wheel-wheel noarch 1:0.31.1-3.module_el8+299+aa6e9afa appstream 44 k 2023-06-20T13:34:17.425 INFO:teuthology.orchestra.run.smithi032.stdout: rmt x86_64 2:1.5.3-13.el8 baseos 51 k 2023-06-20T13:34:17.425 INFO:teuthology.orchestra.run.smithi032.stdout:Installing weak dependencies: 2023-06-20T13:34:17.425 INFO:teuthology.orchestra.run.smithi032.stdout: python2-pip noarch 9.0.3-19.module_el8+299+aa6e9afa appstream 1.8 M 2023-06-20T13:34:17.425 INFO:teuthology.orchestra.run.smithi032.stdout: python2-setuptools noarch 39.0.1-13.module_el8+299+aa6e9afa appstream 702 k 2023-06-20T13:34:17.425 INFO:teuthology.orchestra.run.smithi032.stdout:Enabling module streams: 2023-06-20T13:34:17.425 INFO:teuthology.orchestra.run.smithi032.stdout: python27 2.7 2023-06-20T13:34:17.426 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:34:17.426 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction Summary 2023-06-20T13:34:17.426 INFO:teuthology.orchestra.run.smithi032.stdout:======================================================================================= 2023-06-20T13:34:17.426 INFO:teuthology.orchestra.run.smithi032.stdout:Install 14 Packages 2023-06-20T13:34:17.426 INFO:teuthology.orchestra.run.smithi032.stdout:Upgrade 2 Packages 2023-06-20T13:34:17.426 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:34:17.427 INFO:teuthology.orchestra.run.smithi032.stdout:Total download size: 13 M 2023-06-20T13:34:17.427 INFO:teuthology.orchestra.run.smithi032.stdout:Downloading Packages: 2023-06-20T13:34:17.907 INFO:teuthology.orchestra.run.smithi032.stdout:(1/16): libpmemblk-1.6.1-1.el8.x86_64.rpm 480 kB/s | 92 kB 00:00 2023-06-20T13:34:17.965 INFO:teuthology.orchestra.run.smithi032.stdout:(2/16): python2-2.7.18-12.module_el8+299+aa6e9a 443 kB/s | 110 kB 00:00 2023-06-20T13:34:18.101 INFO:teuthology.orchestra.run.smithi032.stdout:(3/16): fio-3.19-4.el8.x86_64.rpm 1.4 MB/s | 538 kB 00:00 2023-06-20T13:34:18.226 INFO:teuthology.orchestra.run.smithi032.stdout:(4/16): python2-pip-9.0.3-19.module_el8+299+aa6 7.0 MB/s | 1.8 MB 00:00 2023-06-20T13:34:18.268 INFO:teuthology.orchestra.run.smithi032.stdout:(5/16): python2-pip-wheel-9.0.3-19.module_el8+2 5.2 MB/s | 892 kB 00:00 2023-06-20T13:34:18.335 INFO:teuthology.orchestra.run.smithi032.stdout:(6/16): python2-setuptools-39.0.1-13.module_el8 6.3 MB/s | 702 kB 00:00 2023-06-20T13:34:18.360 INFO:teuthology.orchestra.run.smithi032.stdout:(7/16): python2-setuptools-wheel-39.0.1-13.modu 3.1 MB/s | 287 kB 00:00 2023-06-20T13:34:18.394 INFO:teuthology.orchestra.run.smithi032.stdout:(8/16): python2-wheel-wheel-0.31.1-3.module_el8 762 kB/s | 44 kB 00:00 2023-06-20T13:34:18.419 INFO:teuthology.orchestra.run.smithi032.stdout:(9/16): daxctl-libs-71.1-7.el8.x86_64.rpm 720 kB/s | 42 kB 00:00 2023-06-20T13:34:18.452 INFO:teuthology.orchestra.run.smithi032.stdout:(10/16): dump-0.4-0.36.b46.el8.x86_64.rpm 2.8 MB/s | 164 kB 00:00 2023-06-20T13:34:18.478 INFO:teuthology.orchestra.run.smithi032.stdout:(11/16): ndctl-libs-71.1-7.el8.x86_64.rpm 1.3 MB/s | 80 kB 00:00 2023-06-20T13:34:18.511 INFO:teuthology.orchestra.run.smithi032.stdout:(12/16): rmt-1.5.3-13.el8.x86_64.rpm 879 kB/s | 51 kB 00:00 2023-06-20T13:34:18.604 INFO:teuthology.orchestra.run.smithi032.stdout:(13/16): python2-libs-2.7.18-12.module_el8+299+ 9.3 MB/s | 6.5 MB 00:00 2023-06-20T13:34:18.646 INFO:teuthology.orchestra.run.smithi032.stdout:(14/16): sqlite-3.26.0-18.el8.x86_64.rpm 4.9 MB/s | 668 kB 00:00 2023-06-20T13:34:18.712 INFO:teuthology.orchestra.run.smithi032.stdout:(15/16): sqlite-libs-3.26.0-18.el8.x86_64.rpm 5.2 MB/s | 581 kB 00:00 2023-06-20T13:34:38.743 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:34:38.748 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:35:08.930 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:35:08.935 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:35:39.091 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:35:39.096 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:36:09.211 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:36:09.216 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:36:28.318 INFO:teuthology.orchestra.run.smithi032.stdout:[MIRROR] indent-2.2.13-2.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/i/indent-2.2.13-2.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-06-20T13:36:28.601 INFO:teuthology.orchestra.run.smithi032.stdout:(16/16): indent-2.2.13-2.el8.x86_64.rpm 1.4 kB/s | 187 kB 02:10 2023-06-20T13:36:28.601 INFO:teuthology.orchestra.run.smithi032.stdout:-------------------------------------------------------------------------------- 2023-06-20T13:36:28.601 INFO:teuthology.orchestra.run.smithi032.stdout:Total 98 kB/s | 13 MB 02:11 2023-06-20T13:36:28.985 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction check 2023-06-20T13:36:29.029 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction check succeeded. 2023-06-20T13:36:29.030 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction test 2023-06-20T13:36:29.276 INFO:teuthology.orchestra.run.smithi032.stdout:Transaction test succeeded. 2023-06-20T13:36:29.281 INFO:teuthology.orchestra.run.smithi032.stdout:Running transaction 2023-06-20T13:36:30.039 INFO:teuthology.orchestra.run.smithi032.stdout: Preparing : 1/1 2023-06-20T13:36:30.197 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : sqlite-libs-3.26.0-18.el8.x86_64 1/18 2023-06-20T13:36:30.382 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : daxctl-libs-71.1-7.el8.x86_64 2/18 2023-06-20T13:36:30.473 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: daxctl-libs-71.1-7.el8.x86_64 2/18 2023-06-20T13:36:30.657 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : ndctl-libs-71.1-7.el8.x86_64 3/18 2023-06-20T13:36:30.750 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: ndctl-libs-71.1-7.el8.x86_64 3/18 2023-06-20T13:36:30.874 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 4/18 2023-06-20T13:36:30.964 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 4/18 2023-06-20T13:36:31.264 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 5/18 2023-06-20T13:36:31.408 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python2-setuptools-wheel-39.0.1-13.module_el8+299+ 6/18 2023-06-20T13:36:32.958 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa 7/18 2023-06-20T13:36:33.731 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86 8/18 2023-06-20T13:36:34.137 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarc 9/18 2023-06-20T13:36:34.339 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python2-setuptools-39.0.1-13.module_el8+299+aa6e9a 10/18 2023-06-20T13:36:34.489 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 11/18 2023-06-20T13:36:34.535 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 11/18 2023-06-20T13:36:34.902 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 12/18 2023-06-20T13:36:35.143 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : fio-3.19-4.el8.x86_64 13/18 2023-06-20T13:36:35.387 INFO:teuthology.orchestra.run.smithi032.stdout: Upgrading : sqlite-3.26.0-18.el8.x86_64 14/18 2023-06-20T13:36:35.545 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : indent-2.2.13-2.el8.x86_64 15/18 2023-06-20T13:36:35.682 INFO:teuthology.orchestra.run.smithi032.stdout: Installing : python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 16/18 2023-06-20T13:36:35.824 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : sqlite-3.26.0-17.el8.x86_64 17/18 2023-06-20T13:36:35.974 INFO:teuthology.orchestra.run.smithi032.stdout: Cleanup : sqlite-libs-3.26.0-17.el8.x86_64 18/18 2023-06-20T13:36:36.502 INFO:teuthology.orchestra.run.smithi032.stdout: Running scriptlet: sqlite-libs-3.26.0-17.el8.x86_64 18/18 2023-06-20T13:36:36.502 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : fio-3.19-4.el8.x86_64 1/18 2023-06-20T13:36:36.503 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 2/18 2023-06-20T13:36:36.503 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 3/18 2023-06-20T13:36:36.503 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86 4/18 2023-06-20T13:36:36.503 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarc 5/18 2023-06-20T13:36:36.503 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa 6/18 2023-06-20T13:36:36.503 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python2-setuptools-39.0.1-13.module_el8+299+aa6e9a 7/18 2023-06-20T13:36:36.504 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python2-setuptools-wheel-39.0.1-13.module_el8+299+ 8/18 2023-06-20T13:36:36.504 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 9/18 2023-06-20T13:36:36.505 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : daxctl-libs-71.1-7.el8.x86_64 10/18 2023-06-20T13:36:36.505 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 11/18 2023-06-20T13:36:36.505 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : ndctl-libs-71.1-7.el8.x86_64 12/18 2023-06-20T13:36:36.505 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 13/18 2023-06-20T13:36:36.505 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : indent-2.2.13-2.el8.x86_64 14/18 2023-06-20T13:36:36.505 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : sqlite-3.26.0-18.el8.x86_64 15/18 2023-06-20T13:36:36.505 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : sqlite-3.26.0-17.el8.x86_64 16/18 2023-06-20T13:36:36.506 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : sqlite-libs-3.26.0-18.el8.x86_64 17/18 2023-06-20T13:36:37.356 INFO:teuthology.orchestra.run.smithi032.stdout: Verifying : sqlite-libs-3.26.0-17.el8.x86_64 18/18 2023-06-20T13:36:37.356 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:36:37.356 INFO:teuthology.orchestra.run.smithi032.stdout:Upgraded: 2023-06-20T13:36:37.356 INFO:teuthology.orchestra.run.smithi032.stdout: sqlite-3.26.0-18.el8.x86_64 sqlite-libs-3.26.0-18.el8.x86_64 2023-06-20T13:36:37.356 INFO:teuthology.orchestra.run.smithi032.stdout:Installed: 2023-06-20T13:36:37.357 INFO:teuthology.orchestra.run.smithi032.stdout: daxctl-libs-71.1-7.el8.x86_64 2023-06-20T13:36:37.357 INFO:teuthology.orchestra.run.smithi032.stdout: dump-1:0.4-0.36.b46.el8.x86_64 2023-06-20T13:36:37.357 INFO:teuthology.orchestra.run.smithi032.stdout: fio-3.19-4.el8.x86_64 2023-06-20T13:36:37.357 INFO:teuthology.orchestra.run.smithi032.stdout: indent-2.2.13-2.el8.x86_64 2023-06-20T13:36:37.357 INFO:teuthology.orchestra.run.smithi032.stdout: libpmemblk-1.6.1-1.el8.x86_64 2023-06-20T13:36:37.357 INFO:teuthology.orchestra.run.smithi032.stdout: ndctl-libs-71.1-7.el8.x86_64 2023-06-20T13:36:37.357 INFO:teuthology.orchestra.run.smithi032.stdout: python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 2023-06-20T13:36:37.357 INFO:teuthology.orchestra.run.smithi032.stdout: python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86_64 2023-06-20T13:36:37.358 INFO:teuthology.orchestra.run.smithi032.stdout: python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarch 2023-06-20T13:36:37.358 INFO:teuthology.orchestra.run.smithi032.stdout: python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa.noarch 2023-06-20T13:36:37.358 INFO:teuthology.orchestra.run.smithi032.stdout: python2-setuptools-39.0.1-13.module_el8+299+aa6e9afa.noarch 2023-06-20T13:36:37.358 INFO:teuthology.orchestra.run.smithi032.stdout: python2-setuptools-wheel-39.0.1-13.module_el8+299+aa6e9afa.noarch 2023-06-20T13:36:37.358 INFO:teuthology.orchestra.run.smithi032.stdout: python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e9afa.noarch 2023-06-20T13:36:37.358 INFO:teuthology.orchestra.run.smithi032.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-06-20T13:36:37.358 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:36:37.358 INFO:teuthology.orchestra.run.smithi032.stdout:Complete! 2023-06-20T13:36:37.803 DEBUG:teuthology.orchestra.run.smithi032:> sudo useradd -m fsgqa 2023-06-20T13:36:37.875 INFO:teuthology.orchestra.run.smithi032.stderr:useradd: user 'fsgqa' already exists 2023-06-20T13:36:37.877 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-06-20T13:36:37.878 DEBUG:teuthology.orchestra.run.smithi032:> sudo groupadd fsgqa 2023-06-20T13:36:37.946 INFO:teuthology.orchestra.run.smithi032.stderr:groupadd: group 'fsgqa' already exists 2023-06-20T13:36:37.948 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-06-20T13:36:37.949 DEBUG:teuthology.orchestra.run.smithi032:> sudo useradd fsgqa2 2023-06-20T13:36:38.857 DEBUG:teuthology.orchestra.run.smithi032:> sudo useradd 123456-fsgqa 2023-06-20T13:36:39.315 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:36:39.319 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:36:39.486 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-06-20T13:36:39.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.685+0000 7f85d5fff700 1 Processor -- start 2023-06-20T13:36:39.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.686+0000 7f85d5fff700 1 -- start start 2023-06-20T13:36:39.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.687+0000 7f85d5fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85d00d2640 0x7f85d00b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:36:39.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.687+0000 7f85d5fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7f85d00cf8f0 0x7f85d015fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:36:39.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.687+0000 7f85d5fff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d00d1790 con 0x7f85d015c460 2023-06-20T13:36:39.689 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.687+0000 7f85d5fff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85d00cedd0 con 0x7f85d00cf8f0 2023-06-20T13:36:39.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.687+0000 7f85d5fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00cd950 con 0x7f85d00d2640 2023-06-20T13:36:39.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.687+0000 7f85cf7fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f85d015c460 0x7f85d00cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:49804/0 (socket says 172.21.15.32:49804) 2023-06-20T13:36:39.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.687+0000 7f85cf7fe700 1 -- 172.21.15.32:0/4249740875 learned_addr learned my addr 172.21.15.32:0/4249740875 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:36:39.690 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.687+0000 7f85cffff700 1 --2- 172.21.15.32:0/4249740875 >> v2:172.21.15.32:3300/0 conn(0x7f85d00cf8f0 0x7f85d015fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:36:39.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.687+0000 7f85ceffd700 1 --2- 172.21.15.32:0/4249740875 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85d00d2640 0x7f85d00b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:36:39.691 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.688+0000 7f85cffff700 1 -- 172.21.15.32:0/4249740875 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85d00d2640 msgr2=0x7f85d00b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:36:39.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.688+0000 7f85cffff700 1 --2- 172.21.15.32:0/4249740875 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85d00d2640 0x7f85d00b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:36:39.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.688+0000 7f85cffff700 1 -- 172.21.15.32:0/4249740875 >> v1:172.21.15.32:6789/0 conn(0x7f85d015c460 legacy=0x7f85d00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:36:39.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.688+0000 7f85cffff700 1 -- 172.21.15.32:0/4249740875 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d00d14b0 con 0x7f85d00cf8f0 2023-06-20T13:36:39.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.688+0000 7f85ce7fc700 1 -- 172.21.15.32:0/4249740875 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1230969273 0 0) 0x7f85d00d1790 con 0x7f85d015c460 2023-06-20T13:36:39.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.688+0000 7f85cffff700 1 --2- 172.21.15.32:0/4249740875 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85d00cf8f0 0x7f85d015fe20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f85c8009d90 tx=0x7f85c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8726dc4df435aed server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:36:39.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.688+0000 7f85ce7fc700 1 -- 172.21.15.32:0/4249740875 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c800e070 con 0x7f85d00cf8f0 2023-06-20T13:36:39.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.688+0000 7f85ce7fc700 1 -- 172.21.15.32:0/4249740875 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c800bb20 con 0x7f85d00cf8f0 2023-06-20T13:36:39.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.688+0000 7f85ce7fc700 1 -- 172.21.15.32:0/4249740875 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c8012430 con 0x7f85d00cf8f0 2023-06-20T13:36:39.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.689+0000 7f85d5fff700 1 -- 172.21.15.32:0/4249740875 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85d00cf8f0 msgr2=0x7f85d015fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:36:39.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.689+0000 7f85d5fff700 1 --2- 172.21.15.32:0/4249740875 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85d00cf8f0 0x7f85d015fe20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f85c8009d90 tx=0x7f85c800b330 comp rx=0 tx=0).stop 2023-06-20T13:36:39.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.689+0000 7f85d5fff700 1 -- 172.21.15.32:0/4249740875 shutdown_connections 2023-06-20T13:36:39.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.689+0000 7f85d5fff700 1 --2- 172.21.15.32:0/4249740875 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85d00cf8f0 0x7f85d015fe20 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:36:39.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.689+0000 7f85d5fff700 1 --2- 172.21.15.32:0/4249740875 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85d00d2640 0x7f85d00b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:36:39.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.689+0000 7f85d5fff700 1 -- 172.21.15.32:0/4249740875 >> 172.21.15.32:0/4249740875 conn(0x7f85d0071660 msgr2=0x7f85d0071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:36:39.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.689+0000 7f85d5fff700 1 -- 172.21.15.32:0/4249740875 shutdown_connections 2023-06-20T13:36:39.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.689+0000 7f85d5fff700 1 -- 172.21.15.32:0/4249740875 wait complete. 2023-06-20T13:36:39.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.691+0000 7f85d5fff700 1 Processor -- start 2023-06-20T13:36:39.694 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.692+0000 7f85d5fff700 1 -- start start 2023-06-20T13:36:39.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.693+0000 7f85d5fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85d00cf8f0 0x7f85d00c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:36:39.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.693+0000 7f85d5fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85d00d2640 0x7f85d015a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:36:39.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.693+0000 7f85d5fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85d015c460 0x7f85d0149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:36:39.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.693+0000 7f85d5fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00c70c0 con 0x7f85d00d2640 2023-06-20T13:36:39.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.693+0000 7f85d5fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00c8330 con 0x7f85d015c460 2023-06-20T13:36:39.696 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.693+0000 7f85d5fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00c9000 con 0x7f85d00cf8f0 2023-06-20T13:36:39.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.693+0000 7f85ceffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85d00d2640 0x7f85d015a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:36:39.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.693+0000 7f85ceffd700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85d00d2640 0x7f85d015a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:46880/0 (socket says 172.21.15.32:46880) 2023-06-20T13:36:39.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.693+0000 7f85ceffd700 1 -- 172.21.15.32:0/2265455353 learned_addr learned my addr 172.21.15.32:0/2265455353 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:36:39.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.693+0000 7f85cffff700 1 --2- 172.21.15.32:0/2265455353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85d015c460 0x7f85d0149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:36:39.697 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.693+0000 7f85cf7fe700 1 --2- 172.21.15.32:0/2265455353 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85d00cf8f0 0x7f85d00c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:36:39.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.694+0000 7f85ceffd700 1 -- 172.21.15.32:0/2265455353 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85d00cf8f0 msgr2=0x7f85d00c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:36:39.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.694+0000 7f85ceffd700 1 --2- 172.21.15.32:0/2265455353 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85d00cf8f0 0x7f85d00c7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:36:39.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.694+0000 7f85ceffd700 1 -- 172.21.15.32:0/2265455353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85d015c460 msgr2=0x7f85d0149b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:36:39.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.694+0000 7f85ceffd700 1 --2- 172.21.15.32:0/2265455353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85d015c460 0x7f85d0149b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:36:39.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.694+0000 7f85ceffd700 1 -- 172.21.15.32:0/2265455353 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c8009a70 con 0x7f85d00d2640 2023-06-20T13:36:39.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.694+0000 7f85cffff700 1 --2- 172.21.15.32:0/2265455353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85d015c460 0x7f85d0149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:36:39.698 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.694+0000 7f85ceffd700 1 --2- 172.21.15.32:0/2265455353 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85d00d2640 0x7f85d015a0d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f85c400e850 tx=0x7f85c400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:36:39.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.694+0000 7f85b7fff700 1 -- 172.21.15.32:0/2265455353 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c40095b0 con 0x7f85d00d2640 2023-06-20T13:36:39.699 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.694+0000 7f85b7fff700 1 -- 172.21.15.32:0/2265455353 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c400ee50 con 0x7f85d00d2640 2023-06-20T13:36:39.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.694+0000 7f85d5fff700 1 -- 172.21.15.32:0/2265455353 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d00c7310 con 0x7f85d00d2640 2023-06-20T13:36:39.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.694+0000 7f85b7fff700 1 -- 172.21.15.32:0/2265455353 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c400ca70 con 0x7f85d00d2640 2023-06-20T13:36:39.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.694+0000 7f85d5fff700 1 -- 172.21.15.32:0/2265455353 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d00c78d0 con 0x7f85d00d2640 2023-06-20T13:36:39.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.695+0000 7f85d5fff700 1 -- 172.21.15.32:0/2265455353 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d004ea60 con 0x7f85d00d2640 2023-06-20T13:36:39.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.696+0000 7f85b7fff700 1 -- 172.21.15.32:0/2265455353 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f85c400cbd0 con 0x7f85d00d2640 2023-06-20T13:36:39.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.698+0000 7f85b7fff700 1 --2- 172.21.15.32:0/2265455353 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f85bc06ace0 0x7f85bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:36:39.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.698+0000 7f85b7fff700 1 -- 172.21.15.32:0/2265455353 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f85c4089610 con 0x7f85d00d2640 2023-06-20T13:36:39.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.698+0000 7f85cf7fe700 1 --2- 172.21.15.32:0/2265455353 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f85bc06ace0 0x7f85bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:36:39.701 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.699+0000 7f85cf7fe700 1 --2- 172.21.15.32:0/2265455353 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f85bc06ace0 0x7f85bc06d190 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f85c0000f60 tx=0x7f85c0007be0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:36:39.704 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.703+0000 7f85b7fff700 1 -- 172.21.15.32:0/2265455353 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f85c4057fc0 con 0x7f85d00d2640 2023-06-20T13:36:39.991 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.989+0000 7f85d5fff700 1 -- 172.21.15.32:0/2265455353 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f85d00b4fa0 con 0x7f85d00d2640 2023-06-20T13:36:39.992 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.990+0000 7f85b7fff700 1 -- 172.21.15.32:0/2265455353 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7f85c4057b50 con 0x7f85d00d2640 2023-06-20T13:36:39.992 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:36:39.993 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":1,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","modified":"2023-06-20T13:31:10.390872Z","created":"2023-06-20T13:31:10.390872Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:3300","nonce":0},{"type":"v1","addr":"172.21.15.32:6789","nonce":0}]},"addr":"172.21.15.32:6789/0","public_addr":"172.21.15.32:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3301","nonce":0},{"type":"v1","addr":"172.21.15.115:6790","nonce":0}]},"addr":"172.21.15.115:6790/0","public_addr":"172.21.15.115:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-06-20T13:36:39.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.992+0000 7f85d5fff700 1 -- 172.21.15.32:0/2265455353 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f85bc06ace0 msgr2=0x7f85bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:36:39.994 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.992+0000 7f85d5fff700 1 --2- 172.21.15.32:0/2265455353 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f85bc06ace0 0x7f85bc06d190 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f85c0000f60 tx=0x7f85c0007be0 comp rx=0 tx=0).stop 2023-06-20T13:36:39.995 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.992+0000 7f85d5fff700 1 -- 172.21.15.32:0/2265455353 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85d00d2640 msgr2=0x7f85d015a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:36:39.995 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.992+0000 7f85d5fff700 1 --2- 172.21.15.32:0/2265455353 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85d00d2640 0x7f85d015a0d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f85c400e850 tx=0x7f85c400ec10 comp rx=0 tx=0).stop 2023-06-20T13:36:39.995 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.992+0000 7f85d5fff700 1 -- 172.21.15.32:0/2265455353 shutdown_connections 2023-06-20T13:36:39.995 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.992+0000 7f85d5fff700 1 --2- 172.21.15.32:0/2265455353 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f85bc06ace0 0x7f85bc06d190 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:36:39.995 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.992+0000 7f85d5fff700 1 --2- 172.21.15.32:0/2265455353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85d015c460 0x7f85d0149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:36:39.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.992+0000 7f85d5fff700 1 --2- 172.21.15.32:0/2265455353 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f85d00cf8f0 0x7f85d00c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:36:39.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.992+0000 7f85d5fff700 1 --2- 172.21.15.32:0/2265455353 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f85d00d2640 0x7f85d015a0d0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:36:39.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.992+0000 7f85d5fff700 1 -- 172.21.15.32:0/2265455353 >> 172.21.15.32:0/2265455353 conn(0x7f85d0071660 msgr2=0x7f85d00b7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:36:39.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.992+0000 7f85d5fff700 1 -- 172.21.15.32:0/2265455353 shutdown_connections 2023-06-20T13:36:39.996 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:39.992+0000 7f85d5fff700 1 -- 172.21.15.32:0/2265455353 wait complete. 2023-06-20T13:36:39.997 INFO:teuthology.orchestra.run.smithi032.stderr:dumped monmap epoch 1 2023-06-20T13:36:40.013 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-06-20T13:36:40.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.214+0000 7faed69ff700 1 Processor -- start 2023-06-20T13:36:40.216 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.214+0000 7faed69ff700 1 -- start start 2023-06-20T13:36:40.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.216+0000 7faed69ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faed0165150 0x7faed0167530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:36:40.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.216+0000 7faed69ff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed00ce6e0 con 0x7faed006c450 2023-06-20T13:36:40.218 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.216+0000 7faed69ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed00ceb70 con 0x7faed015c1e0 2023-06-20T13:36:40.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.216+0000 7faed69ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed00d06d0 con 0x7faed0165150 2023-06-20T13:36:40.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.216+0000 7faecf7fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7faed006c450 0x7faed006ba50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:35388/0 (socket says 172.21.15.32:35388) 2023-06-20T13:36:40.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.216+0000 7faecf7fe700 1 -- 172.21.15.32:0/2739574262 learned_addr learned my addr 172.21.15.32:0/2739574262 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:36:40.219 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.216+0000 7faed4f9c700 1 --2- 172.21.15.32:0/2739574262 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faed0165150 0x7faed0167530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:36:40.220 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.217+0000 7faeceffd700 1 -- 172.21.15.32:0/2739574262 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1604070880 0 0) 0x7faed00ce6e0 con 0x7faed006c450 2023-06-20T13:36:40.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.217+0000 7faeceffd700 1 -- 172.21.15.32:0/2739574262 --> v1:172.21.15.32:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faeb80035b0 con 0x7faed006c450 2023-06-20T13:36:40.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.217+0000 7faeceffd700 1 -- 172.21.15.32:0/2739574262 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1411409319 0 0) 0x7faed00ceb70 con 0x7faed015c1e0 2023-06-20T13:36:40.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.217+0000 7faeceffd700 1 -- 172.21.15.32:0/2739574262 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faed00ce6e0 con 0x7faed015c1e0 2023-06-20T13:36:40.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.217+0000 7faed4f9c700 1 -- 172.21.15.32:0/2739574262 >> v1:172.21.15.115:6789/0 conn(0x7faed015c1e0 legacy=0x7faed00caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:36:40.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.217+0000 7faed4f9c700 1 -- 172.21.15.32:0/2739574262 >> v1:172.21.15.32:6789/0 conn(0x7faed006c450 legacy=0x7faed006ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:36:40.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.217+0000 7faed4f9c700 1 -- 172.21.15.32:0/2739574262 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed0070b60 con 0x7faed0165150 2023-06-20T13:36:40.221 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.217+0000 7faed4f9c700 1 --2- 172.21.15.32:0/2739574262 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faed0165150 0x7faed0167530 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faec8009dc0 tx=0x7faec800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a62cc7aaf347676 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:36:40.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.217+0000 7faeceffd700 1 -- 172.21.15.32:0/2739574262 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec800e070 con 0x7faed0165150 2023-06-20T13:36:40.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.217+0000 7faeceffd700 1 -- 172.21.15.32:0/2739574262 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec800bb20 con 0x7faed0165150 2023-06-20T13:36:40.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.218+0000 7faeceffd700 1 -- 172.21.15.32:0/2739574262 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec8012430 con 0x7faed0165150 2023-06-20T13:36:40.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.218+0000 7faed69ff700 1 -- 172.21.15.32:0/2739574262 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faed0165150 msgr2=0x7faed0167530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:36:40.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.218+0000 7faed69ff700 1 --2- 172.21.15.32:0/2739574262 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faed0165150 0x7faed0167530 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faec8009dc0 tx=0x7faec800b330 comp rx=0 tx=0).stop 2023-06-20T13:36:40.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.218+0000 7faed69ff700 1 -- 172.21.15.32:0/2739574262 shutdown_connections 2023-06-20T13:36:40.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.218+0000 7faed69ff700 1 --2- 172.21.15.32:0/2739574262 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faed0165150 0x7faed0167530 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:36:40.222 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.218+0000 7faed69ff700 1 -- 172.21.15.32:0/2739574262 >> 172.21.15.32:0/2739574262 conn(0x7faed006e550 msgr2=0x7faed006e920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:36:40.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.218+0000 7faed69ff700 1 -- 172.21.15.32:0/2739574262 shutdown_connections 2023-06-20T13:36:40.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.218+0000 7faed69ff700 1 -- 172.21.15.32:0/2739574262 wait complete. 2023-06-20T13:36:40.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.221+0000 7faed69ff700 1 Processor -- start 2023-06-20T13:36:40.223 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.221+0000 7faed69ff700 1 -- start start 2023-06-20T13:36:40.224 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.222+0000 7faed69ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faed006c450 0x7faed00c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:36:40.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.222+0000 7faed69ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faed015c1e0 0x7faed01552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:36:40.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.222+0000 7faed69ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faed0165150 0x7faed00b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:36:40.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.222+0000 7faed69ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed0157330 con 0x7faed006c450 2023-06-20T13:36:40.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.222+0000 7faed69ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed00c4d80 con 0x7faed015c1e0 2023-06-20T13:36:40.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.222+0000 7faed69ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed00c4490 con 0x7faed0165150 2023-06-20T13:36:40.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.222+0000 7faecffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faed006c450 0x7faed00c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:36:40.225 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.222+0000 7faecffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faed006c450 0x7faed00c83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:47626/0 (socket says 172.21.15.32:47626) 2023-06-20T13:36:40.226 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.222+0000 7faecffff700 1 -- 172.21.15.32:0/1402136254 learned_addr learned my addr 172.21.15.32:0/1402136254 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:36:40.226 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.222+0000 7faecf7fe700 1 --2- 172.21.15.32:0/1402136254 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faed015c1e0 0x7faed01552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:36:40.226 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.223+0000 7faed4f9c700 1 --2- 172.21.15.32:0/1402136254 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faed0165150 0x7faed00b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:36:40.227 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.223+0000 7faecffff700 1 -- 172.21.15.32:0/1402136254 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faed0165150 msgr2=0x7faed00b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:36:40.227 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.223+0000 7faecffff700 1 --2- 172.21.15.32:0/1402136254 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faed0165150 0x7faed00b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:36:40.227 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.223+0000 7faecffff700 1 -- 172.21.15.32:0/1402136254 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faed015c1e0 msgr2=0x7faed01552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:36:40.227 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.223+0000 7faecffff700 1 --2- 172.21.15.32:0/1402136254 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faed015c1e0 0x7faed01552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:36:40.227 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.223+0000 7faecffff700 1 -- 172.21.15.32:0/1402136254 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec8009a70 con 0x7faed006c450 2023-06-20T13:36:40.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.223+0000 7faecf7fe700 1 --2- 172.21.15.32:0/1402136254 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faed015c1e0 0x7faed01552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:36:40.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.223+0000 7faecffff700 1 --2- 172.21.15.32:0/1402136254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faed006c450 0x7faed00c83c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7faec000c520 tx=0x7faec000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:36:40.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.223+0000 7faeccff9700 1 -- 172.21.15.32:0/1402136254 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec00052d0 con 0x7faed006c450 2023-06-20T13:36:40.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.223+0000 7faeccff9700 1 -- 172.21.15.32:0/1402136254 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec0005430 con 0x7faed006c450 2023-06-20T13:36:40.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.223+0000 7faeccff9700 1 -- 172.21.15.32:0/1402136254 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec00038a0 con 0x7faed006c450 2023-06-20T13:36:40.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.223+0000 7faed69ff700 1 -- 172.21.15.32:0/1402136254 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed00c4730 con 0x7faed006c450 2023-06-20T13:36:40.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.224+0000 7faed69ff700 1 -- 172.21.15.32:0/1402136254 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed01563b0 con 0x7faed006c450 2023-06-20T13:36:40.228 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.225+0000 7faed69ff700 1 -- 172.21.15.32:0/1402136254 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed004ea60 con 0x7faed006c450 2023-06-20T13:36:40.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.225+0000 7faeccff9700 1 -- 172.21.15.32:0/1402136254 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faec0003a00 con 0x7faed006c450 2023-06-20T13:36:40.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.227+0000 7faeccff9700 1 --2- 172.21.15.32:0/1402136254 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7faebc06ace0 0x7faebc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:36:40.229 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.227+0000 7faeccff9700 1 -- 172.21.15.32:0/1402136254 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7faec0088ba0 con 0x7faed006c450 2023-06-20T13:36:40.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.227+0000 7faecf7fe700 1 --2- 172.21.15.32:0/1402136254 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7faebc06ace0 0x7faebc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:36:40.230 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.228+0000 7faecf7fe700 1 --2- 172.21.15.32:0/1402136254 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7faebc06ace0 0x7faebc06d190 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7faed0164d70 tx=0x7faec4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:36:40.233 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.231+0000 7faeccff9700 1 -- 172.21.15.32:0/1402136254 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7faec0053a30 con 0x7faed006c450 2023-06-20T13:36:40.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.521+0000 7faed69ff700 1 -- 172.21.15.32:0/1402136254 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7faed00c3ff0 con 0x7faed006c450 2023-06-20T13:36:40.523 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.521+0000 7faeccff9700 1 -- 172.21.15.32:0/1402136254 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) v1 ==== 92+0+63 (secure 0 0 0) 0x7faec0017050 con 0x7faed006c450 2023-06-20T13:36:40.524 INFO:teuthology.orchestra.run.smithi032.stdout:[client.admin] 2023-06-20T13:36:40.524 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== 2023-06-20T13:36:40.525 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.523+0000 7faed69ff700 1 -- 172.21.15.32:0/1402136254 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7faebc06ace0 msgr2=0x7faebc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:36:40.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.523+0000 7faed69ff700 1 --2- 172.21.15.32:0/1402136254 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7faebc06ace0 0x7faebc06d190 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7faed0164d70 tx=0x7faec4009040 comp rx=0 tx=0).stop 2023-06-20T13:36:40.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.523+0000 7faed69ff700 1 -- 172.21.15.32:0/1402136254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faed006c450 msgr2=0x7faed00c83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:36:40.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.523+0000 7faed69ff700 1 --2- 172.21.15.32:0/1402136254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faed006c450 0x7faed00c83c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7faec000c520 tx=0x7faec000c830 comp rx=0 tx=0).stop 2023-06-20T13:36:40.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.523+0000 7faed69ff700 1 -- 172.21.15.32:0/1402136254 shutdown_connections 2023-06-20T13:36:40.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.523+0000 7faed69ff700 1 --2- 172.21.15.32:0/1402136254 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7faebc06ace0 0x7faebc06d190 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:36:40.526 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.523+0000 7faed69ff700 1 --2- 172.21.15.32:0/1402136254 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faed0165150 0x7faed00b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:36:40.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.523+0000 7faed69ff700 1 --2- 172.21.15.32:0/1402136254 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faed006c450 0x7faed00c83c0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:36:40.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.523+0000 7faed69ff700 1 --2- 172.21.15.32:0/1402136254 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faed015c1e0 0x7faed01552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:36:40.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.523+0000 7faed69ff700 1 -- 172.21.15.32:0/1402136254 >> 172.21.15.32:0/1402136254 conn(0x7faed006e550 msgr2=0x7faed00b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:36:40.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.524+0000 7faed69ff700 1 -- 172.21.15.32:0/1402136254 shutdown_connections 2023-06-20T13:36:40.527 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:36:40.524+0000 7faed69ff700 1 -- 172.21.15.32:0/1402136254 wait complete. 2023-06-20T13:36:40.544 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:36:40.544 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/tmp/tmp.LENcwP3t9bxfstests-dev/local.config 2023-06-20T13:36:40.613 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.32:6789:/test export TEST_DIR=/tmp/tmp.smRYDztNNFtest export SCRATCH_DEV=172.21.15.32:6789:/scratch export SCRATCH_MNT=/tmp/tmp.r67jCbZY4dscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ==" 2023-06-20T13:36:40.614 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:36:40.614 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/tmp/tmp.LENcwP3t9bxfstests-dev/ceph.exclude 2023-06-20T13:36:40.721 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo make) 2023-06-20T13:36:40.860 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize -cfi 2023-06-20T13:36:41.331 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: putting auxiliary files in '.'. 2023-06-20T13:36:41.331 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: copying file './config.guess' 2023-06-20T13:36:41.341 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: copying file './config.sub' 2023-06-20T13:36:41.351 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: copying file './install-sh' 2023-06-20T13:36:41.363 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: copying file './ltmain.sh' 2023-06-20T13:36:41.423 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-06-20T13:36:41.424 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-06-20T13:36:41.436 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-06-20T13:36:41.449 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-06-20T13:36:41.461 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-06-20T13:36:41.474 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-06-20T13:36:41.490 INFO:teuthology.orchestra.run.smithi032.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-06-20T13:36:41.493 INFO:teuthology.orchestra.run.smithi032.stdout:cp include/install-sh . 2023-06-20T13:36:41.496 INFO:teuthology.orchestra.run.smithi032.stdout:aclocal -I m4 2023-06-20T13:36:42.760 INFO:teuthology.orchestra.run.smithi032.stdout:autoheader 2023-06-20T13:36:43.131 INFO:teuthology.orchestra.run.smithi032.stdout:autoconf 2023-06-20T13:36:43.344 INFO:teuthology.orchestra.run.smithi032.stdout:./configure \ 2023-06-20T13:36:43.345 INFO:teuthology.orchestra.run.smithi032.stdout: --libexecdir=/usr/lib \ 2023-06-20T13:36:43.345 INFO:teuthology.orchestra.run.smithi032.stdout: --exec_prefix=/var/lib 2023-06-20T13:36:43.977 INFO:teuthology.orchestra.run.smithi032.stdout:checking build system type... x86_64-pc-linux-gnu 2023-06-20T13:36:43.977 INFO:teuthology.orchestra.run.smithi032.stdout:checking host system type... x86_64-pc-linux-gnu 2023-06-20T13:36:43.981 INFO:teuthology.orchestra.run.smithi032.stdout:checking how to print strings... printf 2023-06-20T13:36:43.981 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gcc... gcc 2023-06-20T13:36:44.155 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether the C compiler works... yes 2023-06-20T13:36:44.155 INFO:teuthology.orchestra.run.smithi032.stdout:checking for C compiler default output file name... a.out 2023-06-20T13:36:44.205 INFO:teuthology.orchestra.run.smithi032.stdout:checking for suffix of executables... 2023-06-20T13:36:44.271 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether we are cross compiling... no 2023-06-20T13:36:44.308 INFO:teuthology.orchestra.run.smithi032.stdout:checking for suffix of object files... o 2023-06-20T13:36:44.343 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether we are using the GNU C compiler... yes 2023-06-20T13:36:44.377 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether gcc accepts -g... yes 2023-06-20T13:36:44.425 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gcc option to accept ISO C89... none needed 2023-06-20T13:36:44.433 INFO:teuthology.orchestra.run.smithi032.stdout:checking for a sed that does not truncate output... /bin/sed 2023-06-20T13:36:44.438 INFO:teuthology.orchestra.run.smithi032.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-06-20T13:36:44.441 INFO:teuthology.orchestra.run.smithi032.stdout:checking for egrep... /bin/grep -E 2023-06-20T13:36:44.444 INFO:teuthology.orchestra.run.smithi032.stdout:checking for fgrep... /bin/grep -F 2023-06-20T13:36:44.452 INFO:teuthology.orchestra.run.smithi032.stdout:checking for ld used by gcc... /bin/ld 2023-06-20T13:36:44.456 INFO:teuthology.orchestra.run.smithi032.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-06-20T13:36:44.469 INFO:teuthology.orchestra.run.smithi032.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-06-20T13:36:44.508 INFO:teuthology.orchestra.run.smithi032.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-06-20T13:36:44.509 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether ln -s works... yes 2023-06-20T13:36:44.526 INFO:teuthology.orchestra.run.smithi032.stdout:checking the maximum length of command line arguments... 1572864 2023-06-20T13:36:44.532 INFO:teuthology.orchestra.run.smithi032.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-06-20T13:36:44.533 INFO:teuthology.orchestra.run.smithi032.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-06-20T13:36:44.533 INFO:teuthology.orchestra.run.smithi032.stdout:checking for /bin/ld option to reload object files... -r 2023-06-20T13:36:44.533 INFO:teuthology.orchestra.run.smithi032.stdout:checking for objdump... objdump 2023-06-20T13:36:44.534 INFO:teuthology.orchestra.run.smithi032.stdout:checking how to recognize dependent libraries... pass_all 2023-06-20T13:36:44.534 INFO:teuthology.orchestra.run.smithi032.stdout:checking for dlltool... no 2023-06-20T13:36:44.535 INFO:teuthology.orchestra.run.smithi032.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-06-20T13:36:44.535 INFO:teuthology.orchestra.run.smithi032.stdout:checking for ar... ar 2023-06-20T13:36:44.594 INFO:teuthology.orchestra.run.smithi032.stdout:checking for archiver @FILE support... @ 2023-06-20T13:36:44.595 INFO:teuthology.orchestra.run.smithi032.stdout:checking for strip... strip 2023-06-20T13:36:44.595 INFO:teuthology.orchestra.run.smithi032.stdout:checking for ranlib... ranlib 2023-06-20T13:36:44.595 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gawk... gawk 2023-06-20T13:36:44.706 INFO:teuthology.orchestra.run.smithi032.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-06-20T13:36:44.709 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sysroot... no 2023-06-20T13:36:44.716 INFO:teuthology.orchestra.run.smithi032.stdout:checking for a working dd... /bin/dd 2023-06-20T13:36:44.723 INFO:teuthology.orchestra.run.smithi032.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-06-20T13:36:44.752 INFO:teuthology.orchestra.run.smithi032.stdout:checking for mt... no 2023-06-20T13:36:44.757 INFO:teuthology.orchestra.run.smithi032.stdout:checking if : is a manifest tool... no 2023-06-20T13:36:44.825 INFO:teuthology.orchestra.run.smithi032.stdout:checking how to run the C preprocessor... gcc -E 2023-06-20T13:36:45.054 INFO:teuthology.orchestra.run.smithi032.stdout:checking for ANSI C header files... yes 2023-06-20T13:36:45.099 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/types.h... yes 2023-06-20T13:36:45.158 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/stat.h... yes 2023-06-20T13:36:45.210 INFO:teuthology.orchestra.run.smithi032.stdout:checking for stdlib.h... yes 2023-06-20T13:36:45.264 INFO:teuthology.orchestra.run.smithi032.stdout:checking for string.h... yes 2023-06-20T13:36:45.320 INFO:teuthology.orchestra.run.smithi032.stdout:checking for memory.h... yes 2023-06-20T13:36:45.374 INFO:teuthology.orchestra.run.smithi032.stdout:checking for strings.h... yes 2023-06-20T13:36:45.436 INFO:teuthology.orchestra.run.smithi032.stdout:checking for inttypes.h... yes 2023-06-20T13:36:45.490 INFO:teuthology.orchestra.run.smithi032.stdout:checking for stdint.h... yes 2023-06-20T13:36:45.548 INFO:teuthology.orchestra.run.smithi032.stdout:checking for unistd.h... yes 2023-06-20T13:36:45.610 INFO:teuthology.orchestra.run.smithi032.stdout:checking for dlfcn.h... yes 2023-06-20T13:36:45.619 INFO:teuthology.orchestra.run.smithi032.stdout:checking for objdir... .libs 2023-06-20T13:36:45.754 INFO:teuthology.orchestra.run.smithi032.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-06-20T13:36:45.754 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-06-20T13:36:45.793 INFO:teuthology.orchestra.run.smithi032.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-06-20T13:36:45.832 INFO:teuthology.orchestra.run.smithi032.stdout:checking if gcc static flag -static works... no 2023-06-20T13:36:45.886 INFO:teuthology.orchestra.run.smithi032.stdout:checking if gcc supports -c -o file.o... yes 2023-06-20T13:36:45.886 INFO:teuthology.orchestra.run.smithi032.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-06-20T13:36:45.901 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-06-20T13:36:45.950 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether -lc should be explicitly linked in... no 2023-06-20T13:36:46.054 INFO:teuthology.orchestra.run.smithi032.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-06-20T13:36:46.054 INFO:teuthology.orchestra.run.smithi032.stdout:checking how to hardcode library paths into programs... immediate 2023-06-20T13:36:46.066 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether stripping libraries is possible... yes 2023-06-20T13:36:46.066 INFO:teuthology.orchestra.run.smithi032.stdout:checking if libtool supports shared libraries... yes 2023-06-20T13:36:46.066 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether to build shared libraries... yes 2023-06-20T13:36:46.067 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether to build static libraries... yes 2023-06-20T13:36:46.078 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gcc... (cached) gcc 2023-06-20T13:36:46.117 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-06-20T13:36:46.117 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether gcc accepts -g... (cached) yes 2023-06-20T13:36:46.117 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-06-20T13:36:46.118 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gmake... /usr/bin/gmake 2023-06-20T13:36:46.118 INFO:teuthology.orchestra.run.smithi032.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-06-20T13:36:46.119 INFO:teuthology.orchestra.run.smithi032.stdout:checking for tar... /bin/tar 2023-06-20T13:36:46.119 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gzip... /bin/gzip 2023-06-20T13:36:46.134 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether gcc -MM is supported... yes 2023-06-20T13:36:46.135 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sort... /bin/sort 2023-06-20T13:36:46.135 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether ln -s works... yes 2023-06-20T13:36:46.136 INFO:teuthology.orchestra.run.smithi032.stdout:checking for rpm... /bin/rpm 2023-06-20T13:36:46.144 INFO:teuthology.orchestra.run.smithi032.stdout:checking for rpmbuild... no 2023-06-20T13:36:46.200 INFO:teuthology.orchestra.run.smithi032.stdout:checking assert.h usability... yes 2023-06-20T13:36:46.216 INFO:teuthology.orchestra.run.smithi032.stdout:checking assert.h presence... yes 2023-06-20T13:36:46.216 INFO:teuthology.orchestra.run.smithi032.stdout:checking for assert.h... yes 2023-06-20T13:36:46.273 INFO:teuthology.orchestra.run.smithi032.stdout:checking bstring.h usability... no 2023-06-20T13:36:46.297 INFO:teuthology.orchestra.run.smithi032.stdout:checking bstring.h presence... no 2023-06-20T13:36:46.298 INFO:teuthology.orchestra.run.smithi032.stdout:checking for bstring.h... no 2023-06-20T13:36:46.347 INFO:teuthology.orchestra.run.smithi032.stdout:checking libgen.h usability... yes 2023-06-20T13:36:46.363 INFO:teuthology.orchestra.run.smithi032.stdout:checking libgen.h presence... yes 2023-06-20T13:36:46.363 INFO:teuthology.orchestra.run.smithi032.stdout:checking for libgen.h... yes 2023-06-20T13:36:46.422 INFO:teuthology.orchestra.run.smithi032.stdout:checking dirent.h usability... yes 2023-06-20T13:36:46.439 INFO:teuthology.orchestra.run.smithi032.stdout:checking dirent.h presence... yes 2023-06-20T13:36:46.439 INFO:teuthology.orchestra.run.smithi032.stdout:checking for dirent.h... yes 2023-06-20T13:36:46.520 INFO:teuthology.orchestra.run.smithi032.stdout:checking errno.h usability... yes 2023-06-20T13:36:46.537 INFO:teuthology.orchestra.run.smithi032.stdout:checking errno.h presence... yes 2023-06-20T13:36:46.537 INFO:teuthology.orchestra.run.smithi032.stdout:checking for errno.h... yes 2023-06-20T13:36:46.600 INFO:teuthology.orchestra.run.smithi032.stdout:checking malloc.h usability... yes 2023-06-20T13:36:46.618 INFO:teuthology.orchestra.run.smithi032.stdout:checking malloc.h presence... yes 2023-06-20T13:36:46.618 INFO:teuthology.orchestra.run.smithi032.stdout:checking for malloc.h... yes 2023-06-20T13:36:46.675 INFO:teuthology.orchestra.run.smithi032.stdout:checking uuid.h usability... no 2023-06-20T13:36:46.699 INFO:teuthology.orchestra.run.smithi032.stdout:checking uuid.h presence... no 2023-06-20T13:36:46.700 INFO:teuthology.orchestra.run.smithi032.stdout:checking for uuid.h... no 2023-06-20T13:36:46.757 INFO:teuthology.orchestra.run.smithi032.stdout:checking uuid/uuid.h usability... yes 2023-06-20T13:36:46.777 INFO:teuthology.orchestra.run.smithi032.stdout:checking uuid/uuid.h presence... yes 2023-06-20T13:36:46.777 INFO:teuthology.orchestra.run.smithi032.stdout:checking for uuid/uuid.h... yes 2023-06-20T13:36:46.835 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/uuid.h usability... no 2023-06-20T13:36:46.860 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/uuid.h presence... no 2023-06-20T13:36:46.860 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/uuid.h... no 2023-06-20T13:36:46.911 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/file.h usability... yes 2023-06-20T13:36:46.928 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/file.h presence... yes 2023-06-20T13:36:46.929 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/file.h... yes 2023-06-20T13:36:46.987 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/fcntl.h usability... yes 2023-06-20T13:36:47.004 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/fcntl.h presence... yes 2023-06-20T13:36:47.004 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/fcntl.h... yes 2023-06-20T13:36:47.062 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/syssgi.h usability... no 2023-06-20T13:36:47.086 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/syssgi.h presence... no 2023-06-20T13:36:47.087 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/syssgi.h... no 2023-06-20T13:36:47.162 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/param.h usability... yes 2023-06-20T13:36:47.184 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/param.h presence... yes 2023-06-20T13:36:47.184 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/param.h... yes 2023-06-20T13:36:47.198 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/stat.h... (cached) yes 2023-06-20T13:36:47.263 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/statvfs.h usability... yes 2023-06-20T13:36:47.280 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/statvfs.h presence... yes 2023-06-20T13:36:47.280 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/statvfs.h... yes 2023-06-20T13:36:47.338 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/time.h usability... yes 2023-06-20T13:36:47.355 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/time.h presence... yes 2023-06-20T13:36:47.355 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/time.h... yes 2023-06-20T13:36:47.422 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/ioctl.h usability... yes 2023-06-20T13:36:47.439 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/ioctl.h presence... yes 2023-06-20T13:36:47.439 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/ioctl.h... yes 2023-06-20T13:36:47.501 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/wait.h usability... yes 2023-06-20T13:36:47.520 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/wait.h presence... yes 2023-06-20T13:36:47.520 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/wait.h... yes 2023-06-20T13:36:47.534 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/types.h... (cached) yes 2023-06-20T13:36:47.548 INFO:teuthology.orchestra.run.smithi032.stdout:checking for strings.h... (cached) yes 2023-06-20T13:36:47.606 INFO:teuthology.orchestra.run.smithi032.stdout:checking err.h usability... yes 2023-06-20T13:36:47.623 INFO:teuthology.orchestra.run.smithi032.stdout:checking err.h presence... yes 2023-06-20T13:36:47.623 INFO:teuthology.orchestra.run.smithi032.stdout:checking for err.h... yes 2023-06-20T13:36:47.681 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/falloc.h usability... yes 2023-06-20T13:36:47.696 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/falloc.h presence... yes 2023-06-20T13:36:47.697 INFO:teuthology.orchestra.run.smithi032.stdout:checking for linux/falloc.h... yes 2023-06-20T13:36:47.754 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-06-20T13:36:47.778 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-06-20T13:36:47.778 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/fs/xfs_fsops.h... no 2023-06-20T13:36:47.827 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/fs/xfs_itable.h usability... no 2023-06-20T13:36:47.852 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/fs/xfs_itable.h presence... no 2023-06-20T13:36:47.852 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/fs/xfs_itable.h... no 2023-06-20T13:36:47.901 INFO:teuthology.orchestra.run.smithi032.stdout:checking xfs/platform_defs.h usability... no 2023-06-20T13:36:47.925 INFO:teuthology.orchestra.run.smithi032.stdout:checking xfs/platform_defs.h presence... no 2023-06-20T13:36:47.926 INFO:teuthology.orchestra.run.smithi032.stdout:checking for xfs/platform_defs.h... no 2023-06-20T13:36:47.974 INFO:teuthology.orchestra.run.smithi032.stdout:checking btrfs/ioctl.h usability... no 2023-06-20T13:36:47.999 INFO:teuthology.orchestra.run.smithi032.stdout:checking btrfs/ioctl.h presence... no 2023-06-20T13:36:47.999 INFO:teuthology.orchestra.run.smithi032.stdout:checking for btrfs/ioctl.h... no 2023-06-20T13:36:48.048 INFO:teuthology.orchestra.run.smithi032.stdout:checking cifs/ioctl.h usability... no 2023-06-20T13:36:48.073 INFO:teuthology.orchestra.run.smithi032.stdout:checking cifs/ioctl.h presence... no 2023-06-20T13:36:48.074 INFO:teuthology.orchestra.run.smithi032.stdout:checking for cifs/ioctl.h... no 2023-06-20T13:36:48.124 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/mman.h usability... yes 2023-06-20T13:36:48.141 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/mman.h presence... yes 2023-06-20T13:36:48.141 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/mman.h... yes 2023-06-20T13:36:48.179 INFO:teuthology.orchestra.run.smithi032.stdout:checking for xfs/xfs_log_format.h... no 2023-06-20T13:36:48.246 INFO:teuthology.orchestra.run.smithi032.stdout:checking for uuid_compare... no 2023-06-20T13:36:48.303 INFO:teuthology.orchestra.run.smithi032.stdout:checking for uuid_compare in -luuid... yes 2023-06-20T13:36:48.396 INFO:teuthology.orchestra.run.smithi032.stdout:checking for xfs/xfs.h... yes 2023-06-20T13:36:48.428 INFO:teuthology.orchestra.run.smithi032.stdout:checking for xfs/libxfs.h... no 2023-06-20T13:36:48.467 INFO:teuthology.orchestra.run.smithi032.stdout:checking whether xlog_assign_lsn is declared... no 2023-06-20T13:36:48.521 INFO:teuthology.orchestra.run.smithi032.stdout:checking for xfs/xqm.h... yes 2023-06-20T13:36:48.602 INFO:teuthology.orchestra.run.smithi032.stdout:checking xfsctl from xfs/xfs.h... ok 2023-06-20T13:36:48.648 INFO:teuthology.orchestra.run.smithi032.stdout:checking xfs/handle.h usability... yes 2023-06-20T13:36:48.663 INFO:teuthology.orchestra.run.smithi032.stdout:checking xfs/handle.h presence... yes 2023-06-20T13:36:48.663 INFO:teuthology.orchestra.run.smithi032.stdout:checking for xfs/handle.h... yes 2023-06-20T13:36:48.723 INFO:teuthology.orchestra.run.smithi032.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-06-20T13:36:48.772 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/acl.h usability... yes 2023-06-20T13:36:48.790 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/acl.h presence... yes 2023-06-20T13:36:48.791 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/acl.h... yes 2023-06-20T13:36:48.843 INFO:teuthology.orchestra.run.smithi032.stdout:checking acl/libacl.h usability... yes 2023-06-20T13:36:48.861 INFO:teuthology.orchestra.run.smithi032.stdout:checking acl/libacl.h presence... yes 2023-06-20T13:36:48.862 INFO:teuthology.orchestra.run.smithi032.stdout:checking for acl/libacl.h... yes 2023-06-20T13:36:48.922 INFO:teuthology.orchestra.run.smithi032.stdout:checking for acl_init in -lacl... yes 2023-06-20T13:36:48.967 INFO:teuthology.orchestra.run.smithi032.stdout:checking gdbm-ndbm.h usability... no 2023-06-20T13:36:48.992 INFO:teuthology.orchestra.run.smithi032.stdout:checking gdbm-ndbm.h presence... no 2023-06-20T13:36:48.992 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gdbm-ndbm.h... no 2023-06-20T13:36:49.035 INFO:teuthology.orchestra.run.smithi032.stdout:checking gdbm/ndbm.h usability... no 2023-06-20T13:36:49.059 INFO:teuthology.orchestra.run.smithi032.stdout:checking gdbm/ndbm.h presence... no 2023-06-20T13:36:49.060 INFO:teuthology.orchestra.run.smithi032.stdout:checking for gdbm/ndbm.h... no 2023-06-20T13:36:49.103 INFO:teuthology.orchestra.run.smithi032.stdout:checking ndbm.h usability... no 2023-06-20T13:36:49.127 INFO:teuthology.orchestra.run.smithi032.stdout:checking ndbm.h presence... no 2023-06-20T13:36:49.128 INFO:teuthology.orchestra.run.smithi032.stdout:checking for ndbm.h... no 2023-06-20T13:36:49.175 INFO:teuthology.orchestra.run.smithi032.stdout:checking libaio.h usability... yes 2023-06-20T13:36:49.196 INFO:teuthology.orchestra.run.smithi032.stdout:checking libaio.h presence... yes 2023-06-20T13:36:49.197 INFO:teuthology.orchestra.run.smithi032.stdout:checking for libaio.h... yes 2023-06-20T13:36:49.242 INFO:teuthology.orchestra.run.smithi032.stdout:checking liburing.h usability... no 2023-06-20T13:36:49.267 INFO:teuthology.orchestra.run.smithi032.stdout:checking liburing.h presence... no 2023-06-20T13:36:49.267 INFO:teuthology.orchestra.run.smithi032.stdout:checking for liburing.h... no 2023-06-20T13:36:49.310 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/capability.h usability... no 2023-06-20T13:36:49.335 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/capability.h presence... no 2023-06-20T13:36:49.335 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/capability.h... no 2023-06-20T13:36:49.380 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/fiemap.h usability... yes 2023-06-20T13:36:49.396 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/fiemap.h presence... yes 2023-06-20T13:36:49.397 INFO:teuthology.orchestra.run.smithi032.stdout:checking for linux/fiemap.h... yes 2023-06-20T13:36:49.457 INFO:teuthology.orchestra.run.smithi032.stdout:checking for fallocate... yes 2023-06-20T13:36:49.518 INFO:teuthology.orchestra.run.smithi032.stdout:checking for open_by_handle_at... yes 2023-06-20T13:36:49.566 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/prctl.h usability... yes 2023-06-20T13:36:49.583 INFO:teuthology.orchestra.run.smithi032.stdout:checking sys/prctl.h presence... yes 2023-06-20T13:36:49.583 INFO:teuthology.orchestra.run.smithi032.stdout:checking for sys/prctl.h... yes 2023-06-20T13:36:49.631 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/fs.h usability... yes 2023-06-20T13:36:49.647 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/fs.h presence... yes 2023-06-20T13:36:49.647 INFO:teuthology.orchestra.run.smithi032.stdout:checking for linux/fs.h... yes 2023-06-20T13:36:49.691 INFO:teuthology.orchestra.run.smithi032.stdout:checking btrfsutil.h usability... no 2023-06-20T13:36:49.715 INFO:teuthology.orchestra.run.smithi032.stdout:checking btrfsutil.h presence... no 2023-06-20T13:36:49.715 INFO:teuthology.orchestra.run.smithi032.stdout:checking for btrfsutil.h... no 2023-06-20T13:36:49.786 INFO:teuthology.orchestra.run.smithi032.stdout:checking for copy_file_range... yes 2023-06-20T13:36:49.850 INFO:teuthology.orchestra.run.smithi032.stdout:checking for SEEK_DATA... yes 2023-06-20T13:36:49.930 INFO:teuthology.orchestra.run.smithi032.stdout:checking for BMV_OF_SHARED... yes 2023-06-20T13:36:49.995 INFO:teuthology.orchestra.run.smithi032.stdout:checking for nftw... yes 2023-06-20T13:36:50.066 INFO:teuthology.orchestra.run.smithi032.stdout:checking for RLIMIT_NOFILE... yes 2023-06-20T13:36:50.105 INFO:teuthology.orchestra.run.smithi032.stdout:checking for FIEXCHANGE_RANGE... no 2023-06-20T13:36:50.165 INFO:teuthology.orchestra.run.smithi032.stdout:checking for renameat2... yes 2023-06-20T13:36:50.227 INFO:teuthology.orchestra.run.smithi032.stdout:checking for reallocarray... yes 2023-06-20T13:36:50.260 INFO:teuthology.orchestra.run.smithi032.stdout:checking for struct mount_attr... no 2023-06-20T13:36:50.341 INFO:teuthology.orchestra.run.smithi032.stdout:checking for struct btrfs_qgroup_limit... yes 2023-06-20T13:36:50.415 INFO:teuthology.orchestra.run.smithi032.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-06-20T13:36:50.489 INFO:teuthology.orchestra.run.smithi032.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-06-20T13:36:50.563 INFO:teuthology.orchestra.run.smithi032.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-06-20T13:36:50.777 INFO:teuthology.orchestra.run.smithi032.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-06-20T13:36:50.851 INFO:teuthology.orchestra.run.smithi032.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-06-20T13:36:50.924 INFO:teuthology.orchestra.run.smithi032.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-06-20T13:36:50.979 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/btrfs.h usability... yes 2023-06-20T13:36:50.995 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/btrfs.h presence... yes 2023-06-20T13:36:50.996 INFO:teuthology.orchestra.run.smithi032.stdout:checking for linux/btrfs.h... yes 2023-06-20T13:36:51.057 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/btrfs_tree.h usability... yes 2023-06-20T13:36:51.074 INFO:teuthology.orchestra.run.smithi032.stdout:checking linux/btrfs_tree.h presence... yes 2023-06-20T13:36:51.075 INFO:teuthology.orchestra.run.smithi032.stdout:checking for linux/btrfs_tree.h... yes 2023-06-20T13:36:51.148 INFO:teuthology.orchestra.run.smithi032.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-06-20T13:36:51.177 INFO:teuthology.orchestra.run.smithi032.stdout:configure: creating ./config.status 2023-06-20T13:36:52.086 INFO:teuthology.orchestra.run.smithi032.stdout:config.status: creating include/builddefs 2023-06-20T13:36:52.116 INFO:teuthology.orchestra.run.smithi032.stdout:config.status: creating include/config.h 2023-06-20T13:36:52.138 INFO:teuthology.orchestra.run.smithi032.stdout:config.status: executing libtool commands 2023-06-20T13:36:52.218 INFO:teuthology.orchestra.run.smithi032.stdout:Building include 2023-06-20T13:36:52.225 INFO:teuthology.orchestra.run.smithi032.stdout:Building lib 2023-06-20T13:36:52.231 INFO:teuthology.orchestra.run.smithi032.stdout: [LTDEP] 2023-06-20T13:36:52.435 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] dataascii.lo 2023-06-20T13:36:52.640 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] databin.lo 2023-06-20T13:36:52.878 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] datapid.lo 2023-06-20T13:36:53.069 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] file_lock.lo 2023-06-20T13:36:53.312 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] forker.lo 2023-06-20T13:36:53.534 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] pattern.lo 2023-06-20T13:36:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] open_flags.lo 2023-06-20T13:36:53.970 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] random_range.lo 2023-06-20T13:36:54.285 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] string_to_tokens.lo 2023-06-20T13:36:54.473 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] str_to_bytes.lo 2023-06-20T13:36:54.691 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] tlibio.lo 2023-06-20T13:36:55.019 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] write_log.lo 2023-06-20T13:36:55.356 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] random.lo 2023-06-20T13:36:55.560 INFO:teuthology.orchestra.run.smithi032.stdout: [LD] 2023-06-20T13:36:55.699 INFO:teuthology.orchestra.run.smithi032.stdout:Building ltp 2023-06-20T13:36:55.705 INFO:teuthology.orchestra.run.smithi032.stdout: [DEP] 2023-06-20T13:36:55.921 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] doio 2023-06-20T13:36:56.689 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fsstress 2023-06-20T13:36:58.132 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fsx 2023-06-20T13:36:59.115 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] growfiles 2023-06-20T13:36:59.735 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] iogen 2023-06-20T13:37:00.199 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-stress 2023-06-20T13:37:00.727 INFO:teuthology.orchestra.run.smithi032.stdout:Building src 2023-06-20T13:37:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: [DEP] 2023-06-20T13:37:03.214 INFO:teuthology.orchestra.run.smithi032.stdout: [DEP] 2023-06-20T13:37:03.265 INFO:teuthology.orchestra.run.smithi032.stdout: [DEP] 2023-06-20T13:37:03.281 INFO:teuthology.orchestra.run.smithi032.stdout: [DEP] 2023-06-20T13:37:03.627 INFO:teuthology.orchestra.run.smithi032.stdout: [DEP] 2023-06-20T13:37:03.668 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] dirstress 2023-06-20T13:37:04.013 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fill 2023-06-20T13:37:04.269 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fill2 2023-06-20T13:37:04.603 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] getpagesize 2023-06-20T13:37:04.839 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] holes 2023-06-20T13:37:05.147 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] lstat64 2023-06-20T13:37:05.434 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] nametest 2023-06-20T13:37:05.780 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] permname 2023-06-20T13:37:06.092 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] randholes 2023-06-20T13:37:06.447 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] runas 2023-06-20T13:37:06.728 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] truncfile 2023-06-20T13:37:07.014 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] usemem 2023-06-20T13:37:07.266 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] mmapcat 2023-06-20T13:37:07.517 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] append_reader 2023-06-20T13:37:07.770 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] append_writer 2023-06-20T13:37:08.025 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] dirperf 2023-06-20T13:37:08.352 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] metaperf 2023-06-20T13:37:08.710 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] devzero 2023-06-20T13:37:08.990 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] feature 2023-06-20T13:37:09.315 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] alloc 2023-06-20T13:37:09.503 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:37:09.508 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:37:09.634 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fault 2023-06-20T13:37:09.904 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fstest 2023-06-20T13:37:10.252 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_access_root 2023-06-20T13:37:10.509 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] godown 2023-06-20T13:37:10.784 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] resvtest 2023-06-20T13:37:11.077 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] writemod 2023-06-20T13:37:11.324 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] writev_on_pagefault 2023-06-20T13:37:11.586 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] makeextents 2023-06-20T13:37:11.872 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] itrash 2023-06-20T13:37:12.131 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] rename 2023-06-20T13:37:12.373 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] multi_open_unlink 2023-06-20T13:37:12.642 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] unwritten_sync 2023-06-20T13:37:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] genhashnames 2023-06-20T13:37:13.217 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_holes 2023-06-20T13:37:13.465 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mmap_writev 2023-06-20T13:37:13.715 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_truncate_cmtime 2023-06-20T13:37:13.976 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] dirhash_collide 2023-06-20T13:37:14.262 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_rename_overwrite 2023-06-20T13:37:14.504 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] holetest 2023-06-20T13:37:14.827 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_truncate_self 2023-06-20T13:37:15.068 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] af_unix 2023-06-20T13:37:15.323 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mmap_stale_pmd 2023-06-20T13:37:15.579 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mmap_cow_race 2023-06-20T13:37:15.847 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mmap_fallocate 2023-06-20T13:37:16.102 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fsync-err 2023-06-20T13:37:16.390 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mmap_write_ro 2023-06-20T13:37:16.645 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_ext4_dax_journal_corruption 2023-06-20T13:37:16.907 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_ext4_dax_inline_corruption 2023-06-20T13:37:17.166 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_ofd_locks 2023-06-20T13:37:17.474 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mmap_collision 2023-06-20T13:37:17.776 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] mmap-write-concurrent 2023-06-20T13:37:18.049 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_get_file_time 2023-06-20T13:37:18.297 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_create_short_dirs 2023-06-20T13:37:18.566 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_create_long_dirs 2023-06-20T13:37:18.833 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_enospc 2023-06-20T13:37:19.122 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mmap_writev_overlap 2023-06-20T13:37:19.394 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] checkpoint_journal 2023-06-20T13:37:19.653 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] mmap-rw-fault 2023-06-20T13:37:19.935 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] allocstale 2023-06-20T13:37:20.211 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mmap_cow_memory_failure 2023-06-20T13:37:20.486 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fake-dump-rootino 2023-06-20T13:37:20.739 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] dio-buf-fault 2023-06-20T13:37:20.995 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] xfsctl 2023-06-20T13:37:21.289 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] bstat 2023-06-20T13:37:21.608 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mtab 2023-06-20T13:37:21.896 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] getdevicesize 2023-06-20T13:37:22.142 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] preallo_rw_pattern_reader 2023-06-20T13:37:22.406 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] preallo_rw_pattern_writer 2023-06-20T13:37:22.670 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] ftrunc 2023-06-20T13:37:22.921 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] trunc 2023-06-20T13:37:23.188 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fs_perms 2023-06-20T13:37:23.455 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] testx 2023-06-20T13:37:23.688 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] looptest 2023-06-20T13:37:23.984 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] locktest 2023-06-20T13:37:24.397 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] unwritten_mmap 2023-06-20T13:37:24.667 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] bulkstat_unlink_test 2023-06-20T13:37:24.974 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] deduperace 2023-06-20T13:37:25.273 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] bulkstat_unlink_test_modified 2023-06-20T13:37:25.580 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_dir_offset 2023-06-20T13:37:25.831 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_futimens 2023-06-20T13:37:26.074 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_immutable 2023-06-20T13:37:26.788 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] stale_handle 2023-06-20T13:37:27.067 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] pwrite_mmap_blocked 2023-06-20T13:37:27.324 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_dir_offset2 2023-06-20T13:37:27.621 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] seek_sanity_test 2023-06-20T13:37:28.146 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] seek_copy_test 2023-06-20T13:37:28.426 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_readdir_1 2023-06-20T13:37:28.677 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_readdir_2 2023-06-20T13:37:28.929 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fsync-tester 2023-06-20T13:37:29.282 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] nsexec 2023-06-20T13:37:29.561 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] cloner 2023-06-20T13:37:29.843 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] renameat2 2023-06-20T13:37:30.114 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_getcwd 2023-06-20T13:37:30.376 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] e4compact 2023-06-20T13:37:30.681 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] test-nextquota 2023-06-20T13:37:30.955 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] punch-alternating 2023-06-20T13:37:31.234 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] attr-list-by-handle-cursor-test 2023-06-20T13:37:31.507 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] listxattr 2023-06-20T13:37:31.757 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] dio-interleaved 2023-06-20T13:37:32.022 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_dir_type 2023-06-20T13:37:32.282 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] dio-invalidate-cache 2023-06-20T13:37:32.590 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] stat_test 2023-06-20T13:37:32.992 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_encrypted_d_revalidate 2023-06-20T13:37:33.263 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] attr_replace_test 2023-06-20T13:37:33.532 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] swapon 2023-06-20T13:37:33.800 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] mkswap 2023-06-20T13:37:34.055 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_attr_corruption 2023-06-20T13:37:34.310 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_open_tmpfiles 2023-06-20T13:37:34.597 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fscrypt-crypt-util 2023-06-20T13:37:35.343 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] bulkstat_null_ocount 2023-06-20T13:37:35.609 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] splice-test 2023-06-20T13:37:35.893 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] chprojid_fail 2023-06-20T13:37:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] detached_mounts_propagation 2023-06-20T13:37:36.455 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] ext4_resize 2023-06-20T13:37:36.707 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_readdir_3 2023-06-20T13:37:37.007 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] splice2pipe 2023-06-20T13:37:37.274 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] uuid_ioctl 2023-06-20T13:37:37.532 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fiemap-tester 2023-06-20T13:37:37.906 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_stripealign 2023-06-20T13:37:38.163 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] open_by_handle 2023-06-20T13:37:38.522 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] t_mmap_dio 2023-06-20T13:37:38.789 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] xfsfind 2023-06-20T13:37:39.091 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] fssum 2023-06-20T13:37:39.614 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:37:39.620 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:37:39.635 INFO:teuthology.orchestra.run.smithi032.stdout:Building log-writes 2023-06-20T13:37:39.645 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] replay-log 2023-06-20T13:37:40.070 INFO:teuthology.orchestra.run.smithi032.stdout:Building perf 2023-06-20T13:37:40.078 INFO:teuthology.orchestra.run.smithi032.stdout:Building aio-dio-regress 2023-06-20T13:37:40.089 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-append-write-fallocate-race 2023-06-20T13:37:40.371 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-fcntl-race 2023-06-20T13:37:40.642 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-subblock-eof-read 2023-06-20T13:37:40.892 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-append-write-read-race 2023-06-20T13:37:41.177 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-invalidate-readahead 2023-06-20T13:37:41.453 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-hole-filling-race 2023-06-20T13:37:41.709 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-06-20T13:37:41.951 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-last-ref-held-by-io 2023-06-20T13:37:42.232 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-cycle-write 2023-06-20T13:37:42.524 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-extend-stat 2023-06-20T13:37:42.799 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-06-20T13:37:43.039 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-invalidate-failure 2023-06-20T13:37:43.307 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aiodio_sparse2 2023-06-20T13:37:43.633 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aiocp 2023-06-20T13:37:43.965 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-cow-race 2023-06-20T13:37:44.227 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-write-verify 2023-06-20T13:37:44.525 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] aio-dio-eof-race 2023-06-20T13:37:44.816 INFO:teuthology.orchestra.run.smithi032.stdout:Building vfs 2023-06-20T13:37:44.827 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] vfstest 2023-06-20T13:37:46.915 INFO:teuthology.orchestra.run.smithi032.stdout: [CC] mount-idmapped 2023-06-20T13:37:47.407 INFO:teuthology.orchestra.run.smithi032.stdout:Building m4 2023-06-20T13:37:47.415 INFO:teuthology.orchestra.run.smithi032.stdout:Building common 2023-06-20T13:37:47.422 INFO:teuthology.orchestra.run.smithi032.stdout:Building tests 2023-06-20T13:37:47.432 INFO:teuthology.orchestra.run.smithi032.stdout:Building perf 2023-06-20T13:37:47.442 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/perf/group.list 2023-06-20T13:37:47.472 INFO:teuthology.orchestra.run.smithi032.stdout:Building ext4 2023-06-20T13:37:47.482 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/ext4/group.list 2023-06-20T13:37:47.578 INFO:teuthology.orchestra.run.smithi032.stdout:Building ocfs2 2023-06-20T13:37:47.588 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/ocfs2/group.list 2023-06-20T13:37:47.622 INFO:teuthology.orchestra.run.smithi032.stdout:Building overlay 2023-06-20T13:37:47.632 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/overlay/group.list 2023-06-20T13:37:47.730 INFO:teuthology.orchestra.run.smithi032.stdout:Building cifs 2023-06-20T13:37:47.740 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/cifs/group.list 2023-06-20T13:37:47.772 INFO:teuthology.orchestra.run.smithi032.stdout:Building generic 2023-06-20T13:37:47.784 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/generic/group.list 2023-06-20T13:37:48.030 INFO:teuthology.orchestra.run.smithi032.stdout:Building shared 2023-06-20T13:37:48.040 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/shared/group.list 2023-06-20T13:37:48.084 INFO:teuthology.orchestra.run.smithi032.stdout:Building nfs 2023-06-20T13:37:48.094 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/nfs/group.list 2023-06-20T13:37:48.131 INFO:teuthology.orchestra.run.smithi032.stdout:Building f2fs 2023-06-20T13:37:48.140 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/f2fs/group.list 2023-06-20T13:37:48.185 INFO:teuthology.orchestra.run.smithi032.stdout:Building udf 2023-06-20T13:37:48.194 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/udf/group.list 2023-06-20T13:37:48.224 INFO:teuthology.orchestra.run.smithi032.stdout:Building ceph 2023-06-20T13:37:48.234 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/ceph/group.list 2023-06-20T13:37:48.271 INFO:teuthology.orchestra.run.smithi032.stdout:Building xfs 2023-06-20T13:37:48.283 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/xfs/group.list 2023-06-20T13:37:48.532 INFO:teuthology.orchestra.run.smithi032.stdout:Building btrfs 2023-06-20T13:37:48.543 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/btrfs/group.list 2023-06-20T13:37:48.690 INFO:teuthology.orchestra.run.smithi032.stdout:Building tmpfs 2023-06-20T13:37:48.700 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/tmpfs/group.list 2023-06-20T13:37:48.734 INFO:teuthology.orchestra.run.smithi032.stdout:Building selftest 2023-06-20T13:37:48.744 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/selftest/group.list 2023-06-20T13:37:48.778 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo make install) 2023-06-20T13:37:48.871 INFO:teuthology.orchestra.run.smithi032.stdout:Building include 2023-06-20T13:37:48.878 INFO:teuthology.orchestra.run.smithi032.stdout:Building lib 2023-06-20T13:37:48.886 INFO:teuthology.orchestra.run.smithi032.stdout:Building ltp 2023-06-20T13:37:48.894 INFO:teuthology.orchestra.run.smithi032.stdout:Building src 2023-06-20T13:37:48.956 INFO:teuthology.orchestra.run.smithi032.stdout:Building log-writes 2023-06-20T13:37:48.964 INFO:teuthology.orchestra.run.smithi032.stdout:Building perf 2023-06-20T13:37:48.971 INFO:teuthology.orchestra.run.smithi032.stdout:Building aio-dio-regress 2023-06-20T13:37:48.979 INFO:teuthology.orchestra.run.smithi032.stdout:Building vfs 2023-06-20T13:37:48.987 INFO:teuthology.orchestra.run.smithi032.stdout:Building m4 2023-06-20T13:37:48.994 INFO:teuthology.orchestra.run.smithi032.stdout:Building common 2023-06-20T13:37:49.001 INFO:teuthology.orchestra.run.smithi032.stdout:Building tests 2023-06-20T13:37:49.012 INFO:teuthology.orchestra.run.smithi032.stdout:Building perf 2023-06-20T13:37:49.022 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/perf/group.list 2023-06-20T13:37:49.052 INFO:teuthology.orchestra.run.smithi032.stdout:Building ext4 2023-06-20T13:37:49.062 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/ext4/group.list 2023-06-20T13:37:49.156 INFO:teuthology.orchestra.run.smithi032.stdout:Building ocfs2 2023-06-20T13:37:49.165 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/ocfs2/group.list 2023-06-20T13:37:49.200 INFO:teuthology.orchestra.run.smithi032.stdout:Building overlay 2023-06-20T13:37:49.210 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/overlay/group.list 2023-06-20T13:37:49.308 INFO:teuthology.orchestra.run.smithi032.stdout:Building cifs 2023-06-20T13:37:49.318 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/cifs/group.list 2023-06-20T13:37:49.351 INFO:teuthology.orchestra.run.smithi032.stdout:Building generic 2023-06-20T13:37:49.363 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/generic/group.list 2023-06-20T13:37:49.601 INFO:teuthology.orchestra.run.smithi032.stdout:Building shared 2023-06-20T13:37:49.611 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/shared/group.list 2023-06-20T13:37:49.655 INFO:teuthology.orchestra.run.smithi032.stdout:Building nfs 2023-06-20T13:37:49.665 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/nfs/group.list 2023-06-20T13:37:49.702 INFO:teuthology.orchestra.run.smithi032.stdout:Building f2fs 2023-06-20T13:37:49.712 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/f2fs/group.list 2023-06-20T13:37:49.756 INFO:teuthology.orchestra.run.smithi032.stdout:Building udf 2023-06-20T13:37:49.766 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/udf/group.list 2023-06-20T13:37:49.795 INFO:teuthology.orchestra.run.smithi032.stdout:Building ceph 2023-06-20T13:37:49.805 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/ceph/group.list 2023-06-20T13:37:49.842 INFO:teuthology.orchestra.run.smithi032.stdout:Building xfs 2023-06-20T13:37:49.854 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/xfs/group.list 2023-06-20T13:37:50.099 INFO:teuthology.orchestra.run.smithi032.stdout:Building btrfs 2023-06-20T13:37:50.110 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/btrfs/group.list 2023-06-20T13:37:50.254 INFO:teuthology.orchestra.run.smithi032.stdout:Building tmpfs 2023-06-20T13:37:50.264 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/tmpfs/group.list 2023-06-20T13:37:50.299 INFO:teuthology.orchestra.run.smithi032.stdout:Building selftest 2023-06-20T13:37:50.309 INFO:teuthology.orchestra.run.smithi032.stdout: [GROUP] /tmp/tmp.LENcwP3t9bxfstests-dev/tests/selftest/group.list 2023-06-20T13:37:50.340 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-06-20T13:37:50.342 INFO:teuthology.orchestra.run.smithi032.stdout:gmake[1]: Nothing to be done for 'install'. 2023-06-20T13:37:50.343 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-06-20T13:37:50.346 INFO:teuthology.orchestra.run.smithi032.stdout:gmake[1]: Nothing to be done for 'install'. 2023-06-20T13:37:50.346 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-06-20T13:37:50.350 INFO:teuthology.orchestra.run.smithi032.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-06-20T13:37:50.374 INFO:teuthology.orchestra.run.smithi032.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-06-20T13:37:50.549 INFO:teuthology.orchestra.run.smithi032.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-06-20T13:37:50.573 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-06-20T13:37:50.603 INFO:teuthology.orchestra.run.smithi032.stdout:Building log-writes 2023-06-20T13:37:50.611 INFO:teuthology.orchestra.run.smithi032.stdout:Building perf 2023-06-20T13:37:50.618 INFO:teuthology.orchestra.run.smithi032.stdout:Building aio-dio-regress 2023-06-20T13:37:50.626 INFO:teuthology.orchestra.run.smithi032.stdout:Building vfs 2023-06-20T13:37:50.632 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake -C log-writes install 2023-06-20T13:37:50.634 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-06-20T13:37:50.657 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-06-20T13:37:50.681 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake -C perf install 2023-06-20T13:37:50.684 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-06-20T13:37:50.707 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-06-20T13:37:50.767 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-06-20T13:37:50.770 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-06-20T13:37:50.793 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-hole-filling-race aio-dio-append-write-fallocate-race aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-write-verify aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-06-20T13:37:50.936 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake -C vfs install 2023-06-20T13:37:50.938 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-06-20T13:37:50.962 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-06-20T13:37:50.994 INFO:teuthology.orchestra.run.smithi032.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-06-20T13:37:51.017 INFO:teuthology.orchestra.run.smithi032.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-06-20T13:37:54.005 INFO:teuthology.orchestra.run.smithi032.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-06-20T13:37:54.226 INFO:teuthology.orchestra.run.smithi032.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-06-20T13:37:54.282 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-06-20T13:37:54.285 INFO:teuthology.orchestra.run.smithi032.stdout:gmake[1]: Nothing to be done for 'install'. 2023-06-20T13:37:54.285 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-06-20T13:37:54.288 INFO:teuthology.orchestra.run.smithi032.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-06-20T13:37:54.312 INFO:teuthology.orchestra.run.smithi032.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-06-20T13:37:54.666 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-06-20T13:37:54.669 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LENcwP3t9bxfstests-dev/tests/btrfs/ install 2023-06-20T13:37:54.673 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-06-20T13:37:54.696 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 290 291 299 /var/lib/xfstests/tests/btrfs 2023-06-20T13:37:56.843 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-06-20T13:37:56.866 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 014.out 036.out 016.out 175.out 193.out 240.out 069.out 282.out 015.out 280.out 140.out 258.out 008.out 004.out 199.out 233.out 194.out 234.out 248.out 109.out 033.out 252.out 270.out 040.out 176.out 202.out 137.out 125.out 078.out 152.out 103.out 264.out 243.out 192.out 148.out 075.out 077.out 178.out 284.out 052.out 256.out 207.out 228.out 028.out 183.out 094.out 046.out 273.out 251.out 209.out 089.out 206.out 215.out 115.out 197.out 250.out 266.out 051.out 246.out 219.out 119.out 244.out 128.out 232.out 021.out 275.out 221.out 087.out 121.out 112.out 012.out 195.out 107.out 162.out 083.out 147.out 242.out 187.out 220.out 020.out 102.out 002.out 171.out 261.out 135.out 156.out 092.out 255.out 072.out 068.out 143.out 048.out 062.out 073.out 084.out 129.out 241.out 029.out 229.out 254.out 111.out 011.out 155.out 134.out 170.out 260.out 034.out 161.out 043.out 247.out 216.out 116.out 157.out 274.out 110.out 101.out 238.out 276.out 114.out 138.out 095.out 038.out 145.out 160.out 091.out 081.out 071.out 061.out 085.out 265.out 200.out 100.out 025.out 286.out 269.out 039.out 196.out 098.out 090.out 080.out 070.out 060.out 208.out 009.out 167.out 217.out 120.out 191.out 133.out 117.out 017.out 211.out 158.out 182.out 066.out 146.out 212.out 188.out 065.out 204.out 104.out 041.out 177.out 279.out 281.out 225.out 235.out 253.out 257.out 124.out 035.out 172.out 278.out 063.out 058.out 262.out 169.out 042.out 153.out 097.out 283.out 236.out 186.out 053.out 164.out 154.out 239.out 189.out 139.out 267.out 141.out 214.out 005.out 223.out 086.out 132.out 179.out 144.out 032.out 277.out 205.out 136.out 180.out 096.out 198.out 108.out 190.out 173.out 050.out 105.out 106.out 291.out 185.out 037.out 088.out 285.out 123.out 056.out 201.out 019.out 001.out 287.out 142.out 237.out 151.out 231.out 024.out 163.out 044.out 131.out 213.out 113.out 013.out 031.out 027.out 057.out 272.out 268.out 184.out 259.out 210.out 067.out 227.out 010.out 263.out 127.out 230.out 166.out 130.out 023.out 099.out 082.out 030.out 203.out 003.out 055.out 076.out 245.out 122.out 074.out 222.out 159.out 249.out 022.out 174.out 006.out 045.out 290.out 299.out 224.out 181.out 271.out 149.out 064.out 218.out 118.out 018.out 047.out 168.out 007.out 093.out 079.out 054.out 059.out 150.out 049.out 226.out 126.out 165.out 026.out /var/lib/xfstests/tests/btrfs 2023-06-20T13:37:59.015 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LENcwP3t9bxfstests-dev/tests/ceph/ install 2023-06-20T13:37:59.017 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-06-20T13:37:59.040 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-06-20T13:37:59.093 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-06-20T13:37:59.117 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-06-20T13:37:59.169 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LENcwP3t9bxfstests-dev/tests/cifs/ install 2023-06-20T13:37:59.172 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-06-20T13:37:59.195 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-06-20T13:37:59.218 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-06-20T13:37:59.242 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-06-20T13:37:59.265 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LENcwP3t9bxfstests-dev/tests/ext4/ install 2023-06-20T13:37:59.268 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-06-20T13:37:59.291 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-06-20T13:37:59.805 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-06-20T13:37:59.829 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 005.out 026.out 308.out 008.out 040.out 304.out 007.out 021.out 016.out 037.out 044.out 012.out 009.out 033.out 057.out 050.out 301.out 019.out 034.out 046.out 058.out 047.out 302.out 020.out 002.out 024.out 013.out 031.out 025.out 306.out 017.out 004.out 048.out 038.out 056.out 042.out 052.out 307.out 029.out 011.out 027.out 303.out 003.out 045.out 055.out 053.out 035.out 043.out 059.out 010.out 023.out 022.out 014.out 006.out 015.out 305.out 036.out 271.out 051.out 041.out 030.out 018.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-06-20T13:38:00.365 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LENcwP3t9bxfstests-dev/tests/f2fs/ install 2023-06-20T13:38:00.368 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-06-20T13:38:00.391 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-06-20T13:38:00.422 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-06-20T13:38:00.445 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-06-20T13:38:00.476 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LENcwP3t9bxfstests-dev/tests/generic/ install 2023-06-20T13:38:00.482 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-06-20T13:38:00.505 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 /var/lib/xfstests/tests/generic 2023-06-20T13:38:05.865 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-06-20T13:38:05.889 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 035.out.nfs 050.out.xfsquota 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 537.out 194.out 133.out 683.out 033.out 489.out 696.out 237.out 502.out 310.out 202.out 137.out 586.out 181.out 664.out 571.out 126.out 243.out 592.out 282.out 272.out 728.out 178.out 628.out 528.out 607.out 428.out 507.out 407.out 328.out 171.out 028.out 620.out 273.out 570.out 468.out 182.out 265.out 420.out 492.out 120.out 059.out 595.out 346.out 466.out 443.out 700.out 632.out 652.out 311.out 655.out 591.out 064.out 471.out 432.out 255.out 623.out 371.out 319.out 177.out 523.out 119.out 423.out 232.out 673.out 260.out 312.out 718.out 034.out 465.out 716.out 616.out 246.out 416.out 247.out 216.out 116.out 041.out 358.out 338.out 287.out 238.out 295.out 390.out 497.out 160.out 691.out 274.out 061.out 239.out 457.out 025.out 530.out 258.out 362.out 039.out 098.out 690.out 573.out 706.out 606.out 506.out 406.out 306.out 106.out 642.out 217.out 446.out 017.out 211.out 130.out 158.out 370.out 442.out 188.out 640.out 199.out 467.out 281.out 174.out 163.out 324.out 224.out 355.out 124.out 672.out 278.out 058.out 384.out 296.out 042.out 193.out 097.out 271.out 283.out 541.out 709.out 609.out 045.out 509.out 309.out 391.out 441.out 009.out 356.out 341.out 494.out 189.out 037.out 555.out 712.out 241.out 501.out 612.out 540.out 365.out 412.out 614.out 514.out 414.out 314.out 440.out 114.out 316.out 014.out 026.out 012.out 634.out 340.out 156.out 572.out 240.out 180.out 549.out 473.out 633.out 321.out 140.out 348.out 568.out 185.out 408.out 308.out 566.out 433.out 704.out 108.out 504.out 404.out 304.out 104.out 175.out 096.out 297.out 393.out 333.out 599.out 476.out 099.out 233.out 639.out 107.out 086.out 053.out 500.out 164.out 339.out 294.out 352.out 498.out 139.out 267.out 317.out 399.out 220.out 552.out 695.out 480.out 436.out 544.out 169.out 593.out 067.out 186.out 187.out 679.out 252.out 585.out 003.out 376.out 724.out 206.out 663.out 651.out 248.out 625.out 525.out 670.out 488.out 040.out 325.out 551.out 225.out 636.out 125.out 142.out 715.out 279.out 222.out 515.out 650.out 152.out 658.out 563.out 215.out 451.out 015.out 392.out 682.out 472.out 684.out 674.out 550.out 052.out 351.out 430.out 276.out 094.out 266.out 450.out 463.out 157.out 600.out 349.out 444.out 644.out 487.out 688.out 643.out 615.out 395.out 151.out 415.out 315.out 344.out 115.out 539.out 179.out 542.out 250.out 705.out 475.out 536.out 228.out 518.out 101.out 030.out 244.out 128.out 385.out 005.out 336.out 579.out 236.out 405.out 667.out 205.out 136.out 598.out 036.out 198.out 723.out 008.out 680.out 605.out 505.out 305.out 105.out 263.out 144.out 291.out 437.out 044.out 719.out 619.out 721.out 323.out 685.out 088.out 382.out 337.out 219.out 527.out 019.out 577.out 481.out 574.out 556.out 332.out 060.out 521.out 027.out 191.out 582.out 372.out 478.out 584.out 462.out 597.out 350.out 132.out 693.out 638.out 448.out 660.out 063.out 561.out 214.out 074.out 648.out 387.out 594.out 335.out 438.out 076.out 289.out 699.out 545.out 516.out 477.out 621.out 519.out 290.out 548.out 560.out 166.out 707.out 461.out 381.out 445.out 647.out 626.out 380.out 562.out 526.out 479.out 426.out 192.out 150.out 613.out 326.out 082.out 226.out 668.out 454.out 121.out 447.out 499.out 580.out 460.out 485.out 694.out 347.out 077.out 361.out 564.out 455.out 089.out 558.out 162.out 686.out 147.out 173.out 197.out 396.out 051.out 354.out 298.out 024.out 148.out 360.out 543.out 270.out 261.out 251.out 657.out 692.out 482.out 046.out 726.out 378.out 004.out 458.out 062.out 529.out 231.out 343.out 662.out 503.out 329.out 334.out 590.out 254.out 363.out 131.out 155.out 661.out 547.out 368.out 486.out 223.out 123.out 669.out 023.out 459.out 032.out 277.out 398.out 366.out 161.out 190.out 280.out 470.out 484.out 257.out 006.out 016.out 091.out 201.out 656.out 227.out 676.out 374.out 583.out 285.out 127.out 256.out 654.out 389.out 649.out 301.out 431.out 635.out 288.out 722.out 331.out 377.out 713.out 535.out 513.out 554.out 622.out 313.out 213.out 113.out 013.out 031.out 435.out 630.out 645.out 057.out 727.out 078.out 510.out 627.out 184.out 534.out 427.out 210.out 449.out 327.out 330.out 493.out 604.out 419.out 230.out 071.out 083.out 292.out 299.out 434.out 575.out 073.out 603.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 532.out 245.out 522.out 422.out 624.out 322.out 394.out 159.out 524.out 122.out 689.out 234.out 022.out 424.out 637.out 578.out 490.out 439.out 517.out 154.out 149.out 618.out 675.out 418.out 318.out 264.out 218.out 118.out 018.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 208.out 379.out 569.out 456.out 268.out 421.out 533.out 512.out 221.out 087.out 212.out 538.out 112.out 342.out 021.out 195.out 388.out 483.out 397.out 070.out 596.out 720.out 565.out 196.out 520.out 242.out 576.out 587.out 320.out 629.out 702.out 602.out 153.out 402.out 302.out 020.out 102.out 002.out 717.out 617.out 129.out 429.out 417.out 138.out 167.out 092.out 117.out 357.out 072.out 068.out 143.out 229.out 038.out 084.out 369.out 711.out 262.out 611.out 511.out 411.out 029.out 111.out 011.out 659.out 183.out 170.out 065.out 286.out 043.out 056.out 714.out 559.out 710.out 610.out 687.out 413.out 410.out 701.out 601.out 401.out 110.out 010.out 001.out 141.out 495.out 048.out 665.out 589.out 095.out 581.out 697.out 145.out 641.out 464.out 491.out 081.out 075.out 653.out 671.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 677.out 698.out 553.out 375.out 259.out 090.out 080.out 708.out 608.out 508.out 409.out 307.out 209.out 109.out 007.out 567.out 284.out 557.out 453.out 666.out 364.out 725.out 383.out 085.out 066.out 588.out 146.out 631.out 204.out 353.out 425.out 069.out 093.out 681.out 249.out 207.out 531.out 235.out 646.out 474.out 703.out 253.out 275.out 678.out 496.out 373.out 176.out 134.out 452.out /var/lib/xfstests/tests/generic 2023-06-20T13:38:09.827 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:38:09.831 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:38:11.323 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LENcwP3t9bxfstests-dev/tests/nfs/ install 2023-06-20T13:38:11.326 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-06-20T13:38:11.350 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-06-20T13:38:11.374 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-06-20T13:38:11.397 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-06-20T13:38:11.421 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LENcwP3t9bxfstests-dev/tests/ocfs2/ install 2023-06-20T13:38:11.423 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-06-20T13:38:11.447 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-06-20T13:38:11.470 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-06-20T13:38:11.494 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-06-20T13:38:11.517 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LENcwP3t9bxfstests-dev/tests/overlay/ install 2023-06-20T13:38:11.521 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-06-20T13:38:11.544 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-06-20T13:38:12.265 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-06-20T13:38:12.289 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 110.out 067.out 018.out 024.out 010.out 065.out 020.out 102.out 002.out 113.out 013.out 031.out 045.out 117.out 046.out 075.out 072.out 068.out 063.out 014.out 062.out 038.out 042.out 052.out 029.out 027.out 043.out 112.out 023.out 073.out 078.out 030.out 058.out 003.out 004.out 055.out 053.out 109.out 035.out 116.out 016.out 059.out 101.out 001.out 009.out 047.out 076.out 022.out 074.out 006.out 044.out 115.out 015.out 064.out 114.out 026.out 071.out 111.out 061.out 011.out 041.out 048.out 100.out 019.out 107.out 007.out 028.out 069.out 054.out 049.out 032.out 039.out 077.out 105.out 025.out 056.out 057.out 108.out 070.out 060.out 008.out 040.out 106.out 005.out 021.out 017.out 012.out 037.out 103.out 033.out 066.out 050.out 036.out 051.out 034.out 104.out /var/lib/xfstests/tests/overlay 2023-06-20T13:38:13.010 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LENcwP3t9bxfstests-dev/tests/perf/ install 2023-06-20T13:38:13.012 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-06-20T13:38:13.035 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-06-20T13:38:13.060 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-06-20T13:38:13.083 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-06-20T13:38:13.106 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LENcwP3t9bxfstests-dev/tests/selftest/ install 2023-06-20T13:38:13.109 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-06-20T13:38:13.132 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-06-20T13:38:13.192 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-06-20T13:38:13.215 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-06-20T13:38:13.275 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LENcwP3t9bxfstests-dev/tests/shared/ install 2023-06-20T13:38:13.278 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-06-20T13:38:13.302 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-06-20T13:38:13.342 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-06-20T13:38:13.365 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-06-20T13:38:13.404 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LENcwP3t9bxfstests-dev/tests/tmpfs/ install 2023-06-20T13:38:13.406 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-06-20T13:38:13.430 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-06-20T13:38:13.453 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-06-20T13:38:13.476 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-06-20T13:38:13.500 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LENcwP3t9bxfstests-dev/tests/udf/ install 2023-06-20T13:38:13.502 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-06-20T13:38:13.526 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-06-20T13:38:13.549 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-06-20T13:38:13.573 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-06-20T13:38:13.596 INFO:teuthology.orchestra.run.smithi032.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LENcwP3t9bxfstests-dev/tests/xfs/ install 2023-06-20T13:38:13.602 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-06-20T13:38:13.625 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-06-20T13:38:18.691 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-06-20T13:38:18.714 INFO:teuthology.orchestra.run.smithi032.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 308.out 737.out 108.out 504.out 404.out 104.out 004.out 377.out 537.out 194.out 158.out 337.out 082.out 237.out 759.out 502.out 088.out 202.out 137.out 102.out 746.out 110.out 586.out 181.out 571.out 567.out 592.out 282.out 266.out 728.out 178.out 528.out 769.out 428.out 507.out 407.out 328.out 171.out 028.out 046.out 273.out 570.out 468.out 474.out 059.out 346.out 732.out 784.out 443.out 411.out 532.out 591.out 064.out 471.out 111.out 432.out 255.out 371.out 319.out 177.out 523.out 119.out 775.out 232.out 131.out 243.out 183.out 547.out 738.out 260.out 718.out 034.out 465.out 716.out 161.out 246.out 416.out 247.out 116.out 016.out 041.out 358.out 338.out 287.out 099.out 238.out 065.out 566.out 295.out 138.out 765.out 160.out 291.out 274.out 722.out 061.out 239.out 085.out 457.out 025.out 772.out 530.out 258.out 322.out 039.out 498.out 098.out 517.out 573.out 060.out 506.out 406.out 306.out 106.out 006.out 003.out 217.out 120.out 191.out 133.out 455.out 130.out 442.out 188.out 030.out 199.out 595.out 467.out 281.out 242.out 163.out 771.out 324.out 224.out 050.out 764.out 124.out 382.out 278.out 058.out 741.out 384.out 262.out 042.out 497.out 466.out 193.out 097.out 392.out 283.out 541.out 770.out 709.out 755.out 309.out 441.out 157.out 740.out 356.out 341.out 494.out 189.out 555.out 241.out 540.out 077.out 412.out 514.out 414.out 314.out 440.out 114.out 316.out 074.out 147.out 012.out 155.out 340.out 793.out 156.out 572.out 568.out 240.out 279.out 180.out 733.out 280.out 434.out 140.out 766.out 185.out 408.out 066.out 552.out 304.out 204.out 353.out 425.out 069.out 254.out 335.out 531.out 235.out 556.out 253.out 503.out 418.out 275.out 272.out 496.out 751.out 433.out 176.out 134.out 393.out 333.out 476.out 535.out 739.out 233.out 752.out 736.out 107.out 053.out 164.out 587.out 339.out 294.out 521.out 352.out 799.out 489.out 139.out 774.out 267.out 390.out 399.out 781.out 017.out 169.out 593.out 186.out 452.out 252.out 585.out 167.out 724.out 206.out 794.out 348.out 394.out 509.out 248.out 785.out 424.out 750.out 525.out 488.out 040.out 325.out 551.out 225.out 125.out 142.out 715.out 789.out 581.out 152.out 563.out 215.out 436.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 351.out 430.out 276.out 290.out 094.out 451.out 450.out 744.out 043.out 086.out 349.out 444.out 500.out 487.out 762.out 544.out 305.out 395.out 515.out 415.out 389.out 315.out 344.out 115.out 015.out 542.out 250.out 791.out 464.out 475.out 536.out 228.out 439.out 244.out 128.out 385.out 005.out 336.out 150.out 579.out 236.out 342.out 580.out 136.out 036.out 198.out 723.out 008.out 790.out 505.out 405.out 588.out 205.out 105.out 144.out 768.out 437.out 037.out 044.out 719.out 381.out 721.out 323.out 519.out 562.out 419.out 388.out 123.out 056.out 019.out 577.out 151.out 760.out 574.out 332.out 796.out 027.out 372.out 584.out 462.out 220.out 350.out 312.out 492.out 745.out 076.out 112.out 063.out 561.out 214.out 776.out 014.out 758.out 362.out 387.out 594.out 438.out 265.out 289.out 554.out 516.out 477.out 548.out 560.out 166.out 461.out 445.out 296.out 207.out 493.out 786.out 007.out 251.out 380.out 093.out 526.out 479.out 426.out 192.out 326.out 226.out 454.out 126.out 121.out 447.out 761.out 773.out 460.out 485.out 347.out 035.out 361.out 564.out 788.out 795.out 089.out 747.out 558.out 162.out 743.out 288.out 197.out 396.out 576.out 051.out 354.out 355.out 575.out 148.out 301.out 360.out 543.out 263.out 270.out 261.out 734.out 045.out 292.out 482.out 726.out 729.out 378.out 458.out 062.out 249.out 231.out 343.out 334.out 590.out 363.out 368.out 486.out 223.out 132.out 023.out 459.out 032.out 798.out 277.out 748.out 527.out 146.out 398.out 366.out 427.out 190.out 173.out 470.out 484.out 754.out 767.out 749.out 187.out 091.out 201.out 731.out 782.out 374.out 583.out 285.out 127.out 256.out 501.out 376.out 431.out 068.out 331.out 179.out 713.out 024.out 513.out 413.out 313.out 549.out 213.out 730.out 113.out 013.out 031.out 435.out 182.out 057.out 727.out 078.out 510.out 184.out 797.out 534.out 545.out 210.out 449.out 327.out 330.out 067.out 227.out 010.out 230.out 083.out 473.out 299.out 219.out 073.out 370.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 742.out 245.out 026.out 522.out 787.out 422.out 222.out 159.out 539.out 524.out 122.out 448.out 234.out 022.out 174.out 779.out 490.out 565.out 090.out 423.out 154.out 271.out 149.out 518.out 318.out 264.out 218.out 118.out 018.out 329.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 208.out 379.out 456.out 268.out 421.out 712.out 321.out 533.out 512.out 221.out 087.out 212.out 538.out 021.out 195.out 725.out 483.out 397.out 070.out 373.out 720.out 481.out 196.out 520.out 129.out 446.out 420.out 478.out 320.out 499.out 153.out 402.out 302.out 020.out 529.out 002.out 717.out 429.out 417.out 317.out 365.out 092.out 117.out 357.out 072.out 778.out 143.out 229.out 038.out 084.out 369.out 711.out 511.out 029.out 311.out 211.out 011.out 783.out 170.out 286.out 756.out 175.out 714.out 559.out 710.out 410.out 310.out 401.out 101.out 001.out 141.out 495.out 048.out 589.out 753.out 095.out 297.out 480.out 145.out 257.out 757.out 491.out 081.out 800.out 777.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 780.out 553.out 763.out 375.out 298.out 259.out 080.out 708.out 508.out 409.out 307.out 209.out 109.out 009.out 391.out 284.out 557.out 453.out 364.out 582.out 735.out 383.out /var/lib/xfstests/tests/xfs 2023-06-20T13:38:23.830 INFO:teuthology.orchestra.run.smithi032.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-06-20T13:38:23.853 INFO:teuthology.orchestra.run.smithi032.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-06-20T13:38:23.876 INFO:teuthology.orchestra.run.smithi032.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-06-20T13:38:23.900 INFO:teuthology.orchestra.run.smithi032.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-06-20T13:38:23.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:38:23.928 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec ls tests/generic) 2023-06-20T13:38:23.975 INFO:teuthology.orchestra.run.smithi032.stdout:001 2023-06-20T13:38:23.975 INFO:teuthology.orchestra.run.smithi032.stdout:001.out 2023-06-20T13:38:23.975 INFO:teuthology.orchestra.run.smithi032.stdout:002 2023-06-20T13:38:23.976 INFO:teuthology.orchestra.run.smithi032.stdout:002.out 2023-06-20T13:38:23.976 INFO:teuthology.orchestra.run.smithi032.stdout:003 2023-06-20T13:38:23.976 INFO:teuthology.orchestra.run.smithi032.stdout:003.out 2023-06-20T13:38:23.976 INFO:teuthology.orchestra.run.smithi032.stdout:004 2023-06-20T13:38:23.976 INFO:teuthology.orchestra.run.smithi032.stdout:004.out 2023-06-20T13:38:23.976 INFO:teuthology.orchestra.run.smithi032.stdout:005 2023-06-20T13:38:23.977 INFO:teuthology.orchestra.run.smithi032.stdout:005.out 2023-06-20T13:38:23.977 INFO:teuthology.orchestra.run.smithi032.stdout:006 2023-06-20T13:38:23.977 INFO:teuthology.orchestra.run.smithi032.stdout:006.out 2023-06-20T13:38:23.977 INFO:teuthology.orchestra.run.smithi032.stdout:007 2023-06-20T13:38:23.977 INFO:teuthology.orchestra.run.smithi032.stdout:007.out 2023-06-20T13:38:23.977 INFO:teuthology.orchestra.run.smithi032.stdout:008 2023-06-20T13:38:23.977 INFO:teuthology.orchestra.run.smithi032.stdout:008.out 2023-06-20T13:38:23.978 INFO:teuthology.orchestra.run.smithi032.stdout:009 2023-06-20T13:38:23.978 INFO:teuthology.orchestra.run.smithi032.stdout:009.out 2023-06-20T13:38:23.978 INFO:teuthology.orchestra.run.smithi032.stdout:010 2023-06-20T13:38:23.978 INFO:teuthology.orchestra.run.smithi032.stdout:010.out 2023-06-20T13:38:23.978 INFO:teuthology.orchestra.run.smithi032.stdout:011 2023-06-20T13:38:23.978 INFO:teuthology.orchestra.run.smithi032.stdout:011.out 2023-06-20T13:38:23.978 INFO:teuthology.orchestra.run.smithi032.stdout:012 2023-06-20T13:38:23.978 INFO:teuthology.orchestra.run.smithi032.stdout:012.out 2023-06-20T13:38:23.979 INFO:teuthology.orchestra.run.smithi032.stdout:013 2023-06-20T13:38:23.979 INFO:teuthology.orchestra.run.smithi032.stdout:013.out 2023-06-20T13:38:23.979 INFO:teuthology.orchestra.run.smithi032.stdout:014 2023-06-20T13:38:23.979 INFO:teuthology.orchestra.run.smithi032.stdout:014.out 2023-06-20T13:38:23.979 INFO:teuthology.orchestra.run.smithi032.stdout:015 2023-06-20T13:38:23.979 INFO:teuthology.orchestra.run.smithi032.stdout:015.out 2023-06-20T13:38:23.980 INFO:teuthology.orchestra.run.smithi032.stdout:016 2023-06-20T13:38:23.980 INFO:teuthology.orchestra.run.smithi032.stdout:016.out 2023-06-20T13:38:23.980 INFO:teuthology.orchestra.run.smithi032.stdout:017 2023-06-20T13:38:23.980 INFO:teuthology.orchestra.run.smithi032.stdout:017.out 2023-06-20T13:38:23.981 INFO:teuthology.orchestra.run.smithi032.stdout:018 2023-06-20T13:38:23.981 INFO:teuthology.orchestra.run.smithi032.stdout:018.out 2023-06-20T13:38:23.981 INFO:teuthology.orchestra.run.smithi032.stdout:019 2023-06-20T13:38:23.981 INFO:teuthology.orchestra.run.smithi032.stdout:019.out 2023-06-20T13:38:23.982 INFO:teuthology.orchestra.run.smithi032.stdout:020 2023-06-20T13:38:23.982 INFO:teuthology.orchestra.run.smithi032.stdout:020.out 2023-06-20T13:38:23.982 INFO:teuthology.orchestra.run.smithi032.stdout:021 2023-06-20T13:38:23.983 INFO:teuthology.orchestra.run.smithi032.stdout:021.out 2023-06-20T13:38:23.983 INFO:teuthology.orchestra.run.smithi032.stdout:022 2023-06-20T13:38:23.983 INFO:teuthology.orchestra.run.smithi032.stdout:022.out 2023-06-20T13:38:23.983 INFO:teuthology.orchestra.run.smithi032.stdout:023 2023-06-20T13:38:23.984 INFO:teuthology.orchestra.run.smithi032.stdout:023.out 2023-06-20T13:38:23.984 INFO:teuthology.orchestra.run.smithi032.stdout:024 2023-06-20T13:38:23.984 INFO:teuthology.orchestra.run.smithi032.stdout:024.out 2023-06-20T13:38:23.984 INFO:teuthology.orchestra.run.smithi032.stdout:025 2023-06-20T13:38:23.985 INFO:teuthology.orchestra.run.smithi032.stdout:025.out 2023-06-20T13:38:23.985 INFO:teuthology.orchestra.run.smithi032.stdout:026 2023-06-20T13:38:23.985 INFO:teuthology.orchestra.run.smithi032.stdout:026.out 2023-06-20T13:38:23.986 INFO:teuthology.orchestra.run.smithi032.stdout:027 2023-06-20T13:38:23.986 INFO:teuthology.orchestra.run.smithi032.stdout:027.out 2023-06-20T13:38:23.986 INFO:teuthology.orchestra.run.smithi032.stdout:028 2023-06-20T13:38:23.986 INFO:teuthology.orchestra.run.smithi032.stdout:028.out 2023-06-20T13:38:23.987 INFO:teuthology.orchestra.run.smithi032.stdout:029 2023-06-20T13:38:23.987 INFO:teuthology.orchestra.run.smithi032.stdout:029.out 2023-06-20T13:38:23.987 INFO:teuthology.orchestra.run.smithi032.stdout:030 2023-06-20T13:38:23.988 INFO:teuthology.orchestra.run.smithi032.stdout:030.out 2023-06-20T13:38:23.988 INFO:teuthology.orchestra.run.smithi032.stdout:031 2023-06-20T13:38:23.988 INFO:teuthology.orchestra.run.smithi032.stdout:031.out 2023-06-20T13:38:23.988 INFO:teuthology.orchestra.run.smithi032.stdout:032 2023-06-20T13:38:23.989 INFO:teuthology.orchestra.run.smithi032.stdout:032.out 2023-06-20T13:38:23.989 INFO:teuthology.orchestra.run.smithi032.stdout:033 2023-06-20T13:38:23.989 INFO:teuthology.orchestra.run.smithi032.stdout:033.out 2023-06-20T13:38:23.989 INFO:teuthology.orchestra.run.smithi032.stdout:034 2023-06-20T13:38:23.989 INFO:teuthology.orchestra.run.smithi032.stdout:034.out 2023-06-20T13:38:23.990 INFO:teuthology.orchestra.run.smithi032.stdout:035 2023-06-20T13:38:23.990 INFO:teuthology.orchestra.run.smithi032.stdout:035.cfg 2023-06-20T13:38:23.990 INFO:teuthology.orchestra.run.smithi032.stdout:035.out.default 2023-06-20T13:38:23.990 INFO:teuthology.orchestra.run.smithi032.stdout:035.out.nfs 2023-06-20T13:38:23.991 INFO:teuthology.orchestra.run.smithi032.stdout:036 2023-06-20T13:38:23.991 INFO:teuthology.orchestra.run.smithi032.stdout:036.out 2023-06-20T13:38:23.991 INFO:teuthology.orchestra.run.smithi032.stdout:037 2023-06-20T13:38:23.991 INFO:teuthology.orchestra.run.smithi032.stdout:037.out 2023-06-20T13:38:23.992 INFO:teuthology.orchestra.run.smithi032.stdout:038 2023-06-20T13:38:23.992 INFO:teuthology.orchestra.run.smithi032.stdout:038.out 2023-06-20T13:38:23.992 INFO:teuthology.orchestra.run.smithi032.stdout:039 2023-06-20T13:38:23.992 INFO:teuthology.orchestra.run.smithi032.stdout:039.out 2023-06-20T13:38:23.992 INFO:teuthology.orchestra.run.smithi032.stdout:040 2023-06-20T13:38:23.992 INFO:teuthology.orchestra.run.smithi032.stdout:040.out 2023-06-20T13:38:23.993 INFO:teuthology.orchestra.run.smithi032.stdout:041 2023-06-20T13:38:23.993 INFO:teuthology.orchestra.run.smithi032.stdout:041.out 2023-06-20T13:38:23.993 INFO:teuthology.orchestra.run.smithi032.stdout:042 2023-06-20T13:38:23.993 INFO:teuthology.orchestra.run.smithi032.stdout:042.out 2023-06-20T13:38:23.993 INFO:teuthology.orchestra.run.smithi032.stdout:043 2023-06-20T13:38:23.993 INFO:teuthology.orchestra.run.smithi032.stdout:043.out 2023-06-20T13:38:23.993 INFO:teuthology.orchestra.run.smithi032.stdout:044 2023-06-20T13:38:23.993 INFO:teuthology.orchestra.run.smithi032.stdout:044.out 2023-06-20T13:38:23.994 INFO:teuthology.orchestra.run.smithi032.stdout:045 2023-06-20T13:38:23.994 INFO:teuthology.orchestra.run.smithi032.stdout:045.out 2023-06-20T13:38:23.994 INFO:teuthology.orchestra.run.smithi032.stdout:046 2023-06-20T13:38:23.994 INFO:teuthology.orchestra.run.smithi032.stdout:046.out 2023-06-20T13:38:23.994 INFO:teuthology.orchestra.run.smithi032.stdout:047 2023-06-20T13:38:23.994 INFO:teuthology.orchestra.run.smithi032.stdout:047.out 2023-06-20T13:38:23.994 INFO:teuthology.orchestra.run.smithi032.stdout:048 2023-06-20T13:38:23.995 INFO:teuthology.orchestra.run.smithi032.stdout:048.out 2023-06-20T13:38:23.995 INFO:teuthology.orchestra.run.smithi032.stdout:049 2023-06-20T13:38:23.995 INFO:teuthology.orchestra.run.smithi032.stdout:049.out 2023-06-20T13:38:23.995 INFO:teuthology.orchestra.run.smithi032.stdout:050 2023-06-20T13:38:23.995 INFO:teuthology.orchestra.run.smithi032.stdout:050.cfg 2023-06-20T13:38:23.995 INFO:teuthology.orchestra.run.smithi032.stdout:050.out.default 2023-06-20T13:38:23.995 INFO:teuthology.orchestra.run.smithi032.stdout:050.out.nojournal 2023-06-20T13:38:23.996 INFO:teuthology.orchestra.run.smithi032.stdout:050.out.xfsquota 2023-06-20T13:38:23.996 INFO:teuthology.orchestra.run.smithi032.stdout:051 2023-06-20T13:38:23.996 INFO:teuthology.orchestra.run.smithi032.stdout:051.out 2023-06-20T13:38:23.996 INFO:teuthology.orchestra.run.smithi032.stdout:052 2023-06-20T13:38:23.996 INFO:teuthology.orchestra.run.smithi032.stdout:052.out 2023-06-20T13:38:23.996 INFO:teuthology.orchestra.run.smithi032.stdout:053 2023-06-20T13:38:23.996 INFO:teuthology.orchestra.run.smithi032.stdout:053.out 2023-06-20T13:38:23.996 INFO:teuthology.orchestra.run.smithi032.stdout:054 2023-06-20T13:38:23.997 INFO:teuthology.orchestra.run.smithi032.stdout:054.out 2023-06-20T13:38:23.997 INFO:teuthology.orchestra.run.smithi032.stdout:055 2023-06-20T13:38:23.997 INFO:teuthology.orchestra.run.smithi032.stdout:055.out 2023-06-20T13:38:23.997 INFO:teuthology.orchestra.run.smithi032.stdout:056 2023-06-20T13:38:23.997 INFO:teuthology.orchestra.run.smithi032.stdout:056.out 2023-06-20T13:38:23.998 INFO:teuthology.orchestra.run.smithi032.stdout:057 2023-06-20T13:38:23.998 INFO:teuthology.orchestra.run.smithi032.stdout:057.out 2023-06-20T13:38:23.998 INFO:teuthology.orchestra.run.smithi032.stdout:058 2023-06-20T13:38:23.998 INFO:teuthology.orchestra.run.smithi032.stdout:058.out 2023-06-20T13:38:23.998 INFO:teuthology.orchestra.run.smithi032.stdout:059 2023-06-20T13:38:23.999 INFO:teuthology.orchestra.run.smithi032.stdout:059.out 2023-06-20T13:38:23.999 INFO:teuthology.orchestra.run.smithi032.stdout:060 2023-06-20T13:38:23.999 INFO:teuthology.orchestra.run.smithi032.stdout:060.out 2023-06-20T13:38:23.999 INFO:teuthology.orchestra.run.smithi032.stdout:061 2023-06-20T13:38:23.999 INFO:teuthology.orchestra.run.smithi032.stdout:061.out 2023-06-20T13:38:23.999 INFO:teuthology.orchestra.run.smithi032.stdout:062 2023-06-20T13:38:23.999 INFO:teuthology.orchestra.run.smithi032.stdout:062.out 2023-06-20T13:38:23.999 INFO:teuthology.orchestra.run.smithi032.stdout:063 2023-06-20T13:38:24.000 INFO:teuthology.orchestra.run.smithi032.stdout:063.out 2023-06-20T13:38:24.000 INFO:teuthology.orchestra.run.smithi032.stdout:064 2023-06-20T13:38:24.000 INFO:teuthology.orchestra.run.smithi032.stdout:064.out 2023-06-20T13:38:24.000 INFO:teuthology.orchestra.run.smithi032.stdout:065 2023-06-20T13:38:24.000 INFO:teuthology.orchestra.run.smithi032.stdout:065.out 2023-06-20T13:38:24.000 INFO:teuthology.orchestra.run.smithi032.stdout:066 2023-06-20T13:38:24.000 INFO:teuthology.orchestra.run.smithi032.stdout:066.out 2023-06-20T13:38:24.000 INFO:teuthology.orchestra.run.smithi032.stdout:067 2023-06-20T13:38:24.001 INFO:teuthology.orchestra.run.smithi032.stdout:067.out 2023-06-20T13:38:24.001 INFO:teuthology.orchestra.run.smithi032.stdout:068 2023-06-20T13:38:24.001 INFO:teuthology.orchestra.run.smithi032.stdout:068.out 2023-06-20T13:38:24.001 INFO:teuthology.orchestra.run.smithi032.stdout:069 2023-06-20T13:38:24.001 INFO:teuthology.orchestra.run.smithi032.stdout:069.out 2023-06-20T13:38:24.001 INFO:teuthology.orchestra.run.smithi032.stdout:070 2023-06-20T13:38:24.001 INFO:teuthology.orchestra.run.smithi032.stdout:070.out 2023-06-20T13:38:24.002 INFO:teuthology.orchestra.run.smithi032.stdout:071 2023-06-20T13:38:24.002 INFO:teuthology.orchestra.run.smithi032.stdout:071.out 2023-06-20T13:38:24.002 INFO:teuthology.orchestra.run.smithi032.stdout:072 2023-06-20T13:38:24.002 INFO:teuthology.orchestra.run.smithi032.stdout:072.out 2023-06-20T13:38:24.002 INFO:teuthology.orchestra.run.smithi032.stdout:073 2023-06-20T13:38:24.002 INFO:teuthology.orchestra.run.smithi032.stdout:073.out 2023-06-20T13:38:24.002 INFO:teuthology.orchestra.run.smithi032.stdout:074 2023-06-20T13:38:24.002 INFO:teuthology.orchestra.run.smithi032.stdout:074.out 2023-06-20T13:38:24.003 INFO:teuthology.orchestra.run.smithi032.stdout:075 2023-06-20T13:38:24.003 INFO:teuthology.orchestra.run.smithi032.stdout:075.out 2023-06-20T13:38:24.003 INFO:teuthology.orchestra.run.smithi032.stdout:076 2023-06-20T13:38:24.003 INFO:teuthology.orchestra.run.smithi032.stdout:076.out 2023-06-20T13:38:24.003 INFO:teuthology.orchestra.run.smithi032.stdout:077 2023-06-20T13:38:24.003 INFO:teuthology.orchestra.run.smithi032.stdout:077.out 2023-06-20T13:38:24.003 INFO:teuthology.orchestra.run.smithi032.stdout:078 2023-06-20T13:38:24.003 INFO:teuthology.orchestra.run.smithi032.stdout:078.out 2023-06-20T13:38:24.004 INFO:teuthology.orchestra.run.smithi032.stdout:079 2023-06-20T13:38:24.004 INFO:teuthology.orchestra.run.smithi032.stdout:079.out 2023-06-20T13:38:24.004 INFO:teuthology.orchestra.run.smithi032.stdout:080 2023-06-20T13:38:24.004 INFO:teuthology.orchestra.run.smithi032.stdout:080.out 2023-06-20T13:38:24.004 INFO:teuthology.orchestra.run.smithi032.stdout:081 2023-06-20T13:38:24.004 INFO:teuthology.orchestra.run.smithi032.stdout:081.out 2023-06-20T13:38:24.004 INFO:teuthology.orchestra.run.smithi032.stdout:082 2023-06-20T13:38:24.004 INFO:teuthology.orchestra.run.smithi032.stdout:082.out 2023-06-20T13:38:24.005 INFO:teuthology.orchestra.run.smithi032.stdout:083 2023-06-20T13:38:24.005 INFO:teuthology.orchestra.run.smithi032.stdout:083.out 2023-06-20T13:38:24.005 INFO:teuthology.orchestra.run.smithi032.stdout:084 2023-06-20T13:38:24.005 INFO:teuthology.orchestra.run.smithi032.stdout:084.out 2023-06-20T13:38:24.005 INFO:teuthology.orchestra.run.smithi032.stdout:085 2023-06-20T13:38:24.005 INFO:teuthology.orchestra.run.smithi032.stdout:085.out 2023-06-20T13:38:24.005 INFO:teuthology.orchestra.run.smithi032.stdout:086 2023-06-20T13:38:24.005 INFO:teuthology.orchestra.run.smithi032.stdout:086.out 2023-06-20T13:38:24.006 INFO:teuthology.orchestra.run.smithi032.stdout:087 2023-06-20T13:38:24.006 INFO:teuthology.orchestra.run.smithi032.stdout:087.out 2023-06-20T13:38:24.006 INFO:teuthology.orchestra.run.smithi032.stdout:088 2023-06-20T13:38:24.006 INFO:teuthology.orchestra.run.smithi032.stdout:088.out 2023-06-20T13:38:24.006 INFO:teuthology.orchestra.run.smithi032.stdout:089 2023-06-20T13:38:24.006 INFO:teuthology.orchestra.run.smithi032.stdout:089.out 2023-06-20T13:38:24.006 INFO:teuthology.orchestra.run.smithi032.stdout:090 2023-06-20T13:38:24.006 INFO:teuthology.orchestra.run.smithi032.stdout:090.out 2023-06-20T13:38:24.007 INFO:teuthology.orchestra.run.smithi032.stdout:091 2023-06-20T13:38:24.007 INFO:teuthology.orchestra.run.smithi032.stdout:091.out 2023-06-20T13:38:24.007 INFO:teuthology.orchestra.run.smithi032.stdout:092 2023-06-20T13:38:24.007 INFO:teuthology.orchestra.run.smithi032.stdout:092.out 2023-06-20T13:38:24.007 INFO:teuthology.orchestra.run.smithi032.stdout:093 2023-06-20T13:38:24.007 INFO:teuthology.orchestra.run.smithi032.stdout:093.out 2023-06-20T13:38:24.007 INFO:teuthology.orchestra.run.smithi032.stdout:094 2023-06-20T13:38:24.007 INFO:teuthology.orchestra.run.smithi032.stdout:094.out 2023-06-20T13:38:24.008 INFO:teuthology.orchestra.run.smithi032.stdout:095 2023-06-20T13:38:24.008 INFO:teuthology.orchestra.run.smithi032.stdout:095.out 2023-06-20T13:38:24.008 INFO:teuthology.orchestra.run.smithi032.stdout:096 2023-06-20T13:38:24.008 INFO:teuthology.orchestra.run.smithi032.stdout:096.out 2023-06-20T13:38:24.008 INFO:teuthology.orchestra.run.smithi032.stdout:097 2023-06-20T13:38:24.008 INFO:teuthology.orchestra.run.smithi032.stdout:097.out 2023-06-20T13:38:24.008 INFO:teuthology.orchestra.run.smithi032.stdout:098 2023-06-20T13:38:24.008 INFO:teuthology.orchestra.run.smithi032.stdout:098.out 2023-06-20T13:38:24.009 INFO:teuthology.orchestra.run.smithi032.stdout:099 2023-06-20T13:38:24.009 INFO:teuthology.orchestra.run.smithi032.stdout:099.out 2023-06-20T13:38:24.009 INFO:teuthology.orchestra.run.smithi032.stdout:100 2023-06-20T13:38:24.009 INFO:teuthology.orchestra.run.smithi032.stdout:100.out 2023-06-20T13:38:24.009 INFO:teuthology.orchestra.run.smithi032.stdout:101 2023-06-20T13:38:24.009 INFO:teuthology.orchestra.run.smithi032.stdout:101.out 2023-06-20T13:38:24.009 INFO:teuthology.orchestra.run.smithi032.stdout:102 2023-06-20T13:38:24.009 INFO:teuthology.orchestra.run.smithi032.stdout:102.out 2023-06-20T13:38:24.010 INFO:teuthology.orchestra.run.smithi032.stdout:103 2023-06-20T13:38:24.010 INFO:teuthology.orchestra.run.smithi032.stdout:103.out 2023-06-20T13:38:24.010 INFO:teuthology.orchestra.run.smithi032.stdout:104 2023-06-20T13:38:24.010 INFO:teuthology.orchestra.run.smithi032.stdout:104.out 2023-06-20T13:38:24.010 INFO:teuthology.orchestra.run.smithi032.stdout:105 2023-06-20T13:38:24.010 INFO:teuthology.orchestra.run.smithi032.stdout:105.out 2023-06-20T13:38:24.010 INFO:teuthology.orchestra.run.smithi032.stdout:106 2023-06-20T13:38:24.010 INFO:teuthology.orchestra.run.smithi032.stdout:106.out 2023-06-20T13:38:24.011 INFO:teuthology.orchestra.run.smithi032.stdout:107 2023-06-20T13:38:24.011 INFO:teuthology.orchestra.run.smithi032.stdout:107.out 2023-06-20T13:38:24.011 INFO:teuthology.orchestra.run.smithi032.stdout:108 2023-06-20T13:38:24.011 INFO:teuthology.orchestra.run.smithi032.stdout:108.out 2023-06-20T13:38:24.011 INFO:teuthology.orchestra.run.smithi032.stdout:109 2023-06-20T13:38:24.011 INFO:teuthology.orchestra.run.smithi032.stdout:109.out 2023-06-20T13:38:24.011 INFO:teuthology.orchestra.run.smithi032.stdout:110 2023-06-20T13:38:24.011 INFO:teuthology.orchestra.run.smithi032.stdout:110.out 2023-06-20T13:38:24.012 INFO:teuthology.orchestra.run.smithi032.stdout:111 2023-06-20T13:38:24.012 INFO:teuthology.orchestra.run.smithi032.stdout:111.out 2023-06-20T13:38:24.012 INFO:teuthology.orchestra.run.smithi032.stdout:112 2023-06-20T13:38:24.012 INFO:teuthology.orchestra.run.smithi032.stdout:112.out 2023-06-20T13:38:24.012 INFO:teuthology.orchestra.run.smithi032.stdout:113 2023-06-20T13:38:24.012 INFO:teuthology.orchestra.run.smithi032.stdout:113.out 2023-06-20T13:38:24.012 INFO:teuthology.orchestra.run.smithi032.stdout:114 2023-06-20T13:38:24.013 INFO:teuthology.orchestra.run.smithi032.stdout:114.out 2023-06-20T13:38:24.013 INFO:teuthology.orchestra.run.smithi032.stdout:115 2023-06-20T13:38:24.013 INFO:teuthology.orchestra.run.smithi032.stdout:115.out 2023-06-20T13:38:24.013 INFO:teuthology.orchestra.run.smithi032.stdout:116 2023-06-20T13:38:24.013 INFO:teuthology.orchestra.run.smithi032.stdout:116.out 2023-06-20T13:38:24.013 INFO:teuthology.orchestra.run.smithi032.stdout:117 2023-06-20T13:38:24.013 INFO:teuthology.orchestra.run.smithi032.stdout:117.out 2023-06-20T13:38:24.013 INFO:teuthology.orchestra.run.smithi032.stdout:118 2023-06-20T13:38:24.014 INFO:teuthology.orchestra.run.smithi032.stdout:118.out 2023-06-20T13:38:24.014 INFO:teuthology.orchestra.run.smithi032.stdout:119 2023-06-20T13:38:24.014 INFO:teuthology.orchestra.run.smithi032.stdout:119.out 2023-06-20T13:38:24.014 INFO:teuthology.orchestra.run.smithi032.stdout:120 2023-06-20T13:38:24.014 INFO:teuthology.orchestra.run.smithi032.stdout:120.out 2023-06-20T13:38:24.014 INFO:teuthology.orchestra.run.smithi032.stdout:121 2023-06-20T13:38:24.014 INFO:teuthology.orchestra.run.smithi032.stdout:121.out 2023-06-20T13:38:24.014 INFO:teuthology.orchestra.run.smithi032.stdout:122 2023-06-20T13:38:24.015 INFO:teuthology.orchestra.run.smithi032.stdout:122.out 2023-06-20T13:38:24.015 INFO:teuthology.orchestra.run.smithi032.stdout:123 2023-06-20T13:38:24.015 INFO:teuthology.orchestra.run.smithi032.stdout:123.out 2023-06-20T13:38:24.015 INFO:teuthology.orchestra.run.smithi032.stdout:124 2023-06-20T13:38:24.015 INFO:teuthology.orchestra.run.smithi032.stdout:124.out 2023-06-20T13:38:24.015 INFO:teuthology.orchestra.run.smithi032.stdout:125 2023-06-20T13:38:24.015 INFO:teuthology.orchestra.run.smithi032.stdout:125.out 2023-06-20T13:38:24.015 INFO:teuthology.orchestra.run.smithi032.stdout:126 2023-06-20T13:38:24.016 INFO:teuthology.orchestra.run.smithi032.stdout:126.out 2023-06-20T13:38:24.016 INFO:teuthology.orchestra.run.smithi032.stdout:127 2023-06-20T13:38:24.016 INFO:teuthology.orchestra.run.smithi032.stdout:127.out 2023-06-20T13:38:24.016 INFO:teuthology.orchestra.run.smithi032.stdout:128 2023-06-20T13:38:24.016 INFO:teuthology.orchestra.run.smithi032.stdout:128.out 2023-06-20T13:38:24.016 INFO:teuthology.orchestra.run.smithi032.stdout:129 2023-06-20T13:38:24.016 INFO:teuthology.orchestra.run.smithi032.stdout:129.out 2023-06-20T13:38:24.017 INFO:teuthology.orchestra.run.smithi032.stdout:130 2023-06-20T13:38:24.017 INFO:teuthology.orchestra.run.smithi032.stdout:130.out 2023-06-20T13:38:24.017 INFO:teuthology.orchestra.run.smithi032.stdout:131 2023-06-20T13:38:24.017 INFO:teuthology.orchestra.run.smithi032.stdout:131.out 2023-06-20T13:38:24.017 INFO:teuthology.orchestra.run.smithi032.stdout:132 2023-06-20T13:38:24.017 INFO:teuthology.orchestra.run.smithi032.stdout:132.out 2023-06-20T13:38:24.017 INFO:teuthology.orchestra.run.smithi032.stdout:133 2023-06-20T13:38:24.017 INFO:teuthology.orchestra.run.smithi032.stdout:133.out 2023-06-20T13:38:24.018 INFO:teuthology.orchestra.run.smithi032.stdout:134 2023-06-20T13:38:24.018 INFO:teuthology.orchestra.run.smithi032.stdout:134.out 2023-06-20T13:38:24.018 INFO:teuthology.orchestra.run.smithi032.stdout:135 2023-06-20T13:38:24.018 INFO:teuthology.orchestra.run.smithi032.stdout:135.out 2023-06-20T13:38:24.018 INFO:teuthology.orchestra.run.smithi032.stdout:136 2023-06-20T13:38:24.018 INFO:teuthology.orchestra.run.smithi032.stdout:136.out 2023-06-20T13:38:24.018 INFO:teuthology.orchestra.run.smithi032.stdout:137 2023-06-20T13:38:24.019 INFO:teuthology.orchestra.run.smithi032.stdout:137.out 2023-06-20T13:38:24.019 INFO:teuthology.orchestra.run.smithi032.stdout:138 2023-06-20T13:38:24.019 INFO:teuthology.orchestra.run.smithi032.stdout:138.out 2023-06-20T13:38:24.019 INFO:teuthology.orchestra.run.smithi032.stdout:139 2023-06-20T13:38:24.019 INFO:teuthology.orchestra.run.smithi032.stdout:139.out 2023-06-20T13:38:24.019 INFO:teuthology.orchestra.run.smithi032.stdout:140 2023-06-20T13:38:24.019 INFO:teuthology.orchestra.run.smithi032.stdout:140.out 2023-06-20T13:38:24.019 INFO:teuthology.orchestra.run.smithi032.stdout:141 2023-06-20T13:38:24.020 INFO:teuthology.orchestra.run.smithi032.stdout:141.out 2023-06-20T13:38:24.020 INFO:teuthology.orchestra.run.smithi032.stdout:142 2023-06-20T13:38:24.020 INFO:teuthology.orchestra.run.smithi032.stdout:142.out 2023-06-20T13:38:24.020 INFO:teuthology.orchestra.run.smithi032.stdout:143 2023-06-20T13:38:24.020 INFO:teuthology.orchestra.run.smithi032.stdout:143.out 2023-06-20T13:38:24.020 INFO:teuthology.orchestra.run.smithi032.stdout:144 2023-06-20T13:38:24.020 INFO:teuthology.orchestra.run.smithi032.stdout:144.out 2023-06-20T13:38:24.020 INFO:teuthology.orchestra.run.smithi032.stdout:145 2023-06-20T13:38:24.021 INFO:teuthology.orchestra.run.smithi032.stdout:145.out 2023-06-20T13:38:24.021 INFO:teuthology.orchestra.run.smithi032.stdout:146 2023-06-20T13:38:24.021 INFO:teuthology.orchestra.run.smithi032.stdout:146.out 2023-06-20T13:38:24.021 INFO:teuthology.orchestra.run.smithi032.stdout:147 2023-06-20T13:38:24.021 INFO:teuthology.orchestra.run.smithi032.stdout:147.out 2023-06-20T13:38:24.021 INFO:teuthology.orchestra.run.smithi032.stdout:148 2023-06-20T13:38:24.021 INFO:teuthology.orchestra.run.smithi032.stdout:148.out 2023-06-20T13:38:24.021 INFO:teuthology.orchestra.run.smithi032.stdout:149 2023-06-20T13:38:24.022 INFO:teuthology.orchestra.run.smithi032.stdout:149.out 2023-06-20T13:38:24.022 INFO:teuthology.orchestra.run.smithi032.stdout:150 2023-06-20T13:38:24.022 INFO:teuthology.orchestra.run.smithi032.stdout:150.out 2023-06-20T13:38:24.022 INFO:teuthology.orchestra.run.smithi032.stdout:151 2023-06-20T13:38:24.022 INFO:teuthology.orchestra.run.smithi032.stdout:151.out 2023-06-20T13:38:24.022 INFO:teuthology.orchestra.run.smithi032.stdout:152 2023-06-20T13:38:24.022 INFO:teuthology.orchestra.run.smithi032.stdout:152.out 2023-06-20T13:38:24.022 INFO:teuthology.orchestra.run.smithi032.stdout:153 2023-06-20T13:38:24.023 INFO:teuthology.orchestra.run.smithi032.stdout:153.out 2023-06-20T13:38:24.023 INFO:teuthology.orchestra.run.smithi032.stdout:154 2023-06-20T13:38:24.023 INFO:teuthology.orchestra.run.smithi032.stdout:154.out 2023-06-20T13:38:24.023 INFO:teuthology.orchestra.run.smithi032.stdout:155 2023-06-20T13:38:24.023 INFO:teuthology.orchestra.run.smithi032.stdout:155.out 2023-06-20T13:38:24.023 INFO:teuthology.orchestra.run.smithi032.stdout:156 2023-06-20T13:38:24.023 INFO:teuthology.orchestra.run.smithi032.stdout:156.out 2023-06-20T13:38:24.024 INFO:teuthology.orchestra.run.smithi032.stdout:157 2023-06-20T13:38:24.024 INFO:teuthology.orchestra.run.smithi032.stdout:157.out 2023-06-20T13:38:24.024 INFO:teuthology.orchestra.run.smithi032.stdout:158 2023-06-20T13:38:24.024 INFO:teuthology.orchestra.run.smithi032.stdout:158.out 2023-06-20T13:38:24.024 INFO:teuthology.orchestra.run.smithi032.stdout:159 2023-06-20T13:38:24.024 INFO:teuthology.orchestra.run.smithi032.stdout:159.out 2023-06-20T13:38:24.024 INFO:teuthology.orchestra.run.smithi032.stdout:160 2023-06-20T13:38:24.025 INFO:teuthology.orchestra.run.smithi032.stdout:160.out 2023-06-20T13:38:24.025 INFO:teuthology.orchestra.run.smithi032.stdout:161 2023-06-20T13:38:24.025 INFO:teuthology.orchestra.run.smithi032.stdout:161.out 2023-06-20T13:38:24.025 INFO:teuthology.orchestra.run.smithi032.stdout:162 2023-06-20T13:38:24.025 INFO:teuthology.orchestra.run.smithi032.stdout:162.out 2023-06-20T13:38:24.025 INFO:teuthology.orchestra.run.smithi032.stdout:163 2023-06-20T13:38:24.025 INFO:teuthology.orchestra.run.smithi032.stdout:163.out 2023-06-20T13:38:24.025 INFO:teuthology.orchestra.run.smithi032.stdout:164 2023-06-20T13:38:24.026 INFO:teuthology.orchestra.run.smithi032.stdout:164.out 2023-06-20T13:38:24.026 INFO:teuthology.orchestra.run.smithi032.stdout:165 2023-06-20T13:38:24.026 INFO:teuthology.orchestra.run.smithi032.stdout:165.out 2023-06-20T13:38:24.026 INFO:teuthology.orchestra.run.smithi032.stdout:166 2023-06-20T13:38:24.026 INFO:teuthology.orchestra.run.smithi032.stdout:166.out 2023-06-20T13:38:24.026 INFO:teuthology.orchestra.run.smithi032.stdout:167 2023-06-20T13:38:24.026 INFO:teuthology.orchestra.run.smithi032.stdout:167.out 2023-06-20T13:38:24.027 INFO:teuthology.orchestra.run.smithi032.stdout:168 2023-06-20T13:38:24.027 INFO:teuthology.orchestra.run.smithi032.stdout:168.out 2023-06-20T13:38:24.027 INFO:teuthology.orchestra.run.smithi032.stdout:169 2023-06-20T13:38:24.027 INFO:teuthology.orchestra.run.smithi032.stdout:169.out 2023-06-20T13:38:24.027 INFO:teuthology.orchestra.run.smithi032.stdout:170 2023-06-20T13:38:24.027 INFO:teuthology.orchestra.run.smithi032.stdout:170.out 2023-06-20T13:38:24.027 INFO:teuthology.orchestra.run.smithi032.stdout:171 2023-06-20T13:38:24.027 INFO:teuthology.orchestra.run.smithi032.stdout:171.out 2023-06-20T13:38:24.028 INFO:teuthology.orchestra.run.smithi032.stdout:172 2023-06-20T13:38:24.028 INFO:teuthology.orchestra.run.smithi032.stdout:172.out 2023-06-20T13:38:24.028 INFO:teuthology.orchestra.run.smithi032.stdout:173 2023-06-20T13:38:24.028 INFO:teuthology.orchestra.run.smithi032.stdout:173.out 2023-06-20T13:38:24.028 INFO:teuthology.orchestra.run.smithi032.stdout:174 2023-06-20T13:38:24.028 INFO:teuthology.orchestra.run.smithi032.stdout:174.out 2023-06-20T13:38:24.029 INFO:teuthology.orchestra.run.smithi032.stdout:175 2023-06-20T13:38:24.029 INFO:teuthology.orchestra.run.smithi032.stdout:175.out 2023-06-20T13:38:24.029 INFO:teuthology.orchestra.run.smithi032.stdout:176 2023-06-20T13:38:24.029 INFO:teuthology.orchestra.run.smithi032.stdout:176.out 2023-06-20T13:38:24.029 INFO:teuthology.orchestra.run.smithi032.stdout:177 2023-06-20T13:38:24.029 INFO:teuthology.orchestra.run.smithi032.stdout:177.out 2023-06-20T13:38:24.029 INFO:teuthology.orchestra.run.smithi032.stdout:178 2023-06-20T13:38:24.029 INFO:teuthology.orchestra.run.smithi032.stdout:178.out 2023-06-20T13:38:24.030 INFO:teuthology.orchestra.run.smithi032.stdout:179 2023-06-20T13:38:24.030 INFO:teuthology.orchestra.run.smithi032.stdout:179.out 2023-06-20T13:38:24.030 INFO:teuthology.orchestra.run.smithi032.stdout:180 2023-06-20T13:38:24.030 INFO:teuthology.orchestra.run.smithi032.stdout:180.out 2023-06-20T13:38:24.030 INFO:teuthology.orchestra.run.smithi032.stdout:181 2023-06-20T13:38:24.030 INFO:teuthology.orchestra.run.smithi032.stdout:181.out 2023-06-20T13:38:24.030 INFO:teuthology.orchestra.run.smithi032.stdout:182 2023-06-20T13:38:24.031 INFO:teuthology.orchestra.run.smithi032.stdout:182.out 2023-06-20T13:38:24.031 INFO:teuthology.orchestra.run.smithi032.stdout:183 2023-06-20T13:38:24.031 INFO:teuthology.orchestra.run.smithi032.stdout:183.out 2023-06-20T13:38:24.031 INFO:teuthology.orchestra.run.smithi032.stdout:184 2023-06-20T13:38:24.031 INFO:teuthology.orchestra.run.smithi032.stdout:184.out 2023-06-20T13:38:24.031 INFO:teuthology.orchestra.run.smithi032.stdout:185 2023-06-20T13:38:24.031 INFO:teuthology.orchestra.run.smithi032.stdout:185.out 2023-06-20T13:38:24.031 INFO:teuthology.orchestra.run.smithi032.stdout:186 2023-06-20T13:38:24.032 INFO:teuthology.orchestra.run.smithi032.stdout:186.out 2023-06-20T13:38:24.032 INFO:teuthology.orchestra.run.smithi032.stdout:187 2023-06-20T13:38:24.032 INFO:teuthology.orchestra.run.smithi032.stdout:187.out 2023-06-20T13:38:24.032 INFO:teuthology.orchestra.run.smithi032.stdout:188 2023-06-20T13:38:24.032 INFO:teuthology.orchestra.run.smithi032.stdout:188.out 2023-06-20T13:38:24.032 INFO:teuthology.orchestra.run.smithi032.stdout:189 2023-06-20T13:38:24.032 INFO:teuthology.orchestra.run.smithi032.stdout:189.out 2023-06-20T13:38:24.032 INFO:teuthology.orchestra.run.smithi032.stdout:190 2023-06-20T13:38:24.033 INFO:teuthology.orchestra.run.smithi032.stdout:190.out 2023-06-20T13:38:24.033 INFO:teuthology.orchestra.run.smithi032.stdout:191 2023-06-20T13:38:24.033 INFO:teuthology.orchestra.run.smithi032.stdout:191.out 2023-06-20T13:38:24.033 INFO:teuthology.orchestra.run.smithi032.stdout:192 2023-06-20T13:38:24.033 INFO:teuthology.orchestra.run.smithi032.stdout:192.out 2023-06-20T13:38:24.033 INFO:teuthology.orchestra.run.smithi032.stdout:193 2023-06-20T13:38:24.033 INFO:teuthology.orchestra.run.smithi032.stdout:193.out 2023-06-20T13:38:24.033 INFO:teuthology.orchestra.run.smithi032.stdout:194 2023-06-20T13:38:24.034 INFO:teuthology.orchestra.run.smithi032.stdout:194.out 2023-06-20T13:38:24.034 INFO:teuthology.orchestra.run.smithi032.stdout:195 2023-06-20T13:38:24.034 INFO:teuthology.orchestra.run.smithi032.stdout:195.out 2023-06-20T13:38:24.034 INFO:teuthology.orchestra.run.smithi032.stdout:196 2023-06-20T13:38:24.034 INFO:teuthology.orchestra.run.smithi032.stdout:196.out 2023-06-20T13:38:24.034 INFO:teuthology.orchestra.run.smithi032.stdout:197 2023-06-20T13:38:24.034 INFO:teuthology.orchestra.run.smithi032.stdout:197.out 2023-06-20T13:38:24.034 INFO:teuthology.orchestra.run.smithi032.stdout:198 2023-06-20T13:38:24.035 INFO:teuthology.orchestra.run.smithi032.stdout:198.out 2023-06-20T13:38:24.035 INFO:teuthology.orchestra.run.smithi032.stdout:199 2023-06-20T13:38:24.035 INFO:teuthology.orchestra.run.smithi032.stdout:199.out 2023-06-20T13:38:24.035 INFO:teuthology.orchestra.run.smithi032.stdout:200 2023-06-20T13:38:24.035 INFO:teuthology.orchestra.run.smithi032.stdout:200.out 2023-06-20T13:38:24.035 INFO:teuthology.orchestra.run.smithi032.stdout:201 2023-06-20T13:38:24.035 INFO:teuthology.orchestra.run.smithi032.stdout:201.out 2023-06-20T13:38:24.035 INFO:teuthology.orchestra.run.smithi032.stdout:202 2023-06-20T13:38:24.036 INFO:teuthology.orchestra.run.smithi032.stdout:202.out 2023-06-20T13:38:24.036 INFO:teuthology.orchestra.run.smithi032.stdout:203 2023-06-20T13:38:24.036 INFO:teuthology.orchestra.run.smithi032.stdout:203.out 2023-06-20T13:38:24.036 INFO:teuthology.orchestra.run.smithi032.stdout:204 2023-06-20T13:38:24.036 INFO:teuthology.orchestra.run.smithi032.stdout:204.out 2023-06-20T13:38:24.036 INFO:teuthology.orchestra.run.smithi032.stdout:205 2023-06-20T13:38:24.036 INFO:teuthology.orchestra.run.smithi032.stdout:205.out 2023-06-20T13:38:24.037 INFO:teuthology.orchestra.run.smithi032.stdout:206 2023-06-20T13:38:24.037 INFO:teuthology.orchestra.run.smithi032.stdout:206.out 2023-06-20T13:38:24.037 INFO:teuthology.orchestra.run.smithi032.stdout:207 2023-06-20T13:38:24.037 INFO:teuthology.orchestra.run.smithi032.stdout:207.out 2023-06-20T13:38:24.037 INFO:teuthology.orchestra.run.smithi032.stdout:208 2023-06-20T13:38:24.037 INFO:teuthology.orchestra.run.smithi032.stdout:208.out 2023-06-20T13:38:24.037 INFO:teuthology.orchestra.run.smithi032.stdout:209 2023-06-20T13:38:24.037 INFO:teuthology.orchestra.run.smithi032.stdout:209.out 2023-06-20T13:38:24.038 INFO:teuthology.orchestra.run.smithi032.stdout:210 2023-06-20T13:38:24.038 INFO:teuthology.orchestra.run.smithi032.stdout:210.out 2023-06-20T13:38:24.038 INFO:teuthology.orchestra.run.smithi032.stdout:211 2023-06-20T13:38:24.038 INFO:teuthology.orchestra.run.smithi032.stdout:211.out 2023-06-20T13:38:24.038 INFO:teuthology.orchestra.run.smithi032.stdout:212 2023-06-20T13:38:24.038 INFO:teuthology.orchestra.run.smithi032.stdout:212.out 2023-06-20T13:38:24.038 INFO:teuthology.orchestra.run.smithi032.stdout:213 2023-06-20T13:38:24.038 INFO:teuthology.orchestra.run.smithi032.stdout:213.out 2023-06-20T13:38:24.039 INFO:teuthology.orchestra.run.smithi032.stdout:214 2023-06-20T13:38:24.039 INFO:teuthology.orchestra.run.smithi032.stdout:214.out 2023-06-20T13:38:24.039 INFO:teuthology.orchestra.run.smithi032.stdout:215 2023-06-20T13:38:24.039 INFO:teuthology.orchestra.run.smithi032.stdout:215.out 2023-06-20T13:38:24.039 INFO:teuthology.orchestra.run.smithi032.stdout:216 2023-06-20T13:38:24.039 INFO:teuthology.orchestra.run.smithi032.stdout:216.out 2023-06-20T13:38:24.039 INFO:teuthology.orchestra.run.smithi032.stdout:217 2023-06-20T13:38:24.039 INFO:teuthology.orchestra.run.smithi032.stdout:217.out 2023-06-20T13:38:24.040 INFO:teuthology.orchestra.run.smithi032.stdout:218 2023-06-20T13:38:24.040 INFO:teuthology.orchestra.run.smithi032.stdout:218.out 2023-06-20T13:38:24.040 INFO:teuthology.orchestra.run.smithi032.stdout:219 2023-06-20T13:38:24.040 INFO:teuthology.orchestra.run.smithi032.stdout:219.out 2023-06-20T13:38:24.040 INFO:teuthology.orchestra.run.smithi032.stdout:220 2023-06-20T13:38:24.040 INFO:teuthology.orchestra.run.smithi032.stdout:220.out 2023-06-20T13:38:24.040 INFO:teuthology.orchestra.run.smithi032.stdout:221 2023-06-20T13:38:24.040 INFO:teuthology.orchestra.run.smithi032.stdout:221.out 2023-06-20T13:38:24.041 INFO:teuthology.orchestra.run.smithi032.stdout:222 2023-06-20T13:38:24.041 INFO:teuthology.orchestra.run.smithi032.stdout:222.out 2023-06-20T13:38:24.041 INFO:teuthology.orchestra.run.smithi032.stdout:223 2023-06-20T13:38:24.041 INFO:teuthology.orchestra.run.smithi032.stdout:223.out 2023-06-20T13:38:24.041 INFO:teuthology.orchestra.run.smithi032.stdout:224 2023-06-20T13:38:24.041 INFO:teuthology.orchestra.run.smithi032.stdout:224.out 2023-06-20T13:38:24.041 INFO:teuthology.orchestra.run.smithi032.stdout:225 2023-06-20T13:38:24.041 INFO:teuthology.orchestra.run.smithi032.stdout:225.out 2023-06-20T13:38:24.042 INFO:teuthology.orchestra.run.smithi032.stdout:226 2023-06-20T13:38:24.042 INFO:teuthology.orchestra.run.smithi032.stdout:226.out 2023-06-20T13:38:24.042 INFO:teuthology.orchestra.run.smithi032.stdout:227 2023-06-20T13:38:24.042 INFO:teuthology.orchestra.run.smithi032.stdout:227.out 2023-06-20T13:38:24.042 INFO:teuthology.orchestra.run.smithi032.stdout:228 2023-06-20T13:38:24.042 INFO:teuthology.orchestra.run.smithi032.stdout:228.out 2023-06-20T13:38:24.042 INFO:teuthology.orchestra.run.smithi032.stdout:229 2023-06-20T13:38:24.042 INFO:teuthology.orchestra.run.smithi032.stdout:229.out 2023-06-20T13:38:24.043 INFO:teuthology.orchestra.run.smithi032.stdout:230 2023-06-20T13:38:24.043 INFO:teuthology.orchestra.run.smithi032.stdout:230.out 2023-06-20T13:38:24.043 INFO:teuthology.orchestra.run.smithi032.stdout:231 2023-06-20T13:38:24.043 INFO:teuthology.orchestra.run.smithi032.stdout:231.out 2023-06-20T13:38:24.043 INFO:teuthology.orchestra.run.smithi032.stdout:232 2023-06-20T13:38:24.043 INFO:teuthology.orchestra.run.smithi032.stdout:232.out 2023-06-20T13:38:24.043 INFO:teuthology.orchestra.run.smithi032.stdout:233 2023-06-20T13:38:24.043 INFO:teuthology.orchestra.run.smithi032.stdout:233.out 2023-06-20T13:38:24.044 INFO:teuthology.orchestra.run.smithi032.stdout:234 2023-06-20T13:38:24.044 INFO:teuthology.orchestra.run.smithi032.stdout:234.out 2023-06-20T13:38:24.044 INFO:teuthology.orchestra.run.smithi032.stdout:235 2023-06-20T13:38:24.044 INFO:teuthology.orchestra.run.smithi032.stdout:235.out 2023-06-20T13:38:24.044 INFO:teuthology.orchestra.run.smithi032.stdout:236 2023-06-20T13:38:24.044 INFO:teuthology.orchestra.run.smithi032.stdout:236.out 2023-06-20T13:38:24.044 INFO:teuthology.orchestra.run.smithi032.stdout:237 2023-06-20T13:38:24.044 INFO:teuthology.orchestra.run.smithi032.stdout:237.out 2023-06-20T13:38:24.045 INFO:teuthology.orchestra.run.smithi032.stdout:238 2023-06-20T13:38:24.045 INFO:teuthology.orchestra.run.smithi032.stdout:238.out 2023-06-20T13:38:24.045 INFO:teuthology.orchestra.run.smithi032.stdout:239 2023-06-20T13:38:24.045 INFO:teuthology.orchestra.run.smithi032.stdout:239.out 2023-06-20T13:38:24.045 INFO:teuthology.orchestra.run.smithi032.stdout:240 2023-06-20T13:38:24.046 INFO:teuthology.orchestra.run.smithi032.stdout:240.out 2023-06-20T13:38:24.046 INFO:teuthology.orchestra.run.smithi032.stdout:241 2023-06-20T13:38:24.046 INFO:teuthology.orchestra.run.smithi032.stdout:241.out 2023-06-20T13:38:24.046 INFO:teuthology.orchestra.run.smithi032.stdout:242 2023-06-20T13:38:24.046 INFO:teuthology.orchestra.run.smithi032.stdout:242.out 2023-06-20T13:38:24.046 INFO:teuthology.orchestra.run.smithi032.stdout:243 2023-06-20T13:38:24.046 INFO:teuthology.orchestra.run.smithi032.stdout:243.out 2023-06-20T13:38:24.046 INFO:teuthology.orchestra.run.smithi032.stdout:244 2023-06-20T13:38:24.047 INFO:teuthology.orchestra.run.smithi032.stdout:244.out 2023-06-20T13:38:24.047 INFO:teuthology.orchestra.run.smithi032.stdout:245 2023-06-20T13:38:24.047 INFO:teuthology.orchestra.run.smithi032.stdout:245.out 2023-06-20T13:38:24.047 INFO:teuthology.orchestra.run.smithi032.stdout:246 2023-06-20T13:38:24.047 INFO:teuthology.orchestra.run.smithi032.stdout:246.out 2023-06-20T13:38:24.047 INFO:teuthology.orchestra.run.smithi032.stdout:247 2023-06-20T13:38:24.047 INFO:teuthology.orchestra.run.smithi032.stdout:247.out 2023-06-20T13:38:24.047 INFO:teuthology.orchestra.run.smithi032.stdout:248 2023-06-20T13:38:24.048 INFO:teuthology.orchestra.run.smithi032.stdout:248.out 2023-06-20T13:38:24.048 INFO:teuthology.orchestra.run.smithi032.stdout:249 2023-06-20T13:38:24.048 INFO:teuthology.orchestra.run.smithi032.stdout:249.out 2023-06-20T13:38:24.048 INFO:teuthology.orchestra.run.smithi032.stdout:250 2023-06-20T13:38:24.048 INFO:teuthology.orchestra.run.smithi032.stdout:250.out 2023-06-20T13:38:24.048 INFO:teuthology.orchestra.run.smithi032.stdout:251 2023-06-20T13:38:24.049 INFO:teuthology.orchestra.run.smithi032.stdout:251.out 2023-06-20T13:38:24.049 INFO:teuthology.orchestra.run.smithi032.stdout:252 2023-06-20T13:38:24.049 INFO:teuthology.orchestra.run.smithi032.stdout:252.out 2023-06-20T13:38:24.049 INFO:teuthology.orchestra.run.smithi032.stdout:253 2023-06-20T13:38:24.049 INFO:teuthology.orchestra.run.smithi032.stdout:253.out 2023-06-20T13:38:24.049 INFO:teuthology.orchestra.run.smithi032.stdout:254 2023-06-20T13:38:24.049 INFO:teuthology.orchestra.run.smithi032.stdout:254.out 2023-06-20T13:38:24.049 INFO:teuthology.orchestra.run.smithi032.stdout:255 2023-06-20T13:38:24.050 INFO:teuthology.orchestra.run.smithi032.stdout:255.out 2023-06-20T13:38:24.050 INFO:teuthology.orchestra.run.smithi032.stdout:256 2023-06-20T13:38:24.050 INFO:teuthology.orchestra.run.smithi032.stdout:256.out 2023-06-20T13:38:24.050 INFO:teuthology.orchestra.run.smithi032.stdout:257 2023-06-20T13:38:24.050 INFO:teuthology.orchestra.run.smithi032.stdout:257.out 2023-06-20T13:38:24.050 INFO:teuthology.orchestra.run.smithi032.stdout:258 2023-06-20T13:38:24.050 INFO:teuthology.orchestra.run.smithi032.stdout:258.out 2023-06-20T13:38:24.050 INFO:teuthology.orchestra.run.smithi032.stdout:259 2023-06-20T13:38:24.051 INFO:teuthology.orchestra.run.smithi032.stdout:259.out 2023-06-20T13:38:24.051 INFO:teuthology.orchestra.run.smithi032.stdout:260 2023-06-20T13:38:24.051 INFO:teuthology.orchestra.run.smithi032.stdout:260.out 2023-06-20T13:38:24.051 INFO:teuthology.orchestra.run.smithi032.stdout:261 2023-06-20T13:38:24.051 INFO:teuthology.orchestra.run.smithi032.stdout:261.out 2023-06-20T13:38:24.051 INFO:teuthology.orchestra.run.smithi032.stdout:262 2023-06-20T13:38:24.051 INFO:teuthology.orchestra.run.smithi032.stdout:262.out 2023-06-20T13:38:24.051 INFO:teuthology.orchestra.run.smithi032.stdout:263 2023-06-20T13:38:24.052 INFO:teuthology.orchestra.run.smithi032.stdout:263.out 2023-06-20T13:38:24.052 INFO:teuthology.orchestra.run.smithi032.stdout:264 2023-06-20T13:38:24.052 INFO:teuthology.orchestra.run.smithi032.stdout:264.out 2023-06-20T13:38:24.052 INFO:teuthology.orchestra.run.smithi032.stdout:265 2023-06-20T13:38:24.052 INFO:teuthology.orchestra.run.smithi032.stdout:265.out 2023-06-20T13:38:24.052 INFO:teuthology.orchestra.run.smithi032.stdout:266 2023-06-20T13:38:24.052 INFO:teuthology.orchestra.run.smithi032.stdout:266.out 2023-06-20T13:38:24.052 INFO:teuthology.orchestra.run.smithi032.stdout:267 2023-06-20T13:38:24.053 INFO:teuthology.orchestra.run.smithi032.stdout:267.out 2023-06-20T13:38:24.053 INFO:teuthology.orchestra.run.smithi032.stdout:268 2023-06-20T13:38:24.053 INFO:teuthology.orchestra.run.smithi032.stdout:268.out 2023-06-20T13:38:24.053 INFO:teuthology.orchestra.run.smithi032.stdout:269 2023-06-20T13:38:24.053 INFO:teuthology.orchestra.run.smithi032.stdout:269.out 2023-06-20T13:38:24.053 INFO:teuthology.orchestra.run.smithi032.stdout:270 2023-06-20T13:38:24.053 INFO:teuthology.orchestra.run.smithi032.stdout:270.out 2023-06-20T13:38:24.053 INFO:teuthology.orchestra.run.smithi032.stdout:271 2023-06-20T13:38:24.054 INFO:teuthology.orchestra.run.smithi032.stdout:271.out 2023-06-20T13:38:24.054 INFO:teuthology.orchestra.run.smithi032.stdout:272 2023-06-20T13:38:24.054 INFO:teuthology.orchestra.run.smithi032.stdout:272.out 2023-06-20T13:38:24.054 INFO:teuthology.orchestra.run.smithi032.stdout:273 2023-06-20T13:38:24.054 INFO:teuthology.orchestra.run.smithi032.stdout:273.out 2023-06-20T13:38:24.054 INFO:teuthology.orchestra.run.smithi032.stdout:274 2023-06-20T13:38:24.054 INFO:teuthology.orchestra.run.smithi032.stdout:274.out 2023-06-20T13:38:24.054 INFO:teuthology.orchestra.run.smithi032.stdout:275 2023-06-20T13:38:24.055 INFO:teuthology.orchestra.run.smithi032.stdout:275.out 2023-06-20T13:38:24.055 INFO:teuthology.orchestra.run.smithi032.stdout:276 2023-06-20T13:38:24.055 INFO:teuthology.orchestra.run.smithi032.stdout:276.out 2023-06-20T13:38:24.055 INFO:teuthology.orchestra.run.smithi032.stdout:277 2023-06-20T13:38:24.055 INFO:teuthology.orchestra.run.smithi032.stdout:277.out 2023-06-20T13:38:24.055 INFO:teuthology.orchestra.run.smithi032.stdout:278 2023-06-20T13:38:24.055 INFO:teuthology.orchestra.run.smithi032.stdout:278.out 2023-06-20T13:38:24.055 INFO:teuthology.orchestra.run.smithi032.stdout:279 2023-06-20T13:38:24.056 INFO:teuthology.orchestra.run.smithi032.stdout:279.out 2023-06-20T13:38:24.056 INFO:teuthology.orchestra.run.smithi032.stdout:280 2023-06-20T13:38:24.056 INFO:teuthology.orchestra.run.smithi032.stdout:280.out 2023-06-20T13:38:24.056 INFO:teuthology.orchestra.run.smithi032.stdout:281 2023-06-20T13:38:24.056 INFO:teuthology.orchestra.run.smithi032.stdout:281.out 2023-06-20T13:38:24.056 INFO:teuthology.orchestra.run.smithi032.stdout:282 2023-06-20T13:38:24.056 INFO:teuthology.orchestra.run.smithi032.stdout:282.out 2023-06-20T13:38:24.056 INFO:teuthology.orchestra.run.smithi032.stdout:283 2023-06-20T13:38:24.057 INFO:teuthology.orchestra.run.smithi032.stdout:283.out 2023-06-20T13:38:24.057 INFO:teuthology.orchestra.run.smithi032.stdout:284 2023-06-20T13:38:24.057 INFO:teuthology.orchestra.run.smithi032.stdout:284.out 2023-06-20T13:38:24.057 INFO:teuthology.orchestra.run.smithi032.stdout:285 2023-06-20T13:38:24.057 INFO:teuthology.orchestra.run.smithi032.stdout:285.out 2023-06-20T13:38:24.057 INFO:teuthology.orchestra.run.smithi032.stdout:286 2023-06-20T13:38:24.057 INFO:teuthology.orchestra.run.smithi032.stdout:286.out 2023-06-20T13:38:24.057 INFO:teuthology.orchestra.run.smithi032.stdout:287 2023-06-20T13:38:24.058 INFO:teuthology.orchestra.run.smithi032.stdout:287.out 2023-06-20T13:38:24.058 INFO:teuthology.orchestra.run.smithi032.stdout:288 2023-06-20T13:38:24.058 INFO:teuthology.orchestra.run.smithi032.stdout:288.out 2023-06-20T13:38:24.058 INFO:teuthology.orchestra.run.smithi032.stdout:289 2023-06-20T13:38:24.058 INFO:teuthology.orchestra.run.smithi032.stdout:289.out 2023-06-20T13:38:24.058 INFO:teuthology.orchestra.run.smithi032.stdout:290 2023-06-20T13:38:24.058 INFO:teuthology.orchestra.run.smithi032.stdout:290.out 2023-06-20T13:38:24.058 INFO:teuthology.orchestra.run.smithi032.stdout:291 2023-06-20T13:38:24.059 INFO:teuthology.orchestra.run.smithi032.stdout:291.out 2023-06-20T13:38:24.059 INFO:teuthology.orchestra.run.smithi032.stdout:292 2023-06-20T13:38:24.059 INFO:teuthology.orchestra.run.smithi032.stdout:292.out 2023-06-20T13:38:24.059 INFO:teuthology.orchestra.run.smithi032.stdout:293 2023-06-20T13:38:24.059 INFO:teuthology.orchestra.run.smithi032.stdout:293.out 2023-06-20T13:38:24.059 INFO:teuthology.orchestra.run.smithi032.stdout:294 2023-06-20T13:38:24.059 INFO:teuthology.orchestra.run.smithi032.stdout:294.out 2023-06-20T13:38:24.059 INFO:teuthology.orchestra.run.smithi032.stdout:295 2023-06-20T13:38:24.060 INFO:teuthology.orchestra.run.smithi032.stdout:295.out 2023-06-20T13:38:24.060 INFO:teuthology.orchestra.run.smithi032.stdout:296 2023-06-20T13:38:24.060 INFO:teuthology.orchestra.run.smithi032.stdout:296.out 2023-06-20T13:38:24.060 INFO:teuthology.orchestra.run.smithi032.stdout:297 2023-06-20T13:38:24.060 INFO:teuthology.orchestra.run.smithi032.stdout:297.out 2023-06-20T13:38:24.060 INFO:teuthology.orchestra.run.smithi032.stdout:298 2023-06-20T13:38:24.060 INFO:teuthology.orchestra.run.smithi032.stdout:298.out 2023-06-20T13:38:24.061 INFO:teuthology.orchestra.run.smithi032.stdout:299 2023-06-20T13:38:24.061 INFO:teuthology.orchestra.run.smithi032.stdout:299.out 2023-06-20T13:38:24.061 INFO:teuthology.orchestra.run.smithi032.stdout:300 2023-06-20T13:38:24.061 INFO:teuthology.orchestra.run.smithi032.stdout:300.out 2023-06-20T13:38:24.061 INFO:teuthology.orchestra.run.smithi032.stdout:301 2023-06-20T13:38:24.061 INFO:teuthology.orchestra.run.smithi032.stdout:301.out 2023-06-20T13:38:24.061 INFO:teuthology.orchestra.run.smithi032.stdout:302 2023-06-20T13:38:24.061 INFO:teuthology.orchestra.run.smithi032.stdout:302.out 2023-06-20T13:38:24.062 INFO:teuthology.orchestra.run.smithi032.stdout:303 2023-06-20T13:38:24.062 INFO:teuthology.orchestra.run.smithi032.stdout:303.out 2023-06-20T13:38:24.062 INFO:teuthology.orchestra.run.smithi032.stdout:304 2023-06-20T13:38:24.062 INFO:teuthology.orchestra.run.smithi032.stdout:304.out 2023-06-20T13:38:24.062 INFO:teuthology.orchestra.run.smithi032.stdout:305 2023-06-20T13:38:24.062 INFO:teuthology.orchestra.run.smithi032.stdout:305.out 2023-06-20T13:38:24.062 INFO:teuthology.orchestra.run.smithi032.stdout:306 2023-06-20T13:38:24.062 INFO:teuthology.orchestra.run.smithi032.stdout:306.out 2023-06-20T13:38:24.063 INFO:teuthology.orchestra.run.smithi032.stdout:307 2023-06-20T13:38:24.063 INFO:teuthology.orchestra.run.smithi032.stdout:307.out 2023-06-20T13:38:24.063 INFO:teuthology.orchestra.run.smithi032.stdout:308 2023-06-20T13:38:24.063 INFO:teuthology.orchestra.run.smithi032.stdout:308.out 2023-06-20T13:38:24.063 INFO:teuthology.orchestra.run.smithi032.stdout:309 2023-06-20T13:38:24.063 INFO:teuthology.orchestra.run.smithi032.stdout:309.out 2023-06-20T13:38:24.063 INFO:teuthology.orchestra.run.smithi032.stdout:310 2023-06-20T13:38:24.063 INFO:teuthology.orchestra.run.smithi032.stdout:310.out 2023-06-20T13:38:24.064 INFO:teuthology.orchestra.run.smithi032.stdout:311 2023-06-20T13:38:24.064 INFO:teuthology.orchestra.run.smithi032.stdout:311.out 2023-06-20T13:38:24.064 INFO:teuthology.orchestra.run.smithi032.stdout:312 2023-06-20T13:38:24.064 INFO:teuthology.orchestra.run.smithi032.stdout:312.out 2023-06-20T13:38:24.064 INFO:teuthology.orchestra.run.smithi032.stdout:313 2023-06-20T13:38:24.064 INFO:teuthology.orchestra.run.smithi032.stdout:313.out 2023-06-20T13:38:24.064 INFO:teuthology.orchestra.run.smithi032.stdout:314 2023-06-20T13:38:24.064 INFO:teuthology.orchestra.run.smithi032.stdout:314.out 2023-06-20T13:38:24.065 INFO:teuthology.orchestra.run.smithi032.stdout:315 2023-06-20T13:38:24.065 INFO:teuthology.orchestra.run.smithi032.stdout:315.out 2023-06-20T13:38:24.065 INFO:teuthology.orchestra.run.smithi032.stdout:316 2023-06-20T13:38:24.065 INFO:teuthology.orchestra.run.smithi032.stdout:316.out 2023-06-20T13:38:24.065 INFO:teuthology.orchestra.run.smithi032.stdout:317 2023-06-20T13:38:24.065 INFO:teuthology.orchestra.run.smithi032.stdout:317.out 2023-06-20T13:38:24.065 INFO:teuthology.orchestra.run.smithi032.stdout:318 2023-06-20T13:38:24.066 INFO:teuthology.orchestra.run.smithi032.stdout:318.out 2023-06-20T13:38:24.066 INFO:teuthology.orchestra.run.smithi032.stdout:319 2023-06-20T13:38:24.066 INFO:teuthology.orchestra.run.smithi032.stdout:319.out 2023-06-20T13:38:24.066 INFO:teuthology.orchestra.run.smithi032.stdout:320 2023-06-20T13:38:24.066 INFO:teuthology.orchestra.run.smithi032.stdout:320.out 2023-06-20T13:38:24.066 INFO:teuthology.orchestra.run.smithi032.stdout:321 2023-06-20T13:38:24.066 INFO:teuthology.orchestra.run.smithi032.stdout:321.out 2023-06-20T13:38:24.066 INFO:teuthology.orchestra.run.smithi032.stdout:322 2023-06-20T13:38:24.067 INFO:teuthology.orchestra.run.smithi032.stdout:322.out 2023-06-20T13:38:24.067 INFO:teuthology.orchestra.run.smithi032.stdout:323 2023-06-20T13:38:24.067 INFO:teuthology.orchestra.run.smithi032.stdout:323.out 2023-06-20T13:38:24.067 INFO:teuthology.orchestra.run.smithi032.stdout:324 2023-06-20T13:38:24.067 INFO:teuthology.orchestra.run.smithi032.stdout:324.out 2023-06-20T13:38:24.067 INFO:teuthology.orchestra.run.smithi032.stdout:325 2023-06-20T13:38:24.067 INFO:teuthology.orchestra.run.smithi032.stdout:325.out 2023-06-20T13:38:24.067 INFO:teuthology.orchestra.run.smithi032.stdout:326 2023-06-20T13:38:24.068 INFO:teuthology.orchestra.run.smithi032.stdout:326.out 2023-06-20T13:38:24.068 INFO:teuthology.orchestra.run.smithi032.stdout:327 2023-06-20T13:38:24.068 INFO:teuthology.orchestra.run.smithi032.stdout:327.out 2023-06-20T13:38:24.068 INFO:teuthology.orchestra.run.smithi032.stdout:328 2023-06-20T13:38:24.068 INFO:teuthology.orchestra.run.smithi032.stdout:328.out 2023-06-20T13:38:24.068 INFO:teuthology.orchestra.run.smithi032.stdout:329 2023-06-20T13:38:24.068 INFO:teuthology.orchestra.run.smithi032.stdout:329.out 2023-06-20T13:38:24.068 INFO:teuthology.orchestra.run.smithi032.stdout:330 2023-06-20T13:38:24.069 INFO:teuthology.orchestra.run.smithi032.stdout:330.out 2023-06-20T13:38:24.069 INFO:teuthology.orchestra.run.smithi032.stdout:331 2023-06-20T13:38:24.069 INFO:teuthology.orchestra.run.smithi032.stdout:331.out 2023-06-20T13:38:24.069 INFO:teuthology.orchestra.run.smithi032.stdout:332 2023-06-20T13:38:24.069 INFO:teuthology.orchestra.run.smithi032.stdout:332.out 2023-06-20T13:38:24.069 INFO:teuthology.orchestra.run.smithi032.stdout:333 2023-06-20T13:38:24.069 INFO:teuthology.orchestra.run.smithi032.stdout:333.out 2023-06-20T13:38:24.069 INFO:teuthology.orchestra.run.smithi032.stdout:334 2023-06-20T13:38:24.070 INFO:teuthology.orchestra.run.smithi032.stdout:334.out 2023-06-20T13:38:24.070 INFO:teuthology.orchestra.run.smithi032.stdout:335 2023-06-20T13:38:24.070 INFO:teuthology.orchestra.run.smithi032.stdout:335.out 2023-06-20T13:38:24.070 INFO:teuthology.orchestra.run.smithi032.stdout:336 2023-06-20T13:38:24.070 INFO:teuthology.orchestra.run.smithi032.stdout:336.out 2023-06-20T13:38:24.070 INFO:teuthology.orchestra.run.smithi032.stdout:337 2023-06-20T13:38:24.070 INFO:teuthology.orchestra.run.smithi032.stdout:337.out 2023-06-20T13:38:24.070 INFO:teuthology.orchestra.run.smithi032.stdout:338 2023-06-20T13:38:24.071 INFO:teuthology.orchestra.run.smithi032.stdout:338.out 2023-06-20T13:38:24.071 INFO:teuthology.orchestra.run.smithi032.stdout:339 2023-06-20T13:38:24.071 INFO:teuthology.orchestra.run.smithi032.stdout:339.out 2023-06-20T13:38:24.071 INFO:teuthology.orchestra.run.smithi032.stdout:340 2023-06-20T13:38:24.071 INFO:teuthology.orchestra.run.smithi032.stdout:340.out 2023-06-20T13:38:24.071 INFO:teuthology.orchestra.run.smithi032.stdout:341 2023-06-20T13:38:24.071 INFO:teuthology.orchestra.run.smithi032.stdout:341.out 2023-06-20T13:38:24.071 INFO:teuthology.orchestra.run.smithi032.stdout:342 2023-06-20T13:38:24.072 INFO:teuthology.orchestra.run.smithi032.stdout:342.out 2023-06-20T13:38:24.072 INFO:teuthology.orchestra.run.smithi032.stdout:343 2023-06-20T13:38:24.072 INFO:teuthology.orchestra.run.smithi032.stdout:343.out 2023-06-20T13:38:24.072 INFO:teuthology.orchestra.run.smithi032.stdout:344 2023-06-20T13:38:24.072 INFO:teuthology.orchestra.run.smithi032.stdout:344.out 2023-06-20T13:38:24.072 INFO:teuthology.orchestra.run.smithi032.stdout:345 2023-06-20T13:38:24.072 INFO:teuthology.orchestra.run.smithi032.stdout:345.out 2023-06-20T13:38:24.072 INFO:teuthology.orchestra.run.smithi032.stdout:346 2023-06-20T13:38:24.073 INFO:teuthology.orchestra.run.smithi032.stdout:346.out 2023-06-20T13:38:24.073 INFO:teuthology.orchestra.run.smithi032.stdout:347 2023-06-20T13:38:24.073 INFO:teuthology.orchestra.run.smithi032.stdout:347.out 2023-06-20T13:38:24.073 INFO:teuthology.orchestra.run.smithi032.stdout:348 2023-06-20T13:38:24.073 INFO:teuthology.orchestra.run.smithi032.stdout:348.out 2023-06-20T13:38:24.073 INFO:teuthology.orchestra.run.smithi032.stdout:349 2023-06-20T13:38:24.073 INFO:teuthology.orchestra.run.smithi032.stdout:349.out 2023-06-20T13:38:24.073 INFO:teuthology.orchestra.run.smithi032.stdout:350 2023-06-20T13:38:24.074 INFO:teuthology.orchestra.run.smithi032.stdout:350.out 2023-06-20T13:38:24.074 INFO:teuthology.orchestra.run.smithi032.stdout:351 2023-06-20T13:38:24.074 INFO:teuthology.orchestra.run.smithi032.stdout:351.out 2023-06-20T13:38:24.074 INFO:teuthology.orchestra.run.smithi032.stdout:352 2023-06-20T13:38:24.074 INFO:teuthology.orchestra.run.smithi032.stdout:352.out 2023-06-20T13:38:24.074 INFO:teuthology.orchestra.run.smithi032.stdout:353 2023-06-20T13:38:24.074 INFO:teuthology.orchestra.run.smithi032.stdout:353.out 2023-06-20T13:38:24.074 INFO:teuthology.orchestra.run.smithi032.stdout:354 2023-06-20T13:38:24.075 INFO:teuthology.orchestra.run.smithi032.stdout:354.out 2023-06-20T13:38:24.075 INFO:teuthology.orchestra.run.smithi032.stdout:355 2023-06-20T13:38:24.075 INFO:teuthology.orchestra.run.smithi032.stdout:355.out 2023-06-20T13:38:24.075 INFO:teuthology.orchestra.run.smithi032.stdout:356 2023-06-20T13:38:24.075 INFO:teuthology.orchestra.run.smithi032.stdout:356.out 2023-06-20T13:38:24.075 INFO:teuthology.orchestra.run.smithi032.stdout:357 2023-06-20T13:38:24.075 INFO:teuthology.orchestra.run.smithi032.stdout:357.out 2023-06-20T13:38:24.076 INFO:teuthology.orchestra.run.smithi032.stdout:358 2023-06-20T13:38:24.076 INFO:teuthology.orchestra.run.smithi032.stdout:358.out 2023-06-20T13:38:24.076 INFO:teuthology.orchestra.run.smithi032.stdout:359 2023-06-20T13:38:24.076 INFO:teuthology.orchestra.run.smithi032.stdout:359.out 2023-06-20T13:38:24.076 INFO:teuthology.orchestra.run.smithi032.stdout:360 2023-06-20T13:38:24.076 INFO:teuthology.orchestra.run.smithi032.stdout:360.out 2023-06-20T13:38:24.076 INFO:teuthology.orchestra.run.smithi032.stdout:361 2023-06-20T13:38:24.076 INFO:teuthology.orchestra.run.smithi032.stdout:361.out 2023-06-20T13:38:24.077 INFO:teuthology.orchestra.run.smithi032.stdout:362 2023-06-20T13:38:24.077 INFO:teuthology.orchestra.run.smithi032.stdout:362.out 2023-06-20T13:38:24.077 INFO:teuthology.orchestra.run.smithi032.stdout:363 2023-06-20T13:38:24.077 INFO:teuthology.orchestra.run.smithi032.stdout:363.out 2023-06-20T13:38:24.077 INFO:teuthology.orchestra.run.smithi032.stdout:364 2023-06-20T13:38:24.077 INFO:teuthology.orchestra.run.smithi032.stdout:364.out 2023-06-20T13:38:24.077 INFO:teuthology.orchestra.run.smithi032.stdout:365 2023-06-20T13:38:24.077 INFO:teuthology.orchestra.run.smithi032.stdout:365.out 2023-06-20T13:38:24.078 INFO:teuthology.orchestra.run.smithi032.stdout:366 2023-06-20T13:38:24.078 INFO:teuthology.orchestra.run.smithi032.stdout:366.out 2023-06-20T13:38:24.078 INFO:teuthology.orchestra.run.smithi032.stdout:367 2023-06-20T13:38:24.078 INFO:teuthology.orchestra.run.smithi032.stdout:367.out 2023-06-20T13:38:24.078 INFO:teuthology.orchestra.run.smithi032.stdout:368 2023-06-20T13:38:24.078 INFO:teuthology.orchestra.run.smithi032.stdout:368.out 2023-06-20T13:38:24.078 INFO:teuthology.orchestra.run.smithi032.stdout:369 2023-06-20T13:38:24.078 INFO:teuthology.orchestra.run.smithi032.stdout:369.out 2023-06-20T13:38:24.079 INFO:teuthology.orchestra.run.smithi032.stdout:370 2023-06-20T13:38:24.079 INFO:teuthology.orchestra.run.smithi032.stdout:370.out 2023-06-20T13:38:24.079 INFO:teuthology.orchestra.run.smithi032.stdout:371 2023-06-20T13:38:24.079 INFO:teuthology.orchestra.run.smithi032.stdout:371.out 2023-06-20T13:38:24.079 INFO:teuthology.orchestra.run.smithi032.stdout:372 2023-06-20T13:38:24.079 INFO:teuthology.orchestra.run.smithi032.stdout:372.out 2023-06-20T13:38:24.079 INFO:teuthology.orchestra.run.smithi032.stdout:373 2023-06-20T13:38:24.079 INFO:teuthology.orchestra.run.smithi032.stdout:373.out 2023-06-20T13:38:24.080 INFO:teuthology.orchestra.run.smithi032.stdout:374 2023-06-20T13:38:24.080 INFO:teuthology.orchestra.run.smithi032.stdout:374.out 2023-06-20T13:38:24.080 INFO:teuthology.orchestra.run.smithi032.stdout:375 2023-06-20T13:38:24.080 INFO:teuthology.orchestra.run.smithi032.stdout:375.out 2023-06-20T13:38:24.080 INFO:teuthology.orchestra.run.smithi032.stdout:376 2023-06-20T13:38:24.080 INFO:teuthology.orchestra.run.smithi032.stdout:376.out 2023-06-20T13:38:24.080 INFO:teuthology.orchestra.run.smithi032.stdout:377 2023-06-20T13:38:24.080 INFO:teuthology.orchestra.run.smithi032.stdout:377.out 2023-06-20T13:38:24.081 INFO:teuthology.orchestra.run.smithi032.stdout:378 2023-06-20T13:38:24.081 INFO:teuthology.orchestra.run.smithi032.stdout:378.out 2023-06-20T13:38:24.081 INFO:teuthology.orchestra.run.smithi032.stdout:379 2023-06-20T13:38:24.081 INFO:teuthology.orchestra.run.smithi032.stdout:379.out 2023-06-20T13:38:24.081 INFO:teuthology.orchestra.run.smithi032.stdout:380 2023-06-20T13:38:24.081 INFO:teuthology.orchestra.run.smithi032.stdout:380.out 2023-06-20T13:38:24.081 INFO:teuthology.orchestra.run.smithi032.stdout:381 2023-06-20T13:38:24.081 INFO:teuthology.orchestra.run.smithi032.stdout:381.out 2023-06-20T13:38:24.082 INFO:teuthology.orchestra.run.smithi032.stdout:382 2023-06-20T13:38:24.082 INFO:teuthology.orchestra.run.smithi032.stdout:382.out 2023-06-20T13:38:24.082 INFO:teuthology.orchestra.run.smithi032.stdout:383 2023-06-20T13:38:24.082 INFO:teuthology.orchestra.run.smithi032.stdout:383.out 2023-06-20T13:38:24.082 INFO:teuthology.orchestra.run.smithi032.stdout:384 2023-06-20T13:38:24.082 INFO:teuthology.orchestra.run.smithi032.stdout:384.out 2023-06-20T13:38:24.082 INFO:teuthology.orchestra.run.smithi032.stdout:385 2023-06-20T13:38:24.082 INFO:teuthology.orchestra.run.smithi032.stdout:385.out 2023-06-20T13:38:24.083 INFO:teuthology.orchestra.run.smithi032.stdout:386 2023-06-20T13:38:24.083 INFO:teuthology.orchestra.run.smithi032.stdout:386.out 2023-06-20T13:38:24.083 INFO:teuthology.orchestra.run.smithi032.stdout:387 2023-06-20T13:38:24.083 INFO:teuthology.orchestra.run.smithi032.stdout:387.out 2023-06-20T13:38:24.083 INFO:teuthology.orchestra.run.smithi032.stdout:388 2023-06-20T13:38:24.083 INFO:teuthology.orchestra.run.smithi032.stdout:388.out 2023-06-20T13:38:24.083 INFO:teuthology.orchestra.run.smithi032.stdout:389 2023-06-20T13:38:24.083 INFO:teuthology.orchestra.run.smithi032.stdout:389.out 2023-06-20T13:38:24.084 INFO:teuthology.orchestra.run.smithi032.stdout:390 2023-06-20T13:38:24.084 INFO:teuthology.orchestra.run.smithi032.stdout:390.out 2023-06-20T13:38:24.084 INFO:teuthology.orchestra.run.smithi032.stdout:391 2023-06-20T13:38:24.084 INFO:teuthology.orchestra.run.smithi032.stdout:391.out 2023-06-20T13:38:24.084 INFO:teuthology.orchestra.run.smithi032.stdout:392 2023-06-20T13:38:24.084 INFO:teuthology.orchestra.run.smithi032.stdout:392.out 2023-06-20T13:38:24.084 INFO:teuthology.orchestra.run.smithi032.stdout:393 2023-06-20T13:38:24.085 INFO:teuthology.orchestra.run.smithi032.stdout:393.out 2023-06-20T13:38:24.085 INFO:teuthology.orchestra.run.smithi032.stdout:394 2023-06-20T13:38:24.085 INFO:teuthology.orchestra.run.smithi032.stdout:394.out 2023-06-20T13:38:24.085 INFO:teuthology.orchestra.run.smithi032.stdout:395 2023-06-20T13:38:24.085 INFO:teuthology.orchestra.run.smithi032.stdout:395.out 2023-06-20T13:38:24.085 INFO:teuthology.orchestra.run.smithi032.stdout:396 2023-06-20T13:38:24.085 INFO:teuthology.orchestra.run.smithi032.stdout:396.out 2023-06-20T13:38:24.085 INFO:teuthology.orchestra.run.smithi032.stdout:397 2023-06-20T13:38:24.086 INFO:teuthology.orchestra.run.smithi032.stdout:397.out 2023-06-20T13:38:24.086 INFO:teuthology.orchestra.run.smithi032.stdout:398 2023-06-20T13:38:24.086 INFO:teuthology.orchestra.run.smithi032.stdout:398.out 2023-06-20T13:38:24.086 INFO:teuthology.orchestra.run.smithi032.stdout:399 2023-06-20T13:38:24.086 INFO:teuthology.orchestra.run.smithi032.stdout:399.out 2023-06-20T13:38:24.086 INFO:teuthology.orchestra.run.smithi032.stdout:400 2023-06-20T13:38:24.086 INFO:teuthology.orchestra.run.smithi032.stdout:400.out 2023-06-20T13:38:24.087 INFO:teuthology.orchestra.run.smithi032.stdout:401 2023-06-20T13:38:24.087 INFO:teuthology.orchestra.run.smithi032.stdout:401.out 2023-06-20T13:38:24.087 INFO:teuthology.orchestra.run.smithi032.stdout:402 2023-06-20T13:38:24.087 INFO:teuthology.orchestra.run.smithi032.stdout:402.out 2023-06-20T13:38:24.087 INFO:teuthology.orchestra.run.smithi032.stdout:403 2023-06-20T13:38:24.087 INFO:teuthology.orchestra.run.smithi032.stdout:403.out 2023-06-20T13:38:24.087 INFO:teuthology.orchestra.run.smithi032.stdout:404 2023-06-20T13:38:24.087 INFO:teuthology.orchestra.run.smithi032.stdout:404.out 2023-06-20T13:38:24.088 INFO:teuthology.orchestra.run.smithi032.stdout:405 2023-06-20T13:38:24.088 INFO:teuthology.orchestra.run.smithi032.stdout:405.out 2023-06-20T13:38:24.088 INFO:teuthology.orchestra.run.smithi032.stdout:406 2023-06-20T13:38:24.088 INFO:teuthology.orchestra.run.smithi032.stdout:406.out 2023-06-20T13:38:24.088 INFO:teuthology.orchestra.run.smithi032.stdout:407 2023-06-20T13:38:24.088 INFO:teuthology.orchestra.run.smithi032.stdout:407.out 2023-06-20T13:38:24.088 INFO:teuthology.orchestra.run.smithi032.stdout:408 2023-06-20T13:38:24.089 INFO:teuthology.orchestra.run.smithi032.stdout:408.out 2023-06-20T13:38:24.089 INFO:teuthology.orchestra.run.smithi032.stdout:409 2023-06-20T13:38:24.089 INFO:teuthology.orchestra.run.smithi032.stdout:409.out 2023-06-20T13:38:24.089 INFO:teuthology.orchestra.run.smithi032.stdout:410 2023-06-20T13:38:24.089 INFO:teuthology.orchestra.run.smithi032.stdout:410.out 2023-06-20T13:38:24.089 INFO:teuthology.orchestra.run.smithi032.stdout:411 2023-06-20T13:38:24.089 INFO:teuthology.orchestra.run.smithi032.stdout:411.out 2023-06-20T13:38:24.089 INFO:teuthology.orchestra.run.smithi032.stdout:412 2023-06-20T13:38:24.090 INFO:teuthology.orchestra.run.smithi032.stdout:412.out 2023-06-20T13:38:24.090 INFO:teuthology.orchestra.run.smithi032.stdout:413 2023-06-20T13:38:24.090 INFO:teuthology.orchestra.run.smithi032.stdout:413.out 2023-06-20T13:38:24.090 INFO:teuthology.orchestra.run.smithi032.stdout:414 2023-06-20T13:38:24.090 INFO:teuthology.orchestra.run.smithi032.stdout:414.out 2023-06-20T13:38:24.090 INFO:teuthology.orchestra.run.smithi032.stdout:415 2023-06-20T13:38:24.090 INFO:teuthology.orchestra.run.smithi032.stdout:415.out 2023-06-20T13:38:24.090 INFO:teuthology.orchestra.run.smithi032.stdout:416 2023-06-20T13:38:24.090 INFO:teuthology.orchestra.run.smithi032.stdout:416.out 2023-06-20T13:38:24.091 INFO:teuthology.orchestra.run.smithi032.stdout:417 2023-06-20T13:38:24.091 INFO:teuthology.orchestra.run.smithi032.stdout:417.out 2023-06-20T13:38:24.091 INFO:teuthology.orchestra.run.smithi032.stdout:418 2023-06-20T13:38:24.091 INFO:teuthology.orchestra.run.smithi032.stdout:418.out 2023-06-20T13:38:24.091 INFO:teuthology.orchestra.run.smithi032.stdout:419 2023-06-20T13:38:24.091 INFO:teuthology.orchestra.run.smithi032.stdout:419.out 2023-06-20T13:38:24.092 INFO:teuthology.orchestra.run.smithi032.stdout:420 2023-06-20T13:38:24.092 INFO:teuthology.orchestra.run.smithi032.stdout:420.out 2023-06-20T13:38:24.092 INFO:teuthology.orchestra.run.smithi032.stdout:421 2023-06-20T13:38:24.092 INFO:teuthology.orchestra.run.smithi032.stdout:421.out 2023-06-20T13:38:24.092 INFO:teuthology.orchestra.run.smithi032.stdout:422 2023-06-20T13:38:24.092 INFO:teuthology.orchestra.run.smithi032.stdout:422.out 2023-06-20T13:38:24.092 INFO:teuthology.orchestra.run.smithi032.stdout:423 2023-06-20T13:38:24.092 INFO:teuthology.orchestra.run.smithi032.stdout:423.out 2023-06-20T13:38:24.093 INFO:teuthology.orchestra.run.smithi032.stdout:424 2023-06-20T13:38:24.093 INFO:teuthology.orchestra.run.smithi032.stdout:424.out 2023-06-20T13:38:24.093 INFO:teuthology.orchestra.run.smithi032.stdout:425 2023-06-20T13:38:24.093 INFO:teuthology.orchestra.run.smithi032.stdout:425.out 2023-06-20T13:38:24.093 INFO:teuthology.orchestra.run.smithi032.stdout:426 2023-06-20T13:38:24.093 INFO:teuthology.orchestra.run.smithi032.stdout:426.out 2023-06-20T13:38:24.093 INFO:teuthology.orchestra.run.smithi032.stdout:427 2023-06-20T13:38:24.093 INFO:teuthology.orchestra.run.smithi032.stdout:427.out 2023-06-20T13:38:24.094 INFO:teuthology.orchestra.run.smithi032.stdout:428 2023-06-20T13:38:24.094 INFO:teuthology.orchestra.run.smithi032.stdout:428.out 2023-06-20T13:38:24.094 INFO:teuthology.orchestra.run.smithi032.stdout:429 2023-06-20T13:38:24.094 INFO:teuthology.orchestra.run.smithi032.stdout:429.out 2023-06-20T13:38:24.094 INFO:teuthology.orchestra.run.smithi032.stdout:430 2023-06-20T13:38:24.094 INFO:teuthology.orchestra.run.smithi032.stdout:430.out 2023-06-20T13:38:24.094 INFO:teuthology.orchestra.run.smithi032.stdout:431 2023-06-20T13:38:24.094 INFO:teuthology.orchestra.run.smithi032.stdout:431.out 2023-06-20T13:38:24.095 INFO:teuthology.orchestra.run.smithi032.stdout:432 2023-06-20T13:38:24.095 INFO:teuthology.orchestra.run.smithi032.stdout:432.out 2023-06-20T13:38:24.095 INFO:teuthology.orchestra.run.smithi032.stdout:433 2023-06-20T13:38:24.095 INFO:teuthology.orchestra.run.smithi032.stdout:433.out 2023-06-20T13:38:24.095 INFO:teuthology.orchestra.run.smithi032.stdout:434 2023-06-20T13:38:24.095 INFO:teuthology.orchestra.run.smithi032.stdout:434.out 2023-06-20T13:38:24.095 INFO:teuthology.orchestra.run.smithi032.stdout:435 2023-06-20T13:38:24.095 INFO:teuthology.orchestra.run.smithi032.stdout:435.out 2023-06-20T13:38:24.096 INFO:teuthology.orchestra.run.smithi032.stdout:436 2023-06-20T13:38:24.096 INFO:teuthology.orchestra.run.smithi032.stdout:436.out 2023-06-20T13:38:24.096 INFO:teuthology.orchestra.run.smithi032.stdout:437 2023-06-20T13:38:24.096 INFO:teuthology.orchestra.run.smithi032.stdout:437.out 2023-06-20T13:38:24.096 INFO:teuthology.orchestra.run.smithi032.stdout:438 2023-06-20T13:38:24.096 INFO:teuthology.orchestra.run.smithi032.stdout:438.out 2023-06-20T13:38:24.096 INFO:teuthology.orchestra.run.smithi032.stdout:439 2023-06-20T13:38:24.096 INFO:teuthology.orchestra.run.smithi032.stdout:439.out 2023-06-20T13:38:24.097 INFO:teuthology.orchestra.run.smithi032.stdout:440 2023-06-20T13:38:24.097 INFO:teuthology.orchestra.run.smithi032.stdout:440.out 2023-06-20T13:38:24.097 INFO:teuthology.orchestra.run.smithi032.stdout:441 2023-06-20T13:38:24.097 INFO:teuthology.orchestra.run.smithi032.stdout:441.out 2023-06-20T13:38:24.097 INFO:teuthology.orchestra.run.smithi032.stdout:442 2023-06-20T13:38:24.097 INFO:teuthology.orchestra.run.smithi032.stdout:442.out 2023-06-20T13:38:24.097 INFO:teuthology.orchestra.run.smithi032.stdout:443 2023-06-20T13:38:24.097 INFO:teuthology.orchestra.run.smithi032.stdout:443.out 2023-06-20T13:38:24.098 INFO:teuthology.orchestra.run.smithi032.stdout:444 2023-06-20T13:38:24.098 INFO:teuthology.orchestra.run.smithi032.stdout:444.out 2023-06-20T13:38:24.098 INFO:teuthology.orchestra.run.smithi032.stdout:445 2023-06-20T13:38:24.098 INFO:teuthology.orchestra.run.smithi032.stdout:445.out 2023-06-20T13:38:24.098 INFO:teuthology.orchestra.run.smithi032.stdout:446 2023-06-20T13:38:24.098 INFO:teuthology.orchestra.run.smithi032.stdout:446.out 2023-06-20T13:38:24.098 INFO:teuthology.orchestra.run.smithi032.stdout:447 2023-06-20T13:38:24.098 INFO:teuthology.orchestra.run.smithi032.stdout:447.out 2023-06-20T13:38:24.099 INFO:teuthology.orchestra.run.smithi032.stdout:448 2023-06-20T13:38:24.099 INFO:teuthology.orchestra.run.smithi032.stdout:448.out 2023-06-20T13:38:24.099 INFO:teuthology.orchestra.run.smithi032.stdout:449 2023-06-20T13:38:24.099 INFO:teuthology.orchestra.run.smithi032.stdout:449.out 2023-06-20T13:38:24.099 INFO:teuthology.orchestra.run.smithi032.stdout:450 2023-06-20T13:38:24.099 INFO:teuthology.orchestra.run.smithi032.stdout:450.out 2023-06-20T13:38:24.099 INFO:teuthology.orchestra.run.smithi032.stdout:451 2023-06-20T13:38:24.099 INFO:teuthology.orchestra.run.smithi032.stdout:451.out 2023-06-20T13:38:24.100 INFO:teuthology.orchestra.run.smithi032.stdout:452 2023-06-20T13:38:24.100 INFO:teuthology.orchestra.run.smithi032.stdout:452.out 2023-06-20T13:38:24.100 INFO:teuthology.orchestra.run.smithi032.stdout:453 2023-06-20T13:38:24.100 INFO:teuthology.orchestra.run.smithi032.stdout:453.out 2023-06-20T13:38:24.100 INFO:teuthology.orchestra.run.smithi032.stdout:454 2023-06-20T13:38:24.100 INFO:teuthology.orchestra.run.smithi032.stdout:454.out 2023-06-20T13:38:24.100 INFO:teuthology.orchestra.run.smithi032.stdout:455 2023-06-20T13:38:24.101 INFO:teuthology.orchestra.run.smithi032.stdout:455.out 2023-06-20T13:38:24.101 INFO:teuthology.orchestra.run.smithi032.stdout:456 2023-06-20T13:38:24.101 INFO:teuthology.orchestra.run.smithi032.stdout:456.out 2023-06-20T13:38:24.101 INFO:teuthology.orchestra.run.smithi032.stdout:457 2023-06-20T13:38:24.101 INFO:teuthology.orchestra.run.smithi032.stdout:457.out 2023-06-20T13:38:24.101 INFO:teuthology.orchestra.run.smithi032.stdout:458 2023-06-20T13:38:24.101 INFO:teuthology.orchestra.run.smithi032.stdout:458.out 2023-06-20T13:38:24.101 INFO:teuthology.orchestra.run.smithi032.stdout:459 2023-06-20T13:38:24.102 INFO:teuthology.orchestra.run.smithi032.stdout:459.out 2023-06-20T13:38:24.102 INFO:teuthology.orchestra.run.smithi032.stdout:460 2023-06-20T13:38:24.102 INFO:teuthology.orchestra.run.smithi032.stdout:460.out 2023-06-20T13:38:24.102 INFO:teuthology.orchestra.run.smithi032.stdout:461 2023-06-20T13:38:24.102 INFO:teuthology.orchestra.run.smithi032.stdout:461.out 2023-06-20T13:38:24.102 INFO:teuthology.orchestra.run.smithi032.stdout:462 2023-06-20T13:38:24.102 INFO:teuthology.orchestra.run.smithi032.stdout:462.out 2023-06-20T13:38:24.102 INFO:teuthology.orchestra.run.smithi032.stdout:463 2023-06-20T13:38:24.103 INFO:teuthology.orchestra.run.smithi032.stdout:463.out 2023-06-20T13:38:24.103 INFO:teuthology.orchestra.run.smithi032.stdout:464 2023-06-20T13:38:24.103 INFO:teuthology.orchestra.run.smithi032.stdout:464.out 2023-06-20T13:38:24.103 INFO:teuthology.orchestra.run.smithi032.stdout:465 2023-06-20T13:38:24.103 INFO:teuthology.orchestra.run.smithi032.stdout:465.out 2023-06-20T13:38:24.103 INFO:teuthology.orchestra.run.smithi032.stdout:466 2023-06-20T13:38:24.103 INFO:teuthology.orchestra.run.smithi032.stdout:466.out 2023-06-20T13:38:24.103 INFO:teuthology.orchestra.run.smithi032.stdout:467 2023-06-20T13:38:24.104 INFO:teuthology.orchestra.run.smithi032.stdout:467.out 2023-06-20T13:38:24.104 INFO:teuthology.orchestra.run.smithi032.stdout:468 2023-06-20T13:38:24.104 INFO:teuthology.orchestra.run.smithi032.stdout:468.out 2023-06-20T13:38:24.104 INFO:teuthology.orchestra.run.smithi032.stdout:469 2023-06-20T13:38:24.104 INFO:teuthology.orchestra.run.smithi032.stdout:469.out 2023-06-20T13:38:24.104 INFO:teuthology.orchestra.run.smithi032.stdout:470 2023-06-20T13:38:24.104 INFO:teuthology.orchestra.run.smithi032.stdout:470.out 2023-06-20T13:38:24.104 INFO:teuthology.orchestra.run.smithi032.stdout:471 2023-06-20T13:38:24.105 INFO:teuthology.orchestra.run.smithi032.stdout:471.out 2023-06-20T13:38:24.105 INFO:teuthology.orchestra.run.smithi032.stdout:472 2023-06-20T13:38:24.105 INFO:teuthology.orchestra.run.smithi032.stdout:472.out 2023-06-20T13:38:24.105 INFO:teuthology.orchestra.run.smithi032.stdout:473 2023-06-20T13:38:24.105 INFO:teuthology.orchestra.run.smithi032.stdout:473.out 2023-06-20T13:38:24.105 INFO:teuthology.orchestra.run.smithi032.stdout:474 2023-06-20T13:38:24.105 INFO:teuthology.orchestra.run.smithi032.stdout:474.out 2023-06-20T13:38:24.106 INFO:teuthology.orchestra.run.smithi032.stdout:475 2023-06-20T13:38:24.106 INFO:teuthology.orchestra.run.smithi032.stdout:475.out 2023-06-20T13:38:24.106 INFO:teuthology.orchestra.run.smithi032.stdout:476 2023-06-20T13:38:24.106 INFO:teuthology.orchestra.run.smithi032.stdout:476.out 2023-06-20T13:38:24.106 INFO:teuthology.orchestra.run.smithi032.stdout:477 2023-06-20T13:38:24.106 INFO:teuthology.orchestra.run.smithi032.stdout:477.out 2023-06-20T13:38:24.106 INFO:teuthology.orchestra.run.smithi032.stdout:478 2023-06-20T13:38:24.107 INFO:teuthology.orchestra.run.smithi032.stdout:478.out 2023-06-20T13:38:24.107 INFO:teuthology.orchestra.run.smithi032.stdout:479 2023-06-20T13:38:24.107 INFO:teuthology.orchestra.run.smithi032.stdout:479.out 2023-06-20T13:38:24.107 INFO:teuthology.orchestra.run.smithi032.stdout:480 2023-06-20T13:38:24.107 INFO:teuthology.orchestra.run.smithi032.stdout:480.out 2023-06-20T13:38:24.107 INFO:teuthology.orchestra.run.smithi032.stdout:481 2023-06-20T13:38:24.107 INFO:teuthology.orchestra.run.smithi032.stdout:481.out 2023-06-20T13:38:24.107 INFO:teuthology.orchestra.run.smithi032.stdout:482 2023-06-20T13:38:24.108 INFO:teuthology.orchestra.run.smithi032.stdout:482.out 2023-06-20T13:38:24.108 INFO:teuthology.orchestra.run.smithi032.stdout:483 2023-06-20T13:38:24.108 INFO:teuthology.orchestra.run.smithi032.stdout:483.out 2023-06-20T13:38:24.108 INFO:teuthology.orchestra.run.smithi032.stdout:484 2023-06-20T13:38:24.108 INFO:teuthology.orchestra.run.smithi032.stdout:484.out 2023-06-20T13:38:24.108 INFO:teuthology.orchestra.run.smithi032.stdout:485 2023-06-20T13:38:24.108 INFO:teuthology.orchestra.run.smithi032.stdout:485.out 2023-06-20T13:38:24.109 INFO:teuthology.orchestra.run.smithi032.stdout:486 2023-06-20T13:38:24.109 INFO:teuthology.orchestra.run.smithi032.stdout:486.out 2023-06-20T13:38:24.109 INFO:teuthology.orchestra.run.smithi032.stdout:487 2023-06-20T13:38:24.109 INFO:teuthology.orchestra.run.smithi032.stdout:487.out 2023-06-20T13:38:24.109 INFO:teuthology.orchestra.run.smithi032.stdout:488 2023-06-20T13:38:24.109 INFO:teuthology.orchestra.run.smithi032.stdout:488.out 2023-06-20T13:38:24.109 INFO:teuthology.orchestra.run.smithi032.stdout:489 2023-06-20T13:38:24.110 INFO:teuthology.orchestra.run.smithi032.stdout:489.out 2023-06-20T13:38:24.110 INFO:teuthology.orchestra.run.smithi032.stdout:490 2023-06-20T13:38:24.110 INFO:teuthology.orchestra.run.smithi032.stdout:490.out 2023-06-20T13:38:24.110 INFO:teuthology.orchestra.run.smithi032.stdout:491 2023-06-20T13:38:24.110 INFO:teuthology.orchestra.run.smithi032.stdout:491.out 2023-06-20T13:38:24.110 INFO:teuthology.orchestra.run.smithi032.stdout:492 2023-06-20T13:38:24.110 INFO:teuthology.orchestra.run.smithi032.stdout:492.out 2023-06-20T13:38:24.110 INFO:teuthology.orchestra.run.smithi032.stdout:493 2023-06-20T13:38:24.111 INFO:teuthology.orchestra.run.smithi032.stdout:493.out 2023-06-20T13:38:24.111 INFO:teuthology.orchestra.run.smithi032.stdout:494 2023-06-20T13:38:24.111 INFO:teuthology.orchestra.run.smithi032.stdout:494.out 2023-06-20T13:38:24.111 INFO:teuthology.orchestra.run.smithi032.stdout:495 2023-06-20T13:38:24.111 INFO:teuthology.orchestra.run.smithi032.stdout:495.out 2023-06-20T13:38:24.111 INFO:teuthology.orchestra.run.smithi032.stdout:496 2023-06-20T13:38:24.111 INFO:teuthology.orchestra.run.smithi032.stdout:496.out 2023-06-20T13:38:24.111 INFO:teuthology.orchestra.run.smithi032.stdout:497 2023-06-20T13:38:24.112 INFO:teuthology.orchestra.run.smithi032.stdout:497.out 2023-06-20T13:38:24.112 INFO:teuthology.orchestra.run.smithi032.stdout:498 2023-06-20T13:38:24.112 INFO:teuthology.orchestra.run.smithi032.stdout:498.out 2023-06-20T13:38:24.112 INFO:teuthology.orchestra.run.smithi032.stdout:499 2023-06-20T13:38:24.112 INFO:teuthology.orchestra.run.smithi032.stdout:499.out 2023-06-20T13:38:24.112 INFO:teuthology.orchestra.run.smithi032.stdout:500 2023-06-20T13:38:24.112 INFO:teuthology.orchestra.run.smithi032.stdout:500.out 2023-06-20T13:38:24.112 INFO:teuthology.orchestra.run.smithi032.stdout:501 2023-06-20T13:38:24.113 INFO:teuthology.orchestra.run.smithi032.stdout:501.out 2023-06-20T13:38:24.113 INFO:teuthology.orchestra.run.smithi032.stdout:502 2023-06-20T13:38:24.113 INFO:teuthology.orchestra.run.smithi032.stdout:502.out 2023-06-20T13:38:24.113 INFO:teuthology.orchestra.run.smithi032.stdout:503 2023-06-20T13:38:24.113 INFO:teuthology.orchestra.run.smithi032.stdout:503.out 2023-06-20T13:38:24.113 INFO:teuthology.orchestra.run.smithi032.stdout:504 2023-06-20T13:38:24.113 INFO:teuthology.orchestra.run.smithi032.stdout:504.out 2023-06-20T13:38:24.113 INFO:teuthology.orchestra.run.smithi032.stdout:505 2023-06-20T13:38:24.114 INFO:teuthology.orchestra.run.smithi032.stdout:505.out 2023-06-20T13:38:24.114 INFO:teuthology.orchestra.run.smithi032.stdout:506 2023-06-20T13:38:24.114 INFO:teuthology.orchestra.run.smithi032.stdout:506.out 2023-06-20T13:38:24.114 INFO:teuthology.orchestra.run.smithi032.stdout:507 2023-06-20T13:38:24.114 INFO:teuthology.orchestra.run.smithi032.stdout:507.out 2023-06-20T13:38:24.114 INFO:teuthology.orchestra.run.smithi032.stdout:508 2023-06-20T13:38:24.114 INFO:teuthology.orchestra.run.smithi032.stdout:508.out 2023-06-20T13:38:24.114 INFO:teuthology.orchestra.run.smithi032.stdout:509 2023-06-20T13:38:24.115 INFO:teuthology.orchestra.run.smithi032.stdout:509.out 2023-06-20T13:38:24.115 INFO:teuthology.orchestra.run.smithi032.stdout:510 2023-06-20T13:38:24.115 INFO:teuthology.orchestra.run.smithi032.stdout:510.out 2023-06-20T13:38:24.115 INFO:teuthology.orchestra.run.smithi032.stdout:511 2023-06-20T13:38:24.115 INFO:teuthology.orchestra.run.smithi032.stdout:511.out 2023-06-20T13:38:24.115 INFO:teuthology.orchestra.run.smithi032.stdout:512 2023-06-20T13:38:24.115 INFO:teuthology.orchestra.run.smithi032.stdout:512.out 2023-06-20T13:38:24.115 INFO:teuthology.orchestra.run.smithi032.stdout:513 2023-06-20T13:38:24.116 INFO:teuthology.orchestra.run.smithi032.stdout:513.out 2023-06-20T13:38:24.116 INFO:teuthology.orchestra.run.smithi032.stdout:514 2023-06-20T13:38:24.116 INFO:teuthology.orchestra.run.smithi032.stdout:514.out 2023-06-20T13:38:24.116 INFO:teuthology.orchestra.run.smithi032.stdout:515 2023-06-20T13:38:24.116 INFO:teuthology.orchestra.run.smithi032.stdout:515.out 2023-06-20T13:38:24.116 INFO:teuthology.orchestra.run.smithi032.stdout:516 2023-06-20T13:38:24.116 INFO:teuthology.orchestra.run.smithi032.stdout:516.out 2023-06-20T13:38:24.116 INFO:teuthology.orchestra.run.smithi032.stdout:517 2023-06-20T13:38:24.117 INFO:teuthology.orchestra.run.smithi032.stdout:517.out 2023-06-20T13:38:24.117 INFO:teuthology.orchestra.run.smithi032.stdout:518 2023-06-20T13:38:24.117 INFO:teuthology.orchestra.run.smithi032.stdout:518.out 2023-06-20T13:38:24.117 INFO:teuthology.orchestra.run.smithi032.stdout:519 2023-06-20T13:38:24.117 INFO:teuthology.orchestra.run.smithi032.stdout:519.out 2023-06-20T13:38:24.117 INFO:teuthology.orchestra.run.smithi032.stdout:520 2023-06-20T13:38:24.117 INFO:teuthology.orchestra.run.smithi032.stdout:520.out 2023-06-20T13:38:24.118 INFO:teuthology.orchestra.run.smithi032.stdout:521 2023-06-20T13:38:24.118 INFO:teuthology.orchestra.run.smithi032.stdout:521.out 2023-06-20T13:38:24.118 INFO:teuthology.orchestra.run.smithi032.stdout:522 2023-06-20T13:38:24.118 INFO:teuthology.orchestra.run.smithi032.stdout:522.out 2023-06-20T13:38:24.118 INFO:teuthology.orchestra.run.smithi032.stdout:523 2023-06-20T13:38:24.118 INFO:teuthology.orchestra.run.smithi032.stdout:523.out 2023-06-20T13:38:24.118 INFO:teuthology.orchestra.run.smithi032.stdout:524 2023-06-20T13:38:24.118 INFO:teuthology.orchestra.run.smithi032.stdout:524.out 2023-06-20T13:38:24.119 INFO:teuthology.orchestra.run.smithi032.stdout:525 2023-06-20T13:38:24.119 INFO:teuthology.orchestra.run.smithi032.stdout:525.out 2023-06-20T13:38:24.119 INFO:teuthology.orchestra.run.smithi032.stdout:526 2023-06-20T13:38:24.119 INFO:teuthology.orchestra.run.smithi032.stdout:526.out 2023-06-20T13:38:24.119 INFO:teuthology.orchestra.run.smithi032.stdout:527 2023-06-20T13:38:24.119 INFO:teuthology.orchestra.run.smithi032.stdout:527.out 2023-06-20T13:38:24.119 INFO:teuthology.orchestra.run.smithi032.stdout:528 2023-06-20T13:38:24.119 INFO:teuthology.orchestra.run.smithi032.stdout:528.out 2023-06-20T13:38:24.120 INFO:teuthology.orchestra.run.smithi032.stdout:529 2023-06-20T13:38:24.120 INFO:teuthology.orchestra.run.smithi032.stdout:529.out 2023-06-20T13:38:24.120 INFO:teuthology.orchestra.run.smithi032.stdout:530 2023-06-20T13:38:24.120 INFO:teuthology.orchestra.run.smithi032.stdout:530.out 2023-06-20T13:38:24.120 INFO:teuthology.orchestra.run.smithi032.stdout:531 2023-06-20T13:38:24.120 INFO:teuthology.orchestra.run.smithi032.stdout:531.out 2023-06-20T13:38:24.120 INFO:teuthology.orchestra.run.smithi032.stdout:532 2023-06-20T13:38:24.121 INFO:teuthology.orchestra.run.smithi032.stdout:532.out 2023-06-20T13:38:24.121 INFO:teuthology.orchestra.run.smithi032.stdout:533 2023-06-20T13:38:24.121 INFO:teuthology.orchestra.run.smithi032.stdout:533.out 2023-06-20T13:38:24.121 INFO:teuthology.orchestra.run.smithi032.stdout:534 2023-06-20T13:38:24.121 INFO:teuthology.orchestra.run.smithi032.stdout:534.out 2023-06-20T13:38:24.121 INFO:teuthology.orchestra.run.smithi032.stdout:535 2023-06-20T13:38:24.122 INFO:teuthology.orchestra.run.smithi032.stdout:535.out 2023-06-20T13:38:24.122 INFO:teuthology.orchestra.run.smithi032.stdout:536 2023-06-20T13:38:24.122 INFO:teuthology.orchestra.run.smithi032.stdout:536.out 2023-06-20T13:38:24.122 INFO:teuthology.orchestra.run.smithi032.stdout:537 2023-06-20T13:38:24.122 INFO:teuthology.orchestra.run.smithi032.stdout:537.out 2023-06-20T13:38:24.122 INFO:teuthology.orchestra.run.smithi032.stdout:538 2023-06-20T13:38:24.122 INFO:teuthology.orchestra.run.smithi032.stdout:538.out 2023-06-20T13:38:24.122 INFO:teuthology.orchestra.run.smithi032.stdout:539 2023-06-20T13:38:24.123 INFO:teuthology.orchestra.run.smithi032.stdout:539.out 2023-06-20T13:38:24.123 INFO:teuthology.orchestra.run.smithi032.stdout:540 2023-06-20T13:38:24.123 INFO:teuthology.orchestra.run.smithi032.stdout:540.out 2023-06-20T13:38:24.123 INFO:teuthology.orchestra.run.smithi032.stdout:541 2023-06-20T13:38:24.123 INFO:teuthology.orchestra.run.smithi032.stdout:541.out 2023-06-20T13:38:24.123 INFO:teuthology.orchestra.run.smithi032.stdout:542 2023-06-20T13:38:24.123 INFO:teuthology.orchestra.run.smithi032.stdout:542.out 2023-06-20T13:38:24.124 INFO:teuthology.orchestra.run.smithi032.stdout:543 2023-06-20T13:38:24.124 INFO:teuthology.orchestra.run.smithi032.stdout:543.out 2023-06-20T13:38:24.124 INFO:teuthology.orchestra.run.smithi032.stdout:544 2023-06-20T13:38:24.124 INFO:teuthology.orchestra.run.smithi032.stdout:544.out 2023-06-20T13:38:24.124 INFO:teuthology.orchestra.run.smithi032.stdout:545 2023-06-20T13:38:24.124 INFO:teuthology.orchestra.run.smithi032.stdout:545.out 2023-06-20T13:38:24.124 INFO:teuthology.orchestra.run.smithi032.stdout:546 2023-06-20T13:38:24.124 INFO:teuthology.orchestra.run.smithi032.stdout:546.out 2023-06-20T13:38:24.125 INFO:teuthology.orchestra.run.smithi032.stdout:547 2023-06-20T13:38:24.125 INFO:teuthology.orchestra.run.smithi032.stdout:547.out 2023-06-20T13:38:24.125 INFO:teuthology.orchestra.run.smithi032.stdout:548 2023-06-20T13:38:24.125 INFO:teuthology.orchestra.run.smithi032.stdout:548.out 2023-06-20T13:38:24.125 INFO:teuthology.orchestra.run.smithi032.stdout:549 2023-06-20T13:38:24.125 INFO:teuthology.orchestra.run.smithi032.stdout:549.out 2023-06-20T13:38:24.125 INFO:teuthology.orchestra.run.smithi032.stdout:550 2023-06-20T13:38:24.125 INFO:teuthology.orchestra.run.smithi032.stdout:550.out 2023-06-20T13:38:24.126 INFO:teuthology.orchestra.run.smithi032.stdout:551 2023-06-20T13:38:24.126 INFO:teuthology.orchestra.run.smithi032.stdout:551.out 2023-06-20T13:38:24.126 INFO:teuthology.orchestra.run.smithi032.stdout:552 2023-06-20T13:38:24.126 INFO:teuthology.orchestra.run.smithi032.stdout:552.out 2023-06-20T13:38:24.126 INFO:teuthology.orchestra.run.smithi032.stdout:553 2023-06-20T13:38:24.126 INFO:teuthology.orchestra.run.smithi032.stdout:553.out 2023-06-20T13:38:24.126 INFO:teuthology.orchestra.run.smithi032.stdout:554 2023-06-20T13:38:24.126 INFO:teuthology.orchestra.run.smithi032.stdout:554.out 2023-06-20T13:38:24.127 INFO:teuthology.orchestra.run.smithi032.stdout:555 2023-06-20T13:38:24.127 INFO:teuthology.orchestra.run.smithi032.stdout:555.out 2023-06-20T13:38:24.127 INFO:teuthology.orchestra.run.smithi032.stdout:556 2023-06-20T13:38:24.127 INFO:teuthology.orchestra.run.smithi032.stdout:556.out 2023-06-20T13:38:24.127 INFO:teuthology.orchestra.run.smithi032.stdout:557 2023-06-20T13:38:24.127 INFO:teuthology.orchestra.run.smithi032.stdout:557.out 2023-06-20T13:38:24.127 INFO:teuthology.orchestra.run.smithi032.stdout:558 2023-06-20T13:38:24.127 INFO:teuthology.orchestra.run.smithi032.stdout:558.out 2023-06-20T13:38:24.128 INFO:teuthology.orchestra.run.smithi032.stdout:559 2023-06-20T13:38:24.128 INFO:teuthology.orchestra.run.smithi032.stdout:559.out 2023-06-20T13:38:24.128 INFO:teuthology.orchestra.run.smithi032.stdout:560 2023-06-20T13:38:24.128 INFO:teuthology.orchestra.run.smithi032.stdout:560.out 2023-06-20T13:38:24.128 INFO:teuthology.orchestra.run.smithi032.stdout:561 2023-06-20T13:38:24.128 INFO:teuthology.orchestra.run.smithi032.stdout:561.out 2023-06-20T13:38:24.128 INFO:teuthology.orchestra.run.smithi032.stdout:562 2023-06-20T13:38:24.128 INFO:teuthology.orchestra.run.smithi032.stdout:562.out 2023-06-20T13:38:24.129 INFO:teuthology.orchestra.run.smithi032.stdout:563 2023-06-20T13:38:24.129 INFO:teuthology.orchestra.run.smithi032.stdout:563.out 2023-06-20T13:38:24.129 INFO:teuthology.orchestra.run.smithi032.stdout:564 2023-06-20T13:38:24.129 INFO:teuthology.orchestra.run.smithi032.stdout:564.out 2023-06-20T13:38:24.129 INFO:teuthology.orchestra.run.smithi032.stdout:565 2023-06-20T13:38:24.129 INFO:teuthology.orchestra.run.smithi032.stdout:565.out 2023-06-20T13:38:24.129 INFO:teuthology.orchestra.run.smithi032.stdout:566 2023-06-20T13:38:24.129 INFO:teuthology.orchestra.run.smithi032.stdout:566.out 2023-06-20T13:38:24.130 INFO:teuthology.orchestra.run.smithi032.stdout:567 2023-06-20T13:38:24.130 INFO:teuthology.orchestra.run.smithi032.stdout:567.out 2023-06-20T13:38:24.130 INFO:teuthology.orchestra.run.smithi032.stdout:568 2023-06-20T13:38:24.130 INFO:teuthology.orchestra.run.smithi032.stdout:568.out 2023-06-20T13:38:24.130 INFO:teuthology.orchestra.run.smithi032.stdout:569 2023-06-20T13:38:24.130 INFO:teuthology.orchestra.run.smithi032.stdout:569.out 2023-06-20T13:38:24.130 INFO:teuthology.orchestra.run.smithi032.stdout:570 2023-06-20T13:38:24.130 INFO:teuthology.orchestra.run.smithi032.stdout:570.out 2023-06-20T13:38:24.131 INFO:teuthology.orchestra.run.smithi032.stdout:571 2023-06-20T13:38:24.131 INFO:teuthology.orchestra.run.smithi032.stdout:571.out 2023-06-20T13:38:24.131 INFO:teuthology.orchestra.run.smithi032.stdout:572 2023-06-20T13:38:24.131 INFO:teuthology.orchestra.run.smithi032.stdout:572.out 2023-06-20T13:38:24.131 INFO:teuthology.orchestra.run.smithi032.stdout:573 2023-06-20T13:38:24.131 INFO:teuthology.orchestra.run.smithi032.stdout:573.out 2023-06-20T13:38:24.131 INFO:teuthology.orchestra.run.smithi032.stdout:574 2023-06-20T13:38:24.131 INFO:teuthology.orchestra.run.smithi032.stdout:574.out 2023-06-20T13:38:24.132 INFO:teuthology.orchestra.run.smithi032.stdout:575 2023-06-20T13:38:24.132 INFO:teuthology.orchestra.run.smithi032.stdout:575.out 2023-06-20T13:38:24.132 INFO:teuthology.orchestra.run.smithi032.stdout:576 2023-06-20T13:38:24.132 INFO:teuthology.orchestra.run.smithi032.stdout:576.out 2023-06-20T13:38:24.132 INFO:teuthology.orchestra.run.smithi032.stdout:577 2023-06-20T13:38:24.132 INFO:teuthology.orchestra.run.smithi032.stdout:577.out 2023-06-20T13:38:24.132 INFO:teuthology.orchestra.run.smithi032.stdout:578 2023-06-20T13:38:24.132 INFO:teuthology.orchestra.run.smithi032.stdout:578.out 2023-06-20T13:38:24.133 INFO:teuthology.orchestra.run.smithi032.stdout:579 2023-06-20T13:38:24.133 INFO:teuthology.orchestra.run.smithi032.stdout:579.out 2023-06-20T13:38:24.133 INFO:teuthology.orchestra.run.smithi032.stdout:580 2023-06-20T13:38:24.133 INFO:teuthology.orchestra.run.smithi032.stdout:580.out 2023-06-20T13:38:24.133 INFO:teuthology.orchestra.run.smithi032.stdout:581 2023-06-20T13:38:24.133 INFO:teuthology.orchestra.run.smithi032.stdout:581.out 2023-06-20T13:38:24.133 INFO:teuthology.orchestra.run.smithi032.stdout:582 2023-06-20T13:38:24.133 INFO:teuthology.orchestra.run.smithi032.stdout:582.out 2023-06-20T13:38:24.134 INFO:teuthology.orchestra.run.smithi032.stdout:583 2023-06-20T13:38:24.134 INFO:teuthology.orchestra.run.smithi032.stdout:583.out 2023-06-20T13:38:24.134 INFO:teuthology.orchestra.run.smithi032.stdout:584 2023-06-20T13:38:24.134 INFO:teuthology.orchestra.run.smithi032.stdout:584.out 2023-06-20T13:38:24.134 INFO:teuthology.orchestra.run.smithi032.stdout:585 2023-06-20T13:38:24.134 INFO:teuthology.orchestra.run.smithi032.stdout:585.out 2023-06-20T13:38:24.134 INFO:teuthology.orchestra.run.smithi032.stdout:586 2023-06-20T13:38:24.134 INFO:teuthology.orchestra.run.smithi032.stdout:586.out 2023-06-20T13:38:24.135 INFO:teuthology.orchestra.run.smithi032.stdout:587 2023-06-20T13:38:24.135 INFO:teuthology.orchestra.run.smithi032.stdout:587.out 2023-06-20T13:38:24.135 INFO:teuthology.orchestra.run.smithi032.stdout:588 2023-06-20T13:38:24.135 INFO:teuthology.orchestra.run.smithi032.stdout:588.out 2023-06-20T13:38:24.135 INFO:teuthology.orchestra.run.smithi032.stdout:589 2023-06-20T13:38:24.135 INFO:teuthology.orchestra.run.smithi032.stdout:589.out 2023-06-20T13:38:24.135 INFO:teuthology.orchestra.run.smithi032.stdout:590 2023-06-20T13:38:24.135 INFO:teuthology.orchestra.run.smithi032.stdout:590.out 2023-06-20T13:38:24.136 INFO:teuthology.orchestra.run.smithi032.stdout:591 2023-06-20T13:38:24.136 INFO:teuthology.orchestra.run.smithi032.stdout:591.out 2023-06-20T13:38:24.136 INFO:teuthology.orchestra.run.smithi032.stdout:592 2023-06-20T13:38:24.136 INFO:teuthology.orchestra.run.smithi032.stdout:592.out 2023-06-20T13:38:24.136 INFO:teuthology.orchestra.run.smithi032.stdout:593 2023-06-20T13:38:24.136 INFO:teuthology.orchestra.run.smithi032.stdout:593.out 2023-06-20T13:38:24.136 INFO:teuthology.orchestra.run.smithi032.stdout:594 2023-06-20T13:38:24.136 INFO:teuthology.orchestra.run.smithi032.stdout:594.out 2023-06-20T13:38:24.137 INFO:teuthology.orchestra.run.smithi032.stdout:595 2023-06-20T13:38:24.137 INFO:teuthology.orchestra.run.smithi032.stdout:595.out 2023-06-20T13:38:24.137 INFO:teuthology.orchestra.run.smithi032.stdout:596 2023-06-20T13:38:24.137 INFO:teuthology.orchestra.run.smithi032.stdout:596.out 2023-06-20T13:38:24.137 INFO:teuthology.orchestra.run.smithi032.stdout:597 2023-06-20T13:38:24.137 INFO:teuthology.orchestra.run.smithi032.stdout:597.out 2023-06-20T13:38:24.137 INFO:teuthology.orchestra.run.smithi032.stdout:598 2023-06-20T13:38:24.137 INFO:teuthology.orchestra.run.smithi032.stdout:598.out 2023-06-20T13:38:24.138 INFO:teuthology.orchestra.run.smithi032.stdout:599 2023-06-20T13:38:24.138 INFO:teuthology.orchestra.run.smithi032.stdout:599.out 2023-06-20T13:38:24.138 INFO:teuthology.orchestra.run.smithi032.stdout:600 2023-06-20T13:38:24.138 INFO:teuthology.orchestra.run.smithi032.stdout:600.out 2023-06-20T13:38:24.138 INFO:teuthology.orchestra.run.smithi032.stdout:601 2023-06-20T13:38:24.138 INFO:teuthology.orchestra.run.smithi032.stdout:601.out 2023-06-20T13:38:24.138 INFO:teuthology.orchestra.run.smithi032.stdout:602 2023-06-20T13:38:24.138 INFO:teuthology.orchestra.run.smithi032.stdout:602.out 2023-06-20T13:38:24.139 INFO:teuthology.orchestra.run.smithi032.stdout:603 2023-06-20T13:38:24.139 INFO:teuthology.orchestra.run.smithi032.stdout:603.out 2023-06-20T13:38:24.139 INFO:teuthology.orchestra.run.smithi032.stdout:604 2023-06-20T13:38:24.139 INFO:teuthology.orchestra.run.smithi032.stdout:604.out 2023-06-20T13:38:24.139 INFO:teuthology.orchestra.run.smithi032.stdout:605 2023-06-20T13:38:24.139 INFO:teuthology.orchestra.run.smithi032.stdout:605.out 2023-06-20T13:38:24.139 INFO:teuthology.orchestra.run.smithi032.stdout:606 2023-06-20T13:38:24.139 INFO:teuthology.orchestra.run.smithi032.stdout:606.out 2023-06-20T13:38:24.140 INFO:teuthology.orchestra.run.smithi032.stdout:607 2023-06-20T13:38:24.140 INFO:teuthology.orchestra.run.smithi032.stdout:607.out 2023-06-20T13:38:24.140 INFO:teuthology.orchestra.run.smithi032.stdout:608 2023-06-20T13:38:24.140 INFO:teuthology.orchestra.run.smithi032.stdout:608.out 2023-06-20T13:38:24.140 INFO:teuthology.orchestra.run.smithi032.stdout:609 2023-06-20T13:38:24.140 INFO:teuthology.orchestra.run.smithi032.stdout:609.out 2023-06-20T13:38:24.140 INFO:teuthology.orchestra.run.smithi032.stdout:610 2023-06-20T13:38:24.141 INFO:teuthology.orchestra.run.smithi032.stdout:610.out 2023-06-20T13:38:24.141 INFO:teuthology.orchestra.run.smithi032.stdout:611 2023-06-20T13:38:24.141 INFO:teuthology.orchestra.run.smithi032.stdout:611.out 2023-06-20T13:38:24.141 INFO:teuthology.orchestra.run.smithi032.stdout:612 2023-06-20T13:38:24.141 INFO:teuthology.orchestra.run.smithi032.stdout:612.out 2023-06-20T13:38:24.141 INFO:teuthology.orchestra.run.smithi032.stdout:613 2023-06-20T13:38:24.141 INFO:teuthology.orchestra.run.smithi032.stdout:613.out 2023-06-20T13:38:24.141 INFO:teuthology.orchestra.run.smithi032.stdout:614 2023-06-20T13:38:24.142 INFO:teuthology.orchestra.run.smithi032.stdout:614.out 2023-06-20T13:38:24.142 INFO:teuthology.orchestra.run.smithi032.stdout:615 2023-06-20T13:38:24.142 INFO:teuthology.orchestra.run.smithi032.stdout:615.out 2023-06-20T13:38:24.142 INFO:teuthology.orchestra.run.smithi032.stdout:616 2023-06-20T13:38:24.142 INFO:teuthology.orchestra.run.smithi032.stdout:616.out 2023-06-20T13:38:24.142 INFO:teuthology.orchestra.run.smithi032.stdout:617 2023-06-20T13:38:24.142 INFO:teuthology.orchestra.run.smithi032.stdout:617.out 2023-06-20T13:38:24.142 INFO:teuthology.orchestra.run.smithi032.stdout:618 2023-06-20T13:38:24.143 INFO:teuthology.orchestra.run.smithi032.stdout:618.out 2023-06-20T13:38:24.143 INFO:teuthology.orchestra.run.smithi032.stdout:619 2023-06-20T13:38:24.143 INFO:teuthology.orchestra.run.smithi032.stdout:619.out 2023-06-20T13:38:24.143 INFO:teuthology.orchestra.run.smithi032.stdout:620 2023-06-20T13:38:24.143 INFO:teuthology.orchestra.run.smithi032.stdout:620.out 2023-06-20T13:38:24.143 INFO:teuthology.orchestra.run.smithi032.stdout:621 2023-06-20T13:38:24.143 INFO:teuthology.orchestra.run.smithi032.stdout:621.out 2023-06-20T13:38:24.143 INFO:teuthology.orchestra.run.smithi032.stdout:622 2023-06-20T13:38:24.143 INFO:teuthology.orchestra.run.smithi032.stdout:622.out 2023-06-20T13:38:24.144 INFO:teuthology.orchestra.run.smithi032.stdout:623 2023-06-20T13:38:24.144 INFO:teuthology.orchestra.run.smithi032.stdout:623.out 2023-06-20T13:38:24.144 INFO:teuthology.orchestra.run.smithi032.stdout:624 2023-06-20T13:38:24.144 INFO:teuthology.orchestra.run.smithi032.stdout:624.out 2023-06-20T13:38:24.144 INFO:teuthology.orchestra.run.smithi032.stdout:625 2023-06-20T13:38:24.144 INFO:teuthology.orchestra.run.smithi032.stdout:625.out 2023-06-20T13:38:24.144 INFO:teuthology.orchestra.run.smithi032.stdout:626 2023-06-20T13:38:24.145 INFO:teuthology.orchestra.run.smithi032.stdout:626.out 2023-06-20T13:38:24.145 INFO:teuthology.orchestra.run.smithi032.stdout:627 2023-06-20T13:38:24.145 INFO:teuthology.orchestra.run.smithi032.stdout:627.out 2023-06-20T13:38:24.145 INFO:teuthology.orchestra.run.smithi032.stdout:628 2023-06-20T13:38:24.145 INFO:teuthology.orchestra.run.smithi032.stdout:628.out 2023-06-20T13:38:24.145 INFO:teuthology.orchestra.run.smithi032.stdout:629 2023-06-20T13:38:24.145 INFO:teuthology.orchestra.run.smithi032.stdout:629.out 2023-06-20T13:38:24.145 INFO:teuthology.orchestra.run.smithi032.stdout:630 2023-06-20T13:38:24.145 INFO:teuthology.orchestra.run.smithi032.stdout:630.out 2023-06-20T13:38:24.146 INFO:teuthology.orchestra.run.smithi032.stdout:631 2023-06-20T13:38:24.146 INFO:teuthology.orchestra.run.smithi032.stdout:631.out 2023-06-20T13:38:24.146 INFO:teuthology.orchestra.run.smithi032.stdout:632 2023-06-20T13:38:24.146 INFO:teuthology.orchestra.run.smithi032.stdout:632.out 2023-06-20T13:38:24.146 INFO:teuthology.orchestra.run.smithi032.stdout:633 2023-06-20T13:38:24.146 INFO:teuthology.orchestra.run.smithi032.stdout:633.out 2023-06-20T13:38:24.146 INFO:teuthology.orchestra.run.smithi032.stdout:634 2023-06-20T13:38:24.146 INFO:teuthology.orchestra.run.smithi032.stdout:634.out 2023-06-20T13:38:24.147 INFO:teuthology.orchestra.run.smithi032.stdout:635 2023-06-20T13:38:24.147 INFO:teuthology.orchestra.run.smithi032.stdout:635.out 2023-06-20T13:38:24.147 INFO:teuthology.orchestra.run.smithi032.stdout:636 2023-06-20T13:38:24.147 INFO:teuthology.orchestra.run.smithi032.stdout:636.out 2023-06-20T13:38:24.147 INFO:teuthology.orchestra.run.smithi032.stdout:637 2023-06-20T13:38:24.147 INFO:teuthology.orchestra.run.smithi032.stdout:637.out 2023-06-20T13:38:24.147 INFO:teuthology.orchestra.run.smithi032.stdout:638 2023-06-20T13:38:24.147 INFO:teuthology.orchestra.run.smithi032.stdout:638.out 2023-06-20T13:38:24.148 INFO:teuthology.orchestra.run.smithi032.stdout:639 2023-06-20T13:38:24.148 INFO:teuthology.orchestra.run.smithi032.stdout:639.out 2023-06-20T13:38:24.148 INFO:teuthology.orchestra.run.smithi032.stdout:640 2023-06-20T13:38:24.148 INFO:teuthology.orchestra.run.smithi032.stdout:640.out 2023-06-20T13:38:24.148 INFO:teuthology.orchestra.run.smithi032.stdout:641 2023-06-20T13:38:24.148 INFO:teuthology.orchestra.run.smithi032.stdout:641.out 2023-06-20T13:38:24.148 INFO:teuthology.orchestra.run.smithi032.stdout:642 2023-06-20T13:38:24.148 INFO:teuthology.orchestra.run.smithi032.stdout:642.out 2023-06-20T13:38:24.149 INFO:teuthology.orchestra.run.smithi032.stdout:643 2023-06-20T13:38:24.149 INFO:teuthology.orchestra.run.smithi032.stdout:643.out 2023-06-20T13:38:24.149 INFO:teuthology.orchestra.run.smithi032.stdout:644 2023-06-20T13:38:24.149 INFO:teuthology.orchestra.run.smithi032.stdout:644.out 2023-06-20T13:38:24.149 INFO:teuthology.orchestra.run.smithi032.stdout:645 2023-06-20T13:38:24.149 INFO:teuthology.orchestra.run.smithi032.stdout:645.out 2023-06-20T13:38:24.149 INFO:teuthology.orchestra.run.smithi032.stdout:646 2023-06-20T13:38:24.149 INFO:teuthology.orchestra.run.smithi032.stdout:646.out 2023-06-20T13:38:24.150 INFO:teuthology.orchestra.run.smithi032.stdout:647 2023-06-20T13:38:24.150 INFO:teuthology.orchestra.run.smithi032.stdout:647.out 2023-06-20T13:38:24.150 INFO:teuthology.orchestra.run.smithi032.stdout:648 2023-06-20T13:38:24.150 INFO:teuthology.orchestra.run.smithi032.stdout:648.out 2023-06-20T13:38:24.150 INFO:teuthology.orchestra.run.smithi032.stdout:649 2023-06-20T13:38:24.150 INFO:teuthology.orchestra.run.smithi032.stdout:649.out 2023-06-20T13:38:24.150 INFO:teuthology.orchestra.run.smithi032.stdout:650 2023-06-20T13:38:24.150 INFO:teuthology.orchestra.run.smithi032.stdout:650.out 2023-06-20T13:38:24.151 INFO:teuthology.orchestra.run.smithi032.stdout:651 2023-06-20T13:38:24.151 INFO:teuthology.orchestra.run.smithi032.stdout:651.out 2023-06-20T13:38:24.151 INFO:teuthology.orchestra.run.smithi032.stdout:652 2023-06-20T13:38:24.151 INFO:teuthology.orchestra.run.smithi032.stdout:652.out 2023-06-20T13:38:24.151 INFO:teuthology.orchestra.run.smithi032.stdout:653 2023-06-20T13:38:24.151 INFO:teuthology.orchestra.run.smithi032.stdout:653.out 2023-06-20T13:38:24.151 INFO:teuthology.orchestra.run.smithi032.stdout:654 2023-06-20T13:38:24.151 INFO:teuthology.orchestra.run.smithi032.stdout:654.out 2023-06-20T13:38:24.152 INFO:teuthology.orchestra.run.smithi032.stdout:655 2023-06-20T13:38:24.152 INFO:teuthology.orchestra.run.smithi032.stdout:655.out 2023-06-20T13:38:24.152 INFO:teuthology.orchestra.run.smithi032.stdout:656 2023-06-20T13:38:24.152 INFO:teuthology.orchestra.run.smithi032.stdout:656.out 2023-06-20T13:38:24.152 INFO:teuthology.orchestra.run.smithi032.stdout:657 2023-06-20T13:38:24.152 INFO:teuthology.orchestra.run.smithi032.stdout:657.out 2023-06-20T13:38:24.152 INFO:teuthology.orchestra.run.smithi032.stdout:658 2023-06-20T13:38:24.152 INFO:teuthology.orchestra.run.smithi032.stdout:658.out 2023-06-20T13:38:24.153 INFO:teuthology.orchestra.run.smithi032.stdout:659 2023-06-20T13:38:24.153 INFO:teuthology.orchestra.run.smithi032.stdout:659.out 2023-06-20T13:38:24.153 INFO:teuthology.orchestra.run.smithi032.stdout:660 2023-06-20T13:38:24.153 INFO:teuthology.orchestra.run.smithi032.stdout:660.out 2023-06-20T13:38:24.153 INFO:teuthology.orchestra.run.smithi032.stdout:661 2023-06-20T13:38:24.153 INFO:teuthology.orchestra.run.smithi032.stdout:661.out 2023-06-20T13:38:24.153 INFO:teuthology.orchestra.run.smithi032.stdout:662 2023-06-20T13:38:24.153 INFO:teuthology.orchestra.run.smithi032.stdout:662.out 2023-06-20T13:38:24.154 INFO:teuthology.orchestra.run.smithi032.stdout:663 2023-06-20T13:38:24.154 INFO:teuthology.orchestra.run.smithi032.stdout:663.out 2023-06-20T13:38:24.154 INFO:teuthology.orchestra.run.smithi032.stdout:664 2023-06-20T13:38:24.154 INFO:teuthology.orchestra.run.smithi032.stdout:664.out 2023-06-20T13:38:24.154 INFO:teuthology.orchestra.run.smithi032.stdout:665 2023-06-20T13:38:24.154 INFO:teuthology.orchestra.run.smithi032.stdout:665.out 2023-06-20T13:38:24.154 INFO:teuthology.orchestra.run.smithi032.stdout:666 2023-06-20T13:38:24.154 INFO:teuthology.orchestra.run.smithi032.stdout:666.out 2023-06-20T13:38:24.155 INFO:teuthology.orchestra.run.smithi032.stdout:667 2023-06-20T13:38:24.155 INFO:teuthology.orchestra.run.smithi032.stdout:667.out 2023-06-20T13:38:24.155 INFO:teuthology.orchestra.run.smithi032.stdout:668 2023-06-20T13:38:24.155 INFO:teuthology.orchestra.run.smithi032.stdout:668.out 2023-06-20T13:38:24.155 INFO:teuthology.orchestra.run.smithi032.stdout:669 2023-06-20T13:38:24.155 INFO:teuthology.orchestra.run.smithi032.stdout:669.out 2023-06-20T13:38:24.155 INFO:teuthology.orchestra.run.smithi032.stdout:670 2023-06-20T13:38:24.155 INFO:teuthology.orchestra.run.smithi032.stdout:670.out 2023-06-20T13:38:24.156 INFO:teuthology.orchestra.run.smithi032.stdout:671 2023-06-20T13:38:24.156 INFO:teuthology.orchestra.run.smithi032.stdout:671.out 2023-06-20T13:38:24.156 INFO:teuthology.orchestra.run.smithi032.stdout:672 2023-06-20T13:38:24.156 INFO:teuthology.orchestra.run.smithi032.stdout:672.out 2023-06-20T13:38:24.156 INFO:teuthology.orchestra.run.smithi032.stdout:673 2023-06-20T13:38:24.156 INFO:teuthology.orchestra.run.smithi032.stdout:673.out 2023-06-20T13:38:24.156 INFO:teuthology.orchestra.run.smithi032.stdout:674 2023-06-20T13:38:24.157 INFO:teuthology.orchestra.run.smithi032.stdout:674.out 2023-06-20T13:38:24.157 INFO:teuthology.orchestra.run.smithi032.stdout:675 2023-06-20T13:38:24.157 INFO:teuthology.orchestra.run.smithi032.stdout:675.out 2023-06-20T13:38:24.157 INFO:teuthology.orchestra.run.smithi032.stdout:676 2023-06-20T13:38:24.157 INFO:teuthology.orchestra.run.smithi032.stdout:676.out 2023-06-20T13:38:24.157 INFO:teuthology.orchestra.run.smithi032.stdout:677 2023-06-20T13:38:24.157 INFO:teuthology.orchestra.run.smithi032.stdout:677.out 2023-06-20T13:38:24.158 INFO:teuthology.orchestra.run.smithi032.stdout:678 2023-06-20T13:38:24.158 INFO:teuthology.orchestra.run.smithi032.stdout:678.out 2023-06-20T13:38:24.158 INFO:teuthology.orchestra.run.smithi032.stdout:679 2023-06-20T13:38:24.158 INFO:teuthology.orchestra.run.smithi032.stdout:679.out 2023-06-20T13:38:24.158 INFO:teuthology.orchestra.run.smithi032.stdout:680 2023-06-20T13:38:24.158 INFO:teuthology.orchestra.run.smithi032.stdout:680.out 2023-06-20T13:38:24.158 INFO:teuthology.orchestra.run.smithi032.stdout:681 2023-06-20T13:38:24.159 INFO:teuthology.orchestra.run.smithi032.stdout:681.out 2023-06-20T13:38:24.159 INFO:teuthology.orchestra.run.smithi032.stdout:682 2023-06-20T13:38:24.159 INFO:teuthology.orchestra.run.smithi032.stdout:682.out 2023-06-20T13:38:24.159 INFO:teuthology.orchestra.run.smithi032.stdout:683 2023-06-20T13:38:24.159 INFO:teuthology.orchestra.run.smithi032.stdout:683.out 2023-06-20T13:38:24.159 INFO:teuthology.orchestra.run.smithi032.stdout:684 2023-06-20T13:38:24.159 INFO:teuthology.orchestra.run.smithi032.stdout:684.out 2023-06-20T13:38:24.159 INFO:teuthology.orchestra.run.smithi032.stdout:685 2023-06-20T13:38:24.160 INFO:teuthology.orchestra.run.smithi032.stdout:685.out 2023-06-20T13:38:24.160 INFO:teuthology.orchestra.run.smithi032.stdout:686 2023-06-20T13:38:24.160 INFO:teuthology.orchestra.run.smithi032.stdout:686.out 2023-06-20T13:38:24.160 INFO:teuthology.orchestra.run.smithi032.stdout:687 2023-06-20T13:38:24.160 INFO:teuthology.orchestra.run.smithi032.stdout:687.out 2023-06-20T13:38:24.160 INFO:teuthology.orchestra.run.smithi032.stdout:688 2023-06-20T13:38:24.160 INFO:teuthology.orchestra.run.smithi032.stdout:688.out 2023-06-20T13:38:24.161 INFO:teuthology.orchestra.run.smithi032.stdout:689 2023-06-20T13:38:24.161 INFO:teuthology.orchestra.run.smithi032.stdout:689.out 2023-06-20T13:38:24.161 INFO:teuthology.orchestra.run.smithi032.stdout:690 2023-06-20T13:38:24.161 INFO:teuthology.orchestra.run.smithi032.stdout:690.out 2023-06-20T13:38:24.161 INFO:teuthology.orchestra.run.smithi032.stdout:691 2023-06-20T13:38:24.161 INFO:teuthology.orchestra.run.smithi032.stdout:691.out 2023-06-20T13:38:24.161 INFO:teuthology.orchestra.run.smithi032.stdout:692 2023-06-20T13:38:24.161 INFO:teuthology.orchestra.run.smithi032.stdout:692.out 2023-06-20T13:38:24.162 INFO:teuthology.orchestra.run.smithi032.stdout:693 2023-06-20T13:38:24.162 INFO:teuthology.orchestra.run.smithi032.stdout:693.out 2023-06-20T13:38:24.162 INFO:teuthology.orchestra.run.smithi032.stdout:694 2023-06-20T13:38:24.162 INFO:teuthology.orchestra.run.smithi032.stdout:694.out 2023-06-20T13:38:24.162 INFO:teuthology.orchestra.run.smithi032.stdout:695 2023-06-20T13:38:24.162 INFO:teuthology.orchestra.run.smithi032.stdout:695.out 2023-06-20T13:38:24.162 INFO:teuthology.orchestra.run.smithi032.stdout:696 2023-06-20T13:38:24.162 INFO:teuthology.orchestra.run.smithi032.stdout:696.out 2023-06-20T13:38:24.163 INFO:teuthology.orchestra.run.smithi032.stdout:697 2023-06-20T13:38:24.163 INFO:teuthology.orchestra.run.smithi032.stdout:697.out 2023-06-20T13:38:24.163 INFO:teuthology.orchestra.run.smithi032.stdout:698 2023-06-20T13:38:24.163 INFO:teuthology.orchestra.run.smithi032.stdout:698.out 2023-06-20T13:38:24.163 INFO:teuthology.orchestra.run.smithi032.stdout:699 2023-06-20T13:38:24.163 INFO:teuthology.orchestra.run.smithi032.stdout:699.out 2023-06-20T13:38:24.163 INFO:teuthology.orchestra.run.smithi032.stdout:700 2023-06-20T13:38:24.163 INFO:teuthology.orchestra.run.smithi032.stdout:700.out 2023-06-20T13:38:24.164 INFO:teuthology.orchestra.run.smithi032.stdout:701 2023-06-20T13:38:24.164 INFO:teuthology.orchestra.run.smithi032.stdout:701.out 2023-06-20T13:38:24.164 INFO:teuthology.orchestra.run.smithi032.stdout:702 2023-06-20T13:38:24.164 INFO:teuthology.orchestra.run.smithi032.stdout:702.out 2023-06-20T13:38:24.164 INFO:teuthology.orchestra.run.smithi032.stdout:703 2023-06-20T13:38:24.164 INFO:teuthology.orchestra.run.smithi032.stdout:703.out 2023-06-20T13:38:24.164 INFO:teuthology.orchestra.run.smithi032.stdout:704 2023-06-20T13:38:24.164 INFO:teuthology.orchestra.run.smithi032.stdout:704.out 2023-06-20T13:38:24.165 INFO:teuthology.orchestra.run.smithi032.stdout:705 2023-06-20T13:38:24.165 INFO:teuthology.orchestra.run.smithi032.stdout:705.out 2023-06-20T13:38:24.165 INFO:teuthology.orchestra.run.smithi032.stdout:706 2023-06-20T13:38:24.165 INFO:teuthology.orchestra.run.smithi032.stdout:706.out 2023-06-20T13:38:24.165 INFO:teuthology.orchestra.run.smithi032.stdout:707 2023-06-20T13:38:24.165 INFO:teuthology.orchestra.run.smithi032.stdout:707.out 2023-06-20T13:38:24.165 INFO:teuthology.orchestra.run.smithi032.stdout:708 2023-06-20T13:38:24.165 INFO:teuthology.orchestra.run.smithi032.stdout:708.out 2023-06-20T13:38:24.166 INFO:teuthology.orchestra.run.smithi032.stdout:709 2023-06-20T13:38:24.166 INFO:teuthology.orchestra.run.smithi032.stdout:709.out 2023-06-20T13:38:24.166 INFO:teuthology.orchestra.run.smithi032.stdout:710 2023-06-20T13:38:24.166 INFO:teuthology.orchestra.run.smithi032.stdout:710.out 2023-06-20T13:38:24.166 INFO:teuthology.orchestra.run.smithi032.stdout:711 2023-06-20T13:38:24.166 INFO:teuthology.orchestra.run.smithi032.stdout:711.out 2023-06-20T13:38:24.166 INFO:teuthology.orchestra.run.smithi032.stdout:712 2023-06-20T13:38:24.166 INFO:teuthology.orchestra.run.smithi032.stdout:712.out 2023-06-20T13:38:24.167 INFO:teuthology.orchestra.run.smithi032.stdout:713 2023-06-20T13:38:24.167 INFO:teuthology.orchestra.run.smithi032.stdout:713.out 2023-06-20T13:38:24.167 INFO:teuthology.orchestra.run.smithi032.stdout:714 2023-06-20T13:38:24.167 INFO:teuthology.orchestra.run.smithi032.stdout:714.out 2023-06-20T13:38:24.167 INFO:teuthology.orchestra.run.smithi032.stdout:715 2023-06-20T13:38:24.167 INFO:teuthology.orchestra.run.smithi032.stdout:715.out 2023-06-20T13:38:24.167 INFO:teuthology.orchestra.run.smithi032.stdout:716 2023-06-20T13:38:24.167 INFO:teuthology.orchestra.run.smithi032.stdout:716.out 2023-06-20T13:38:24.168 INFO:teuthology.orchestra.run.smithi032.stdout:717 2023-06-20T13:38:24.168 INFO:teuthology.orchestra.run.smithi032.stdout:717.out 2023-06-20T13:38:24.168 INFO:teuthology.orchestra.run.smithi032.stdout:718 2023-06-20T13:38:24.168 INFO:teuthology.orchestra.run.smithi032.stdout:718.out 2023-06-20T13:38:24.168 INFO:teuthology.orchestra.run.smithi032.stdout:719 2023-06-20T13:38:24.168 INFO:teuthology.orchestra.run.smithi032.stdout:719.out 2023-06-20T13:38:24.168 INFO:teuthology.orchestra.run.smithi032.stdout:720 2023-06-20T13:38:24.168 INFO:teuthology.orchestra.run.smithi032.stdout:720.out 2023-06-20T13:38:24.169 INFO:teuthology.orchestra.run.smithi032.stdout:721 2023-06-20T13:38:24.169 INFO:teuthology.orchestra.run.smithi032.stdout:721.out 2023-06-20T13:38:24.169 INFO:teuthology.orchestra.run.smithi032.stdout:722 2023-06-20T13:38:24.169 INFO:teuthology.orchestra.run.smithi032.stdout:722.out 2023-06-20T13:38:24.169 INFO:teuthology.orchestra.run.smithi032.stdout:723 2023-06-20T13:38:24.169 INFO:teuthology.orchestra.run.smithi032.stdout:723.out 2023-06-20T13:38:24.169 INFO:teuthology.orchestra.run.smithi032.stdout:724 2023-06-20T13:38:24.169 INFO:teuthology.orchestra.run.smithi032.stdout:724.out 2023-06-20T13:38:24.170 INFO:teuthology.orchestra.run.smithi032.stdout:725 2023-06-20T13:38:24.170 INFO:teuthology.orchestra.run.smithi032.stdout:725.out 2023-06-20T13:38:24.170 INFO:teuthology.orchestra.run.smithi032.stdout:726 2023-06-20T13:38:24.170 INFO:teuthology.orchestra.run.smithi032.stdout:726.out 2023-06-20T13:38:24.170 INFO:teuthology.orchestra.run.smithi032.stdout:727 2023-06-20T13:38:24.170 INFO:teuthology.orchestra.run.smithi032.stdout:727.out 2023-06-20T13:38:24.170 INFO:teuthology.orchestra.run.smithi032.stdout:728 2023-06-20T13:38:24.170 INFO:teuthology.orchestra.run.smithi032.stdout:728.out 2023-06-20T13:38:24.171 INFO:teuthology.orchestra.run.smithi032.stdout:group.list 2023-06-20T13:38:24.171 INFO:teuthology.orchestra.run.smithi032.stdout:Makefile 2023-06-20T13:38:24.172 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-06-20T13:38:24.687 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:38:24.699 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:38:24.700 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:38:24.703 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:38:24.703 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:38:32.644 INFO:teuthology.orchestra.run.smithi032.stdout:generic/001 8s 2023-06-20T13:38:32.657 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/001 2023-06-20T13:38:32.658 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:38:32.663 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:38:32.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:38:32.812 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-06-20T13:38:33.267 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:38:33.279 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:38:33.280 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:38:33.283 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:38:33.283 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:38:34.158 INFO:teuthology.orchestra.run.smithi032.stdout:generic/002 1s 2023-06-20T13:38:34.171 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/002 2023-06-20T13:38:34.171 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:38:34.177 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:38:34.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:38:34.259 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-06-20T13:38:34.707 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:38:34.719 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:38:34.720 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:38:34.723 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:38:34.723 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:38:35.222 INFO:teuthology.orchestra.run.smithi032.stdout:generic/003 [not run] atime not maintained by ceph 2023-06-20T13:38:35.232 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/003 2023-06-20T13:38:35.232 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/003 2023-06-20T13:38:35.233 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:38:35.238 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:38:35.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:38:35.273 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-06-20T13:38:35.722 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:38:35.734 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:38:35.735 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:38:35.737 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:38:35.738 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:38:36.239 INFO:teuthology.orchestra.run.smithi032.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-06-20T13:38:36.249 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/004 2023-06-20T13:38:36.249 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/004 2023-06-20T13:38:36.250 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:38:36.255 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:38:36.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:38:36.291 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-06-20T13:38:36.739 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:38:36.751 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:38:36.753 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:38:36.755 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:38:36.755 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:38:37.536 INFO:teuthology.orchestra.run.smithi032.stdout:generic/005 1s 2023-06-20T13:38:37.549 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/005 2023-06-20T13:38:37.549 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:38:37.554 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:38:37.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:38:37.657 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-06-20T13:38:38.112 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:38:38.124 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:38:38.125 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:38:38.128 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:38:38.128 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:38:40.013 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:38:40.018 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:39:02.269 INFO:teuthology.orchestra.run.smithi032.stdout:generic/006 24s 2023-06-20T13:39:02.283 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/006 2023-06-20T13:39:02.284 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:39:02.289 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:39:02.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:39:02.353 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-06-20T13:39:02.804 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:39:02.816 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:39:02.817 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:39:02.822 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:39:02.822 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:39:10.114 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:39:10.118 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:39:40.219 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:39:40.224 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:39:52.266 INFO:teuthology.orchestra.run.smithi032.stdout:generic/007 49s 2023-06-20T13:39:53.406 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/007 2023-06-20T13:39:53.406 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:39:53.413 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:39:53.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:39:53.549 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-06-20T13:39:54.005 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:39:54.018 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:39:54.018 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:39:54.021 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:39:54.021 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:39:54.634 INFO:teuthology.orchestra.run.smithi032.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-20T13:39:54.644 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/008 2023-06-20T13:39:54.644 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/008 2023-06-20T13:39:54.644 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:39:54.650 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:39:54.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:39:54.694 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-06-20T13:39:55.150 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:39:55.162 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:39:55.163 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:39:55.166 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:39:55.166 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:39:55.773 INFO:teuthology.orchestra.run.smithi032.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-20T13:39:55.783 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/009 2023-06-20T13:39:55.783 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/009 2023-06-20T13:39:55.783 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:39:55.789 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:39:55.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:39:55.835 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-06-20T13:39:56.287 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:39:56.299 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:39:56.300 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:39:56.303 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:39:56.303 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:39:56.776 INFO:teuthology.orchestra.run.smithi032.stdout:generic/010 [not run] /tmp/tmp.LENcwP3t9bxfstests-dev/src/dbtest not built 2023-06-20T13:39:56.786 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/010 2023-06-20T13:39:56.786 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/010 2023-06-20T13:39:56.786 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:39:56.792 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:39:56.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:39:56.829 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-06-20T13:39:57.278 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:39:57.290 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:39:57.291 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:39:57.294 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:39:57.294 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:40:11.173 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:40:11.180 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:40:27.476 INFO:teuthology.orchestra.run.smithi032.stdout:generic/011 30s 2023-06-20T13:40:27.489 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/011 2023-06-20T13:40:27.490 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:40:27.495 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:40:27.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:40:27.721 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-06-20T13:40:28.236 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:40:28.249 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:40:28.250 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:40:28.252 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:40:28.252 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:40:28.932 INFO:teuthology.orchestra.run.smithi032.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-20T13:40:28.942 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/012 2023-06-20T13:40:28.942 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/012 2023-06-20T13:40:28.942 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:40:28.948 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:40:29.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:40:29.029 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-06-20T13:40:29.487 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:40:29.499 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:40:29.500 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:40:29.503 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:40:29.503 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:40:41.344 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:40:41.358 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:41:11.866 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:41:11.876 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:41:31.283 INFO:teuthology.orchestra.run.smithi032.stdout:generic/013 62s 2023-06-20T13:41:31.470 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/013 2023-06-20T13:41:31.470 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:41:31.479 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:41:31.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:41:31.544 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-06-20T13:41:32.244 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:41:32.263 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:41:32.264 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:41:32.268 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:41:32.268 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:41:42.002 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:41:42.013 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:42:12.161 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:42:12.171 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:42:42.318 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:42:42.332 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:43:12.550 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:43:12.574 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:43:42.715 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:43:42.728 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:44:12.952 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:44:12.960 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:44:43.194 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:44:43.200 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:45:13.353 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:45:13.358 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:45:44.432 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:45:44.440 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:46:04.623 INFO:teuthology.orchestra.run.smithi032.stdout:generic/014 272s 2023-06-20T13:46:04.637 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/014 2023-06-20T13:46:04.638 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:46:04.644 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:46:04.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:46:04.707 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-06-20T13:46:05.415 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:46:05.432 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:46:05.434 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:46:05.438 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:46:05.439 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:46:06.189 INFO:teuthology.orchestra.run.smithi032.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-20T13:46:06.204 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/015 2023-06-20T13:46:06.204 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/015 2023-06-20T13:46:06.205 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:46:06.213 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:46:06.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:46:06.275 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-06-20T13:46:06.983 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:46:07.002 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:46:07.005 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:46:07.010 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:46:07.010 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:46:08.097 INFO:teuthology.orchestra.run.smithi032.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-20T13:46:08.112 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/016 2023-06-20T13:46:08.113 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/016 2023-06-20T13:46:08.114 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:46:08.124 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:46:08.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:46:08.293 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-06-20T13:46:09.104 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:46:09.121 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:46:09.123 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:46:09.126 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:46:09.126 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:46:09.956 INFO:teuthology.orchestra.run.smithi032.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-20T13:46:09.970 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/017 2023-06-20T13:46:09.971 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/017 2023-06-20T13:46:09.971 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:46:09.979 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:46:10.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:46:10.044 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-06-20T13:46:10.749 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:46:10.769 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:46:10.770 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:46:10.773 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:46:10.773 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:46:11.781 INFO:teuthology.orchestra.run.smithi032.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-06-20T13:46:11.814 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/018 2023-06-20T13:46:11.814 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/018 2023-06-20T13:46:11.815 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:46:11.824 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:46:11.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:46:11.877 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-06-20T13:46:12.601 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:46:12.624 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:46:12.625 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:46:12.628 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:46:12.628 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:46:13.415 INFO:teuthology.orchestra.run.smithi032.stdout:generic/019 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2023-06-20T13:46:13.429 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/019 2023-06-20T13:46:13.430 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/019 2023-06-20T13:46:13.430 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:46:13.440 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:46:13.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:46:13.489 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-06-20T13:46:14.215 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:46:14.234 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:46:14.236 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:46:14.239 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:46:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:46:17.191 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:46:17.199 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:46:24.374 INFO:teuthology.orchestra.run.smithi032.stdout:generic/020 10s 2023-06-20T13:46:24.392 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/020 2023-06-20T13:46:24.392 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:46:24.401 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:46:24.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:46:24.534 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-06-20T13:46:25.359 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:46:25.383 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:46:25.385 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:46:25.388 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:46:25.389 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:46:26.434 INFO:teuthology.orchestra.run.smithi032.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-20T13:46:26.451 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/021 2023-06-20T13:46:26.451 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/021 2023-06-20T13:46:26.451 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:46:26.463 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:46:26.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:46:26.590 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-06-20T13:46:27.436 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:46:27.458 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:46:27.459 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:46:27.462 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:46:27.463 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:46:28.505 INFO:teuthology.orchestra.run.smithi032.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-20T13:46:28.520 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/022 2023-06-20T13:46:28.520 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/022 2023-06-20T13:46:28.521 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:46:28.535 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:46:28.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:46:28.664 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-06-20T13:46:29.502 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:46:29.531 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:46:29.532 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:46:29.537 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:46:29.537 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:46:47.347 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:46:47.353 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:47:15.836 INFO:teuthology.orchestra.run.smithi032.stdout:generic/023 46s 2023-06-20T13:47:15.859 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/023 2023-06-20T13:47:15.859 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:47:15.868 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:47:16.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:47:16.022 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-06-20T13:47:16.825 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:47:16.842 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:47:16.843 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:47:16.846 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:47:16.846 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:47:17.720 INFO:teuthology.orchestra.run.smithi032.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-06-20T13:47:17.736 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/024 2023-06-20T13:47:17.737 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/024 2023-06-20T13:47:17.737 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:47:17.748 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:47:17.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:47:17.900 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-06-20T13:47:18.194 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:47:18.202 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:47:18.759 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:47:18.781 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:47:18.782 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:47:18.786 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:47:18.786 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:47:19.603 INFO:teuthology.orchestra.run.smithi032.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-06-20T13:47:19.618 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/025 2023-06-20T13:47:19.619 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/025 2023-06-20T13:47:19.619 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:47:19.629 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:47:19.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:47:19.749 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-06-20T13:47:20.583 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:47:20.604 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:47:20.605 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:47:20.609 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:47:20.609 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:47:21.448 INFO:teuthology.orchestra.run.smithi032.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-06-20T13:47:21.464 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/026 2023-06-20T13:47:21.465 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/026 2023-06-20T13:47:21.465 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:47:21.477 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:47:21.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:47:21.549 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-06-20T13:47:22.265 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:47:22.287 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:47:22.289 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:47:22.293 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:47:22.293 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:47:23.062 INFO:teuthology.orchestra.run.smithi032.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-20T13:47:23.077 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/027 2023-06-20T13:47:23.077 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/027 2023-06-20T13:47:23.077 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:47:23.087 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:47:23.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:47:23.156 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-06-20T13:47:23.878 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:47:23.905 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:47:23.906 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:47:23.910 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:47:23.910 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:47:29.736 INFO:teuthology.orchestra.run.smithi032.stdout:generic/028 5s 2023-06-20T13:47:29.759 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/028 2023-06-20T13:47:29.760 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:47:29.768 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:47:29.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:47:29.840 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-06-20T13:47:30.542 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:47:30.558 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:47:30.563 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:47:30.566 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:47:30.567 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:47:33.070 INFO:teuthology.orchestra.run.smithi032.stdout:generic/029 3s 2023-06-20T13:47:33.083 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/029 2023-06-20T13:47:33.083 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:47:33.089 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:47:33.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:47:33.109 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-06-20T13:47:33.563 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:47:33.575 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:47:33.576 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:47:33.579 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:47:33.579 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:47:35.139 INFO:teuthology.orchestra.run.smithi032.stdout:generic/030 2s 2023-06-20T13:47:35.152 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/030 2023-06-20T13:47:35.152 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:47:35.158 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:47:35.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:47:35.178 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-06-20T13:47:35.630 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:47:35.643 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:47:35.644 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:47:35.647 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:47:35.647 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:47:36.265 INFO:teuthology.orchestra.run.smithi032.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-06-20T13:47:36.275 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/031 2023-06-20T13:47:36.276 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/031 2023-06-20T13:47:36.276 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:47:36.281 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:47:36.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:47:36.325 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-06-20T13:47:36.777 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:47:36.789 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:47:36.790 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:47:36.793 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:47:36.793 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:47:37.301 INFO:teuthology.orchestra.run.smithi032.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-20T13:47:37.311 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/032 2023-06-20T13:47:37.311 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/032 2023-06-20T13:47:37.311 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:47:37.317 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:47:37.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:47:37.353 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-06-20T13:47:37.803 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:47:37.815 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:47:37.816 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:47:37.819 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:47:37.819 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:47:38.437 INFO:teuthology.orchestra.run.smithi032.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-20T13:47:38.446 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/033 2023-06-20T13:47:38.447 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/033 2023-06-20T13:47:38.447 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:47:38.452 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:47:38.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:47:38.497 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-06-20T13:47:38.943 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:47:38.955 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:47:38.956 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:47:38.959 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:47:38.959 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:47:39.480 INFO:teuthology.orchestra.run.smithi032.stdout:generic/034 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2023-06-20T13:47:39.491 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/034 2023-06-20T13:47:39.491 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/034 2023-06-20T13:47:39.491 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:47:39.497 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:47:39.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:47:39.531 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-06-20T13:47:39.978 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:47:39.990 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:47:39.992 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:47:39.994 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:47:39.994 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:47:40.585 INFO:teuthology.orchestra.run.smithi032.stdout:generic/035 0s 2023-06-20T13:47:40.598 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/035 2023-06-20T13:47:40.598 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:47:40.604 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:47:40.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:47:40.795 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-06-20T13:47:41.374 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:47:41.386 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:47:41.387 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:47:41.390 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:47:41.390 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:47:48.345 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:47:48.351 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:47:52.030 INFO:teuthology.orchestra.run.smithi032.stdout:generic/036 11s 2023-06-20T13:47:52.039 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/036 2023-06-20T13:47:52.039 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:47:52.045 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:47:52.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:47:52.180 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-06-20T13:47:52.815 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:47:52.828 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:47:52.829 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:47:52.831 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:47:52.831 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:00.142 INFO:teuthology.orchestra.run.smithi032.stdout:generic/037 7s 2023-06-20T13:48:00.155 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/037 2023-06-20T13:48:00.155 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:00.161 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:00.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:00.182 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-06-20T13:48:00.628 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:00.641 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:00.642 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:00.645 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:00.645 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:01.156 INFO:teuthology.orchestra.run.smithi032.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-20T13:48:01.166 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/038 2023-06-20T13:48:01.166 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/038 2023-06-20T13:48:01.166 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:01.172 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:01.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:01.212 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-06-20T13:48:01.663 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:01.675 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:01.677 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:01.679 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:01.680 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:02.210 INFO:teuthology.orchestra.run.smithi032.stdout:generic/039 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2023-06-20T13:48:02.220 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/039 2023-06-20T13:48:02.220 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/039 2023-06-20T13:48:02.220 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:02.226 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:02.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:02.266 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-06-20T13:48:02.714 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:02.727 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:02.728 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:02.730 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:02.730 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:03.278 INFO:teuthology.orchestra.run.smithi032.stdout:generic/040 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2023-06-20T13:48:03.287 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/040 2023-06-20T13:48:03.287 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/040 2023-06-20T13:48:03.288 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:03.293 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:03.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:03.331 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-06-20T13:48:03.784 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:03.796 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:03.797 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:03.800 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:03.800 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:04.344 INFO:teuthology.orchestra.run.smithi032.stdout:generic/041 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2023-06-20T13:48:04.354 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/041 2023-06-20T13:48:04.354 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/041 2023-06-20T13:48:04.354 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:04.360 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:04.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:04.402 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-06-20T13:48:04.851 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:04.864 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:04.865 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:04.867 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:04.867 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:05.539 INFO:teuthology.orchestra.run.smithi032.stdout:generic/042 [not run] ceph does not support shutdown 2023-06-20T13:48:05.568 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/042 2023-06-20T13:48:05.568 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/042 2023-06-20T13:48:05.568 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:05.574 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:05.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:05.612 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-06-20T13:48:06.060 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:06.072 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:06.073 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:06.076 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:06.076 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:06.733 INFO:teuthology.orchestra.run.smithi032.stdout:generic/043 [not run] ceph does not support shutdown 2023-06-20T13:48:06.759 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/043 2023-06-20T13:48:06.759 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/043 2023-06-20T13:48:06.759 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:06.765 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:06.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:06.801 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-06-20T13:48:07.264 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:07.276 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:07.277 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:07.280 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:07.280 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:07.929 INFO:teuthology.orchestra.run.smithi032.stdout:generic/044 [not run] ceph does not support shutdown 2023-06-20T13:48:07.957 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/044 2023-06-20T13:48:07.958 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/044 2023-06-20T13:48:07.958 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:07.964 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:07.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:07.997 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-06-20T13:48:08.446 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:08.459 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:08.460 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:08.462 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:08.462 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:09.100 INFO:teuthology.orchestra.run.smithi032.stdout:generic/045 [not run] ceph does not support shutdown 2023-06-20T13:48:09.126 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/045 2023-06-20T13:48:09.127 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/045 2023-06-20T13:48:09.127 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:09.132 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:09.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:09.171 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-06-20T13:48:09.621 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:09.633 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:09.634 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:09.637 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:09.637 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:10.281 INFO:teuthology.orchestra.run.smithi032.stdout:generic/046 [not run] ceph does not support shutdown 2023-06-20T13:48:10.305 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/046 2023-06-20T13:48:10.305 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/046 2023-06-20T13:48:10.306 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:10.311 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:10.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:10.348 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-06-20T13:48:10.792 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:10.804 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:10.805 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:10.808 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:10.808 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:11.459 INFO:teuthology.orchestra.run.smithi032.stdout:generic/047 [not run] ceph does not support shutdown 2023-06-20T13:48:11.486 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/047 2023-06-20T13:48:11.486 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/047 2023-06-20T13:48:11.487 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:11.492 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:11.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:11.531 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-06-20T13:48:11.976 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:11.989 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:11.990 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:11.992 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:11.992 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:12.638 INFO:teuthology.orchestra.run.smithi032.stdout:generic/048 [not run] ceph does not support shutdown 2023-06-20T13:48:12.668 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/048 2023-06-20T13:48:12.668 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/048 2023-06-20T13:48:12.668 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:12.673 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:12.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:12.707 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-06-20T13:48:13.152 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:13.165 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:13.166 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:13.168 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:13.168 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:13.820 INFO:teuthology.orchestra.run.smithi032.stdout:generic/049 [not run] ceph does not support shutdown 2023-06-20T13:48:13.848 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/049 2023-06-20T13:48:13.849 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/049 2023-06-20T13:48:13.849 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:13.854 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:13.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:13.886 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-06-20T13:48:14.337 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:14.349 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:14.350 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:14.353 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:14.354 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:14.995 INFO:teuthology.orchestra.run.smithi032.stdout:generic/050 [not run] ceph does not support shutdown 2023-06-20T13:48:15.030 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/050 2023-06-20T13:48:15.031 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/050 2023-06-20T13:48:15.031 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:15.036 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:15.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:15.076 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-06-20T13:48:15.529 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:15.541 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:15.542 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:15.545 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:15.545 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:16.215 INFO:teuthology.orchestra.run.smithi032.stdout:generic/051 [not run] ceph does not support shutdown 2023-06-20T13:48:16.225 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/051 2023-06-20T13:48:16.225 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/051 2023-06-20T13:48:16.225 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:16.231 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:16.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:16.277 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-06-20T13:48:16.729 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:16.741 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:16.742 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:16.745 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:16.745 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:17.387 INFO:teuthology.orchestra.run.smithi032.stdout:generic/052 [not run] ceph does not support shutdown 2023-06-20T13:48:17.411 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/052 2023-06-20T13:48:17.412 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/052 2023-06-20T13:48:17.412 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:17.417 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:17.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:17.456 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-06-20T13:48:17.906 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:17.918 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:17.919 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:17.922 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:17.923 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:18.471 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:48:18.476 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:48:19.099 INFO:teuthology.orchestra.run.smithi032.stdout:generic/053 1s 2023-06-20T13:48:19.142 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/053 2023-06-20T13:48:19.142 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:19.149 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:19.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:19.196 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-06-20T13:48:19.668 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:19.680 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:19.681 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:19.684 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:19.684 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:20.358 INFO:teuthology.orchestra.run.smithi032.stdout:generic/054 [not run] ceph does not support shutdown 2023-06-20T13:48:20.390 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/054 2023-06-20T13:48:20.391 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/054 2023-06-20T13:48:20.391 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:20.397 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:20.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:20.432 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-06-20T13:48:20.887 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:20.899 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:20.901 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:20.903 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:20.903 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:21.567 INFO:teuthology.orchestra.run.smithi032.stdout:generic/055 [not run] ceph does not support shutdown 2023-06-20T13:48:21.591 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/055 2023-06-20T13:48:21.592 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/055 2023-06-20T13:48:21.592 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:21.597 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:21.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:21.634 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-06-20T13:48:22.083 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:22.096 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:22.097 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:22.099 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:22.100 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:22.648 INFO:teuthology.orchestra.run.smithi032.stdout:generic/056 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2023-06-20T13:48:22.658 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/056 2023-06-20T13:48:22.658 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/056 2023-06-20T13:48:22.658 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:22.663 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:22.700 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:22.702 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-06-20T13:48:23.150 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:23.191 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:23.192 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:23.192 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:23.192 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:23.706 INFO:teuthology.orchestra.run.smithi032.stdout:generic/057 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2023-06-20T13:48:23.717 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/057 2023-06-20T13:48:23.717 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/057 2023-06-20T13:48:23.717 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:23.722 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:23.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:23.762 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-06-20T13:48:24.212 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:24.225 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:24.226 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:24.229 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:24.229 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:24.878 INFO:teuthology.orchestra.run.smithi032.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-20T13:48:24.888 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/058 2023-06-20T13:48:24.888 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/058 2023-06-20T13:48:24.889 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:24.894 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:25.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:25.020 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-06-20T13:48:25.643 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:25.656 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:25.657 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:25.659 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:25.659 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:26.181 INFO:teuthology.orchestra.run.smithi032.stdout:generic/059 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2023-06-20T13:48:26.191 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/059 2023-06-20T13:48:26.192 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/059 2023-06-20T13:48:26.192 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:26.197 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:26.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:26.244 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-06-20T13:48:26.697 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:26.709 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:26.710 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:26.713 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:26.713 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:27.375 INFO:teuthology.orchestra.run.smithi032.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-20T13:48:27.385 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/060 2023-06-20T13:48:27.385 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/060 2023-06-20T13:48:27.385 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:27.391 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:27.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:27.513 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-06-20T13:48:28.163 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:28.175 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:28.176 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:28.179 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:28.179 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:28.837 INFO:teuthology.orchestra.run.smithi032.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-20T13:48:28.847 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/061 2023-06-20T13:48:28.847 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/061 2023-06-20T13:48:28.848 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:28.853 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:28.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:28.990 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-06-20T13:48:29.639 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:29.651 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:29.652 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:29.655 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:29.655 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:32.276 INFO:teuthology.orchestra.run.smithi032.stdout:generic/062 3s 2023-06-20T13:48:32.333 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/062 2023-06-20T13:48:32.333 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:32.355 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:32.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:32.417 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-06-20T13:48:32.961 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:32.974 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:32.975 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:32.977 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:32.977 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:33.701 INFO:teuthology.orchestra.run.smithi032.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-20T13:48:33.710 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/063 2023-06-20T13:48:33.710 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/063 2023-06-20T13:48:33.711 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:33.717 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:33.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:33.842 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-06-20T13:48:34.478 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:34.496 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:34.497 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:34.500 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:34.500 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:35.032 INFO:teuthology.orchestra.run.smithi032.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-20T13:48:35.042 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/064 2023-06-20T13:48:35.042 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/064 2023-06-20T13:48:35.043 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:35.048 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:35.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:35.097 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-06-20T13:48:35.550 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:35.562 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:35.563 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:35.566 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:35.566 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:36.103 INFO:teuthology.orchestra.run.smithi032.stdout:generic/065 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2023-06-20T13:48:36.114 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/065 2023-06-20T13:48:36.114 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/065 2023-06-20T13:48:36.114 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:36.119 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:36.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:36.161 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-06-20T13:48:36.617 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:36.630 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:36.631 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:36.633 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:36.634 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:37.154 INFO:teuthology.orchestra.run.smithi032.stdout:generic/066 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2023-06-20T13:48:37.164 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/066 2023-06-20T13:48:37.164 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/066 2023-06-20T13:48:37.164 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:37.170 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:37.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:37.205 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-06-20T13:48:37.657 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:37.669 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:37.670 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:37.673 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:37.673 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:38.257 INFO:teuthology.orchestra.run.smithi032.stdout:generic/067 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2023-06-20T13:48:38.267 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/067 2023-06-20T13:48:38.268 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/067 2023-06-20T13:48:38.268 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:38.274 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:38.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:38.319 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-06-20T13:48:38.777 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:38.789 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:38.790 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:38.793 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:38.793 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:39.336 INFO:teuthology.orchestra.run.smithi032.stdout:generic/068 [not run] ceph does not support freezing 2023-06-20T13:48:39.346 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/068 2023-06-20T13:48:39.346 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/068 2023-06-20T13:48:39.346 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:48:39.352 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:39.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:48:39.394 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-06-20T13:48:39.847 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:48:39.859 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:48:39.860 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:48:39.863 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:48:39.863 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:48:48.593 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:48:48.599 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:49:00.856 INFO:teuthology.orchestra.run.smithi032.stdout:generic/069 20s 2023-06-20T13:49:00.914 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/069 2023-06-20T13:49:00.914 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:49:00.944 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:49:00.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:49:00.988 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-06-20T13:49:01.452 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:49:01.464 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:49:01.465 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:49:01.468 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:49:01.468 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:49:18.705 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:49:18.711 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:49:23.523 INFO:teuthology.orchestra.run.smithi032.stdout:generic/070 22s 2023-06-20T13:49:23.535 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/070 2023-06-20T13:49:23.535 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:49:23.541 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:49:23.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:49:23.811 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-06-20T13:49:24.611 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:49:24.630 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:49:24.632 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:49:24.635 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:49:24.635 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:49:25.426 INFO:teuthology.orchestra.run.smithi032.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-20T13:49:25.441 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/071 2023-06-20T13:49:25.443 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/071 2023-06-20T13:49:25.443 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:49:25.452 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:49:25.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:49:25.523 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-06-20T13:49:26.262 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:49:26.284 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:49:26.285 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:49:26.289 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:49:26.289 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:49:27.244 INFO:teuthology.orchestra.run.smithi032.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-06-20T13:49:27.260 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/072 2023-06-20T13:49:27.261 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/072 2023-06-20T13:49:27.261 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:49:27.271 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:49:27.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:49:27.335 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-06-20T13:49:28.063 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:49:28.081 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:49:28.083 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:49:28.087 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:49:28.087 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:49:28.870 INFO:teuthology.orchestra.run.smithi032.stdout:generic/073 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2023-06-20T13:49:28.885 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/073 2023-06-20T13:49:28.886 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/073 2023-06-20T13:49:28.886 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:49:28.894 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:49:28.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:49:28.947 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-06-20T13:49:29.682 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:49:29.707 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:49:29.709 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:49:29.713 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:49:29.713 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:49:49.033 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:49:49.040 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:50:17.145 INFO:teuthology.orchestra.run.smithi032.stdout:generic/074 48s 2023-06-20T13:50:17.162 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/074 2023-06-20T13:50:17.162 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:50:17.171 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:50:18.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:50:18.214 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-06-20T13:50:19.085 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:50:19.107 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:50:19.108 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:50:19.111 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:50:19.111 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:50:19.413 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:50:19.419 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:50:19.721 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-06-20T13:50:19.719+0000 7ff85a9f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 119870) UID: 0 2023-06-20T13:50:19.722 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-06-20T13:50:19.719+0000 7fa4293f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 119870) UID: 0 2023-06-20T13:50:55.679 INFO:teuthology.orchestra.run.smithi032.stdout:generic/075 36s 2023-06-20T13:50:57.030 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/075 2023-06-20T13:50:57.030 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:50:57.042 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:50:57.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:50:57.147 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-06-20T13:50:58.040 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:50:58.057 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:50:58.058 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:50:58.062 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:50:58.062 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:50:58.830 INFO:teuthology.orchestra.run.smithi032.stdout:generic/076 [not run] require 172.21.15.32:6789:/scratch to be local device 2023-06-20T13:50:58.847 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/076 2023-06-20T13:50:58.847 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/076 2023-06-20T13:50:58.847 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:50:58.856 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:50:58.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:50:58.911 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-06-20T13:50:59.599 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:50:59.614 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:50:59.617 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:50:59.619 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:50:59.619 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:51:01.423 INFO:teuthology.orchestra.run.smithi032.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-20T13:51:01.438 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/077 2023-06-20T13:51:01.438 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/077 2023-06-20T13:51:01.438 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:51:01.448 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:51:01.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:51:01.605 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-06-20T13:51:02.479 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:51:02.498 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:51:02.500 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:51:02.505 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:51:02.505 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:51:03.354 INFO:teuthology.orchestra.run.smithi032.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-06-20T13:51:03.366 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/078 2023-06-20T13:51:03.367 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/078 2023-06-20T13:51:03.367 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:51:03.374 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:51:03.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:51:03.493 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-06-20T13:51:04.366 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:51:04.386 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:51:04.388 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:51:04.391 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:51:04.391 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:51:05.217 INFO:teuthology.orchestra.run.smithi032.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-06-20T13:51:05.233 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/079 2023-06-20T13:51:05.233 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/079 2023-06-20T13:51:05.233 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:51:05.242 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:51:05.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:51:05.313 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-06-20T13:51:06.023 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:51:06.045 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:51:06.047 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:51:06.050 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:51:06.051 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:51:08.920 INFO:teuthology.orchestra.run.smithi032.stdout:generic/080 2s 2023-06-20T13:51:08.937 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/080 2023-06-20T13:51:08.937 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:51:08.944 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:51:09.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:51:09.027 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-06-20T13:51:09.713 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:51:09.736 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:51:09.737 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:51:09.740 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:51:09.741 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:51:10.542 INFO:teuthology.orchestra.run.smithi032.stdout:generic/081 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2023-06-20T13:51:10.564 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/081 2023-06-20T13:51:10.565 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/081 2023-06-20T13:51:10.565 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:51:10.571 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:51:10.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:51:10.623 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-06-20T13:51:11.318 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:51:11.347 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:51:11.348 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:51:11.352 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:51:11.352 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:51:12.159 INFO:teuthology.orchestra.run.smithi032.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-20T13:51:12.174 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/082 2023-06-20T13:51:12.174 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/082 2023-06-20T13:51:12.174 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:51:12.180 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:51:12.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:51:12.244 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-06-20T13:51:12.948 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:51:12.971 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:51:12.973 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:51:12.976 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:51:12.977 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:51:13.735 INFO:teuthology.orchestra.run.smithi032.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-20T13:51:13.747 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/083 2023-06-20T13:51:13.748 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/083 2023-06-20T13:51:13.748 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:51:13.757 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:51:13.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:51:13.831 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-06-20T13:51:14.634 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:51:14.646 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:51:14.647 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:51:14.649 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:51:14.650 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:51:16.058 INFO:tasks.ceph.mds.d.smithi115.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4512-g2016e3af/rpm/el8/BUILD/ceph-18.0.0-4512-g2016e3af/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7fa421bea700 time 2023-06-20T13:51:16.058175+0000 2023-06-20T13:51:16.059 INFO:tasks.ceph.mds.d.smithi115.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4512-g2016e3af/rpm/el8/BUILD/ceph-18.0.0-4512-g2016e3af/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-06-20T13:51:16.638 INFO:tasks.ceph.mds.d.smithi115.stderr: ceph version 18.0.0-4512-g2016e3af (2016e3af238feea2bbee7eb0e99c925a041afbfb) reef (dev) 2023-06-20T13:51:16.638 INFO:tasks.ceph.mds.d.smithi115.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fa4380a9dbf] 2023-06-20T13:51:16.638 INFO:tasks.ceph.mds.d.smithi115.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a9f85) [0x7fa4380a9f85] 2023-06-20T13:51:16.638 INFO:tasks.ceph.mds.d.smithi115.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x5633fb31a032] 2023-06-20T13:51:16.638 INFO:tasks.ceph.mds.d.smithi115.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x5633fb301f4c] 2023-06-20T13:51:16.639 INFO:tasks.ceph.mds.d.smithi115.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x5633fb30ad87] 2023-06-20T13:51:16.639 INFO:tasks.ceph.mds.d.smithi115.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x5633fb30f5ff] 2023-06-20T13:51:16.639 INFO:tasks.ceph.mds.d.smithi115.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x5633fb161137] 2023-06-20T13:51:16.639 INFO:tasks.ceph.mds.d.smithi115.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x5633fb161fe0] 2023-06-20T13:51:16.639 INFO:tasks.ceph.mds.d.smithi115.stderr: 9: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x5633fb163ee5] 2023-06-20T13:51:16.639 INFO:tasks.ceph.mds.d.smithi115.stderr: 10: (C_MDS_link_local_finish::finish(int)+0x35) [0x5633fb1ea5b5] 2023-06-20T13:51:16.639 INFO:tasks.ceph.mds.d.smithi115.stderr: 11: (MDSContext::complete(int)+0x5f) [0x5633fb448d7f] 2023-06-20T13:51:16.640 INFO:tasks.ceph.mds.d.smithi115.stderr: 12: (MDSIOContextBase::complete(int)+0x524) [0x5633fb449504] 2023-06-20T13:51:16.640 INFO:tasks.ceph.mds.d.smithi115.stderr: 13: (MDSLogContextBase::complete(int)+0x5b) [0x5633fb4498bb] 2023-06-20T13:51:16.640 INFO:tasks.ceph.mds.d.smithi115.stderr: 14: (Finisher::finisher_thread_entry()+0x18d) [0x7fa43814d87d] 2023-06-20T13:51:16.640 INFO:tasks.ceph.mds.d.smithi115.stderr: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fa4364081ca] 2023-06-20T13:51:16.640 INFO:tasks.ceph.mds.d.smithi115.stderr: 16: clone() 2023-06-20T13:51:16.640 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-06-20T13:51:16.635+0000 7fa421bea700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4512-g2016e3af/rpm/el8/BUILD/ceph-18.0.0-4512-g2016e3af/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7fa421bea700 time 2023-06-20T13:51:16.058175+0000 2023-06-20T13:51:16.640 INFO:tasks.ceph.mds.d.smithi115.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4512-g2016e3af/rpm/el8/BUILD/ceph-18.0.0-4512-g2016e3af/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-06-20T13:51:16.641 INFO:tasks.ceph.mds.d.smithi115.stderr: 2023-06-20T13:51:16.641 INFO:tasks.ceph.mds.d.smithi115.stderr: ceph version 18.0.0-4512-g2016e3af (2016e3af238feea2bbee7eb0e99c925a041afbfb) reef (dev) 2023-06-20T13:51:16.641 INFO:tasks.ceph.mds.d.smithi115.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fa4380a9dbf] 2023-06-20T13:51:16.641 INFO:tasks.ceph.mds.d.smithi115.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a9f85) [0x7fa4380a9f85] 2023-06-20T13:51:16.641 INFO:tasks.ceph.mds.d.smithi115.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x5633fb31a032] 2023-06-20T13:51:16.641 INFO:tasks.ceph.mds.d.smithi115.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x5633fb301f4c] 2023-06-20T13:51:16.641 INFO:tasks.ceph.mds.d.smithi115.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x5633fb30ad87] 2023-06-20T13:51:16.641 INFO:tasks.ceph.mds.d.smithi115.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x5633fb30f5ff] 2023-06-20T13:51:16.642 INFO:tasks.ceph.mds.d.smithi115.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x5633fb161137] 2023-06-20T13:51:16.642 INFO:tasks.ceph.mds.d.smithi115.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x5633fb161fe0] 2023-06-20T13:51:16.642 INFO:tasks.ceph.mds.d.smithi115.stderr: 9: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x5633fb163ee5] 2023-06-20T13:51:16.642 INFO:tasks.ceph.mds.d.smithi115.stderr: 10: (C_MDS_link_local_finish::finish(int)+0x35) [0x5633fb1ea5b5] 2023-06-20T13:51:16.642 INFO:tasks.ceph.mds.d.smithi115.stderr: 11: (MDSContext::complete(int)+0x5f) [0x5633fb448d7f] 2023-06-20T13:51:16.642 INFO:tasks.ceph.mds.d.smithi115.stderr: 12: (MDSIOContextBase::complete(int)+0x524) [0x5633fb449504] 2023-06-20T13:51:16.642 INFO:tasks.ceph.mds.d.smithi115.stderr: 13: (MDSLogContextBase::complete(int)+0x5b) [0x5633fb4498bb] 2023-06-20T13:51:16.642 INFO:tasks.ceph.mds.d.smithi115.stderr: 14: (Finisher::finisher_thread_entry()+0x18d) [0x7fa43814d87d] 2023-06-20T13:51:16.643 INFO:tasks.ceph.mds.d.smithi115.stderr: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fa4364081ca] 2023-06-20T13:51:16.643 INFO:tasks.ceph.mds.d.smithi115.stderr: 16: clone() 2023-06-20T13:51:16.643 INFO:tasks.ceph.mds.d.smithi115.stderr: 2023-06-20T13:51:16.643 INFO:tasks.ceph.mds.d.smithi115.stderr:*** Caught signal (Aborted) ** 2023-06-20T13:51:16.643 INFO:tasks.ceph.mds.d.smithi115.stderr: in thread 7fa421bea700 thread_name:MR_Finisher 2023-06-20T13:51:16.644 INFO:tasks.ceph.mds.d.smithi115.stderr: ceph version 18.0.0-4512-g2016e3af (2016e3af238feea2bbee7eb0e99c925a041afbfb) reef (dev) 2023-06-20T13:51:16.644 INFO:tasks.ceph.mds.d.smithi115.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fa436412cf0] 2023-06-20T13:51:16.644 INFO:tasks.ceph.mds.d.smithi115.stderr: 2: gsignal() 2023-06-20T13:51:16.644 INFO:tasks.ceph.mds.d.smithi115.stderr: 3: abort() 2023-06-20T13:51:16.644 INFO:tasks.ceph.mds.d.smithi115.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fa4380a9e19] 2023-06-20T13:51:16.644 INFO:tasks.ceph.mds.d.smithi115.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a9f85) [0x7fa4380a9f85] 2023-06-20T13:51:16.645 INFO:tasks.ceph.mds.d.smithi115.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x5633fb31a032] 2023-06-20T13:51:16.645 INFO:tasks.ceph.mds.d.smithi115.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x5633fb301f4c] 2023-06-20T13:51:16.645 INFO:tasks.ceph.mds.d.smithi115.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x5633fb30ad87] 2023-06-20T13:51:16.645 INFO:tasks.ceph.mds.d.smithi115.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x5633fb30f5ff] 2023-06-20T13:51:16.645 INFO:tasks.ceph.mds.d.smithi115.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x5633fb161137] 2023-06-20T13:51:16.645 INFO:tasks.ceph.mds.d.smithi115.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x5633fb161fe0] 2023-06-20T13:51:16.645 INFO:tasks.ceph.mds.d.smithi115.stderr: 12: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x5633fb163ee5] 2023-06-20T13:51:16.646 INFO:tasks.ceph.mds.d.smithi115.stderr: 13: (C_MDS_link_local_finish::finish(int)+0x35) [0x5633fb1ea5b5] 2023-06-20T13:51:16.646 INFO:tasks.ceph.mds.d.smithi115.stderr: 14: (MDSContext::complete(int)+0x5f) [0x5633fb448d7f] 2023-06-20T13:51:16.646 INFO:tasks.ceph.mds.d.smithi115.stderr: 15: (MDSIOContextBase::complete(int)+0x524) [0x5633fb449504] 2023-06-20T13:51:16.646 INFO:tasks.ceph.mds.d.smithi115.stderr: 16: (MDSLogContextBase::complete(int)+0x5b) [0x5633fb4498bb] 2023-06-20T13:51:16.646 INFO:tasks.ceph.mds.d.smithi115.stderr: 17: (Finisher::finisher_thread_entry()+0x18d) [0x7fa43814d87d] 2023-06-20T13:51:16.646 INFO:tasks.ceph.mds.d.smithi115.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fa4364081ca] 2023-06-20T13:51:16.646 INFO:tasks.ceph.mds.d.smithi115.stderr: 19: clone() 2023-06-20T13:51:16.646 INFO:tasks.ceph.mds.d.smithi115.stderr:2023-06-20T13:51:16.638+0000 7fa421bea700 -1 *** Caught signal (Aborted) ** 2023-06-20T13:51:16.647 INFO:tasks.ceph.mds.d.smithi115.stderr: in thread 7fa421bea700 thread_name:MR_Finisher 2023-06-20T13:51:16.647 INFO:tasks.ceph.mds.d.smithi115.stderr: 2023-06-20T13:51:16.647 INFO:tasks.ceph.mds.d.smithi115.stderr: ceph version 18.0.0-4512-g2016e3af (2016e3af238feea2bbee7eb0e99c925a041afbfb) reef (dev) 2023-06-20T13:51:16.647 INFO:tasks.ceph.mds.d.smithi115.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fa436412cf0] 2023-06-20T13:51:16.647 INFO:tasks.ceph.mds.d.smithi115.stderr: 2: gsignal() 2023-06-20T13:51:16.647 INFO:tasks.ceph.mds.d.smithi115.stderr: 3: abort() 2023-06-20T13:51:16.647 INFO:tasks.ceph.mds.d.smithi115.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fa4380a9e19] 2023-06-20T13:51:16.647 INFO:tasks.ceph.mds.d.smithi115.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a9f85) [0x7fa4380a9f85] 2023-06-20T13:51:16.648 INFO:tasks.ceph.mds.d.smithi115.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x5633fb31a032] 2023-06-20T13:51:16.648 INFO:tasks.ceph.mds.d.smithi115.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x5633fb301f4c] 2023-06-20T13:51:16.648 INFO:tasks.ceph.mds.d.smithi115.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x5633fb30ad87] 2023-06-20T13:51:16.648 INFO:tasks.ceph.mds.d.smithi115.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x5633fb30f5ff] 2023-06-20T13:51:16.648 INFO:tasks.ceph.mds.d.smithi115.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x5633fb161137] 2023-06-20T13:51:16.648 INFO:tasks.ceph.mds.d.smithi115.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x5633fb161fe0] 2023-06-20T13:51:16.648 INFO:tasks.ceph.mds.d.smithi115.stderr: 12: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x5633fb163ee5] 2023-06-20T13:51:16.649 INFO:tasks.ceph.mds.d.smithi115.stderr: 13: (C_MDS_link_local_finish::finish(int)+0x35) [0x5633fb1ea5b5] 2023-06-20T13:51:16.649 INFO:tasks.ceph.mds.d.smithi115.stderr: 14: (MDSContext::complete(int)+0x5f) [0x5633fb448d7f] 2023-06-20T13:51:16.649 INFO:tasks.ceph.mds.d.smithi115.stderr: 15: (MDSIOContextBase::complete(int)+0x524) [0x5633fb449504] 2023-06-20T13:51:16.649 INFO:tasks.ceph.mds.d.smithi115.stderr: 16: (MDSLogContextBase::complete(int)+0x5b) [0x5633fb4498bb] 2023-06-20T13:51:16.649 INFO:tasks.ceph.mds.d.smithi115.stderr: 17: (Finisher::finisher_thread_entry()+0x18d) [0x7fa43814d87d] 2023-06-20T13:51:16.649 INFO:tasks.ceph.mds.d.smithi115.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fa4364081ca] 2023-06-20T13:51:16.649 INFO:tasks.ceph.mds.d.smithi115.stderr: 19: clone() 2023-06-20T13:51:16.649 INFO:tasks.ceph.mds.d.smithi115.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-06-20T13:51:16.650 INFO:tasks.ceph.mds.d.smithi115.stderr: 2023-06-20T13:51:16.667 INFO:tasks.ceph.mds.d.smithi115.stderr: -1> 2023-06-20T13:51:16.635+0000 7fa421bea700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4512-g2016e3af/rpm/el8/BUILD/ceph-18.0.0-4512-g2016e3af/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7fa421bea700 time 2023-06-20T13:51:16.058175+0000 2023-06-20T13:51:16.667 INFO:tasks.ceph.mds.d.smithi115.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4512-g2016e3af/rpm/el8/BUILD/ceph-18.0.0-4512-g2016e3af/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-06-20T13:51:16.667 INFO:tasks.ceph.mds.d.smithi115.stderr: 2023-06-20T13:51:16.667 INFO:tasks.ceph.mds.d.smithi115.stderr: ceph version 18.0.0-4512-g2016e3af (2016e3af238feea2bbee7eb0e99c925a041afbfb) reef (dev) 2023-06-20T13:51:16.668 INFO:tasks.ceph.mds.d.smithi115.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fa4380a9dbf] 2023-06-20T13:51:16.668 INFO:tasks.ceph.mds.d.smithi115.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a9f85) [0x7fa4380a9f85] 2023-06-20T13:51:16.668 INFO:tasks.ceph.mds.d.smithi115.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x5633fb31a032] 2023-06-20T13:51:16.668 INFO:tasks.ceph.mds.d.smithi115.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x5633fb301f4c] 2023-06-20T13:51:16.668 INFO:tasks.ceph.mds.d.smithi115.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x5633fb30ad87] 2023-06-20T13:51:16.668 INFO:tasks.ceph.mds.d.smithi115.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x5633fb30f5ff] 2023-06-20T13:51:16.668 INFO:tasks.ceph.mds.d.smithi115.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x5633fb161137] 2023-06-20T13:51:16.669 INFO:tasks.ceph.mds.d.smithi115.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x5633fb161fe0] 2023-06-20T13:51:16.669 INFO:tasks.ceph.mds.d.smithi115.stderr: 9: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x5633fb163ee5] 2023-06-20T13:51:16.669 INFO:tasks.ceph.mds.d.smithi115.stderr: 10: (C_MDS_link_local_finish::finish(int)+0x35) [0x5633fb1ea5b5] 2023-06-20T13:51:16.669 INFO:tasks.ceph.mds.d.smithi115.stderr: 11: (MDSContext::complete(int)+0x5f) [0x5633fb448d7f] 2023-06-20T13:51:16.669 INFO:tasks.ceph.mds.d.smithi115.stderr: 12: (MDSIOContextBase::complete(int)+0x524) [0x5633fb449504] 2023-06-20T13:51:16.669 INFO:tasks.ceph.mds.d.smithi115.stderr: 13: (MDSLogContextBase::complete(int)+0x5b) [0x5633fb4498bb] 2023-06-20T13:51:16.669 INFO:tasks.ceph.mds.d.smithi115.stderr: 14: (Finisher::finisher_thread_entry()+0x18d) [0x7fa43814d87d] 2023-06-20T13:51:16.669 INFO:tasks.ceph.mds.d.smithi115.stderr: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fa4364081ca] 2023-06-20T13:51:16.670 INFO:tasks.ceph.mds.d.smithi115.stderr: 16: clone() 2023-06-20T13:51:16.670 INFO:tasks.ceph.mds.d.smithi115.stderr: 2023-06-20T13:51:16.670 INFO:tasks.ceph.mds.d.smithi115.stderr: 0> 2023-06-20T13:51:16.638+0000 7fa421bea700 -1 *** Caught signal (Aborted) ** 2023-06-20T13:51:16.670 INFO:tasks.ceph.mds.d.smithi115.stderr: in thread 7fa421bea700 thread_name:MR_Finisher 2023-06-20T13:51:16.670 INFO:tasks.ceph.mds.d.smithi115.stderr: 2023-06-20T13:51:16.670 INFO:tasks.ceph.mds.d.smithi115.stderr: ceph version 18.0.0-4512-g2016e3af (2016e3af238feea2bbee7eb0e99c925a041afbfb) reef (dev) 2023-06-20T13:51:16.670 INFO:tasks.ceph.mds.d.smithi115.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fa436412cf0] 2023-06-20T13:51:16.671 INFO:tasks.ceph.mds.d.smithi115.stderr: 2: gsignal() 2023-06-20T13:51:16.671 INFO:tasks.ceph.mds.d.smithi115.stderr: 3: abort() 2023-06-20T13:51:16.671 INFO:tasks.ceph.mds.d.smithi115.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fa4380a9e19] 2023-06-20T13:51:16.671 INFO:tasks.ceph.mds.d.smithi115.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a9f85) [0x7fa4380a9f85] 2023-06-20T13:51:16.671 INFO:tasks.ceph.mds.d.smithi115.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x5633fb31a032] 2023-06-20T13:51:16.671 INFO:tasks.ceph.mds.d.smithi115.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x5633fb301f4c] 2023-06-20T13:51:16.671 INFO:tasks.ceph.mds.d.smithi115.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x5633fb30ad87] 2023-06-20T13:51:16.671 INFO:tasks.ceph.mds.d.smithi115.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x5633fb30f5ff] 2023-06-20T13:51:16.672 INFO:tasks.ceph.mds.d.smithi115.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x5633fb161137] 2023-06-20T13:51:16.672 INFO:tasks.ceph.mds.d.smithi115.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x5633fb161fe0] 2023-06-20T13:51:16.672 INFO:tasks.ceph.mds.d.smithi115.stderr: 12: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x5633fb163ee5] 2023-06-20T13:51:16.672 INFO:tasks.ceph.mds.d.smithi115.stderr: 13: (C_MDS_link_local_finish::finish(int)+0x35) [0x5633fb1ea5b5] 2023-06-20T13:51:16.672 INFO:tasks.ceph.mds.d.smithi115.stderr: 14: (MDSContext::complete(int)+0x5f) [0x5633fb448d7f] 2023-06-20T13:51:16.672 INFO:tasks.ceph.mds.d.smithi115.stderr: 15: (MDSIOContextBase::complete(int)+0x524) [0x5633fb449504] 2023-06-20T13:51:16.672 INFO:tasks.ceph.mds.d.smithi115.stderr: 16: (MDSLogContextBase::complete(int)+0x5b) [0x5633fb4498bb] 2023-06-20T13:51:16.672 INFO:tasks.ceph.mds.d.smithi115.stderr: 17: (Finisher::finisher_thread_entry()+0x18d) [0x7fa43814d87d] 2023-06-20T13:51:16.673 INFO:tasks.ceph.mds.d.smithi115.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fa4364081ca] 2023-06-20T13:51:16.673 INFO:tasks.ceph.mds.d.smithi115.stderr: 19: clone() 2023-06-20T13:51:16.673 INFO:tasks.ceph.mds.d.smithi115.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-06-20T13:51:16.673 INFO:tasks.ceph.mds.d.smithi115.stderr: 2023-06-20T13:51:16.682 INFO:tasks.ceph.mds.d.smithi115.stderr: -1> 2023-06-20T13:51:16.635+0000 7fa421bea700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4512-g2016e3af/rpm/el8/BUILD/ceph-18.0.0-4512-g2016e3af/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7fa421bea700 time 2023-06-20T13:51:16.058175+0000 2023-06-20T13:51:16.682 INFO:tasks.ceph.mds.d.smithi115.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4512-g2016e3af/rpm/el8/BUILD/ceph-18.0.0-4512-g2016e3af/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-06-20T13:51:16.682 INFO:tasks.ceph.mds.d.smithi115.stderr: 2023-06-20T13:51:16.682 INFO:tasks.ceph.mds.d.smithi115.stderr: ceph version 18.0.0-4512-g2016e3af (2016e3af238feea2bbee7eb0e99c925a041afbfb) reef (dev) 2023-06-20T13:51:16.683 INFO:tasks.ceph.mds.d.smithi115.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fa4380a9dbf] 2023-06-20T13:51:16.683 INFO:tasks.ceph.mds.d.smithi115.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a9f85) [0x7fa4380a9f85] 2023-06-20T13:51:16.683 INFO:tasks.ceph.mds.d.smithi115.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x5633fb31a032] 2023-06-20T13:51:16.683 INFO:tasks.ceph.mds.d.smithi115.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x5633fb301f4c] 2023-06-20T13:51:16.683 INFO:tasks.ceph.mds.d.smithi115.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x5633fb30ad87] 2023-06-20T13:51:16.683 INFO:tasks.ceph.mds.d.smithi115.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x5633fb30f5ff] 2023-06-20T13:51:16.683 INFO:tasks.ceph.mds.d.smithi115.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x5633fb161137] 2023-06-20T13:51:16.683 INFO:tasks.ceph.mds.d.smithi115.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x5633fb161fe0] 2023-06-20T13:51:16.684 INFO:tasks.ceph.mds.d.smithi115.stderr: 9: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x5633fb163ee5] 2023-06-20T13:51:16.684 INFO:tasks.ceph.mds.d.smithi115.stderr: 10: (C_MDS_link_local_finish::finish(int)+0x35) [0x5633fb1ea5b5] 2023-06-20T13:51:16.684 INFO:tasks.ceph.mds.d.smithi115.stderr: 11: (MDSContext::complete(int)+0x5f) [0x5633fb448d7f] 2023-06-20T13:51:16.684 INFO:tasks.ceph.mds.d.smithi115.stderr: 12: (MDSIOContextBase::complete(int)+0x524) [0x5633fb449504] 2023-06-20T13:51:16.684 INFO:tasks.ceph.mds.d.smithi115.stderr: 13: (MDSLogContextBase::complete(int)+0x5b) [0x5633fb4498bb] 2023-06-20T13:51:16.684 INFO:tasks.ceph.mds.d.smithi115.stderr: 14: (Finisher::finisher_thread_entry()+0x18d) [0x7fa43814d87d] 2023-06-20T13:51:16.684 INFO:tasks.ceph.mds.d.smithi115.stderr: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fa4364081ca] 2023-06-20T13:51:16.685 INFO:tasks.ceph.mds.d.smithi115.stderr: 16: clone() 2023-06-20T13:51:16.685 INFO:tasks.ceph.mds.d.smithi115.stderr: 2023-06-20T13:51:16.685 INFO:tasks.ceph.mds.d.smithi115.stderr: 0> 2023-06-20T13:51:16.638+0000 7fa421bea700 -1 *** Caught signal (Aborted) ** 2023-06-20T13:51:16.685 INFO:tasks.ceph.mds.d.smithi115.stderr: in thread 7fa421bea700 thread_name:MR_Finisher 2023-06-20T13:51:16.685 INFO:tasks.ceph.mds.d.smithi115.stderr: 2023-06-20T13:51:16.685 INFO:tasks.ceph.mds.d.smithi115.stderr: ceph version 18.0.0-4512-g2016e3af (2016e3af238feea2bbee7eb0e99c925a041afbfb) reef (dev) 2023-06-20T13:51:16.685 INFO:tasks.ceph.mds.d.smithi115.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fa436412cf0] 2023-06-20T13:51:16.685 INFO:tasks.ceph.mds.d.smithi115.stderr: 2: gsignal() 2023-06-20T13:51:16.686 INFO:tasks.ceph.mds.d.smithi115.stderr: 3: abort() 2023-06-20T13:51:16.686 INFO:tasks.ceph.mds.d.smithi115.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fa4380a9e19] 2023-06-20T13:51:16.686 INFO:tasks.ceph.mds.d.smithi115.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a9f85) [0x7fa4380a9f85] 2023-06-20T13:51:16.686 INFO:tasks.ceph.mds.d.smithi115.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x5633fb31a032] 2023-06-20T13:51:16.686 INFO:tasks.ceph.mds.d.smithi115.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x5633fb301f4c] 2023-06-20T13:51:16.686 INFO:tasks.ceph.mds.d.smithi115.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x5633fb30ad87] 2023-06-20T13:51:16.686 INFO:tasks.ceph.mds.d.smithi115.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x5633fb30f5ff] 2023-06-20T13:51:16.686 INFO:tasks.ceph.mds.d.smithi115.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x5633fb161137] 2023-06-20T13:51:16.687 INFO:tasks.ceph.mds.d.smithi115.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x5633fb161fe0] 2023-06-20T13:51:16.687 INFO:tasks.ceph.mds.d.smithi115.stderr: 12: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x5633fb163ee5] 2023-06-20T13:51:16.687 INFO:tasks.ceph.mds.d.smithi115.stderr: 13: (C_MDS_link_local_finish::finish(int)+0x35) [0x5633fb1ea5b5] 2023-06-20T13:51:16.687 INFO:tasks.ceph.mds.d.smithi115.stderr: 14: (MDSContext::complete(int)+0x5f) [0x5633fb448d7f] 2023-06-20T13:51:16.687 INFO:tasks.ceph.mds.d.smithi115.stderr: 15: (MDSIOContextBase::complete(int)+0x524) [0x5633fb449504] 2023-06-20T13:51:16.687 INFO:tasks.ceph.mds.d.smithi115.stderr: 16: (MDSLogContextBase::complete(int)+0x5b) [0x5633fb4498bb] 2023-06-20T13:51:16.687 INFO:tasks.ceph.mds.d.smithi115.stderr: 17: (Finisher::finisher_thread_entry()+0x18d) [0x7fa43814d87d] 2023-06-20T13:51:16.688 INFO:tasks.ceph.mds.d.smithi115.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fa4364081ca] 2023-06-20T13:51:16.688 INFO:tasks.ceph.mds.d.smithi115.stderr: 19: clone() 2023-06-20T13:51:16.688 INFO:tasks.ceph.mds.d.smithi115.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-06-20T13:51:16.688 INFO:tasks.ceph.mds.d.smithi115.stderr: 2023-06-20T13:51:19.800 INFO:tasks.ceph.mds.d.smithi115.stderr:daemon-helper: command crashed with signal 6 2023-06-20T13:51:26.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-06-20T13:51:33.304 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~7s 2023-06-20T13:51:39.913 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~13s 2023-06-20T13:51:44.862 INFO:teuthology.orchestra.run.smithi032.stdout:generic/084 30s 2023-06-20T13:51:44.955 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/084 2023-06-20T13:51:44.955 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:51:44.974 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:51:45.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:51:45.005 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-06-20T13:51:45.457 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:51:45.470 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:51:45.472 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:51:45.475 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:51:45.476 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:51:46.025 INFO:teuthology.orchestra.run.smithi032.stdout:generic/085 [not run] require 172.21.15.32:6789:/scratch to be valid block disk 2023-06-20T13:51:46.035 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/085 2023-06-20T13:51:46.035 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/085 2023-06-20T13:51:46.035 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:51:46.040 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:51:46.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:51:46.080 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-06-20T13:51:46.243 INFO:tasks.ceph.mds.a.smithi032.stderr:2023-06-20T13:51:46.242+0000 7fbfab7f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-20T13:51:46.525 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~20s 2023-06-20T13:51:46.537 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:51:46.550 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:51:46.551 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:51:46.553 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:51:46.554 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:51:47.068 INFO:teuthology.orchestra.run.smithi032.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-20T13:51:47.078 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/086 2023-06-20T13:51:47.079 INFO:teuthology.orchestra.run.smithi032.stdout:Not run: generic/086 2023-06-20T13:51:47.079 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:51:47.084 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:51:47.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:51:47.122 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-06-20T13:51:47.577 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:51:47.590 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:51:47.591 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:51:47.593 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:51:47.593 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:51:48.205 INFO:teuthology.orchestra.run.smithi032.stdout:generic/087 1s 2023-06-20T13:51:48.218 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/087 2023-06-20T13:51:48.218 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:51:48.224 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:51:48.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:51:48.380 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-06-20T13:51:49.033 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:51:49.045 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:51:49.046 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:51:49.048 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:51:49.049 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:51:49.612 INFO:teuthology.orchestra.run.smithi032.stdout:generic/088 0s 2023-06-20T13:51:49.625 INFO:teuthology.orchestra.run.smithi032.stdout:Ran: generic/088 2023-06-20T13:51:49.625 INFO:teuthology.orchestra.run.smithi032.stdout:Passed all 1 tests 2023-06-20T13:51:49.631 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:51:49.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-20T13:51:49.794 DEBUG:teuthology.orchestra.run.smithi032:> (cd /tmp/tmp.LENcwP3t9bxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-06-20T13:51:50.424 INFO:teuthology.orchestra.run.smithi032.stdout:FSTYP -- ceph 2023-06-20T13:51:50.437 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM -- Linux/x86_64 smithi032 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-20T13:51:50.438 INFO:teuthology.orchestra.run.smithi032.stdout:MKFS_OPTIONS -- 172.21.15.32:6789:/scratch 2023-06-20T13:51:50.440 INFO:teuthology.orchestra.run.smithi032.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAeqpFkjubHLBAAOMIXEAa+KdPvMV7klVsjfQ== -o context=system_u:object_r:root_t:s0 172.21.15.32:6789:/scratch /tmp/tmp.r67jCbZY4dscratch 2023-06-20T13:51:50.441 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:51:53.136 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~26s 2023-06-20T13:51:59.747 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~33s 2023-06-20T13:52:06.359 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~40s 2023-06-20T13:52:12.970 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~46s 2023-06-20T13:52:19.582 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~53s 2023-06-20T13:52:26.194 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~60s 2023-06-20T13:52:32.806 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~66s 2023-06-20T13:52:39.418 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~73s 2023-06-20T13:52:46.031 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~79s 2023-06-20T13:52:52.643 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~86s 2023-06-20T13:52:59.254 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~93s 2023-06-20T13:53:05.864 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~99s 2023-06-20T13:53:12.475 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~106s 2023-06-20T13:53:19.084 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~112s 2023-06-20T13:53:23.909 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:53:23.919 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:53:25.697 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~119s 2023-06-20T13:53:32.307 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~126s 2023-06-20T13:53:38.918 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~132s 2023-06-20T13:53:45.530 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~139s 2023-06-20T13:53:52.141 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~145s 2023-06-20T13:53:54.061 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:53:54.079 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:53:58.752 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~152s 2023-06-20T13:54:05.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~159s 2023-06-20T13:54:11.975 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~165s 2023-06-20T13:54:18.586 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~172s 2023-06-20T13:54:24.249 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:54:24.268 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:54:25.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~179s 2023-06-20T13:54:31.809 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~185s 2023-06-20T13:54:38.421 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~192s 2023-06-20T13:54:45.032 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~198s 2023-06-20T13:54:51.643 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~205s 2023-06-20T13:54:58.255 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~212s 2023-06-20T13:55:04.866 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~218s 2023-06-20T13:55:06.497 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:55:06.502 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:55:11.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~225s 2023-06-20T13:55:18.087 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~231s 2023-06-20T13:55:24.699 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~238s 2023-06-20T13:55:31.310 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~245s 2023-06-20T13:55:36.936 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:55:36.942 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:55:37.920 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~251s 2023-06-20T13:55:41.247 INFO:tasks.ceph.mds.a.smithi032.stderr:2023-06-20T13:55:41.247+0000 7fbfaf7f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 225843) UID: 0 2023-06-20T13:55:41.251 INFO:tasks.ceph.mds.c.smithi032.stderr:2023-06-20T13:55:41.248+0000 7fe62fdf9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 225843) UID: 0 2023-06-20T13:55:44.530 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~258s 2023-06-20T13:55:51.141 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~264s 2023-06-20T13:55:57.751 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~271s 2023-06-20T13:56:04.360 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~278s 2023-06-20T13:56:10.970 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~284s 2023-06-20T13:56:17.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~291s 2023-06-20T13:56:24.192 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~297s 2023-06-20T13:56:30.803 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~304s 2023-06-20T13:56:30.803 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-06-20T13:56:30.803 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:56:30.804 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-20T13:56:30.875 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:56:30.875 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-20T13:56:30.931 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-20T13:56:31.431 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.430+0000 7efefb3ff700 1 Processor -- start 2023-06-20T13:56:31.432 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.430+0000 7efefb3ff700 1 -- start start 2023-06-20T13:56:31.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.431+0000 7efefb3ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efef415c460 0x7efef40b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:31.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.431+0000 7efefb3ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efef40d2640 0x7efef40cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:31.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.431+0000 7efefb3ff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7efef40cf720 0x7efef40cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:31.433 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.431+0000 7efefb3ff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efef40cedd0 con 0x7efef40cf720 2023-06-20T13:56:31.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.431+0000 7efefb3ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efef40d1790 con 0x7efef40d2640 2023-06-20T13:56:31.434 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.431+0000 7efefb3ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef40cd950 con 0x7efef415c460 2023-06-20T13:56:31.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.432+0000 7efef999c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7efef40cf720 0x7efef40cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:31.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.432+0000 7efef999c700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7efef40cf720 0x7efef40cfbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35042/0 (socket says 172.21.15.32:35042) 2023-06-20T13:56:31.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.432+0000 7efef919b700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efef415c460 0x7efef40b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:31.435 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.432+0000 7efef999c700 1 -- 172.21.15.32:0/4244789653 learned_addr learned my addr 172.21.15.32:0/4244789653 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:56:31.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.432+0000 7efef899a700 1 --2- 172.21.15.32:0/4244789653 >> v2:172.21.15.115:3300/0 conn(0x7efef40d2640 0x7efef40cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:31.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.432+0000 7efef999c700 1 -- 172.21.15.32:0/4244789653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efef415c460 msgr2=0x7efef40b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:56:31.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.432+0000 7efef999c700 1 --2- 172.21.15.32:0/4244789653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efef415c460 0x7efef40b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:31.436 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.432+0000 7efef999c700 1 -- 172.21.15.32:0/4244789653 >> v2:172.21.15.115:3300/0 conn(0x7efef40d2640 msgr2=0x7efef40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:56:31.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.432+0000 7efef999c700 1 --2- 172.21.15.32:0/4244789653 >> v2:172.21.15.115:3300/0 conn(0x7efef40d2640 0x7efef40cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:31.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.432+0000 7efef999c700 1 -- 172.21.15.32:0/4244789653 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef40d14b0 con 0x7efef40cf720 2023-06-20T13:56:31.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.433+0000 7efef999c700 1 --2- 172.21.15.32:0/4244789653 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efef40cf720 0x7efef40cfbc0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7efef40d3c50 tx=0x7efeec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87eb380527ab1768 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:56:31.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.433+0000 7efeebfff700 1 -- 172.21.15.32:0/4244789653 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec00e070 con 0x7efef40cf720 2023-06-20T13:56:31.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.433+0000 7efeebfff700 1 -- 172.21.15.32:0/4244789653 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeec00b910 con 0x7efef40cf720 2023-06-20T13:56:31.437 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.433+0000 7efeebfff700 1 -- 172.21.15.32:0/4244789653 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec00bcc0 con 0x7efef40cf720 2023-06-20T13:56:31.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.434+0000 7efefb3ff700 1 -- 172.21.15.32:0/4244789653 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efef40cf720 msgr2=0x7efef40cfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:31.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.434+0000 7efefb3ff700 1 --2- 172.21.15.32:0/4244789653 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efef40cf720 0x7efef40cfbc0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7efef40d3c50 tx=0x7efeec00b330 comp rx=0 tx=0).stop 2023-06-20T13:56:31.438 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.434+0000 7efefb3ff700 1 -- 172.21.15.32:0/4244789653 shutdown_connections 2023-06-20T13:56:31.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.434+0000 7efefb3ff700 1 --2- 172.21.15.32:0/4244789653 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efef40cf720 0x7efef40cfbc0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:31.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.434+0000 7efefb3ff700 1 --2- 172.21.15.32:0/4244789653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efef415c460 0x7efef40b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:31.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.434+0000 7efefb3ff700 1 --2- 172.21.15.32:0/4244789653 >> v2:172.21.15.115:3300/0 conn(0x7efef40d2640 0x7efef40cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:31.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.434+0000 7efefb3ff700 1 -- 172.21.15.32:0/4244789653 >> 172.21.15.32:0/4244789653 conn(0x7efef4071660 msgr2=0x7efef4071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:56:31.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.434+0000 7efefb3ff700 1 -- 172.21.15.32:0/4244789653 shutdown_connections 2023-06-20T13:56:31.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.434+0000 7efefb3ff700 1 -- 172.21.15.32:0/4244789653 wait complete. 2023-06-20T13:56:31.439 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.437+0000 7efefb3ff700 1 Processor -- start 2023-06-20T13:56:31.440 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.437+0000 7efefb3ff700 1 -- start start 2023-06-20T13:56:31.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.438+0000 7efefb3ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efef40cf720 0x7efef41540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:31.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.438+0000 7efefb3ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efef40d2640 0x7efef41e7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:31.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.438+0000 7efefb3ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efef415c460 0x7efef415fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:31.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.438+0000 7efefb3ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef4154600 con 0x7efef415c460 2023-06-20T13:56:31.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.438+0000 7efefb3ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef415d5b0 con 0x7efef40d2640 2023-06-20T13:56:31.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.438+0000 7efefb3ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef415d890 con 0x7efef40cf720 2023-06-20T13:56:31.441 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.438+0000 7efef999c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efef415c460 0x7efef415fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:31.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.438+0000 7efef999c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efef415c460 0x7efef415fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35050/0 (socket says 172.21.15.32:35050) 2023-06-20T13:56:31.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.438+0000 7efef999c700 1 -- 172.21.15.32:0/2300230849 learned_addr learned my addr 172.21.15.32:0/2300230849 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:56:31.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.438+0000 7efef919b700 1 --2- 172.21.15.32:0/2300230849 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efef40cf720 0x7efef41540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:31.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.439+0000 7efef899a700 1 --2- 172.21.15.32:0/2300230849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efef40d2640 0x7efef41e7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:31.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.439+0000 7efef999c700 1 -- 172.21.15.32:0/2300230849 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efef40cf720 msgr2=0x7efef41540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:31.442 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.439+0000 7efef999c700 1 --2- 172.21.15.32:0/2300230849 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efef40cf720 0x7efef41540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:31.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.439+0000 7efef999c700 1 -- 172.21.15.32:0/2300230849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efef40d2640 msgr2=0x7efef41e7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:31.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.439+0000 7efef999c700 1 --2- 172.21.15.32:0/2300230849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efef40d2640 0x7efef41e7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:31.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.439+0000 7efef999c700 1 -- 172.21.15.32:0/2300230849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeec009b30 con 0x7efef415c460 2023-06-20T13:56:31.443 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.439+0000 7efef999c700 1 --2- 172.21.15.32:0/2300230849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efef415c460 0x7efef415fcf0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7efeec012000 tx=0x7efeec004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:56:31.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.440+0000 7efee9ffb700 1 -- 172.21.15.32:0/2300230849 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec0099b0 con 0x7efef415c460 2023-06-20T13:56:31.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.440+0000 7efee9ffb700 1 -- 172.21.15.32:0/2300230849 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeec00ce80 con 0x7efef415c460 2023-06-20T13:56:31.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.440+0000 7efee9ffb700 1 -- 172.21.15.32:0/2300230849 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec004490 con 0x7efef415c460 2023-06-20T13:56:31.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.440+0000 7efefb3ff700 1 -- 172.21.15.32:0/2300230849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efef415db70 con 0x7efef415c460 2023-06-20T13:56:31.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.440+0000 7efefb3ff700 1 -- 172.21.15.32:0/2300230849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efef415e130 con 0x7efef415c460 2023-06-20T13:56:31.444 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.441+0000 7efefb3ff700 1 -- 172.21.15.32:0/2300230849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efef404ea60 con 0x7efef415c460 2023-06-20T13:56:31.445 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.443+0000 7efee9ffb700 1 -- 172.21.15.32:0/2300230849 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efeec0045f0 con 0x7efef415c460 2023-06-20T13:56:31.446 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.445+0000 7efee9ffb700 1 --2- 172.21.15.32:0/2300230849 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7efed806ace0 0x7efed806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:31.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.445+0000 7efee9ffb700 1 -- 172.21.15.32:0/2300230849 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6526+0+0 (secure 0 0 0) 0x7efeec08abe0 con 0x7efef415c460 2023-06-20T13:56:31.447 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.445+0000 7efef919b700 1 --2- 172.21.15.32:0/2300230849 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7efed806ace0 0x7efed806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:31.448 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.446+0000 7efef919b700 1 --2- 172.21.15.32:0/2300230849 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7efed806ace0 0x7efed806d190 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efef0009b40 tx=0x7efef0009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:56:31.449 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.448+0000 7efee9ffb700 1 -- 172.21.15.32:0/2300230849 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efeec055c50 con 0x7efef415c460 2023-06-20T13:56:31.806 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.800+0000 7efefb3ff700 1 -- 172.21.15.32:0/2300230849 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efef40b4fa0 con 0x7efef415c460 2023-06-20T13:56:31.808 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.807+0000 7efee9ffb700 1 -- 172.21.15.32:0/2300230849 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+18759 (secure 0 0 0) 0x7efeec059270 con 0x7efef415c460 2023-06-20T13:56:31.821 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-20T13:56:31.821 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":44,"fsid":"8ec09bdb-4968-488f-bf51-7b0f1e92355f","created":"2023-06-20T13:31:51.979905+0000","modified":"2023-06-20T13:51:32.439292+0000","last_up_change":"2023-06-20T13:32:05.521263+0000","last_in_change":"2023-06-20T13:31:56.391375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-20T13:32:05.308022+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-20T13:32:12.857161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-06-20T13:34:02.254258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-06-20T13:34:03.489075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"06beff51-eef0-4858-98db-b93e76a3024e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6801","nonce":3795707735}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6805","nonce":3795707735}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6811","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6813","nonce":3795707735}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":3795707735},{"type":"v1","addr":"172.21.15.32:6809","nonce":3795707735}]},"public_addr":"172.21.15.32:6801/3795707735","cluster_addr":"172.21.15.32:6805/3795707735","heartbeat_back_addr":"172.21.15.32:6813/3795707735","heartbeat_front_addr":"172.21.15.32:6809/3795707735","state":["exists","up"]},{"osd":1,"uuid":"1d692926-34ad-4a3c-840d-78a47f84b527","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6825","nonce":2743925394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6827","nonce":2743925394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6831","nonce":2743925394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2743925394},{"type":"v1","addr":"172.21.15.32:6829","nonce":2743925394}]},"public_addr":"172.21.15.32:6825/2743925394","cluster_addr":"172.21.15.32:6827/2743925394","heartbeat_back_addr":"172.21.15.32:6831/2743925394","heartbeat_front_addr":"172.21.15.32:6829/2743925394","state":["exists","up"]},{"osd":2,"uuid":"14963a08-538e-4893-a4b5-b52d385489e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6804","nonce":253057972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6808","nonce":253057972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6815","nonce":253057972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":253057972},{"type":"v1","addr":"172.21.15.32:6812","nonce":253057972}]},"public_addr":"172.21.15.32:6804/253057972","cluster_addr":"172.21.15.32:6808/253057972","heartbeat_back_addr":"172.21.15.32:6815/253057972","heartbeat_front_addr":"172.21.15.32:6812/253057972","state":["exists","up"]},{"osd":3,"uuid":"2aa828fc-ed09-4aa4-bcb7-36007ab5d730","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6817","nonce":2342106296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6819","nonce":2342106296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6823","nonce":2342106296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2342106296},{"type":"v1","addr":"172.21.15.32:6821","nonce":2342106296}]},"public_addr":"172.21.15.32:6817/2342106296","cluster_addr":"172.21.15.32:6819/2342106296","heartbeat_back_addr":"172.21.15.32:6823/2342106296","heartbeat_front_addr":"172.21.15.32:6821/2342106296","state":["exists","up"]},{"osd":4,"uuid":"240d7e02-12ad-4700-a12d-c337cde8cfab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6801","nonce":1219874985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6803","nonce":1219874985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6807","nonce":1219874985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":1219874985},{"type":"v1","addr":"172.21.15.115:6805","nonce":1219874985}]},"public_addr":"172.21.15.115:6801/1219874985","cluster_addr":"172.21.15.115:6803/1219874985","heartbeat_back_addr":"172.21.15.115:6807/1219874985","heartbeat_front_addr":"172.21.15.115:6805/1219874985","state":["exists","up"]},{"osd":5,"uuid":"00276e97-2dce-4d81-8f9c-118a2db95a02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6817","nonce":121241249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6819","nonce":121241249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6824","nonce":121241249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":121241249},{"type":"v1","addr":"172.21.15.115:6821","nonce":121241249}]},"public_addr":"172.21.15.115:6817/121241249","cluster_addr":"172.21.15.115:6819/121241249","heartbeat_back_addr":"172.21.15.115:6824/121241249","heartbeat_front_addr":"172.21.15.115:6821/121241249","state":["exists","up"]},{"osd":6,"uuid":"c7699199-2e94-49d1-8473-ebb243767a94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6809","nonce":555708777}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6811","nonce":555708777}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6815","nonce":555708777}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":555708777},{"type":"v1","addr":"172.21.15.115:6813","nonce":555708777}]},"public_addr":"172.21.15.115:6809/555708777","cluster_addr":"172.21.15.115:6811/555708777","heartbeat_back_addr":"172.21.15.115:6815/555708777","heartbeat_front_addr":"172.21.15.115:6813/555708777","state":["exists","up"]},{"osd":7,"uuid":"835f84b1-3eed-44be-9c04-3b779a9dc7d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6823","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6825","nonce":2723705964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6827","nonce":2723705964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6831","nonce":2723705964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":2723705964},{"type":"v1","addr":"172.21.15.115:6829","nonce":2723705964}]},"public_addr":"172.21.15.115:6825/2723705964","cluster_addr":"172.21.15.115:6827/2723705964","heartbeat_back_addr":"172.21.15.115:6831/2723705964","heartbeat_front_addr":"172.21.15.115:6829/2723705964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.981167+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.001707+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.708892+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.709285+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.676035+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:02.044845+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.988636+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-20T13:32:01.747852+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.30","mappings":[{"from":0,"to":5}]},{"pgid":"7.35","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.115:6835/1096571469":"2023-06-21T13:51:32.439209+0000","172.21.15.115:6832/1096571469":"2023-06-21T13:51:32.439209+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-20T13:56:31.822 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.820+0000 7efefb3ff700 1 -- 172.21.15.32:0/2300230849 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7efed806ace0 msgr2=0x7efed806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:31.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.820+0000 7efefb3ff700 1 --2- 172.21.15.32:0/2300230849 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7efed806ace0 0x7efed806d190 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efef0009b40 tx=0x7efef0009210 comp rx=0 tx=0).stop 2023-06-20T13:56:31.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.820+0000 7efefb3ff700 1 -- 172.21.15.32:0/2300230849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efef415c460 msgr2=0x7efef415fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:31.823 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.820+0000 7efefb3ff700 1 --2- 172.21.15.32:0/2300230849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efef415c460 0x7efef415fcf0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7efeec012000 tx=0x7efeec004ad0 comp rx=0 tx=0).stop 2023-06-20T13:56:31.830 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.829+0000 7efefb3ff700 1 -- 172.21.15.32:0/2300230849 shutdown_connections 2023-06-20T13:56:31.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.829+0000 7efefb3ff700 1 --2- 172.21.15.32:0/2300230849 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7efed806ace0 0x7efed806d190 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:31.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.829+0000 7efefb3ff700 1 --2- 172.21.15.32:0/2300230849 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7efef415c460 0x7efef415fcf0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:31.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.829+0000 7efefb3ff700 1 --2- 172.21.15.32:0/2300230849 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efef40cf720 0x7efef41540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:31.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.829+0000 7efefb3ff700 1 --2- 172.21.15.32:0/2300230849 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efef40d2640 0x7efef41e7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:31.831 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.829+0000 7efefb3ff700 1 -- 172.21.15.32:0/2300230849 >> 172.21.15.32:0/2300230849 conn(0x7efef4071660 msgr2=0x7efef4071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:56:31.839 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.837+0000 7efefb3ff700 1 -- 172.21.15.32:0/2300230849 shutdown_connections 2023-06-20T13:56:31.840 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:31.838+0000 7efefb3ff700 1 -- 172.21.15.32:0/2300230849 wait complete. 2023-06-20T13:56:31.875 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-20T13:32:05.308022+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-20T13:32:12.857161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-20T13:34:02.254258+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-06-20T13:34:03.489075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-20T13:56:31.876 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-20T13:56:32.118 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.118+0000 7faf5dbff700 1 Processor -- start 2023-06-20T13:56:32.119 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.118+0000 7faf5dbff700 1 -- start start 2023-06-20T13:56:32.120 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.119+0000 7faf5dbff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7faf580b4c80 0x7faf580cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:32.120 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.119+0000 7faf5dbff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7faf580d1c90 0x7faf581608a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:32.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.119+0000 7faf5dbff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf580cf370 con 0x7faf580b82e0 2023-06-20T13:56:32.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.120+0000 7faf5dbff700 1 -- --> v2:172.21.15.32:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf58160de0 con 0x7faf580d1c90 2023-06-20T13:56:32.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.120+0000 7faf5dbff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf580b86b0 con 0x7faf580b4c80 2023-06-20T13:56:32.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.120+0000 7faf57fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7faf580d1c90 0x7faf581608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:32.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.120+0000 7faf57fff700 1 --2- >> v2:172.21.15.32:3300/0 conn(0x7faf580d1c90 0x7faf581608a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35052/0 (socket says 172.21.15.32:35052) 2023-06-20T13:56:32.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.120+0000 7faf57fff700 1 -- 172.21.15.32:0/4029686573 learned_addr learned my addr 172.21.15.32:0/4029686573 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:56:32.121 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.120+0000 7faf56ffd700 1 --2- 172.21.15.32:0/4029686573 >> v2:172.21.15.115:3300/0 conn(0x7faf580b4c80 0x7faf580cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:32.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.121+0000 7faf57fff700 1 -- 172.21.15.32:0/4029686573 >> v2:172.21.15.115:3300/0 conn(0x7faf580b4c80 msgr2=0x7faf580cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:56:32.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.121+0000 7faf57fff700 1 --2- 172.21.15.32:0/4029686573 >> v2:172.21.15.115:3300/0 conn(0x7faf580b4c80 0x7faf580cd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:32.123 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.121+0000 7faf57fff700 1 -- 172.21.15.32:0/4029686573 >> v1:172.21.15.115:6789/0 conn(0x7faf580b82e0 legacy=0x7faf580b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:32.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.121+0000 7faf57fff700 1 -- 172.21.15.32:0/4029686573 --> v2:172.21.15.32:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf580cf090 con 0x7faf580d1c90 2023-06-20T13:56:32.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.121+0000 7faf57fff700 1 --2- 172.21.15.32:0/4029686573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf580d1c90 0x7faf581608a0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7faf5806c630 tx=0x7faf5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d312059d3c18a106 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:56:32.124 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.121+0000 7faf567fc700 1 -- 172.21.15.32:0/4029686573 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5000e070 con 0x7faf580d1c90 2023-06-20T13:56:32.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.121+0000 7faf567fc700 1 -- 172.21.15.32:0/4029686573 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5000b910 con 0x7faf580d1c90 2023-06-20T13:56:32.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.121+0000 7faf567fc700 1 -- 172.21.15.32:0/4029686573 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5000bcc0 con 0x7faf580d1c90 2023-06-20T13:56:32.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.122+0000 7faf5dbff700 1 -- 172.21.15.32:0/4029686573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf580d1c90 msgr2=0x7faf581608a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:32.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.122+0000 7faf5dbff700 1 --2- 172.21.15.32:0/4029686573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf580d1c90 0x7faf581608a0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7faf5806c630 tx=0x7faf5000b330 comp rx=0 tx=0).stop 2023-06-20T13:56:32.125 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.122+0000 7faf5dbff700 1 -- 172.21.15.32:0/4029686573 shutdown_connections 2023-06-20T13:56:32.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.122+0000 7faf5dbff700 1 --2- 172.21.15.32:0/4029686573 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf580d1c90 0x7faf581608a0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:32.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.122+0000 7faf5dbff700 1 --2- 172.21.15.32:0/4029686573 >> v2:172.21.15.115:3300/0 conn(0x7faf580b4c80 0x7faf580cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:32.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.122+0000 7faf5dbff700 1 -- 172.21.15.32:0/4029686573 >> 172.21.15.32:0/4029686573 conn(0x7faf580722a0 msgr2=0x7faf580cf570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:56:32.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.122+0000 7faf5dbff700 1 -- 172.21.15.32:0/4029686573 shutdown_connections 2023-06-20T13:56:32.126 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.122+0000 7faf5dbff700 1 -- 172.21.15.32:0/4029686573 wait complete. 2023-06-20T13:56:32.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.124+0000 7faf5dbff700 1 Processor -- start 2023-06-20T13:56:32.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.124+0000 7faf5dbff700 1 -- start start 2023-06-20T13:56:32.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.125+0000 7faf5dbff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf580b4c80 0x7faf5815b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:32.129 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.125+0000 7faf5dbff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf580b82e0 0x7faf5815d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:32.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.125+0000 7faf5dbff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf580d1c90 0x7faf580ab0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:32.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.125+0000 7faf5dbff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5815e300 con 0x7faf580d1c90 2023-06-20T13:56:32.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.125+0000 7faf5dbff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5815e5e0 con 0x7faf580b4c80 2023-06-20T13:56:32.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.125+0000 7faf5dbff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5815e8c0 con 0x7faf580b82e0 2023-06-20T13:56:32.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.125+0000 7faf577fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf580b4c80 0x7faf5815b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:32.130 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.125+0000 7faf577fe700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf580b4c80 0x7faf5815b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:58324/0 (socket says 172.21.15.32:58324) 2023-06-20T13:56:32.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.125+0000 7faf577fe700 1 -- 172.21.15.32:0/530383648 learned_addr learned my addr 172.21.15.32:0/530383648 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:56:32.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.125+0000 7faf56ffd700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf580b82e0 0x7faf5815d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:32.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.126+0000 7faf57fff700 1 --2- 172.21.15.32:0/530383648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf580d1c90 0x7faf580ab0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:32.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.126+0000 7faf577fe700 1 -- 172.21.15.32:0/530383648 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf580b82e0 msgr2=0x7faf5815d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:32.131 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.126+0000 7faf577fe700 1 --2- 172.21.15.32:0/530383648 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf580b82e0 0x7faf5815d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:32.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.126+0000 7faf577fe700 1 -- 172.21.15.32:0/530383648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf580d1c90 msgr2=0x7faf580ab0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:32.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.126+0000 7faf577fe700 1 --2- 172.21.15.32:0/530383648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf580d1c90 0x7faf580ab0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:32.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.126+0000 7faf577fe700 1 -- 172.21.15.32:0/530383648 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf50009b30 con 0x7faf580b4c80 2023-06-20T13:56:32.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.126+0000 7faf577fe700 1 --2- 172.21.15.32:0/530383648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf580b4c80 0x7faf5815b210 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faf4800c450 tx=0x7faf4800c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:56:32.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.127+0000 7faf3ffff700 1 -- 172.21.15.32:0/530383648 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf480052d0 con 0x7faf580b4c80 2023-06-20T13:56:32.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.127+0000 7faf3ffff700 1 -- 172.21.15.32:0/530383648 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf48005430 con 0x7faf580b4c80 2023-06-20T13:56:32.132 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.127+0000 7faf5dbff700 1 -- 172.21.15.32:0/530383648 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5815eba0 con 0x7faf580b4c80 2023-06-20T13:56:32.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.127+0000 7faf3ffff700 1 -- 172.21.15.32:0/530383648 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf480038c0 con 0x7faf580b4c80 2023-06-20T13:56:32.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.127+0000 7faf5dbff700 1 -- 172.21.15.32:0/530383648 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5815b750 con 0x7faf580b4c80 2023-06-20T13:56:32.133 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.128+0000 7faf5dbff700 1 -- 172.21.15.32:0/530383648 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf5804ea60 con 0x7faf580b4c80 2023-06-20T13:56:32.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.130+0000 7faf3ffff700 1 -- 172.21.15.32:0/530383648 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faf48003a20 con 0x7faf580b4c80 2023-06-20T13:56:32.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.131+0000 7faf3ffff700 1 --2- 172.21.15.32:0/530383648 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7faf4406ace0 0x7faf4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:32.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.131+0000 7faf3ffff700 1 -- 172.21.15.32:0/530383648 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6526+0+0 (secure 0 0 0) 0x7faf480888e0 con 0x7faf580b4c80 2023-06-20T13:56:32.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.131+0000 7faf56ffd700 1 --2- 172.21.15.32:0/530383648 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7faf4406ace0 0x7faf4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:32.134 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.132+0000 7faf56ffd700 1 --2- 172.21.15.32:0/530383648 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7faf4406ace0 0x7faf4406d190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7faf581600b0 tx=0x7faf4c009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:56:32.137 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.136+0000 7faf3ffff700 1 -- 172.21.15.32:0/530383648 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7faf48053850 con 0x7faf580b4c80 2023-06-20T13:56:32.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.402+0000 7faf5dbff700 1 -- 172.21.15.32:0/530383648 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faf580b6990 con 0x7faf580b4c80 2023-06-20T13:56:32.403 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.403+0000 7faf3ffff700 1 -- 172.21.15.32:0/530383648 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7faf4800ce60 con 0x7faf580b4c80 2023-06-20T13:56:32.403 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 1 2023-06-20T13:56:32.406 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.406+0000 7faf5dbff700 1 -- 172.21.15.32:0/530383648 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7faf4406ace0 msgr2=0x7faf4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:32.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.406+0000 7faf5dbff700 1 --2- 172.21.15.32:0/530383648 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7faf4406ace0 0x7faf4406d190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7faf581600b0 tx=0x7faf4c009210 comp rx=0 tx=0).stop 2023-06-20T13:56:32.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.406+0000 7faf5dbff700 1 -- 172.21.15.32:0/530383648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf580b4c80 msgr2=0x7faf5815b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:32.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.406+0000 7faf5dbff700 1 --2- 172.21.15.32:0/530383648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf580b4c80 0x7faf5815b210 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faf4800c450 tx=0x7faf4800c760 comp rx=0 tx=0).stop 2023-06-20T13:56:32.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.406+0000 7faf5dbff700 1 -- 172.21.15.32:0/530383648 shutdown_connections 2023-06-20T13:56:32.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.406+0000 7faf5dbff700 1 --2- 172.21.15.32:0/530383648 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7faf4406ace0 0x7faf4406d190 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:32.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.406+0000 7faf5dbff700 1 --2- 172.21.15.32:0/530383648 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7faf580d1c90 0x7faf580ab0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:32.407 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.406+0000 7faf5dbff700 1 --2- 172.21.15.32:0/530383648 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf580b4c80 0x7faf5815b210 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:32.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.406+0000 7faf5dbff700 1 --2- 172.21.15.32:0/530383648 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf580b82e0 0x7faf5815d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:32.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.406+0000 7faf5dbff700 1 -- 172.21.15.32:0/530383648 >> 172.21.15.32:0/530383648 conn(0x7faf580722a0 msgr2=0x7faf580b5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:56:32.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.406+0000 7faf5dbff700 1 -- 172.21.15.32:0/530383648 shutdown_connections 2023-06-20T13:56:32.408 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.406+0000 7faf5dbff700 1 -- 172.21.15.32:0/530383648 wait complete. 2023-06-20T13:56:32.434 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-20T13:56:32.671 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.671+0000 7f60e5fff700 1 Processor -- start 2023-06-20T13:56:32.672 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.671+0000 7f60e5fff700 1 -- start start 2023-06-20T13:56:32.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.673+0000 7f60e5fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60e00cd230 0x7f60e00d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:32.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.673+0000 7f60e5fff700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e00d08d0 con 0x7f60e006b040 2023-06-20T13:56:32.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.673+0000 7f60e5fff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e00ce160 con 0x7f60e0160b00 2023-06-20T13:56:32.674 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.673+0000 7f60e5fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e015d7f0 con 0x7f60e00cd230 2023-06-20T13:56:32.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.674+0000 7f60df7fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f60e006b040 0x7f60e006b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:50532/0 (socket says 172.21.15.32:50532) 2023-06-20T13:56:32.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.674+0000 7f60df7fe700 1 -- 172.21.15.32:0/2663210632 learned_addr learned my addr 172.21.15.32:0/2663210632 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:56:32.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.674+0000 7f60dffff700 1 --2- 172.21.15.32:0/2663210632 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60e00cd230 0x7f60e00d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:32.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.674+0000 7f60de7fc700 1 -- 172.21.15.32:0/2663210632 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326636591 0 0) 0x7f60e00ce160 con 0x7f60e0160b00 2023-06-20T13:56:32.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.674+0000 7f60de7fc700 1 -- 172.21.15.32:0/2663210632 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60c80035b0 con 0x7f60e0160b00 2023-06-20T13:56:32.675 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.674+0000 7f60dffff700 1 -- 172.21.15.32:0/2663210632 >> v1:172.21.15.115:6789/0 conn(0x7f60e0160b00 legacy=0x7f60e00ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:32.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.674+0000 7f60dffff700 1 -- 172.21.15.32:0/2663210632 >> v1:172.21.15.32:6789/0 conn(0x7f60e006b040 legacy=0x7f60e006b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:32.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.674+0000 7f60de7fc700 1 -- 172.21.15.32:0/2663210632 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 571914386 0 0) 0x7f60e00d08d0 con 0x7f60e006b040 2023-06-20T13:56:32.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.674+0000 7f60dffff700 1 -- 172.21.15.32:0/2663210632 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e00cdba0 con 0x7f60e00cd230 2023-06-20T13:56:32.676 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.675+0000 7f60dffff700 1 --2- 172.21.15.32:0/2663210632 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60e00cd230 0x7f60e00d0d60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009dc0 tx=0x7f60d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=688b964fa645d4f6 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:56:32.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.675+0000 7f60de7fc700 1 -- 172.21.15.32:0/2663210632 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d800e070 con 0x7f60e00cd230 2023-06-20T13:56:32.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.675+0000 7f60de7fc700 1 -- 172.21.15.32:0/2663210632 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d800bb20 con 0x7f60e00cd230 2023-06-20T13:56:32.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.675+0000 7f60de7fc700 1 -- 172.21.15.32:0/2663210632 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d800be90 con 0x7f60e00cd230 2023-06-20T13:56:32.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.676+0000 7f60e5fff700 1 -- 172.21.15.32:0/2663210632 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60e00cd230 msgr2=0x7f60e00d0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:32.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.676+0000 7f60e5fff700 1 --2- 172.21.15.32:0/2663210632 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60e00cd230 0x7f60e00d0d60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009dc0 tx=0x7f60d800b330 comp rx=0 tx=0).stop 2023-06-20T13:56:32.677 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.676+0000 7f60e5fff700 1 -- 172.21.15.32:0/2663210632 shutdown_connections 2023-06-20T13:56:32.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.676+0000 7f60e5fff700 1 --2- 172.21.15.32:0/2663210632 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60e00cd230 0x7f60e00d0d60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:32.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.676+0000 7f60e5fff700 1 -- 172.21.15.32:0/2663210632 >> 172.21.15.32:0/2663210632 conn(0x7f60e006a850 msgr2=0x7f60e0099c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:56:32.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.676+0000 7f60e5fff700 1 -- 172.21.15.32:0/2663210632 shutdown_connections 2023-06-20T13:56:32.678 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.676+0000 7f60e5fff700 1 -- 172.21.15.32:0/2663210632 wait complete. 2023-06-20T13:56:32.679 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.679+0000 7f60e5fff700 1 Processor -- start 2023-06-20T13:56:32.680 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.679+0000 7f60e5fff700 1 -- start start 2023-06-20T13:56:32.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.681+0000 7f60e5fff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60e006b040 0x7f60e00b6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:32.681 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.681+0000 7f60e5fff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60e00cd230 0x7f60e00b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:32.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.681+0000 7f60e5fff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60e0160b00 0x7f60e0156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:32.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.681+0000 7f60e5fff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e0158070 con 0x7f60e0160b00 2023-06-20T13:56:32.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.681+0000 7f60e5fff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e00b49f0 con 0x7f60e006b040 2023-06-20T13:56:32.682 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.681+0000 7f60e5fff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e00b5810 con 0x7f60e00cd230 2023-06-20T13:56:32.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.681+0000 7f60dffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60e0160b00 0x7f60e0156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:32.683 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.681+0000 7f60dffff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60e0160b00 0x7f60e0156fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35070/0 (socket says 172.21.15.32:35070) 2023-06-20T13:56:32.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.681+0000 7f60dffff700 1 -- 172.21.15.32:0/2382729424 learned_addr learned my addr 172.21.15.32:0/2382729424 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:56:32.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.681+0000 7f60df7fe700 1 --2- 172.21.15.32:0/2382729424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60e006b040 0x7f60e00b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:32.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.682+0000 7f60deffd700 1 --2- 172.21.15.32:0/2382729424 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60e00cd230 0x7f60e00b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:32.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.682+0000 7f60dffff700 1 -- 172.21.15.32:0/2382729424 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60e00cd230 msgr2=0x7f60e00b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:32.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.682+0000 7f60dffff700 1 --2- 172.21.15.32:0/2382729424 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60e00cd230 0x7f60e00b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:32.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.682+0000 7f60dffff700 1 -- 172.21.15.32:0/2382729424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60e006b040 msgr2=0x7f60e00b6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:32.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.682+0000 7f60dffff700 1 --2- 172.21.15.32:0/2382729424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60e006b040 0x7f60e00b6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:32.684 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.682+0000 7f60dffff700 1 -- 172.21.15.32:0/2382729424 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d8009a70 con 0x7f60e0160b00 2023-06-20T13:56:32.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.682+0000 7f60deffd700 1 --2- 172.21.15.32:0/2382729424 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60e00cd230 0x7f60e00b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:56:32.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.682+0000 7f60dffff700 1 --2- 172.21.15.32:0/2382729424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60e0160b00 0x7f60e0156fb0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f60e00ce4a0 tx=0x7f60d8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:56:32.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.683+0000 7f60c7fff700 1 -- 172.21.15.32:0/2382729424 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d8012a90 con 0x7f60e0160b00 2023-06-20T13:56:32.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.683+0000 7f60c7fff700 1 -- 172.21.15.32:0/2382729424 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d8012bf0 con 0x7f60e0160b00 2023-06-20T13:56:32.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.683+0000 7f60c7fff700 1 -- 172.21.15.32:0/2382729424 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d8025420 con 0x7f60e0160b00 2023-06-20T13:56:32.685 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.683+0000 7f60e5fff700 1 -- 172.21.15.32:0/2382729424 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e00b4c00 con 0x7f60e0160b00 2023-06-20T13:56:32.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.683+0000 7f60e5fff700 1 -- 172.21.15.32:0/2382729424 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e00b51c0 con 0x7f60e0160b00 2023-06-20T13:56:32.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.685+0000 7f60e5fff700 1 -- 172.21.15.32:0/2382729424 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e004ea60 con 0x7f60e0160b00 2023-06-20T13:56:32.686 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.685+0000 7f60c7fff700 1 -- 172.21.15.32:0/2382729424 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f60d8023070 con 0x7f60e0160b00 2023-06-20T13:56:32.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.687+0000 7f60c7fff700 1 --2- 172.21.15.32:0/2382729424 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f60cc06ace0 0x7f60cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:32.687 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.687+0000 7f60c7fff700 1 -- 172.21.15.32:0/2382729424 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f60d808a790 con 0x7f60e0160b00 2023-06-20T13:56:32.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.688+0000 7f60df7fe700 1 --2- 172.21.15.32:0/2382729424 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f60cc06ace0 0x7f60cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:32.688 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.688+0000 7f60df7fe700 1 --2- 172.21.15.32:0/2382729424 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f60cc06ace0 0x7f60cc06d190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f60d0007fd0 tx=0x7f60d0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:56:32.692 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.691+0000 7f60c7fff700 1 -- 172.21.15.32:0/2382729424 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f60d8055700 con 0x7f60e0160b00 2023-06-20T13:56:32.962 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.961+0000 7f60e5fff700 1 -- 172.21.15.32:0/2382729424 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f60e006e2c0 con 0x7f60e0160b00 2023-06-20T13:56:32.963 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.962+0000 7f60c7fff700 1 -- 172.21.15.32:0/2382729424 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v44) v1 ==== 92+0+10 (secure 0 0 0) 0x7f60d8058d20 con 0x7f60e0160b00 2023-06-20T13:56:32.963 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 8 2023-06-20T13:56:32.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.964+0000 7f60e5fff700 1 -- 172.21.15.32:0/2382729424 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f60cc06ace0 msgr2=0x7f60cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:32.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.964+0000 7f60e5fff700 1 --2- 172.21.15.32:0/2382729424 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f60cc06ace0 0x7f60cc06d190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f60d0007fd0 tx=0x7f60d0009040 comp rx=0 tx=0).stop 2023-06-20T13:56:32.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.964+0000 7f60e5fff700 1 -- 172.21.15.32:0/2382729424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60e0160b00 msgr2=0x7f60e0156fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:32.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.964+0000 7f60e5fff700 1 --2- 172.21.15.32:0/2382729424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60e0160b00 0x7f60e0156fb0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f60e00ce4a0 tx=0x7f60d8004ad0 comp rx=0 tx=0).stop 2023-06-20T13:56:32.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.964+0000 7f60e5fff700 1 -- 172.21.15.32:0/2382729424 shutdown_connections 2023-06-20T13:56:32.965 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.964+0000 7f60e5fff700 1 --2- 172.21.15.32:0/2382729424 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f60cc06ace0 0x7f60cc06d190 secure :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f60d0007fd0 tx=0x7f60d0009040 comp rx=0 tx=0).stop 2023-06-20T13:56:32.966 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.964+0000 7f60e5fff700 1 --2- 172.21.15.32:0/2382729424 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f60e0160b00 0x7f60e0156fb0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:32.966 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.964+0000 7f60e5fff700 1 --2- 172.21.15.32:0/2382729424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60e006b040 0x7f60e00b6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:32.966 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.964+0000 7f60e5fff700 1 --2- 172.21.15.32:0/2382729424 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60e00cd230 0x7f60e00b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:32.966 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.964+0000 7f60e5fff700 1 -- 172.21.15.32:0/2382729424 >> 172.21.15.32:0/2382729424 conn(0x7f60e006a850 msgr2=0x7f60e00ae980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:56:32.966 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.965+0000 7f60e5fff700 1 -- 172.21.15.32:0/2382729424 shutdown_connections 2023-06-20T13:56:32.967 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:32.965+0000 7f60e5fff700 1 -- 172.21.15.32:0/2382729424 wait complete. 2023-06-20T13:56:32.984 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-20T13:56:33.240 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.240+0000 7f8b4cdff700 1 Processor -- start 2023-06-20T13:56:33.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.240+0000 7f8b4cdff700 1 -- start start 2023-06-20T13:56:33.241 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.241+0000 7f8b4cdff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b480b82e0 0x7f8b480cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:33.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.241+0000 7f8b4cdff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8b480b4c80 0x7f8b481608a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:33.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.241+0000 7f8b4cdff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b480cf370 con 0x7f8b480d1c90 2023-06-20T13:56:33.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.241+0000 7f8b4cdff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b48160de0 con 0x7f8b480b4c80 2023-06-20T13:56:33.242 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.241+0000 7f8b4cdff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b480b86b0 con 0x7f8b480b82e0 2023-06-20T13:56:33.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.242+0000 7f8b46d9d700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8b480b4c80 0x7f8b481608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:33.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.242+0000 7f8b4659c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b480b82e0 0x7f8b480cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:33.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.242+0000 7f8b45d9b700 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f8b480d1c90 0x7f8b480b4570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.32:33870/0 (socket says 172.21.15.32:33870) 2023-06-20T13:56:33.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.242+0000 7f8b45d9b700 1 -- 172.21.15.32:0/3545564036 learned_addr learned my addr 172.21.15.32:0/3545564036 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:56:33.243 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.242+0000 7f8b46d9d700 1 -- 172.21.15.32:0/3545564036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b480b82e0 msgr2=0x7f8b480cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:56:33.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.242+0000 7f8b46d9d700 1 --2- 172.21.15.32:0/3545564036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b480b82e0 0x7f8b480cd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:33.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.242+0000 7f8b46d9d700 1 -- 172.21.15.32:0/3545564036 >> v1:172.21.15.115:6789/0 conn(0x7f8b480d1c90 legacy=0x7f8b480b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:33.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.243+0000 7f8b46d9d700 1 -- 172.21.15.32:0/3545564036 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b480cf090 con 0x7f8b480b4c80 2023-06-20T13:56:33.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.242+0000 7f8b4559a700 1 -- 172.21.15.32:0/3545564036 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 671538590 0 0) 0x7f8b480cf370 con 0x7f8b480d1c90 2023-06-20T13:56:33.244 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.243+0000 7f8b4659c700 1 --2- 172.21.15.32:0/3545564036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b480b82e0 0x7f8b480cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:56:33.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.243+0000 7f8b46d9d700 1 --2- 172.21.15.32:0/3545564036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b480b4c80 0x7f8b481608a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8b40009d90 tx=0x7f8b4000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5680b5685e0a4909 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:56:33.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.243+0000 7f8b4559a700 1 -- 172.21.15.32:0/3545564036 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4000e070 con 0x7f8b480b4c80 2023-06-20T13:56:33.245 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.243+0000 7f8b4559a700 1 -- 172.21.15.32:0/3545564036 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4000bb20 con 0x7f8b480b4c80 2023-06-20T13:56:33.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.243+0000 7f8b4559a700 1 -- 172.21.15.32:0/3545564036 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b40012430 con 0x7f8b480b4c80 2023-06-20T13:56:33.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.244+0000 7f8b4cdff700 1 -- 172.21.15.32:0/3545564036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b480b4c80 msgr2=0x7f8b481608a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:33.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.244+0000 7f8b4cdff700 1 --2- 172.21.15.32:0/3545564036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b480b4c80 0x7f8b481608a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8b40009d90 tx=0x7f8b4000b330 comp rx=0 tx=0).stop 2023-06-20T13:56:33.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.244+0000 7f8b4cdff700 1 -- 172.21.15.32:0/3545564036 shutdown_connections 2023-06-20T13:56:33.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.244+0000 7f8b4cdff700 1 --2- 172.21.15.32:0/3545564036 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b480b82e0 0x7f8b480cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:33.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.244+0000 7f8b4cdff700 1 --2- 172.21.15.32:0/3545564036 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b480b4c80 0x7f8b481608a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:33.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.244+0000 7f8b4cdff700 1 -- 172.21.15.32:0/3545564036 >> 172.21.15.32:0/3545564036 conn(0x7f8b480722a0 msgr2=0x7f8b480cf570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:56:33.246 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.244+0000 7f8b4cdff700 1 -- 172.21.15.32:0/3545564036 shutdown_connections 2023-06-20T13:56:33.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.244+0000 7f8b4cdff700 1 -- 172.21.15.32:0/3545564036 wait complete. 2023-06-20T13:56:33.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.246+0000 7f8b4cdff700 1 Processor -- start 2023-06-20T13:56:33.247 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.246+0000 7f8b4cdff700 1 -- start start 2023-06-20T13:56:33.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.247+0000 7f8b4cdff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b480b4c80 0x7f8b4815e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:33.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.247+0000 7f8b4cdff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b480b82e0 0x7f8b480a94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:33.248 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.247+0000 7f8b4cdff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b480d1c90 0x7f8b48159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:33.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.247+0000 7f8b4cdff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b481f63d0 con 0x7f8b480d1c90 2023-06-20T13:56:33.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.248+0000 7f8b4cdff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4815dce0 con 0x7f8b480b4c80 2023-06-20T13:56:33.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.248+0000 7f8b4cdff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b481f5750 con 0x7f8b480b82e0 2023-06-20T13:56:33.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.248+0000 7f8b4659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b480b4c80 0x7f8b4815e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:33.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.248+0000 7f8b4659c700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b480b4c80 0x7f8b4815e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:58364/0 (socket says 172.21.15.32:58364) 2023-06-20T13:56:33.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.248+0000 7f8b4659c700 1 -- 172.21.15.32:0/2154753101 learned_addr learned my addr 172.21.15.32:0/2154753101 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:56:33.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.248+0000 7f8b45d9b700 1 --2- 172.21.15.32:0/2154753101 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b480b82e0 0x7f8b480a94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:33.249 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.248+0000 7f8b46d9d700 1 --2- 172.21.15.32:0/2154753101 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b480d1c90 0x7f8b48159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:33.250 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.248+0000 7f8b4659c700 1 -- 172.21.15.32:0/2154753101 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b480b82e0 msgr2=0x7f8b480a94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:33.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.248+0000 7f8b4659c700 1 --2- 172.21.15.32:0/2154753101 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b480b82e0 0x7f8b480a94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:33.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.248+0000 7f8b4659c700 1 -- 172.21.15.32:0/2154753101 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b480d1c90 msgr2=0x7f8b48159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:33.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.248+0000 7f8b4659c700 1 --2- 172.21.15.32:0/2154753101 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b480d1c90 0x7f8b48159ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:33.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.248+0000 7f8b4659c700 1 -- 172.21.15.32:0/2154753101 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b380094a0 con 0x7f8b480b4c80 2023-06-20T13:56:33.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.249+0000 7f8b45d9b700 1 --2- 172.21.15.32:0/2154753101 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b480b82e0 0x7f8b480a94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-20T13:56:33.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.249+0000 7f8b4659c700 1 --2- 172.21.15.32:0/2154753101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b480b4c80 0x7f8b4815e210 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800ebe0 tx=0x7f8b3800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:56:33.251 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.249+0000 7f8b36ffd700 1 -- 172.21.15.32:0/2154753101 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3800c850 con 0x7f8b480b4c80 2023-06-20T13:56:33.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.249+0000 7f8b36ffd700 1 -- 172.21.15.32:0/2154753101 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3800c9b0 con 0x7f8b480b4c80 2023-06-20T13:56:33.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.249+0000 7f8b4cdff700 1 -- 172.21.15.32:0/2154753101 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b40009a70 con 0x7f8b480b4c80 2023-06-20T13:56:33.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.249+0000 7f8b36ffd700 1 -- 172.21.15.32:0/2154753101 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3800cd40 con 0x7f8b480b4c80 2023-06-20T13:56:33.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.249+0000 7f8b4cdff700 1 -- 172.21.15.32:0/2154753101 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b481f5d10 con 0x7f8b480b4c80 2023-06-20T13:56:33.252 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.251+0000 7f8b4cdff700 1 -- 172.21.15.32:0/2154753101 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b4804ea60 con 0x7f8b480b4c80 2023-06-20T13:56:33.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.252+0000 7f8b36ffd700 1 -- 172.21.15.32:0/2154753101 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8b38013470 con 0x7f8b480b4c80 2023-06-20T13:56:33.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.253+0000 7f8b36ffd700 1 --2- 172.21.15.32:0/2154753101 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8b2806ace0 0x7f8b2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:33.253 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.253+0000 7f8b36ffd700 1 -- 172.21.15.32:0/2154753101 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f8b380897c0 con 0x7f8b480b4c80 2023-06-20T13:56:33.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.253+0000 7f8b45d9b700 1 --2- 172.21.15.32:0/2154753101 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8b2806ace0 0x7f8b2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:33.254 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.254+0000 7f8b45d9b700 1 --2- 172.21.15.32:0/2154753101 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8b2806ace0 0x7f8b2806d190 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8b481ef9e0 tx=0x7f8b3c007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:56:33.258 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.258+0000 7f8b36ffd700 1 -- 172.21.15.32:0/2154753101 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8b38054600 con 0x7f8b480b4c80 2023-06-20T13:56:33.693 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.687+0000 7f8b4cdff700 1 -- 172.21.15.32:0/2154753101 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8b480d1130 con 0x7f8b480b4c80 2023-06-20T13:56:33.700 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.699+0000 7f8b36ffd700 1 -- 172.21.15.32:0/2154753101 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8b3800cea0 con 0x7f8b480b4c80 2023-06-20T13:56:33.704 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 32 2023-06-20T13:56:33.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.706+0000 7f8b4cdff700 1 -- 172.21.15.32:0/2154753101 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8b2806ace0 msgr2=0x7f8b2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:33.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.707+0000 7f8b4cdff700 1 --2- 172.21.15.32:0/2154753101 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8b2806ace0 0x7f8b2806d190 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8b481ef9e0 tx=0x7f8b3c007de0 comp rx=0 tx=0).stop 2023-06-20T13:56:33.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.707+0000 7f8b4cdff700 1 -- 172.21.15.32:0/2154753101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b480b4c80 msgr2=0x7f8b4815e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:33.707 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.707+0000 7f8b4cdff700 1 --2- 172.21.15.32:0/2154753101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b480b4c80 0x7f8b4815e210 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800ebe0 tx=0x7f8b3800eef0 comp rx=0 tx=0).stop 2023-06-20T13:56:33.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.713+0000 7f8b4cdff700 1 -- 172.21.15.32:0/2154753101 shutdown_connections 2023-06-20T13:56:33.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.713+0000 7f8b4cdff700 1 --2- 172.21.15.32:0/2154753101 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f8b2806ace0 0x7f8b2806d190 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:33.714 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.713+0000 7f8b4cdff700 1 --2- 172.21.15.32:0/2154753101 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8b480d1c90 0x7f8b48159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:33.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.713+0000 7f8b4cdff700 1 --2- 172.21.15.32:0/2154753101 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b480b4c80 0x7f8b4815e210 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:33.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.713+0000 7f8b4cdff700 1 --2- 172.21.15.32:0/2154753101 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b480b82e0 0x7f8b480a94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:33.715 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.713+0000 7f8b4cdff700 1 -- 172.21.15.32:0/2154753101 >> 172.21.15.32:0/2154753101 conn(0x7f8b480722a0 msgr2=0x7f8b480d0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:56:33.717 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.716+0000 7f8b4cdff700 1 -- 172.21.15.32:0/2154753101 shutdown_connections 2023-06-20T13:56:33.726 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:33.726+0000 7f8b4cdff700 1 -- 172.21.15.32:0/2154753101 wait complete. 2023-06-20T13:56:33.791 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-20T13:56:34.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.299+0000 7f97783ff700 1 Processor -- start 2023-06-20T13:56:34.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.299+0000 7f97783ff700 1 -- start start 2023-06-20T13:56:34.302 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.301+0000 7f97783ff700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f977006d070 0x7f97700b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:34.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.301+0000 7f97783ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f977006d510 0x7f97700b4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:34.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.301+0000 7f97783ff700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97700cb430 con 0x7f97701587e0 2023-06-20T13:56:34.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.301+0000 7f97783ff700 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97700c55d0 con 0x7f977006d070 2023-06-20T13:56:34.303 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.301+0000 7f97783ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97700cb710 con 0x7f977006d510 2023-06-20T13:56:34.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.308+0000 7f977599a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f977006d070 0x7f97700b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:34.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.309+0000 7f977599a700 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f977006d070 0x7f97700b3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.32:58374/0 (socket says 172.21.15.32:58374) 2023-06-20T13:56:34.309 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.309+0000 7f977599a700 1 -- 172.21.15.32:0/1855087760 learned_addr learned my addr 172.21.15.32:0/1855087760 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:56:34.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.310+0000 7f977699c700 1 --2- 172.21.15.32:0/1855087760 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f977006d510 0x7f97700b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:34.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.311+0000 7f977599a700 1 -- 172.21.15.32:0/1855087760 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f977006d510 msgr2=0x7f97700b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-20T13:56:34.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.311+0000 7f977599a700 1 --2- 172.21.15.32:0/1855087760 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f977006d510 0x7f97700b4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:34.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.311+0000 7f977599a700 1 -- 172.21.15.32:0/1855087760 >> v1:172.21.15.115:6789/0 conn(0x7f97701587e0 legacy=0x7f97700c8cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-20T13:56:34.312 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.311+0000 7f977599a700 1 -- 172.21.15.32:0/1855087760 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97700cb9f0 con 0x7f977006d070 2023-06-20T13:56:34.313 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.311+0000 7f977599a700 1 --2- 172.21.15.32:0/1855087760 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f977006d070 0x7f97700b3c10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f976c0088f0 tx=0x7f976c00d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba20d38b19c054f0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:56:34.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.314+0000 7f9775199700 1 -- 172.21.15.32:0/1855087760 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c010070 con 0x7f977006d070 2023-06-20T13:56:34.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.314+0000 7f9775199700 1 -- 172.21.15.32:0/1855087760 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c00d990 con 0x7f977006d070 2023-06-20T13:56:34.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.314+0000 7f9775199700 1 -- 172.21.15.32:0/1855087760 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c00dd20 con 0x7f977006d070 2023-06-20T13:56:34.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.315+0000 7f97783ff700 1 -- 172.21.15.32:0/1855087760 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f977006d070 msgr2=0x7f97700b3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:34.316 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.315+0000 7f97783ff700 1 --2- 172.21.15.32:0/1855087760 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f977006d070 0x7f97700b3c10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f976c0088f0 tx=0x7f976c00d330 comp rx=0 tx=0).stop 2023-06-20T13:56:34.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.315+0000 7f97783ff700 1 -- 172.21.15.32:0/1855087760 shutdown_connections 2023-06-20T13:56:34.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.315+0000 7f97783ff700 1 --2- 172.21.15.32:0/1855087760 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f977006d510 0x7f97700b4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:34.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.315+0000 7f97783ff700 1 --2- 172.21.15.32:0/1855087760 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f977006d070 0x7f97700b3c10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:34.317 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.315+0000 7f97783ff700 1 -- 172.21.15.32:0/1855087760 >> 172.21.15.32:0/1855087760 conn(0x7f9770069f30 msgr2=0x7f977006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:56:34.333 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.319+0000 7f97783ff700 1 -- 172.21.15.32:0/1855087760 shutdown_connections 2023-06-20T13:56:34.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.331+0000 7f97783ff700 1 -- 172.21.15.32:0/1855087760 wait complete. 2023-06-20T13:56:34.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.334+0000 7f97783ff700 1 Processor -- start 2023-06-20T13:56:34.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.334+0000 7f97783ff700 1 -- start start 2023-06-20T13:56:34.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.335+0000 7f97783ff700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f977006d070 0x7f97701f5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:34.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.335+0000 7f97783ff700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f977006d510 0x7f97701e2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:34.337 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.335+0000 7f97783ff700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97701587e0 0x7f97701e2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:34.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.335+0000 7f97783ff700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97700c5b60 con 0x7f977006d070 2023-06-20T13:56:34.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.335+0000 7f97783ff700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97700c48a0 con 0x7f977006d510 2023-06-20T13:56:34.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.335+0000 7f97783ff700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97701e39e0 con 0x7f97701587e0 2023-06-20T13:56:34.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.336+0000 7f977699c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97701587e0 0x7f97701e2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:34.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.336+0000 7f977699c700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97701587e0 0x7f97701e2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.32:58788/0 (socket says 172.21.15.32:58788) 2023-06-20T13:56:34.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.336+0000 7f977699c700 1 -- 172.21.15.32:0/1274720259 learned_addr learned my addr 172.21.15.32:0/1274720259 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:56:34.338 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.336+0000 7f977599a700 1 --2- 172.21.15.32:0/1274720259 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f977006d510 0x7f97701e2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:34.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.337+0000 7f977699c700 1 -- 172.21.15.32:0/1274720259 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f977006d510 msgr2=0x7f97701e2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:34.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.337+0000 7f977699c700 1 --2- 172.21.15.32:0/1274720259 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f977006d510 0x7f97701e2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:34.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.337+0000 7f977699c700 1 -- 172.21.15.32:0/1274720259 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f977006d070 msgr2=0x7f97701f5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:34.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.337+0000 7f977699c700 1 --2- 172.21.15.32:0/1274720259 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f977006d070 0x7f97701f5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:34.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.337+0000 7f977699c700 1 -- 172.21.15.32:0/1274720259 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c0085d0 con 0x7f97701587e0 2023-06-20T13:56:34.339 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.337+0000 7f977699c700 1 --2- 172.21.15.32:0/1274720259 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97701587e0 0x7f97701e2d50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f976000e980 tx=0x7f976000ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:56:34.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.338+0000 7f9766ffd700 1 -- 172.21.15.32:0/1274720259 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9760009730 con 0x7f97701587e0 2023-06-20T13:56:34.340 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.338+0000 7f9766ffd700 1 -- 172.21.15.32:0/1274720259 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976000c850 con 0x7f97701587e0 2023-06-20T13:56:34.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.338+0000 7f9766ffd700 1 -- 172.21.15.32:0/1274720259 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976000cbc0 con 0x7f97701587e0 2023-06-20T13:56:34.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.338+0000 7f97783ff700 1 -- 172.21.15.32:0/1274720259 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97701e3420 con 0x7f97701587e0 2023-06-20T13:56:34.341 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.339+0000 7f97783ff700 1 -- 172.21.15.32:0/1274720259 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97700c57f0 con 0x7f97701587e0 2023-06-20T13:56:34.342 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.341+0000 7f97783ff700 1 -- 172.21.15.32:0/1274720259 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97580052e0 con 0x7f97701587e0 2023-06-20T13:56:34.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.344+0000 7f9766ffd700 1 -- 172.21.15.32:0/1274720259 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f976000cd20 con 0x7f97701587e0 2023-06-20T13:56:34.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.347+0000 7f9766ffd700 1 --2- 172.21.15.32:0/1274720259 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f975406adb0 0x7f975406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:34.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.347+0000 7f9766ffd700 1 -- 172.21.15.32:0/1274720259 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f97600898f0 con 0x7f97701587e0 2023-06-20T13:56:34.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.348+0000 7f977619b700 1 --2- 172.21.15.32:0/1274720259 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f975406adb0 0x7f975406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:34.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.349+0000 7f9766ffd700 1 -- 172.21.15.32:0/1274720259 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9760058240 con 0x7f97701587e0 2023-06-20T13:56:34.361 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.350+0000 7f977619b700 1 --2- 172.21.15.32:0/1274720259 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f975406adb0 0x7f975406d260 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f976800abb0 tx=0x7f9768009250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:56:34.732 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.732+0000 7f97783ff700 1 -- 172.21.15.32:0/1274720259 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9758005b10 con 0x7f97701587e0 2023-06-20T13:56:34.733 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.733+0000 7f9766ffd700 1 -- 172.21.15.32:0/1274720259 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7f97600210a0 con 0x7f97701587e0 2023-06-20T13:56:34.733 INFO:teuthology.orchestra.run.smithi032.stdout:pg_num: 64 2023-06-20T13:56:34.736 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.736+0000 7f97783ff700 1 -- 172.21.15.32:0/1274720259 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f975406adb0 msgr2=0x7f975406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:34.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.736+0000 7f97783ff700 1 --2- 172.21.15.32:0/1274720259 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f975406adb0 0x7f975406d260 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f976800abb0 tx=0x7f9768009250 comp rx=0 tx=0).stop 2023-06-20T13:56:34.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.736+0000 7f97783ff700 1 -- 172.21.15.32:0/1274720259 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97701587e0 msgr2=0x7f97701e2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:34.737 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.736+0000 7f97783ff700 1 --2- 172.21.15.32:0/1274720259 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97701587e0 0x7f97701e2d50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f976000e980 tx=0x7f976000ed40 comp rx=0 tx=0).stop 2023-06-20T13:56:34.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.736+0000 7f97783ff700 1 -- 172.21.15.32:0/1274720259 shutdown_connections 2023-06-20T13:56:34.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.736+0000 7f97783ff700 1 --2- 172.21.15.32:0/1274720259 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f975406adb0 0x7f975406d260 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:34.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.736+0000 7f97783ff700 1 --2- 172.21.15.32:0/1274720259 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f97701587e0 0x7f97701e2d50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:34.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.736+0000 7f97783ff700 1 --2- 172.21.15.32:0/1274720259 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f977006d070 0x7f97701f5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:34.738 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.736+0000 7f97783ff700 1 --2- 172.21.15.32:0/1274720259 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f977006d510 0x7f97701e2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:34.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.736+0000 7f97783ff700 1 -- 172.21.15.32:0/1274720259 >> 172.21.15.32:0/1274720259 conn(0x7f9770069f30 msgr2=0x7f97700ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:56:34.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.737+0000 7f97783ff700 1 -- 172.21.15.32:0/1274720259 shutdown_connections 2023-06-20T13:56:34.739 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:34.737+0000 7f97783ff700 1 -- 172.21.15.32:0/1274720259 wait complete. 2023-06-20T13:56:34.768 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-20T13:56:35.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.090+0000 7f893959d700 1 Processor -- start 2023-06-20T13:56:35.091 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.090+0000 7f893959d700 1 -- start start 2023-06-20T13:56:35.092 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.091+0000 7f893959d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8934164e60 0x7f8934167240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:35.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.091+0000 7f893959d700 1 -- --> v1:172.21.15.32:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89340ccfd0 con 0x7f89340af630 2023-06-20T13:56:35.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.091+0000 7f893959d700 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89340cd2b0 con 0x7f89340d0550 2023-06-20T13:56:35.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.091+0000 7f893959d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89340cd590 con 0x7f8934164e60 2023-06-20T13:56:35.093 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.092+0000 7f89337fe700 1 --1- >> v1:172.21.15.32:6789/0 conn(0x7f89340af630 0x7f89340d2f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.32:6789/0 says I am v1:172.21.15.32:50536/0 (socket says 172.21.15.32:50536) 2023-06-20T13:56:35.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.092+0000 7f89337fe700 1 -- 172.21.15.32:0/193732514 learned_addr learned my addr 172.21.15.32:0/193732514 (peer_addr_for_me v1:172.21.15.32:0/0) 2023-06-20T13:56:35.094 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.092+0000 7f8938d9c700 1 --2- 172.21.15.32:0/193732514 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8934164e60 0x7f8934167240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:35.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.092+0000 7f8932ffd700 1 -- 172.21.15.32:0/193732514 <== mon.0 v1:172.21.15.32:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 852477418 0 0) 0x7f89340ccfd0 con 0x7f89340af630 2023-06-20T13:56:35.096 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.092+0000 7f8938d9c700 1 -- 172.21.15.32:0/193732514 >> v1:172.21.15.115:6789/0 conn(0x7f89340d0550 legacy=0x7f89340d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:35.097 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.092+0000 7f8938d9c700 1 -- 172.21.15.32:0/193732514 >> v1:172.21.15.32:6789/0 conn(0x7f89340af630 legacy=0x7f89340d2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:35.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.092+0000 7f8938d9c700 1 -- 172.21.15.32:0/193732514 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89340cd870 con 0x7f8934164e60 2023-06-20T13:56:35.098 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.093+0000 7f8938d9c700 1 --2- 172.21.15.32:0/193732514 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8934164e60 0x7f8934167240 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f892c009dc0 tx=0x7f892c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ab2f06c88c1c45f server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:56:35.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.093+0000 7f8932ffd700 1 -- 172.21.15.32:0/193732514 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c00e070 con 0x7f8934164e60 2023-06-20T13:56:35.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.093+0000 7f8932ffd700 1 -- 172.21.15.32:0/193732514 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892c00bad0 con 0x7f8934164e60 2023-06-20T13:56:35.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.093+0000 7f8932ffd700 1 -- 172.21.15.32:0/193732514 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c00be80 con 0x7f8934164e60 2023-06-20T13:56:35.099 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.094+0000 7f893959d700 1 -- 172.21.15.32:0/193732514 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8934164e60 msgr2=0x7f8934167240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:35.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.094+0000 7f893959d700 1 --2- 172.21.15.32:0/193732514 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8934164e60 0x7f8934167240 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f892c009dc0 tx=0x7f892c00b330 comp rx=0 tx=0).stop 2023-06-20T13:56:35.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.094+0000 7f893959d700 1 -- 172.21.15.32:0/193732514 shutdown_connections 2023-06-20T13:56:35.100 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.094+0000 7f893959d700 1 --2- 172.21.15.32:0/193732514 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8934164e60 0x7f8934167240 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:35.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.094+0000 7f893959d700 1 -- 172.21.15.32:0/193732514 >> 172.21.15.32:0/193732514 conn(0x7f8934071f80 msgr2=0x7f893409bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:56:35.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.094+0000 7f893959d700 1 -- 172.21.15.32:0/193732514 shutdown_connections 2023-06-20T13:56:35.101 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.094+0000 7f893959d700 1 -- 172.21.15.32:0/193732514 wait complete. 2023-06-20T13:56:35.104 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.096+0000 7f893959d700 1 Processor -- start 2023-06-20T13:56:35.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.097+0000 7f893959d700 1 -- start start 2023-06-20T13:56:35.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.097+0000 7f893959d700 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89340af630 0x7f89340c7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:35.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.097+0000 7f893959d700 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89340d0550 0x7f89340c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:35.105 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.097+0000 7f893959d700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8934164e60 0x7f89340c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:35.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.097+0000 7f893959d700 1 -- --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893406c120 con 0x7f8934164e60 2023-06-20T13:56:35.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.097+0000 7f893959d700 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89340b8130 con 0x7f89340d0550 2023-06-20T13:56:35.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.097+0000 7f893959d700 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89340b8410 con 0x7f89340af630 2023-06-20T13:56:35.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.098+0000 7f8938d9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8934164e60 0x7f89340c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:35.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.098+0000 7f8938d9c700 1 --2- >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8934164e60 0x7f89340c69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.32:3300/0 says I am v2:172.21.15.32:35094/0 (socket says 172.21.15.32:35094) 2023-06-20T13:56:35.106 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.098+0000 7f8938d9c700 1 -- 172.21.15.32:0/1943512353 learned_addr learned my addr 172.21.15.32:0/1943512353 (peer_addr_for_me v2:172.21.15.32:0/0) 2023-06-20T13:56:35.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.098+0000 7f8933fff700 1 --2- 172.21.15.32:0/1943512353 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89340af630 0x7f89340c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:35.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.098+0000 7f89337fe700 1 --2- 172.21.15.32:0/1943512353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89340d0550 0x7f89340c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:35.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.098+0000 7f8938d9c700 1 -- 172.21.15.32:0/1943512353 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89340af630 msgr2=0x7f89340c7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:35.107 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.098+0000 7f8938d9c700 1 --2- 172.21.15.32:0/1943512353 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89340af630 0x7f89340c7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:35.108 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.098+0000 7f8938d9c700 1 -- 172.21.15.32:0/1943512353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89340d0550 msgr2=0x7f89340c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:35.108 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.098+0000 7f8938d9c700 1 --2- 172.21.15.32:0/1943512353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89340d0550 0x7f89340c6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:35.108 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.098+0000 7f8938d9c700 1 -- 172.21.15.32:0/1943512353 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f892c009a70 con 0x7f8934164e60 2023-06-20T13:56:35.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.098+0000 7f89337fe700 1 --2- 172.21.15.32:0/1943512353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89340d0550 0x7f89340c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-20T13:56:35.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.099+0000 7f8938d9c700 1 --2- 172.21.15.32:0/1943512353 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8934164e60 0x7f89340c69d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f892c009d90 tx=0x7f892c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:56:35.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.099+0000 7f8930ff9700 1 -- 172.21.15.32:0/1943512353 <== mon.0 v2:172.21.15.32:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c012630 con 0x7f8934164e60 2023-06-20T13:56:35.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.099+0000 7f893959d700 1 -- 172.21.15.32:0/1943512353 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89340b86f0 con 0x7f8934164e60 2023-06-20T13:56:35.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.099+0000 7f8930ff9700 1 -- 172.21.15.32:0/1943512353 <== mon.0 v2:172.21.15.32:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892c012790 con 0x7f8934164e60 2023-06-20T13:56:35.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.099+0000 7f8930ff9700 1 -- 172.21.15.32:0/1943512353 <== mon.0 v2:172.21.15.32:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c012b40 con 0x7f8934164e60 2023-06-20T13:56:35.109 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.099+0000 7f893959d700 1 -- 172.21.15.32:0/1943512353 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89340c7c80 con 0x7f8934164e60 2023-06-20T13:56:35.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.100+0000 7f893959d700 1 -- 172.21.15.32:0/1943512353 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89340c7e10 con 0x7f8934164e60 2023-06-20T13:56:35.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.102+0000 7f8930ff9700 1 -- 172.21.15.32:0/1943512353 <== mon.0 v2:172.21.15.32:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f892c012ca0 con 0x7f8934164e60 2023-06-20T13:56:35.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.103+0000 7f8930ff9700 1 --2- 172.21.15.32:0/1943512353 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f892006ace0 0x7f892006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-20T13:56:35.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.103+0000 7f8930ff9700 1 -- 172.21.15.32:0/1943512353 <== mon.0 v2:172.21.15.32:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f892c08bc90 con 0x7f8934164e60 2023-06-20T13:56:35.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.103+0000 7f8933fff700 1 --2- 172.21.15.32:0/1943512353 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f892006ace0 0x7f892006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-20T13:56:35.110 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.104+0000 7f8933fff700 1 --2- 172.21.15.32:0/1943512353 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f892006ace0 0x7f892006d190 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8924000fb0 tx=0x7f8924009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-20T13:56:35.111 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.109+0000 7f8930ff9700 1 -- 172.21.15.32:0/1943512353 <== mon.0 v2:172.21.15.32:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f892c056b60 con 0x7f8934164e60 2023-06-20T13:56:35.399 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.399+0000 7f893959d700 1 -- 172.21.15.32:0/1943512353 --> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8934067590 con 0x7f8934164e60 2023-06-20T13:56:35.400 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.399+0000 7f8930ff9700 1 -- 172.21.15.32:0/1943512353 <== mon.0 v2:172.21.15.32:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v44) v1 ==== 80+0+124 (secure 0 0 0) 0x7f892c05a180 con 0x7f8934164e60 2023-06-20T13:56:35.400 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.115:6835/1096571469 2023-06-21T13:51:32.439209+0000 2023-06-20T13:56:35.400 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.115:6832/1096571469 2023-06-21T13:51:32.439209+0000 2023-06-20T13:56:35.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.402+0000 7f893959d700 1 -- 172.21.15.32:0/1943512353 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f892006ace0 msgr2=0x7f892006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:35.402 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.402+0000 7f893959d700 1 --2- 172.21.15.32:0/1943512353 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f892006ace0 0x7f892006d190 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8924000fb0 tx=0x7f8924009040 comp rx=0 tx=0).stop 2023-06-20T13:56:35.403 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.402+0000 7f893959d700 1 -- 172.21.15.32:0/1943512353 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8934164e60 msgr2=0x7f89340c69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-20T13:56:35.403 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.402+0000 7f893959d700 1 --2- 172.21.15.32:0/1943512353 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8934164e60 0x7f89340c69d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f892c009d90 tx=0x7f892c004ad0 comp rx=0 tx=0).stop 2023-06-20T13:56:35.403 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.402+0000 7f893959d700 1 -- 172.21.15.32:0/1943512353 shutdown_connections 2023-06-20T13:56:35.403 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.402+0000 7f893959d700 1 --2- 172.21.15.32:0/1943512353 >> [v2:172.21.15.32:6832/1136488437,v1:172.21.15.32:6833/1136488437] conn(0x7f892006ace0 0x7f892006d190 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:35.403 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.402+0000 7f893959d700 1 --2- 172.21.15.32:0/1943512353 >> [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] conn(0x7f8934164e60 0x7f89340c69d0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:35.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.402+0000 7f893959d700 1 --2- 172.21.15.32:0/1943512353 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f89340af630 0x7f89340c7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:35.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.402+0000 7f893959d700 1 --2- 172.21.15.32:0/1943512353 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f89340d0550 0x7f89340c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-20T13:56:35.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.402+0000 7f893959d700 1 -- 172.21.15.32:0/1943512353 >> 172.21.15.32:0/1943512353 conn(0x7f8934071f80 msgr2=0x7f89340729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-20T13:56:35.404 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.402+0000 7f893959d700 1 -- 172.21.15.32:0/1943512353 shutdown_connections 2023-06-20T13:56:35.405 INFO:teuthology.orchestra.run.smithi032.stderr:2023-06-20T13:56:35.402+0000 7f893959d700 1 -- 172.21.15.32:0/1943512353 wait complete. 2023-06-20T13:56:35.405 INFO:teuthology.orchestra.run.smithi032.stderr:listed 2 entries 2023-06-20T13:56:35.423 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-06-20T13:56:35.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:56:35.424 DEBUG:teuthology.orchestra.run.smithi032:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-06-20T13:56:35.531 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2023-06-20T13:56:35.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:56:35.532 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-20T13:56:35.597 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2023-06-20T13:56:35.597 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-20T13:56:35.654 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348780k,nr_inodes=4087195,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275628k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 172.21.15.32:6789:/test /tmp/tmp.smRYDztNNFtest ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=8ec09bdb-4968-488f-bf51-7b0f1e92355f,acl 0 0 2023-06-20T13:56:35.654 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi032.front.sepia.ceph.com 2023-06-20T13:56:35.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:56:35.655 DEBUG:teuthology.orchestra.run.smithi032:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-20T13:56:35.712 INFO:teuthology.orchestra.run.smithi032.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-06-20T13:56:35.712 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-20T13:56:35.713 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:56:35.713 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-20T13:56:35.799 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345636k,nr_inodes=4086409,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-06-20T13:56:35.799 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-06-20T13:56:35.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:56:35.800 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-20T13:56:35.975 INFO:teuthology.orchestra.run.smithi115.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-06-20T13:56:35.976 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-20T13:56:35.977 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2023-06-20T13:56:35.977 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-20T13:56:36.064 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345636k,nr_inodes=4086409,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275000k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-06-20T13:56:36.064 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi115.front.sepia.ceph.com 2023-06-20T13:56:36.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-20T13:56:36.065 DEBUG:teuthology.orchestra.run.smithi115:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-20T13:56:36.133 INFO:teuthology.orchestra.run.smithi115.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-06-20T13:56:36.134 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-20T13:56:37.745 INFO:tasks.ceph.osd.0:Sent signal 15 2023-06-20T13:56:37.746 INFO:tasks.ceph.osd.1:Sent signal 15 2023-06-20T13:56:37.746 INFO:tasks.ceph.osd.2:Sent signal 15 2023-06-20T13:56:37.746 INFO:tasks.ceph.osd.3:Sent signal 15 2023-06-20T13:56:37.746 INFO:tasks.ceph.osd.4:Sent signal 15 2023-06-20T13:56:37.747 INFO:tasks.ceph.osd.5:Sent signal 15 2023-06-20T13:56:37.747 INFO:tasks.ceph.osd.6:Sent signal 15 2023-06-20T13:56:37.747 INFO:tasks.ceph.osd.7:Sent signal 15 2023-06-20T13:56:37.748 INFO:tasks.ceph.mds.a:Sent signal 15 2023-06-20T13:56:37.748 INFO:tasks.ceph.mds.c:Sent signal 15 2023-06-20T13:56:37.748 INFO:tasks.ceph.mds.b:Sent signal 15 2023-06-20T13:56:37.748 INFO:tasks.ceph.mon.a:Sent signal 15 2023-06-20T13:56:37.749 INFO:tasks.ceph.mon.b:Sent signal 15 2023-06-20T13:56:37.749 INFO:tasks.ceph.mon.c:Sent signal 15 2023-06-20T13:56:37.749 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-06-20T13:56:37.750 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-06-20T13:56:37.750 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-06-20T13:56:37.746+0000 7f858f3f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 110209) UID: 0 2023-06-20T13:56:37.750 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-06-20T13:56:37.747+0000 7f858f3f9700 -1 osd.4 44 *** Got signal Terminated *** 2023-06-20T13:56:37.750 INFO:tasks.ceph.osd.4.smithi115.stderr:2023-06-20T13:56:37.747+0000 7f858f3f9700 -1 osd.4 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-20T13:56:37.751 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-06-20T13:56:37.747+0000 7f21a81f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 110215) UID: 0 2023-06-20T13:56:37.751 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-06-20T13:56:37.747+0000 7f21a81f9700 -1 osd.5 44 *** Got signal Terminated *** 2023-06-20T13:56:37.751 INFO:tasks.ceph.osd.5.smithi115.stderr:2023-06-20T13:56:37.747+0000 7f21a81f9700 -1 osd.5 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-20T13:56:37.751 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-06-20T13:56:37.747+0000 7f35de3f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 110216) UID: 0 2023-06-20T13:56:37.752 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-06-20T13:56:37.747+0000 7f35de3f9700 -1 osd.6 44 *** Got signal Terminated *** 2023-06-20T13:56:37.752 INFO:tasks.ceph.osd.6.smithi115.stderr:2023-06-20T13:56:37.747+0000 7f35de3f9700 -1 osd.6 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-20T13:56:37.752 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-06-20T13:56:37.747+0000 7f0ec4df9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 110218) UID: 0 2023-06-20T13:56:37.752 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-06-20T13:56:37.747+0000 7f0ec4df9700 -1 osd.7 44 *** Got signal Terminated *** 2023-06-20T13:56:37.753 INFO:tasks.ceph.osd.7.smithi115.stderr:2023-06-20T13:56:37.747+0000 7f0ec4df9700 -1 osd.7 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-20T13:56:37.753 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-06-20T13:56:37.748+0000 7ff85a9f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 117983) UID: 0 2023-06-20T13:56:37.753 INFO:tasks.ceph.mds.b.smithi115.stderr:2023-06-20T13:56:37.748+0000 7ff85a9f9700 -1 mds.b *** got signal Terminated *** 2023-06-20T13:56:37.753 INFO:tasks.ceph.mon.b.smithi115.stderr:2023-06-20T13:56:37.749+0000 7fa91ebff700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 109500) UID: 0 2023-06-20T13:56:37.754 INFO:tasks.ceph.mon.b.smithi115.stderr:2023-06-20T13:56:37.749+0000 7fa91ebff700 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-06-20T13:56:37.754 INFO:tasks.ceph.osd.0.smithi032.stderr:2023-06-20T13:56:37.744+0000 7f7f9b5f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 109943) UID: 0 2023-06-20T13:56:37.754 INFO:tasks.ceph.osd.0.smithi032.stderr:2023-06-20T13:56:37.744+0000 7f7f9b5f9700 -1 osd.0 44 *** Got signal Terminated *** 2023-06-20T13:56:37.754 INFO:tasks.ceph.osd.0.smithi032.stderr:2023-06-20T13:56:37.744+0000 7f7f9b5f9700 -1 osd.0 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-20T13:56:37.755 INFO:tasks.ceph.osd.1.smithi032.stderr:2023-06-20T13:56:37.745+0000 7fe69b7f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 109944) UID: 0 2023-06-20T13:56:37.755 INFO:tasks.ceph.osd.1.smithi032.stderr:2023-06-20T13:56:37.745+0000 7fe69b7f9700 -1 osd.1 44 *** Got signal Terminated *** 2023-06-20T13:56:37.755 INFO:tasks.ceph.osd.1.smithi032.stderr:2023-06-20T13:56:37.745+0000 7fe69b7f9700 -1 osd.1 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-20T13:56:37.755 INFO:tasks.ceph.osd.3.smithi032.stderr:2023-06-20T13:56:37.747+0000 7f595bbf9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 109955) UID: 0 2023-06-20T13:56:37.755 INFO:tasks.ceph.osd.3.smithi032.stderr:2023-06-20T13:56:37.747+0000 7f595bbf9700 -1 osd.3 44 *** Got signal Terminated *** 2023-06-20T13:56:37.756 INFO:tasks.ceph.osd.3.smithi032.stderr:2023-06-20T13:56:37.747+0000 7f595bbf9700 -1 osd.3 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-20T13:56:37.756 INFO:tasks.ceph.osd.2.smithi032.stderr:2023-06-20T13:56:37.750+0000 7f9ccddf9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 109954) UID: 0 2023-06-20T13:56:37.756 INFO:tasks.ceph.osd.2.smithi032.stderr:2023-06-20T13:56:37.750+0000 7f9ccddf9700 -1 osd.2 44 *** Got signal Terminated *** 2023-06-20T13:56:37.756 INFO:tasks.ceph.osd.2.smithi032.stderr:2023-06-20T13:56:37.750+0000 7f9ccddf9700 -1 osd.2 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-20T13:56:37.757 INFO:tasks.ceph.mds.c.smithi032.stderr:2023-06-20T13:56:37.750+0000 7fe62fdf9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 126260) UID: 0 2023-06-20T13:56:37.757 INFO:tasks.ceph.mds.c.smithi032.stderr:2023-06-20T13:56:37.750+0000 7fe62fdf9700 -1 mds.c *** got signal Terminated *** 2023-06-20T13:56:37.757 INFO:tasks.ceph.mon.a.smithi032.stderr:2023-06-20T13:56:37.752+0000 7f81a1bff700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 109608) UID: 0 2023-06-20T13:56:37.757 INFO:tasks.ceph.mon.a.smithi032.stderr:2023-06-20T13:56:37.752+0000 7f81a1bff700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-06-20T13:56:37.757 INFO:tasks.ceph.mds.a.smithi032.stderr:2023-06-20T13:56:37.750+0000 7fbfaf7f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 126259) UID: 0 2023-06-20T13:56:37.758 INFO:tasks.ceph.mds.a.smithi032.stderr:2023-06-20T13:56:37.750+0000 7fbfaf7f9700 -1 mds.a *** got signal Terminated *** 2023-06-20T13:56:37.758 INFO:tasks.ceph.mon.c.smithi115.stderr:2023-06-20T13:56:37.754+0000 7f4c009ff700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 109501) UID: 0 2023-06-20T13:56:37.758 INFO:tasks.ceph.mon.c.smithi115.stderr:2023-06-20T13:56:37.754+0000 7f4c009ff700 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-06-20T13:56:37.956 INFO:tasks.ceph.mgr.x.smithi115.stderr:daemon-helper: command crashed with signal 15 2023-06-20T13:58:36.077 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:58:36.083 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:59:06.213 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:59:06.221 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:59:36.449 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T13:59:36.454 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:00:06.568 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:00:06.573 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:00:36.753 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:00:36.758 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:01:06.938 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:01:06.944 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:01:37.058 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:01:37.063 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:02:07.170 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:02:07.174 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:02:37.363 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:02:37.368 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:03:07.473 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:03:07.479 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:03:37.587 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:03:37.592 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:04:07.770 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:04:07.775 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:04:37.881 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:04:37.886 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:05:07.991 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:05:07.996 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:05:38.152 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:05:38.157 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:06:08.330 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:06:08.335 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:06:38.440 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:06:38.446 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:07:08.644 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:07:08.650 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:07:38.830 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:07:38.835 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:08:08.940 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:08:08.946 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:08:39.126 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:08:39.131 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:09:09.312 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:09:09.316 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:09:39.422 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:09:39.427 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:10:09.608 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:10:09.613 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:10:39.796 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:10:39.801 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:11:10.105 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:11:10.111 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:11:40.215 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:11:40.220 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:12:10.393 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:12:10.399 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:12:40.578 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:12:40.583 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:13:10.708 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:13:10.713 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:13:40.909 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:13:40.915 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:14:11.111 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:14:11.116 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:14:41.513 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:14:41.519 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:15:11.633 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:15:11.638 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:15:41.827 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:15:41.833 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:16:12.046 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:16:12.051 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:16:42.158 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:16:42.163 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:17:12.344 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:17:12.349 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:17:42.570 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:17:42.574 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:18:12.683 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:18:12.689 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:18:42.884 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:18:42.889 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:19:13.085 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:19:13.091 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:19:43.196 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:19:43.202 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:20:13.308 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:20:13.313 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:20:43.486 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:20:43.491 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:21:13.612 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:21:13.617 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:21:43.848 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:21:43.854 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:22:14.017 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:22:14.023 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:22:44.237 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:22:44.242 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:23:14.347 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:23:14.352 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:23:44.541 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:23:44.546 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:24:14.652 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:24:14.657 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:24:44.763 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:24:44.769 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:25:14.949 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:25:14.954 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:25:45.134 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:25:45.139 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:26:15.254 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:26:15.259 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:26:45.452 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:26:45.456 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:27:15.642 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:27:15.647 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:27:45.869 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:27:45.873 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:28:15.977 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:28:15.982 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:28:46.199 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:28:46.204 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:29:16.306 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:29:16.312 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:29:46.420 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:29:46.425 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:30:16.606 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:30:16.611 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:30:46.809 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:30:46.815 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:31:16.919 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:31:16.925 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:31:47.044 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:31:47.050 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:32:17.217 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:32:17.222 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:32:47.594 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:32:47.600 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:33:17.704 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:33:17.710 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:33:47.832 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:33:47.837 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:34:18.035 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:34:18.040 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:34:48.145 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:34:48.151 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:35:18.340 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:35:18.344 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:35:48.525 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:35:48.531 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:36:18.640 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:36:18.644 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:36:48.845 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:36:48.851 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:37:19.041 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:37:19.045 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:37:49.193 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:37:49.198 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:38:19.379 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:38:19.384 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:38:49.506 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:38:49.511 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:39:19.884 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:39:19.889 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:39:49.999 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:39:50.004 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:40:20.172 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:40:20.177 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:40:50.285 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:40:50.290 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:41:20.466 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:41:20.471 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:41:50.580 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:41:50.586 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:42:20.774 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:42:20.779 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:42:50.892 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:42:50.898 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:43:21.015 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:43:21.020 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:43:51.197 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:43:51.202 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:44:21.326 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:44:21.332 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:44:51.444 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:44:51.449 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:45:21.556 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:45:21.561 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:45:51.669 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:45:51.674 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:46:21.785 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:46:21.790 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:46:52.079 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:46:52.083 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:47:22.281 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:47:22.286 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:47:52.392 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:47:52.397 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:48:22.569 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:48:22.574 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:48:52.755 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:48:52.759 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:49:22.861 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:49:22.866 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:49:53.035 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:49:53.040 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:50:23.237 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:50:23.247 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:50:53.490 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:50:53.495 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:51:23.610 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:51:23.615 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:51:53.795 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:51:53.801 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:52:23.973 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:52:23.978 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:52:54.089 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:52:54.094 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:53:24.260 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:53:24.266 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:53:54.455 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:53:54.459 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:54:24.573 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:54:24.578 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:54:54.760 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:54:54.765 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:55:24.937 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:55:24.942 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:55:55.131 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:55:55.137 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:56:25.244 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:56:25.249 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:56:55.428 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:56:55.433 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:57:25.614 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:57:25.619 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:57:55.732 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:57:55.737 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:58:25.919 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:58:25.924 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:58:56.112 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:58:56.117 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:59:26.474 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:59:26.478 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:59:56.602 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T14:59:56.607 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:00:26.794 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:00:26.799 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:00:56.972 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:00:56.978 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:01:27.083 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:01:27.088 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:01:57.269 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:01:57.274 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:02:27.446 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:02:27.451 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:02:57.571 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:02:57.576 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:03:27.768 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:03:27.773 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:03:57.946 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:03:57.952 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:04:28.065 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:04:28.070 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:04:58.233 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:04:58.238 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:05:28.419 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:05:28.424 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:05:58.547 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:05:58.552 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:06:28.724 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:06:28.730 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:06:58.902 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:06:58.907 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:07:29.024 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:07:29.029 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:07:59.226 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:07:59.231 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:08:29.434 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:08:29.439 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:08:59.736 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:08:59.742 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:09:29.848 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:09:29.854 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:10:00.069 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:10:00.076 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:10:30.278 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:10:30.283 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:11:00.405 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:11:00.410 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:11:30.584 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:11:30.589 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:12:00.776 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:12:00.781 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:12:31.053 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:12:31.060 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:13:01.173 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:13:01.178 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:13:31.366 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:13:31.371 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:14:01.487 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:14:01.492 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:14:31.605 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:14:31.610 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:15:01.782 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:15:01.787 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:15:31.893 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:15:31.898 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:16:02.321 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:16:02.326 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:16:32.439 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:16:32.444 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:17:02.600 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:17:02.605 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:17:32.805 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:17:32.810 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:18:02.921 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:18:02.926 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:18:33.083 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:18:33.087 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:19:03.260 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:19:03.265 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:19:33.370 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:19:33.375 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:20:03.540 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:20:03.545 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:20:33.725 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:20:33.730 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:21:03.837 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:21:03.842 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:21:34.030 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:21:34.035 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:22:04.233 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:22:04.238 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:22:34.451 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:22:34.456 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:23:04.620 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:23:04.625 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:23:34.757 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:23:34.762 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:24:04.934 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:24:04.940 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:24:35.055 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:24:35.060 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:25:05.289 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:25:05.294 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:25:35.399 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:25:35.405 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:26:05.515 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:26:05.521 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:26:35.704 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:26:35.709 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:27:05.881 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:27:05.886 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:27:35.991 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:27:35.997 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:28:06.111 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:28:06.116 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:28:36.247 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:28:36.252 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:29:06.574 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:29:06.579 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:29:36.789 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:29:36.795 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:30:06.962 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:30:06.967 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:30:37.166 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:30:37.171 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:31:07.276 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:31:07.281 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:31:37.461 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:31:37.467 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:32:07.638 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:32:07.643 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:32:37.758 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:32:37.763 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:33:07.944 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:33:07.949 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:33:38.120 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:33:38.126 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:34:08.532 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:34:08.537 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:34:38.650 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:34:38.655 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:35:08.761 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:35:08.766 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:35:38.997 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:35:39.002 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:36:09.109 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:36:09.114 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:36:39.285 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:36:39.290 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:37:09.471 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:37:09.476 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:37:39.590 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:37:39.595 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:38:09.779 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:38:09.784 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:38:39.969 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:38:39.975 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:39:10.089 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:39:10.094 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:39:40.208 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:39:40.214 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:40:10.402 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:40:10.408 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:40:40.695 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:40:40.700 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:41:10.807 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:41:10.812 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:41:41.001 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:41:41.005 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:42:11.187 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:42:11.192 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:42:41.322 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:42:41.327 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:43:11.502 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:43:11.508 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:43:41.619 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:43:41.623 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:44:11.737 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:44:11.742 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:44:41.898 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:44:41.903 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:45:12.076 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:45:12.081 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:45:42.189 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:45:42.195 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:46:12.381 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:46:12.386 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:46:42.550 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:46:42.555 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:47:12.666 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:47:12.671 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:47:42.838 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:47:42.843 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:48:13.023 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:48:13.029 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:48:43.226 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:48:43.231 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:49:13.395 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:49:13.401 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:49:43.574 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:49:43.580 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:50:13.759 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:50:13.764 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:50:43.879 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:50:43.885 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:51:14.065 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:51:14.070 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:51:44.267 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:51:44.282 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:52:14.392 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:52:14.398 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:52:44.589 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:52:44.594 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:53:14.816 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:53:14.821 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:53:44.935 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:53:44.940 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:54:15.104 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:54:15.109 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:54:45.298 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:54:45.303 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:55:15.417 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:55:15.423 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:55:45.628 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:55:45.633 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:56:15.805 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:56:15.810 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:56:45.924 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:56:45.929 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:57:16.036 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:57:16.041 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:57:46.154 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:57:46.159 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:58:16.540 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:58:16.545 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:58:46.671 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:58:46.676 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:59:16.852 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:59:16.857 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:59:47.063 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T15:59:47.068 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:00:17.172 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:00:17.177 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:00:47.368 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:00:47.373 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:01:17.563 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:01:17.568 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:01:47.698 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:01:47.703 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:02:17.816 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:02:17.822 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:02:48.003 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:02:48.008 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:03:18.138 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:03:18.143 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:03:48.315 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:03:48.321 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:04:18.509 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:04:18.514 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:04:48.626 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:04:48.631 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:05:18.814 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:05:18.819 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:05:49.009 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:05:49.015 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:06:19.119 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:06:19.125 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:06:49.234 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:06:49.239 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:07:19.415 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:07:19.421 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:07:49.535 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:07:49.540 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:08:19.712 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:08:19.719 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:08:49.898 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:08:49.904 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:09:20.075 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:09:20.080 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:09:50.194 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:09:50.199 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:10:20.354 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:10:20.359 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:10:50.474 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:10:50.479 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:11:20.585 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:11:20.590 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:11:50.770 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:11:50.776 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:12:20.956 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:12:20.961 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:12:51.075 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:12:51.080 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:13:21.186 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:13:21.191 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:13:51.396 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:13:51.401 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:14:21.525 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:14:21.530 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:14:51.735 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:14:51.740 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:15:21.904 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:15:21.910 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:15:52.015 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:15:52.020 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:16:22.199 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:16:22.205 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:16:52.396 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:16:52.401 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:17:22.527 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:17:22.532 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:17:52.757 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:17:52.762 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:18:22.893 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:18:22.898 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:18:53.061 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:18:53.066 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:19:23.181 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:19:23.186 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:19:53.366 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:19:53.371 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:20:23.526 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:20:23.532 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:20:53.637 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:20:53.642 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:21:23.806 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:21:23.811 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:21:53.984 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:21:53.990 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:22:24.104 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:22:24.110 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:22:54.288 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:22:54.293 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:23:24.525 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:23:24.530 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:23:54.643 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:23:54.649 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:24:24.829 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:24:24.835 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:24:55.014 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:24:55.019 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:25:25.133 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:25:25.138 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:25:55.319 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:25:55.324 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:26:25.497 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:26:25.502 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:26:55.607 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:26:55.612 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:27:25.830 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:27:25.836 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:27:55.996 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:27:56.002 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:28:26.181 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:28:26.186 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:28:56.300 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:28:56.305 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:29:26.511 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:29:26.516 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:29:56.636 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:29:56.641 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:30:26.751 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:30:26.756 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:30:56.876 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:30:56.881 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:31:27.045 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:31:27.050 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:31:57.157 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:31:57.162 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:32:27.342 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:32:27.347 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:32:57.511 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:32:57.516 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:33:27.630 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:33:27.635 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:33:57.816 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:33:57.821 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:34:27.935 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:34:27.940 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:34:58.171 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:34:58.176 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:35:28.290 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:35:28.294 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:35:58.484 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:35:58.489 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:36:28.653 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:36:28.658 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:36:58.763 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:36:58.768 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:37:28.924 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:37:28.929 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:37:59.101 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:37:59.106 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:38:29.213 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:38:29.218 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:38:59.407 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:38:59.412 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:39:29.600 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:39:29.606 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:39:59.719 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:39:59.725 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:40:29.904 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:40:29.910 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:41:00.090 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:41:00.096 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:41:30.294 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:41:30.300 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:42:00.412 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:42:00.416 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:42:30.590 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:42:30.597 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:43:00.816 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:43:00.822 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:43:30.936 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:43:30.941 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:44:01.114 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:44:01.119 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:44:31.308 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:44:31.314 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:45:01.426 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:45:01.433 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:45:31.620 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:45:31.626 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:46:01.797 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:46:01.802 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:46:32.091 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:46:32.097 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:47:02.211 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:47:02.216 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:47:32.379 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:47:32.385 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:48:02.582 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:48:02.587 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:48:32.707 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:48:32.712 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:49:02.895 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:49:02.900 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:49:33.072 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:49:33.077 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:50:03.191 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:50:03.196 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:50:33.403 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:50:33.408 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:51:03.562 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:51:03.568 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:51:33.694 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:51:33.700 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:52:03.875 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:52:03.880 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:52:34.036 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:52:34.041 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:53:04.155 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:53:04.161 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:53:34.342 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:53:34.347 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:54:04.522 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:54:04.527 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:54:34.653 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:54:34.658 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:55:04.848 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:55:04.853 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:55:35.059 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:55:35.064 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:56:05.354 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:56:05.358 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:56:35.472 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:56:35.477 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:57:05.682 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:57:05.687 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:57:35.886 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:57:35.891 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:58:06.004 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:58:06.010 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:58:36.190 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:58:36.195 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:59:06.367 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:59:06.376 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:59:36.486 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T16:59:36.491 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:00:06.681 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:00:06.686 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:00:36.875 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:00:36.880 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:01:06.993 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:01:06.998 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:01:37.113 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:01:37.118 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:02:07.273 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:02:07.279 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:02:37.675 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:02:37.680 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:03:07.810 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:03:07.815 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:03:37.996 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:03:38.001 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:04:08.199 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:04:08.205 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:04:38.318 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:04:38.323 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:05:08.505 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:05:08.510 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:05:38.648 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:05:38.653 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:06:08.766 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:06:08.772 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:06:38.953 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:06:38.959 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:07:09.147 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:07:09.152 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:07:39.253 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:07:39.259 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:08:09.385 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:08:09.390 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:08:39.570 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:08:39.575 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:09:09.814 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:09:09.819 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:09:39.927 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:09:39.931 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:10:10.103 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:10:10.108 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:10:40.224 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:10:40.229 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:11:10.340 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:11:10.346 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:11:40.517 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:11:40.523 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:12:10.704 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:12:10.709 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:12:40.830 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:12:40.835 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:13:11.016 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:13:11.021 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:13:41.211 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:13:41.216 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:14:11.588 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:14:11.593 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:14:41.707 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:14:41.713 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:15:11.875 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:15:11.880 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:15:42.054 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:15:42.059 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:16:12.172 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:16:12.177 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:16:42.333 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:16:42.338 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:17:12.518 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:17:12.524 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:17:42.632 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:17:42.637 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:18:12.739 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:18:12.745 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:18:42.934 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:18:42.940 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:19:13.044 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:19:13.050 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:19:43.239 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:19:43.244 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:20:13.433 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:20:13.438 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:20:43.760 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:20:43.765 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:21:13.879 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:21:13.885 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:21:44.057 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:21:44.062 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:22:14.251 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:22:14.256 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:22:44.403 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:22:44.408 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:23:14.588 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:23:14.593 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:23:44.758 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:23:44.762 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:24:15.110 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:24:15.116 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:24:45.229 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:24:45.235 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:25:15.415 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:25:15.420 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:25:45.584 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:25:45.589 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:26:15.711 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:26:15.716 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:26:45.840 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:26:45.845 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:27:16.024 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:27:16.029 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:27:46.143 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:27:46.148 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:28:16.336 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:28:16.341 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:28:46.514 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:28:46.519 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:29:16.624 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:29:16.629 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:29:46.811 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:29:46.816 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:30:16.996 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:30:17.002 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:30:47.282 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:30:47.288 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:31:17.402 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:31:17.407 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:31:47.603 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:31:47.609 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:32:17.772 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:32:17.778 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:32:47.910 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:32:47.915 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:33:18.095 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:33:18.101 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:33:48.256 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:33:48.261 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:34:18.374 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:34:18.380 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:34:48.534 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:34:48.540 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:35:18.737 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:35:18.742 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:35:48.857 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:35:48.862 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:36:19.060 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:36:19.065 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:36:49.245 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:36:49.251 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:37:19.539 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:37:19.544 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:37:49.674 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:37:49.679 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:38:19.852 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:38:19.858 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:38:50.013 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:38:50.018 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:39:20.131 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:39:20.136 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:39:50.326 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:39:50.331 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:40:20.453 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:40:20.458 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:40:50.583 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:40:50.588 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:41:20.766 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:41:20.772 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:41:50.960 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:41:50.965 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:42:21.079 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:42:21.084 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:42:51.283 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:42:51.288 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:43:21.459 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:43:21.464 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:43:51.830 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:43:51.835 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:44:21.959 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:44:21.965 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:44:52.142 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:44:52.147 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:45:22.318 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:45:22.324 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:45:52.435 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:45:52.441 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:46:22.631 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:46:22.637 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:46:52.809 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:46:52.814 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:47:22.928 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:47:22.936 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:47:53.072 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:47:53.077 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:48:23.267 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:48:23.272 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:48:53.385 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:48:53.390 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:49:23.571 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:49:23.576 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:49:53.740 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:49:53.745 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:50:23.859 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:50:23.865 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:50:54.020 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:50:54.027 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:51:24.221 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:51:24.228 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:51:54.333 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:51:54.338 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:52:24.510 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:52:24.516 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:52:54.646 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:52:54.652 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:53:24.840 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:53:24.846 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:53:54.959 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:53:54.964 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:54:25.120 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:54:25.125 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:54:55.338 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:54:55.344 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:55:25.450 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:55:25.455 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:55:55.637 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:55:55.643 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:56:25.821 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:56:25.825 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:56:55.939 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:56:55.944 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:57:26.059 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:57:26.064 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:57:56.195 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:57:56.201 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:58:26.338 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:58:26.343 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:58:56.460 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:58:56.464 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:59:26.670 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:59:26.675 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:59:56.805 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T17:59:56.811 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:00:26.939 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:00:26.945 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:00:57.134 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:00:57.139 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:01:27.370 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:01:27.375 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:01:57.573 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:01:57.582 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:02:27.750 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:02:27.762 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:02:57.961 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:02:57.967 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:03:28.072 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:03:28.077 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:03:58.265 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:03:58.271 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:04:28.459 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:04:28.467 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:04:58.734 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:04:58.739 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:05:28.856 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:05:28.861 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:05:59.041 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:05:59.046 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:06:29.293 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:06:29.298 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:06:59.407 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:06:59.412 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:07:29.582 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:07:29.586 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:07:59.784 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:07:59.789 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:08:29.903 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:08:29.909 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:09:00.113 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:09:00.118 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:09:30.291 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:09:30.296 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:10:00.409 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:10:00.414 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:10:30.587 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:10:30.592 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:11:00.765 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:11:00.770 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:11:30.884 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:11:30.890 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:12:01.011 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:12:01.016 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:12:31.188 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:12:31.194 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:13:01.311 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:13:01.317 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:13:31.443 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:13:31.449 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:14:01.637 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:14:01.643 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:14:31.805 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:14:31.810 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:15:01.927 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:15:01.933 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:15:32.110 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:15:32.116 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:16:02.287 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:16:02.292 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:16:32.403 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:16:32.408 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:17:02.641 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:17:02.646 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:17:32.811 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:17:32.816 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:18:02.938 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:18:02.943 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:18:33.068 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:18:33.073 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:19:03.251 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:19:03.256 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:19:33.420 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:19:33.425 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:20:03.539 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:20:03.544 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:20:33.700 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:20:33.705 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:21:03.869 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:21:03.874 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:21:33.988 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:21:33.993 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:22:04.123 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:22:04.128 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:22:34.243 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:22:34.248 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:23:04.362 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:23:04.367 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:23:34.556 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:23:34.561 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:24:04.716 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:24:04.721 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:24:34.834 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:24:34.839 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:25:04.970 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:25:04.975 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:25:35.082 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:25:35.087 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:26:05.408 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:26:05.414 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:26:35.519 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:26:35.524 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:27:05.638 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:27:05.643 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:27:35.832 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:27:35.837 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:28:05.952 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:28:05.956 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:28:36.154 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:28:36.159 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:29:06.357 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:29:06.361 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:29:36.750 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:29:36.755 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:30:06.887 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:30:06.892 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:30:37.065 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:30:37.070 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:31:07.251 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:31:07.256 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:31:37.375 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:31:37.380 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:32:07.564 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:32:07.569 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:32:37.766 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:32:37.771 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:33:07.893 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:33:07.898 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:33:38.013 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:33:38.018 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:34:08.191 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:34:08.195 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:34:38.309 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:34:38.314 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:35:08.529 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:35:08.534 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:35:38.698 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:35:38.703 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:36:08.808 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:36:08.814 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:36:38.989 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:36:38.995 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:37:09.188 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:37:09.193 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:37:39.390 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:37:39.395 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:38:09.509 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:38:09.514 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:38:39.704 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:38:39.708 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:39:09.897 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:39:09.902 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:39:40.020 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:39:40.024 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:40:10.203 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:40:10.207 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:40:40.397 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:40:40.402 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:41:10.504 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:41:10.509 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:41:40.685 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:41:40.690 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:42:10.871 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:42:10.876 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:42:41.148 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:42:41.153 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:43:11.387 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:43:11.392 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:43:41.561 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:43:41.566 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:44:11.738 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:44:11.743 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:44:41.858 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:44:41.862 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:45:12.002 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:45:12.007 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:45:42.116 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:45:42.121 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:46:12.239 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:46:12.244 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:46:42.417 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:46:42.422 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:47:12.595 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:47:12.600 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:47:42.707 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:47:42.712 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:48:12.935 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:48:12.940 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:48:43.118 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:48:43.123 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:49:13.462 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:49:13.467 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:49:43.582 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:49:43.586 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:50:13.725 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:50:13.730 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:50:43.837 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:50:43.841 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:51:13.958 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:51:13.963 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:51:44.149 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:51:44.154 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:52:14.369 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:52:14.374 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:52:44.488 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:52:44.492 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:53:14.682 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:53:14.687 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:53:44.859 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:53:44.864 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:54:15.204 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:54:15.208 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:54:45.322 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:54:45.327 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:55:15.475 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:55:15.480 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:55:45.644 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:55:45.649 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:56:15.766 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:56:15.772 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:56:45.965 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:56:45.971 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:57:16.168 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:57:16.173 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:57:46.287 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:57:46.291 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:58:16.481 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:58:16.486 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:58:46.667 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:58:46.672 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:59:16.953 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:59:16.957 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:59:47.071 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T18:59:47.077 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:00:17.215 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:00:17.220 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:00:47.418 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:00:47.423 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:01:17.528 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:01:17.534 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:01:47.706 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:01:47.711 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:02:17.875 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:02:17.881 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:02:47.995 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:02:48.000 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:03:18.113 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:03:18.118 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:03:48.299 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:03:48.304 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:04:18.410 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:04:18.415 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:04:48.605 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:04:48.610 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:05:18.773 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:05:18.779 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:05:48.892 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:05:48.897 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:06:19.011 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:06:19.016 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:06:49.180 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:06:49.185 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:07:19.300 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:07:19.305 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:07:49.594 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:07:49.599 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:08:19.746 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:08:19.751 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:08:49.890 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:08:49.894 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:09:20.009 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:09:20.014 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:09:50.203 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:09:50.208 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:10:20.372 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:10:20.377 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:10:50.508 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:10:50.513 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:11:20.686 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:11:20.691 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:11:50.864 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:11:50.869 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:12:21.275 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:12:21.280 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:12:51.385 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:12:51.390 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:13:21.562 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:13:21.567 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:13:51.748 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:13:51.753 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:14:21.886 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:14:21.891 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:14:52.086 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:14:52.090 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:15:22.280 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:15:22.285 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:15:52.399 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:15:52.404 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:16:22.577 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:16:22.582 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:16:52.765 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:16:52.769 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:17:23.174 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:17:23.179 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:17:53.291 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:17:53.296 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:18:23.461 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:18:23.467 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:18:53.647 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:18:53.652 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:19:23.783 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:19:23.787 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:19:53.977 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:19:53.982 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:20:24.163 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:20:24.168 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:20:54.281 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:20:54.286 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:21:24.402 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:21:24.407 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:21:54.578 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:21:54.583 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:22:24.713 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:22:24.718 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:22:54.833 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:22:54.838 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:23:25.002 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:23:25.007 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:23:55.106 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:23:55.111 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:24:25.299 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:24:25.304 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:24:55.494 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:24:55.499 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:25:25.612 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:25:25.617 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:25:55.789 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:25:55.794 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:26:25.966 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:26:25.971 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:26:56.085 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:26:56.090 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:27:26.221 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:27:26.226 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:27:56.398 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:27:56.404 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:28:26.726 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:28:26.731 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:28:56.837 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:28:56.842 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:29:27.055 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:29:27.060 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:29:57.251 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:29:57.256 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:30:27.483 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:30:27.488 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:30:57.655 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:30:57.660 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:31:27.832 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:31:27.838 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:31:57.959 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:31:57.964 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:32:28.073 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:32:28.078 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:32:58.204 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:32:58.209 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:33:28.318 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:33:28.323 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:33:58.559 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:33:58.563 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:34:28.747 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:34:28.752 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:34:58.957 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:34:58.962 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:35:29.076 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:35:29.081 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:35:59.254 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:35:59.259 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:36:29.415 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:36:29.420 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:36:59.717 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:36:59.722 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:37:29.831 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:37:29.836 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:38:00.022 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:38:00.027 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:38:30.141 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:38:30.146 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:39:00.335 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:39:00.340 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:39:30.520 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:39:30.525 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:40:00.655 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:40:00.660 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:40:30.850 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:40:30.855 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:41:01.018 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:41:01.023 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:41:31.179 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:41:31.184 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:42:01.373 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:42:01.377 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:42:31.554 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:42:31.559 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:43:01.726 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:43:01.731 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:43:31.896 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:43:31.901 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:44:02.064 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:44:02.069 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:44:32.241 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:44:32.246 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:45:02.402 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:45:02.407 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:45:32.587 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:45:32.592 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:46:02.764 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:46:02.770 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:46:32.933 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:46:32.937 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:47:03.035 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:47:03.041 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:47:33.213 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:47:33.218 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:48:03.398 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:48:03.403 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:48:33.566 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:48:33.571 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:49:03.735 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:49:03.740 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:49:33.913 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:49:33.918 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:50:04.115 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:50:04.120 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:50:34.317 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:50:34.322 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:51:04.486 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:51:04.491 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:51:34.688 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:51:34.693 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:52:04.865 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:52:04.870 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:52:35.042 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:52:35.047 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:53:05.228 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:53:05.234 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:53:35.430 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:53:35.434 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:54:05.623 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:54:05.628 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:54:35.832 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:54:35.837 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:55:06.019 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:55:06.024 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:55:36.205 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:55:36.210 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:56:06.374 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:56:06.379 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:56:36.523 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:56:36.528 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:57:06.679 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:57:06.683 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:57:36.881 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:57:36.886 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:58:07.058 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:58:07.063 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:58:37.252 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:58:37.257 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:59:07.437 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:59:07.443 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:59:37.622 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T19:59:37.628 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:00:07.800 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:00:07.805 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:00:37.985 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:00:37.989 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:01:08.162 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:01:08.167 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:01:38.280 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:01:38.285 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:02:08.483 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:02:08.488 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:02:38.661 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:02:38.666 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:03:08.854 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:03:08.859 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:03:39.056 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:03:39.061 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:04:09.234 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:04:09.239 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:04:39.419 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:04:39.424 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:05:09.597 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:05:09.602 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:05:39.782 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:05:39.787 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:06:10.011 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:06:10.015 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:06:40.177 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:06:40.182 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:07:10.380 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:07:10.385 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:07:40.565 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:07:40.570 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:08:10.751 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:08:10.756 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:08:40.936 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:08:40.941 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:09:11.113 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:09:11.118 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:09:41.332 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:09:41.337 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:10:11.509 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:10:11.514 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:10:41.687 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:10:41.692 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:11:11.867 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:11:11.872 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:11:42.049 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:11:42.055 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:12:12.268 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:12:12.274 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:12:42.421 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:12:42.426 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:13:12.597 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:13:12.602 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:13:42.791 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:13:42.796 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:14:12.977 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:14:12.982 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:14:43.179 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:14:43.184 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:15:13.381 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:15:13.386 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:15:43.498 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:15:43.503 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:16:13.668 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:16:13.673 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:16:43.861 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:16:43.866 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:17:14.064 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:17:14.068 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:17:44.225 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:17:44.230 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:18:14.435 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:18:14.440 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:18:44.613 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:18:44.618 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:19:14.808 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:19:14.813 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:19:45.000 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:19:45.005 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:20:15.185 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:20:15.190 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:20:45.371 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:20:45.376 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:21:15.556 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:21:15.561 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:21:45.734 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:21:45.738 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:22:15.869 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:22:15.874 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:22:46.038 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:22:46.043 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:23:16.207 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:23:16.212 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:23:46.400 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:23:46.405 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:24:16.577 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:24:16.582 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:24:46.721 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:24:46.726 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:25:16.915 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:25:16.920 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:25:47.109 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:25:47.114 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:26:17.287 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:26:17.292 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:26:47.480 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:26:47.484 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:27:17.598 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:27:17.603 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:27:47.801 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:27:47.806 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:28:17.986 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:28:17.991 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:28:48.180 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:28:48.185 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:29:18.357 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:29:18.362 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:29:48.509 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:29:48.514 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:30:18.696 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:30:18.701 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:30:48.881 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:30:48.886 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:31:19.066 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:31:19.072 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:31:49.251 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:31:49.256 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:32:19.462 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:32:19.467 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:32:49.632 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:32:49.637 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:33:19.817 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:33:19.822 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:33:50.011 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:33:50.015 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:34:20.187 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:34:20.192 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:34:50.348 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:34:50.352 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:35:20.534 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:35:20.539 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:35:50.736 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:35:50.741 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:36:20.930 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:36:20.935 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:36:51.123 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:36:51.128 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:37:21.301 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:37:21.306 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:37:51.494 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:37:51.499 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:38:21.671 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:38:21.677 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:38:51.856 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:38:51.861 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:39:22.042 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:39:22.047 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:39:52.229 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:39:52.234 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:40:22.396 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:40:22.402 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:40:52.590 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:40:52.595 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:41:22.781 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:41:22.786 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:41:52.978 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:41:52.983 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:42:23.147 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:42:23.152 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:42:53.315 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:42:53.320 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:43:23.492 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:43:23.498 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:43:53.686 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:43:53.691 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:44:23.889 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:44:23.894 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:44:54.082 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:44:54.087 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:45:24.252 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:45:24.257 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:45:54.428 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:45:54.434 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:46:24.605 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:46:24.611 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:46:54.783 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:46:54.787 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:47:24.968 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:47:24.973 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:47:55.154 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:47:55.159 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:48:25.356 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:48:25.361 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:48:55.517 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:48:55.521 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:49:25.702 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:49:25.707 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:49:55.904 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:49:55.909 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:50:26.081 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:50:26.086 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:50:56.259 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:50:56.264 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:51:26.461 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:51:26.466 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:51:56.654 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:51:56.659 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:52:26.832 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:52:26.837 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:52:57.034 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:52:57.039 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:53:27.203 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:53:27.208 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:53:57.381 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:53:57.385 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:54:27.566 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:54:27.570 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:54:57.751 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:54:57.756 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:55:27.944 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:55:27.949 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:55:58.121 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:55:58.126 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:56:28.308 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:56:28.313 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:56:58.510 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:56:58.515 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:57:28.687 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:57:28.692 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:57:58.881 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:57:58.886 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:58:29.083 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:58:29.088 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:58:59.195 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:58:59.200 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:59:29.404 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:59:29.409 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:59:59.598 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T20:59:59.603 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:00:29.775 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:00:29.780 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:00:59.944 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:00:59.949 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:01:30.167 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:01:30.172 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:02:00.348 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:02:00.353 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:02:30.544 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:02:30.548 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:03:00.801 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:03:00.806 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:03:30.996 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:03:31.001 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:04:01.206 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:04:01.212 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:04:31.409 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:04:31.414 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:05:01.603 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:05:01.608 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:05:31.788 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:05:31.793 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:06:01.974 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:06:01.979 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:06:32.152 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:06:32.157 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:07:02.354 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:07:02.359 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:07:32.564 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:07:32.569 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:08:02.758 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:08:02.763 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:08:32.934 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:08:32.939 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:09:03.112 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:09:03.117 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:09:33.314 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:09:33.319 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:10:03.508 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:10:03.513 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:10:33.710 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:10:33.716 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:11:03.921 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:11:03.926 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:11:34.106 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:11:34.111 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:12:04.258 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:12:04.263 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:12:34.427 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:12:34.432 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:13:04.537 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:13:04.541 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:13:34.706 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:13:34.712 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:14:04.829 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:14:04.834 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:14:34.952 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:14:34.957 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:15:05.066 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:15:05.070 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:15:35.165 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:15:35.170 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:16:05.284 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:16:05.289 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:16:35.394 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:16:35.399 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:17:05.514 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:17:05.519 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:17:35.624 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:17:35.629 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:18:05.743 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:18:05.748 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:18:35.873 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:18:35.878 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:19:05.996 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:19:06.001 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:19:36.219 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:19:36.224 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:20:06.326 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:20:06.331 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:20:36.436 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:20:36.441 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:21:06.553 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:21:06.558 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:21:36.676 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:21:36.681 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:22:06.819 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:22:06.825 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:22:36.988 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:22:36.993 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:23:07.164 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:23:07.169 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:23:37.334 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:23:37.339 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:24:07.511 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:24:07.516 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:24:37.696 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:24:37.701 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:25:07.873 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:25:07.878 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:25:38.059 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:25:38.064 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:26:08.237 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:26:08.242 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:26:38.405 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:26:38.410 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:27:08.598 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:27:08.603 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:27:38.792 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:27:38.797 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:28:08.987 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:28:08.992 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:28:39.171 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:28:39.176 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:29:09.405 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:29:09.410 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:29:39.583 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:29:39.588 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:30:09.769 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:30:09.774 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:30:39.964 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:30:39.969 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:31:10.140 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:31:10.145 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:31:40.251 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:31:40.256 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:32:10.453 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:32:10.458 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:32:40.622 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:32:40.627 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:33:10.807 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:33:10.812 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:33:41.041 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:33:41.046 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:34:11.204 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:34:11.209 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:34:41.381 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:34:41.386 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:35:11.542 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:35:11.547 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:35:41.719 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:35:41.724 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:36:11.904 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:36:11.908 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:36:42.097 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:36:42.102 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:37:12.292 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:37:12.297 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:37:42.477 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:37:42.483 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:38:12.646 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:38:12.651 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:38:42.823 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:38:42.827 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:39:13.008 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:39:13.013 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:39:43.194 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:39:43.199 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:40:13.371 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:40:13.376 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:40:43.556 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:40:43.562 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:41:13.667 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:41:13.671 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:41:43.878 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:41:43.883 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:42:14.031 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:42:14.036 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:42:44.225 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:42:44.230 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:43:14.410 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:43:14.415 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:43:44.571 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:43:44.576 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:44:14.757 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:44:14.762 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:44:44.926 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:44:44.931 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:45:15.111 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:45:15.117 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:45:45.287 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:45:45.292 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:46:15.473 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:46:15.478 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:46:45.675 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:46:45.680 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:47:15.844 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:47:15.849 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:47:46.012 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:47:46.017 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:48:16.206 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:48:16.211 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:48:46.392 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:48:46.397 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:49:16.585 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:49:16.590 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:49:46.763 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:49:46.768 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:50:16.940 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:50:16.945 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:50:47.063 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:50:47.068 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:51:17.236 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:51:17.241 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:51:47.430 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:51:47.434 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:52:17.607 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:52:17.612 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:52:47.792 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:52:47.797 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:53:17.994 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:53:17.999 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:53:48.171 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:53:48.176 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:54:18.382 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:54:18.388 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:54:48.550 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:54:48.555 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:55:18.736 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:55:18.741 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:55:48.921 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:55:48.926 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:56:19.102 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:56:19.107 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:56:49.293 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:56:49.298 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:57:19.494 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:57:19.500 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:57:49.680 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:57:49.685 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:58:19.865 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:58:19.870 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:58:50.051 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:58:50.056 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:59:20.228 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:59:20.234 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:59:50.405 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T21:59:50.411 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:00:20.516 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:00:20.521 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:00:50.693 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:00:50.698 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:01:20.870 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:01:20.875 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:01:51.006 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:01:51.011 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:02:21.191 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:02:21.196 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:02:51.351 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:02:51.356 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:03:21.537 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:03:21.542 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:03:51.705 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:03:51.710 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:04:21.849 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:04:21.854 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:04:52.027 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:04:52.032 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:05:22.196 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:05:22.201 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:05:52.389 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:05:52.394 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:06:22.566 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:06:22.571 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:06:52.718 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:06:52.723 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:07:22.912 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:07:22.917 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:07:53.097 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:07:53.102 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:08:23.291 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:08:23.296 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:08:53.460 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:08:53.465 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:09:23.603 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:09:23.608 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:09:53.781 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:09:53.786 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:10:23.966 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:10:23.971 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:10:54.093 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:10:54.098 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:11:24.287 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:11:24.292 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:11:54.456 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:11:54.460 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:12:24.649 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:12:24.654 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:12:54.836 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:12:54.840 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:13:25.012 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:13:25.016 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:13:55.214 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:13:55.219 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:14:25.391 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:14:25.397 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:14:55.568 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:14:55.573 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:15:25.763 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:15:25.768 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:15:55.947 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:15:55.952 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:16:26.133 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:16:26.138 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:16:56.285 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:16:56.290 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:17:26.454 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:17:26.459 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:17:56.622 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:17:56.626 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:18:26.800 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:18:26.805 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:18:56.960 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:18:56.965 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:19:27.137 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:19:27.143 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:19:57.314 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:19:57.319 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:20:27.475 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:20:27.480 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:20:57.678 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:20:57.683 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:21:27.863 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:21:27.868 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:21:58.052 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:21:58.057 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:22:28.233 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:22:28.238 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:22:58.427 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:22:58.431 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:23:28.605 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:23:28.610 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:23:58.717 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:23:58.722 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:24:28.884 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:24:28.889 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:24:59.069 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:24:59.074 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:25:29.247 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:25:29.252 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:25:59.415 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:25:59.420 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:26:29.618 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:26:29.635 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:26:59.803 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:26:59.809 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:27:29.989 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:27:29.994 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:28:00.182 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:28:00.187 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:28:30.367 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:28:30.372 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:29:00.535 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:29:00.540 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:29:30.763 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:29:30.768 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:30:00.956 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:30:00.961 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:30:31.142 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:30:31.147 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:31:01.311 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:31:01.316 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:31:31.505 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:31:31.510 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:32:01.683 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:32:01.687 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:32:31.876 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:32:31.880 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:33:02.111 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:33:02.116 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:33:32.221 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:33:32.226 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:34:02.425 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:34:02.430 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:34:32.592 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:34:32.597 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:35:02.754 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:35:02.759 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:35:32.930 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:35:32.936 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:36:03.179 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:36:03.204 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:36:33.410 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:36:33.415 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:37:03.579 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:37:03.584 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:37:33.763 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:37:33.768 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:38:03.932 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:38:03.937 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:38:34.179 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:38:34.184 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:39:04.370 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:39:04.376 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:39:34.547 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:39:34.552 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:40:04.716 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:40:04.721 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:40:34.894 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:40:34.899 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:41:05.071 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:41:05.076 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:41:35.282 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:41:35.287 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:42:05.458 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:42:05.463 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:42:35.660 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:42:35.665 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:43:05.837 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:43:05.842 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:43:36.022 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:43:36.027 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:44:06.224 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:44:06.230 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:44:36.402 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:44:36.407 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:45:06.595 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:45:06.600 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:45:36.798 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:45:36.803 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:46:06.967 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:46:06.972 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:46:37.198 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:46:37.203 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:47:07.304 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:47:07.309 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:47:37.418 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:47:37.424 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:48:07.534 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:48:07.539 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:48:37.663 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:48:37.668 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:49:07.796 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:49:07.801 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:49:37.907 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:49:37.912 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:50:08.025 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:50:08.030 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:50:38.144 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:50:38.149 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:51:08.255 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:51:08.260 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:51:38.391 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:51:38.396 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:52:08.568 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:52:08.573 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:52:38.745 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:52:38.751 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:53:08.914 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:53:08.919 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:53:39.100 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:53:39.105 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:54:09.260 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:54:09.265 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:54:39.445 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:54:39.451 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:55:09.639 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:55:09.644 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:55:39.824 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:55:39.829 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:56:10.010 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:56:10.015 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:56:40.153 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:56:40.159 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:57:10.348 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:57:10.353 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:57:40.517 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:57:40.521 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:58:10.702 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:58:10.707 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:58:40.888 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:58:40.893 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:59:11.006 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:59:11.011 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:59:41.174 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T22:59:41.179 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:00:11.344 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:00:11.348 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:00:41.512 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:00:41.517 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:01:11.623 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:01:11.628 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:01:41.791 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:01:41.797 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:02:11.961 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:02:11.966 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:02:42.147 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:02:42.152 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:03:12.332 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:03:12.337 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:03:42.517 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:03:42.522 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:04:12.702 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:04:12.708 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:04:42.872 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:04:42.876 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:05:13.040 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:05:13.045 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:05:43.242 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:05:43.247 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:06:13.437 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:06:13.442 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:06:43.630 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:06:43.635 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:07:13.798 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:07:13.803 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:07:43.984 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:07:43.989 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:08:14.162 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:08:14.167 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:08:44.339 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:08:44.344 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:09:14.533 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:09:14.538 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:09:44.693 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:09:44.698 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:10:14.886 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:10:14.891 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:10:45.089 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:10:45.094 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:11:15.197 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:11:15.201 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:11:45.376 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:11:45.381 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:12:15.546 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:12:15.550 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:12:45.706 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:12:45.710 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:13:15.883 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:13:15.888 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:13:46.060 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:13:46.065 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:14:16.254 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:14:16.259 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:14:46.431 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:14:46.435 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:15:16.607 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:15:16.612 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:15:46.777 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:15:46.782 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:16:16.971 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:16:16.976 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:16:47.156 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:16:47.162 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:17:17.341 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:17:17.346 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:17:47.528 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:17:47.533 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:18:17.696 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:18:17.701 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:18:47.898 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:18:47.902 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:19:18.075 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:19:18.080 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:19:48.244 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:19:48.249 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:20:18.438 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:20:18.444 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:20:48.615 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:20:48.621 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:21:18.826 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:21:18.831 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:21:49.003 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:21:49.008 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:22:19.196 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:22:19.201 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:22:49.366 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:22:49.371 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:23:19.551 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:23:19.556 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:23:49.753 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:23:49.758 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:24:19.872 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:24:19.877 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:24:49.993 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:24:49.998 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:25:20.110 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:25:20.115 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:25:50.230 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:25:50.235 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:26:20.355 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:26:20.360 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:26:50.483 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:26:50.488 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:27:20.593 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:27:20.598 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:27:50.703 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:27:50.708 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:28:20.814 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:28:20.819 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:28:51.016 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:28:51.021 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:29:21.193 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:29:21.198 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:29:51.371 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:29:51.376 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:30:21.548 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:30:21.553 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:30:51.741 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:30:51.746 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:31:21.919 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:31:21.925 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:31:52.122 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:31:52.126 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:32:22.299 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:32:22.304 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:32:52.492 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:32:52.497 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:33:22.678 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:33:22.682 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:33:52.888 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:33:52.893 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:34:22.999 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:34:23.004 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:34:53.184 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:34:53.189 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:35:23.361 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:35:23.366 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:35:53.555 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:35:53.560 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:36:23.741 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:36:23.745 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:36:53.918 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:36:53.923 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:37:24.095 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:37:24.100 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:37:54.264 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:37:54.269 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:38:24.458 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:38:24.462 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:38:54.652 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:38:54.657 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:39:24.829 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:39:24.834 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:39:55.005 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:39:55.010 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:40:25.183 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:40:25.187 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:40:55.296 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:40:55.301 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:41:25.446 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:41:25.452 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:41:55.615 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:41:55.620 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:42:25.783 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:42:25.788 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:42:55.986 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:42:55.991 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:43:26.171 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:43:26.176 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:43:56.290 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:43:56.295 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:44:26.492 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:44:26.497 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:44:56.661 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:44:56.666 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:45:26.854 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:45:26.860 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:45:57.039 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:45:57.044 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:46:27.175 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:46:27.180 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:46:57.352 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:46:57.357 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:47:27.546 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:47:27.551 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:47:57.732 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:47:57.737 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:48:27.917 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:48:27.922 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:48:58.044 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:48:58.049 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:49:28.221 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:49:28.226 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:49:58.407 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:49:58.411 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:50:28.600 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:50:28.605 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:50:58.794 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:50:58.799 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:51:28.988 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:51:28.993 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:51:59.157 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:51:59.162 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:52:29.350 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:52:29.355 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:52:59.528 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:52:59.533 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:53:29.705 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:53:29.710 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:53:59.866 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:53:59.870 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:54:30.043 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:54:30.048 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:55:00.211 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:55:00.216 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:55:30.388 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:55:30.393 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:56:00.566 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:56:00.570 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:56:30.743 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:56:30.749 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:57:00.953 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:57:00.958 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:57:31.139 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:57:31.144 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:58:01.299 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:58:01.304 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:58:31.492 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:58:31.497 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:59:01.661 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:59:01.666 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:59:31.855 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-20T23:59:31.860 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:00:02.024 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:00:02.029 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:00:32.203 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:00:32.209 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:01:02.413 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:01:02.418 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:01:32.581 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:01:32.586 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:02:02.779 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:02:02.784 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:02:32.969 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:02:32.974 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:03:03.121 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:03:03.126 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:03:33.331 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:03:33.336 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:04:03.517 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:04:03.522 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:04:33.703 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:04:33.708 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:05:03.880 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:05:03.884 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:05:34.048 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:05:34.052 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:06:04.234 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:06:04.239 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:06:34.403 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:06:34.408 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:07:04.588 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:07:04.593 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:07:34.765 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:07:34.771 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:08:04.959 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:08:04.964 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:08:35.094 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:08:35.100 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:09:05.255 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:09:05.260 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:09:35.440 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:09:35.445 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:10:05.558 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:10:05.602 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:10:35.795 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:10:35.801 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:11:05.980 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:11:05.986 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:11:36.158 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:11:36.163 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:12:06.360 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:12:06.365 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:12:36.478 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:12:36.483 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:13:06.664 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:13:06.669 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:13:36.841 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:13:36.847 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:14:07.018 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:14:07.023 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:14:37.195 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:14:37.200 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:15:07.372 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:15:07.378 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:15:37.557 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:15:37.562 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:16:07.743 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:16:07.748 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:16:37.920 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:16:37.925 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:17:08.114 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:17:08.119 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:17:38.292 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:17:38.297 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:18:08.485 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:18:08.490 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:18:38.662 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:18:38.667 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:19:08.840 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:19:08.845 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:19:39.016 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:19:39.021 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:20:09.210 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:20:09.215 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:20:39.379 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:20:39.384 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:21:09.665 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:21:09.669 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:21:39.842 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:21:39.846 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:22:10.019 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:22:10.024 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:22:40.196 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:22:40.201 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:23:10.356 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:23:10.362 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:23:40.525 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:23:40.530 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:24:10.703 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:24:10.708 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:24:40.888 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:24:40.893 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:25:11.057 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:25:11.062 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:25:41.258 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:25:41.263 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:26:11.443 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:26:11.448 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:26:41.629 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:26:41.634 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:27:11.815 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:27:11.820 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:27:42.009 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:27:42.014 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:28:12.130 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:28:12.134 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:28:42.239 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:28:42.244 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:29:12.358 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:29:12.363 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:29:42.468 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:29:42.473 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:30:12.578 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:30:12.583 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:30:42.697 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:30:42.702 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:31:12.807 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:31:12.812 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:31:42.920 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:31:42.925 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:32:13.035 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:32:13.040 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:32:43.147 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:32:43.152 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:33:13.350 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:33:13.355 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:33:43.518 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:33:43.524 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:34:13.694 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:34:13.700 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:34:43.805 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:34:43.810 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:35:13.999 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:35:14.004 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:35:44.177 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:35:44.182 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:36:14.346 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:36:14.351 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:36:44.539 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:36:44.544 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:37:14.725 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:37:14.730 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:37:44.910 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:37:44.915 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:38:15.104 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:38:15.109 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:38:45.282 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:38:45.287 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:39:15.483 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:39:15.488 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:39:45.669 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:39:45.674 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:40:15.846 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:40:15.851 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:40:45.981 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:40:45.986 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:41:16.167 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:41:16.172 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:41:46.344 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:41:46.349 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:42:16.522 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:42:16.526 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:42:46.698 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:42:46.703 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:43:16.910 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:43:16.915 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:43:47.086 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:43:47.091 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:44:17.263 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:44:17.268 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:44:47.465 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:44:47.470 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:45:17.651 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:45:17.656 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:45:47.845 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:45:47.850 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:46:18.030 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:46:18.035 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:46:48.182 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:46:48.186 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:47:18.367 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:47:18.372 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:47:48.561 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:47:48.567 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:48:18.763 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:48:18.768 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:48:48.957 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:48:48.962 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:49:19.150 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:49:19.155 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:49:49.344 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:49:49.349 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:50:19.521 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:50:19.526 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:50:49.665 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:50:49.670 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:51:19.842 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:51:19.847 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:51:50.020 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:51:50.025 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:52:20.188 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:52:20.193 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:52:50.357 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:52:50.362 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:53:20.510 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:53:20.515 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:53:50.687 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:53:50.692 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:54:20.871 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:54:20.876 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:54:51.057 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:54:51.063 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:55:21.243 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:55:21.248 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:55:51.362 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:55:51.367 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:56:21.539 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:56:21.544 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:56:51.742 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:56:51.747 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:57:21.901 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:57:21.906 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:57:52.087 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:57:52.092 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:58:22.218 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:58:22.223 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:58:52.391 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:58:52.396 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:59:22.560 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:59:22.564 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:59:52.737 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T00:59:52.742 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T01:00:22.905 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T01:00:22.910 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T01:00:53.082 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T01:00:53.087 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T01:01:23.277 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T01:01:23.281 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T01:01:53.445 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T01:01:53.450 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T01:02:23.648 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T01:02:23.653 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T01:02:53.841 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T01:02:53.847 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T01:03:24.019 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T01:03:24.025 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T01:03:54.212 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T01:03:54.218 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T01:04:24.388 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T01:04:24.394 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T01:04:54.574 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T01:04:54.579 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T01:05:24.760 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T01:05:24.765 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T01:05:54.945 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T01:05:54.950 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T01:06:25.123 DEBUG:teuthology.orchestra.run.smithi032:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T01:06:25.128 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-21T01:06:36.204 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-06-21T01:06:36.205 DEBUG:teuthology.task.console_log:Killing console logger for smithi032 2023-06-21T01:06:36.206 DEBUG:teuthology.task.console_log:Killing console logger for smithi115 2023-06-21T01:06:36.206 DEBUG:teuthology.exit:Finished running handlers